There is a threefold distinction between [divine punishment and divine chastisement]. First, the character in which God acts. In the former God acts as Judge, in the latter as Father. The second distinction…lies in the recipients of each. The objects of the former are His enemies. The subjects of the latter are His children. A third distinction is seen in the design of each: the one is retributive, the other remedial. The one flows from His anger, the other from His love.
A.W. Pink