Upper: when the bushings or balljoint goes bad.
Lower: all the bushings and the balljoint can be replaced separately, but its not much more to replace the whole arm.

You may notice clunking noises and/or check for play when the tire is off the ground.