Yeah, you should be crossing the fronts when you bring them to the rear. The front tires get feathered from taking the loads while turning whereas the rear tires are just "following" the fronts. When you cross them to the rear it smooths out any feathering caused from being on the front.