Sometimes drinking whole milk can contribute to excess body fat. It is also best to design your workouts around what you want to accomplish. Perhaps more upper body and core workouts would benefit you more than lower-body workouts. I hope this is of some help to you!