My opinion is that for folks who are not already metabolically deranged, full-fat milk in moderation, provided no dairy allergies exist, is probably not a problem.
Where possible (budget, etc.), opting for local and/or grass-fed milk has potential benefits in terms of the balance of fatty acids (omega-3 vs. omega-6 FA), but the real bad news is low-fat or skim, which takes away the main component that is potentially beneficial, while leaving the sugar.
For those of us who need to keep carbs low, milk is not a great option, since a single glass represents more than half of the recommended limit of 20g of carbs.
On the plus side, use the milk to make homemade yogurt, and you can let the probiotic bacteria eat the sugar, and you get the yummy yogurt.