I think the real issue is that lots of folks have dairy intolerances to some degree with one or more dairy components. And or so-called A1 or A2. If you don’t, there’s no reason to avoid dairy. It’s not some magical or mysterious substance. Dairy fat contains mostly SFAs, a lot of MUFAs and very low PUFAs. Cream less than butter or ghee, of course.
Sure, if you’re a purist, our Pleistocene ancestors did not eat cheese and drink milk. I suspect that’s why many folks have problems with it - humans evolved to wean off mother’s milk as a growing child. So only some of us have the necessary enzymes and hormones necessary to utilize it. If so, I see no reason to avoid it. I think it one of the better results of the Holocene agricultural ‘revolution’. Butter, cheese and cream are a major component of my diet.