Some people do fine with dairy, other folks have issues with it, whether it’s a sensitivity, or maybe an inability to eat just a little. Some folks are fine with butter others need to use ghee which lacks certain proteins that butter has. It’s toally individual. I think all the time about going dairy free to see if I notice improvements (in skin, weight loss, hormones, stuffy nose issues) but I have not pulled the trigger yet, lol.
If you do have dairy make sure it’s full fat, like heavy cream instead of milk. And check cheese labels for hidden starches and fillers, often pre-shredded cheese will have extra junk.