Sometimes churches run food pantries and they aren’t just for homeless people. I would say the majority are just poor and trying to feed their families.
Maybe your town is blessed and doesn’t need a food pantry but you could save it for the next time you visit a larger city. We cleaned our pantry of most of the carbage about 6 months after going keto and gave all that was donatable to a food pantry.
One Christmas a neighbor stopped by with a basket of fruit instead of cookies because she knew we ate “low carb” 
so I feel your pain.