Not if the amount is tiny enough, at least one would expect so, some people have more complicated bodies. We almost all eat sugars when we eat food, just natural ones in good cases…
And even if you got kicked out, you go back in no time if you eat properly. It doesn’t even restart fat adaptation (I was so very careful in my first keto months, I never was that well behaved eating wise! I didn’t know this back then). I understand you want to stay in ketosis but if the harm(?) is already done, don’t worry about it, it’s not such a big deal. KCKO!