It’s always the same, when your liver runs out of glycogen, you’re back. One meal makes zero difference. Just don’t let the scale play with your head, once your liver is fully loaded, then your muscles start sucking it all in, you’re pretty unlikely to spillover, and even then you’re also burning them as fuel the whole time. Liver doesn’t hold too much, it runs out pretty quick. Your muscles won’t give their glycogen back, that’s burned by them using it.
Exercise is how you speed it up, but really doesn’t matter, Just go along as usual.