[Obsessive Costuming Dude (Alex)]

It is easy to just add a bit onto the side facing piece, although it also occurred to me that you could instead just cinch in the lower end of the side seam a bit (since again, it's going to be elasticized down to a good fit anyway).

Either way will work fine.

Happy sewing! 🙂