Click the X in the top right corner of the special battle window, that usually works for me. Wouldn't surprise me if this is a WG bug, actually.
And if the special battles are still shown in the bottom line, click in there, click on the battle you're already shown in, and then the X, if the above didn't work.