The browser stays running, so when you open it up again it is still on the last page visited. I imagine it eventually closes on its own.
I use the Dolphin browser, which will exit all the way (and clear the cache if you want) when you long press the back button.