Is there a one- or two-step operation that will close all open apps on my iPhone?

Something quicker than a complete two-button shutdown and restart.

Just double tap home button and swipe up

Or you can just restart your phone. Most apps won't start up automatically but only when you open them. Email is not the exception though.