When I use the volume button to take pictures on my iPhone, a song starts playing?

How can I turn that off? I don't want to have click on the Music app and stop the song every time I take a photo. I'm using the volume button on my earphones, if that matters.

Use the toggle switch to to turn sound off by pressing down. This is located on the upper left side. Pull up to resume all sound capacity.
Easy!