Can listening to music on an iPhone WITHOUT headphones damage your hearing?

If the volume is turned up but the music is only playing through the phone's speakers.

Yes it won't damage your hearing

Yes, music that is too loud can damage your hearing. Just turn it down.

If you hold it to your ear, yes.

The speakers are just not powerful enough from a distance.