Is your iPhone's speaker broken?

No, it's not. The bottom left thing that looks like a speaker is actually the mic.

I found this out here.