If this drives you nuts you can turn it off yourself:
Dial #004# and press Call to disable voicemail.
Dial *004# and press Call to enable it again.
This works fine for me on my 3G iPhone in Japan but I'm not taking responsibility if your iPhone explodes, implodes, bricks, or otherwise has problems.

Lifted from ars technica.