My teachers did extensive studies in the impediments to verbal ability in a foreign language environment, their conclusion is the same as yours. The #1 impediment is fear of misspeaking and sounding foolish or stupid, and becoming embarrassed. But there are probably ways to work around it. Let me suggest one that I've used.
I definitely suffer from this, but it is because I am in a classroom full of anime otaku and other nutjobs. In small groups of friends I'm the energizer bunny of fucked up bunpo. I'm getting better though!
I like Charles' idea. It makes a lot of sense and can instantly break any ice. I'm sure within seconds the image would become x-rated though.