It's not a matter of fear, it's a matter of hassle. Why hire an employee you can't communicate with effectively when you can get one who speaks the language?
Unless you've got some out-of-this-world skill set or portfolio, why would you be worth the hassle?