Why don't Muslims speak out against Islamic terrorists?

I think that muslims are being terrorized as much as we are. If they speak out they fear for families that still live in muslim countries around the world. Terrorists (radical islamics) terrorize everyone that does not think like them and luckily not all muslims believe in their fear tactics. I use to wonder the same thing until I realized they probably have more to lose than we do considering the terrorists have access to their family members.