This has happened to me twice recently: I have been on a call when all of a sudden I can hear the other person on loudspeaker, at which point I take the phone away from my face and observe that my face (assumably) has accidentally pressed the FaceTime button.
Is this a known issue and is there a way to prevent this from happening in the future?