I have a very annoying issue with the X11 app on OS X when using it to run things remotely over SSH. Every now and then (it's pretty regular, I'd say about each 1-2 minutes), the app I'm in loses focus, and the keyboard doesn't get sent to it anymore. However, X11 is still the foreground app.
Any ideas on what could be causing this and/or how to debug this?