Having both the video and audio going to the display would be optimal, but if I can just get the video on the display and use headphones plugged into the Xbox, that's perfectly fine and probably easier to achieve.
I have an HDMI to mini DisplayPort adapter, so I tried using that and plugging it into the Thunderbolt port, unfortunately I didn't get sound or video that way.