No, you will not lose your data.
I'm not sure that iTunes will let you downgrade your device - iTunes has been unforgiving with regretted upgrades since iOS 5 was released. However, if you download the firmware file (IPSW) from here, and press the modifier key while clicking "restore" in iTunes, you may be able to give it a shot. (The modifier key is Shift on Windows and Option on Mac.) Before you do this, you're going to want to take a backup.
In iTunes, secondary click (right click or control click) on your device and select "backup" from the menu. After the backup is complete, you can go ahead and try to downgrade, as described above. Once the restore is complete, iTunes will prompt you to set up your iPod - either as a new device, or from a backup. You'll want to select your backup, naturally.
iOS devices keep apps on a separate partition from the firmware, so your game data should be safe.