If you go into
Preferences > General there's two things that you need to uncheck to disable Apple Music.
Show Apple Music
iCloud Music Library
For the Connect Menu, you can do this by going into
Preferences > Parental and checking the
Apple Music Connect tickbox.
Now I'm not entirely sure what ticking the
Internet Radio box does in
Preferences > Parental but it doesn't seem to hide the Apple Music Internet Radio button. I currently haven't found a way to hide this radio button.
Edit: Hiding the heart column in iTunes is simple enough. Just right click the
heart column in iTunes and scroll down till you see the
Love option that's ticked.