If you don't want to install nor use Xcode (I don't) you can install only
command tools for Xcode (please see Edit)
Go to https://developer.apple.com/download/more/ and find Command line tools OS X 10.11) for Xcode 7.1. Then install downloaded .dmg package.
It should work with newer versions of Command line tools OS X however I tested it Command line tools OS X 10.11) for Xcode 7.1 particular version.
Update to macOS 10.13
After updating do macOS 10.13, I had to install
Command Line Tools (macOS 10.13) for Xcode 9 - also works great.
As @setholopolus mentioned in comment,
Also installs only command line tools for Xcode.
You can also verify this at: http://osxdaily.com/2014/02/12/install-command-line-tools-mac-os-x/
I am leaving my answer in case you'd have problems with installation via
PS credits to this SO answer: https://stackoverflow.com/a/33593066/2029818