I'd like to be able to be notified in any way (sound, notification, growl, etc) when someone pings my machine.
Is that possible?
Little Snitch may have the feature you want. It allows you to set up rules on network traffic, both inbound and outbound, mostly for blocking unwanted traffic, but I believe it can perform arbitrary actions such as notification for specific rules and types of traffic like ICMP pings.
There's a trial version that you can use to test.
I have no affiliation with Little Snitch or the company behind it.
Here is a well tested perl script to enable this kind of cheap attack detector: sonar perl script
The sound will change along the logarithmic level of probes (ping).
From an original idea of bmike.
nmap
against your Mac and finally try to penetrate it.