If I do so, will something, such as a service, break?
Mac App Store apps and OS X core applications and services don't depend on Java, but some 3rd party applications (like LibreOffice) do, and they will break if you delete
/usr/bin/java is a symlink:
/usr/bin/java -> /System/Library/Frameworks/JavaVM.framework/Versions/Current/Commands/java
if you notice that an application complains about missing Java or fails to start after deleting
/usr/bin/java simply recreate it like this:
Make the symlink (type your password if asked):
$ sudo ln -s /System/Library/Frameworks/JavaVM.framework/Versions/Current/Commands/java /usr/bin/java