I like having my SSH passphrase stored for the duration of my MacBook session, so that I don't have to keep entering it every time I SSH into a server, but when I restart my computer I want to have to enter it again (I don't want my passphrase encrypted and stored on disk in the keychain). This wasn't the case until I upgraded from Mountain Lion to Sierra; ever since then, it has been permanently storing my passphrase in my keychain. I can open the keychain preferences and delete my SSH passphrase, but the next time I SSH into a server and it prompts me for my passphrase, it is immediately added to the keychain again.
How can I get back to what I had with mountain lion, where my passphrase would be stored for the duration of my MacBook session, but then I would need to reenter it the next time I turn my MacBook on again.