Agreed, sshd is not any different from the key being loaded into RAM by your http server.

But it's even easier and faster to grab a key from RAM. Could just use a debugger or a handy tool like aeskeyfinder or...

https://github.com/mmozeiko/aes-finder

(or another handy tool like heartbleed ;))