This does not address GP's original concern: <<public-facing apps and databases>>

Buy the $500k server and get a VPN.

We’re trying that :) (minus the GPU. Think more like a database/web server).

Although to a lot of reviewers a server is a server. “You have a multi-million dollar compute cluster available, what do you need another server for?”