There's only one single thing I do where I actually need physical access to to Core and that's when I do a full backup of the installation. In this situation I'm shutting down LMCE and boot with a CloneZilla liveCD since I cannot SSH into the machine anymore. Everything else is done with SSH or web admin.
/Joakim
/Joakim