You actually shouldn't have to create a Device for stuff that (like your Calibration utility). It's not really a device, just an app. It's on our todo list anyway to add to the 'computing' button some user defined apps you want to run, much like the 'Start' button in Windows.
It's a trivial task--a couple hours. So, I'll work on it today or tomorrow and put it in the next version. Then in PlutoAdmin on wizard/devices/media directors, you'll be able to add 3rd party apps you want to run.