Experimental assessment of physical realism in a quantum-controlled device