Evolution of a quantum harmonic oscillator coupled to a minimal thermal environment