Coarse graining a non-Markovian collisional model