Quickie
Follow any urge you have to seek alone time right now. Listen to your heart.
Overview
Careless speech can be just that -- careless speech -- so there's no point in fretting over it. Reinterpreting or analyzing someone's comments just wastes your energy. If it's bothering you that much, ask them about it.