I think the ghost was trying to escape. It didn’t seem like he was aware it snuck into his bag. Yayoi also gave the ghost an ultimatum while bringing it back inside like “if you try that again you’ll be punished”