But ... if they were sentient, sentience would just happen for the time of a session, and only when tokens are being generated.

I don't think people here are arguing that sentience would happen when the model is not running, or that sentient experience spans several sessions that do not share some kind of state?

Also, a definition of consciousness is anyway hard to imagine :)