Consider the mechanics here. When you have a conversation with an agent, text is perhaps being generated by multiple models running in hardware spread across multiple data centers. That same hardware is near-simultaneously generating text for thousands of other conversations.
People get weird about this because consciousness is a loaded term. If AIs are conscious, given how they're architected today, they are conscious in such a way that our intuitions about consciousness are likely to mislead.