I’ve had this issue on and off for a while with a mix of both OG Homepods and minis. Rebooting the router seems to work so I suspect in my case it’s that the IoT devices are on a separate VLAN with it’s own SSID from the Homepods (with the necessary firewall rules to allow things to work properly 99% of the time).