Start music from homepod, but only play on airplay receiver in the same room?

OK. I hava a homepod in my office, as well as a stereo which works as an Airplay receiver. I have put the homepod into a different room in homekit, in my hope that it does not play when I say “Siri. play some musing in the office”, but it starts playing on the homepod as well as the stereo.
Is there any way that I canI then usually opn=en the control onm my iPad and disapke the playing on the homepod, and it is fine. But is there a way to let the music only play of the stereo (the airplay receiver is called office as well)?