Apple tv stopped working when HomePods connected.

Hi!

i bought two HomePod minis for using as stereo for my tv. I have a Apple tv 4K. When I use HomePods as main «sound out» the Apple tv becomes laggy, and it cant load YouTube and other apps. I have tried resetting, reinstalling everything and so on, but nothing works. I spent 250 dollars for better sound, but here I am using the tv speakers… Would love if someone knew what I could do to solve this.