Your Roku Ultra is always on. Try unchecking "1-touch play" under Settings->System->Control other devices. Your TV may have settings that affect this as well.
Roku Community Streaming Expert
Help others find this answer and click "Accept as Solution."
If you appreciate my answer, maybe give me a Kudo.
I am not a Roku employee.