The setting to have captions 'Always On' is not working for us.
My hearing being what it is, I most often use Closed Captions myself. I usually turn it off on live events where the live captioning trails too far behind the audio to be of much use.
I've noticed that changing the CC setting in some (all?) channel apps changes the Roku default CC setting also.