Not sure this is a screen reader issue. Volume number is announced whenever raised or lowered. I've turned off the Screen reader in accessibility, but I'm not sure this is screen reader. Closed captions works fine. This happens on all channels on only one TV out of 4.
Is this a Roku player connected to a TV? If so, it is probably the equivalent accessibility aid in the TV (not the Roku) that is announcing those numbers.