Is there a way to permanently disable close caption? Yes I did go into settings and change it numerous times. A couple of channels somehow activate it, as in The Archive\ Thrillgore. It is very annoying.
Both The Archive and Thrillgore seem to have had development of the Roku channel code contracted out to a company called dotstudioPRO. My guess is both are sharing reused code and therefore you are seeing the same bugs or "features" in both. Roku OS will always honor the channel's code over the settings so this will probably have to be addressed by dotstudioPRO.
You could also try including them on a tweet about your experience. The twitter handle is @dotstudioPRO
You may also get better results in contacting the video redistribution customers that dotstudioPRO created the channels for since they might be more willing to listen to bug reports from their direct customers.