No, not with the remotes you have now. If you abandon the IR roku tv remotes on both tv's and purchase two wifi voice remotes, then the remote will only control one roku at a time. With IR remotes there isn't a second address for remotes, so ALL roku tv respond to same IR remote, and nothing can be done to prevent unless you stop using them.
Edmund
Roku Community Streaming Expert
Help others find this answer and click "Accept as Solution."
If you appreciate my answer, maybe give me a Kudo.
I am not a Roku employee.