You don't need Wi-Fi to connect a physical remote to the TV. You do need the TV to be connected to Wi-Fi in order to use the app as a remote. What remote did you get? Roku TVs only work with Roku Voice remotes or a remote from the TV's manufacturer (TCL, Hisense, etc.) or some universal remotes. Remotes from Roku stand-alone players won't work with a Roku TV.
Roku Community Streaming Expert
Help others find this answer and click "Accept as Solution."
If you appreciate my answer, maybe give me a Kudo.
I am not a Roku employee.