If your Roku device isn't already connected to your network then you can't use the phone app until it is. You need a physical remote to get it connected to a network.
Roku Community Streaming Expert
Help others find this answer and click "Accept as Solution."
If you appreciate my answer, maybe give me a Kudo.
I am not a Roku employee.