If you factory reset your Roku device and you're now on the "Let's get started" page, you need a physical remote. There's no way to use the phone app until the device is connected to your network and there's no way to get it connected to your network without a physical remote.
One caveat is that if the Roku device has an Ethernet port, you may be able to get it to recognize a wired connection and get the phone app to connect to it. Not many Roku devices have an Ethernet port.
Roku Community Streaming Expert
Help others find this answer and click "Accept as Solution."
If you appreciate my answer, maybe give me a Kudo.
I am not a Roku employee.