I had had work on it all day

If your Roku device isn't already connected to your network you'll need a physical remote to get it connected.  You can't use the app on your phone unless the Roku device and your phone are connected to the same network.