Yes. During initial setup, you are presented with all of the apps it will install. Uncheck them. And yes, they are all there, all checked. You just have to scroll on the pages to see them.
Once you've past that point in the setup and the downloads start, it's too late to go back. They'll download. You have to remove them one at a time, but once that's done, they won't come back. Unless, of course, they're added on another Roku device on the same account.
That last bit is important if you get a new Roku device (a Roku TV, or a device to attach to a TV) and set it up. All new devices go through the setup. So, for the next Roku device you get, pay close attention to the pages on your Web browser when you set the device up.
DBDukes
Roku Community Streaming Expert
Note: I am not a Roku employee.
If this post solves your problem please help others find this answer and click "Accept as Solution."