After some testing I figured out that my problem was that I was calling GetDefaultFont() in my while loop and that was killing my frame rate, now that I am storing the default font I am getting over 100 fps.
I still find it odd that it was running so much faster on the Roku 2 though.