Edit your all channels list at the same time as your favorites.

You can get rid of channels that are on your all channels list. Let's say, if you want  50 or a 100 channels on your all channel list and only 5 or 10 on your favorite list.

1st, add all channels to favorites that you might want to watch. Maybe 50 or 100 channels. 

Then, go to your favorites and scroll all the way down your favorites to where you can click 'select to add favorite channels'. You'll then have 2 options, Edit channel lineup and Favorite channels.

Click 'Edit channel lineup' You can click on channels to hide from your all channels list. Simply click all channels that don't have hearts. That way, your all channel list will be your large favorite list.

Then, you can unclick the favorites that are not actually your top 5 favorites.