There are lots of reasons why this could happen. At a minimum, it could be isolated to your ISP. To determine the actual cause, you should look into using AWS logging. AWS provides a logging mechanism so you can see what's happening when your video is requested from a user. You can also look into using AWS caching by enabling CloudFront.
FREE Windows desktop software for creating BIF (Trick Play), Direct Publisher (MRSS, JSON), and FireTV feeds @ https://github.com/rrirower. No programming knowledge required.