Roku Developer Program

Join our online forum to talk to Roku developers and fellow channel creators. Ask questions, share tips with the community, and find helpful resources.
cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
David41
Newbie

Test order during Channel Behavior Analysis

Hi,

When trying to run the channel behavior Analysis I can see that the test are not ran in the correct order.

Instead of running in order 1,2,3,4,5,6 it runs 3,5,1,4,2,6

The problem is that test 1 and 6 are sign in / sign out scripts

 

#Test titleStatusSeverityCategoryRequirementsActions
1beforeAllPassInfoSetup 
roku-blog
 

 

2Channel Launch PerformancePassInfoPerformance3.2
roku-blog
 

 

3Channel Deep Linking BasicErrorErrorDeep Linking5.1
roku-blog
 

 

4Channel Deep Linking BasicPassInfoDeep Linking5.1
roku-blog
 

 

5Channel Content Play PerformanceErrorErrorPerformance3.6
roku-blog
 

 

6afterAllPassInfoTeardown 
roku-blog
 

 

 

Any ideas why?

 

 

0 Kudos
1 REPLY 1
Uguisu
Binge Watcher

Re: Test order during Channel Behavior Analysis

From my understanding of the Channel Behavior Analysis the order in which they are shouldn't matter. The Sign in / sign out scripts should run for every channel test that is run. All the channel tests are independent from each other.
If you look to the Actions column it should give you several ways of determining what went wrong with the test; with a general information on the error, the script that was used and a screen shot of your channel where it failed. Note the script can be used to run the tests on your own system so you can watch it run.
Hope this helps.

0 Kudos