ashmanny​
It's possible this is a bug/issue with the (likely 5519) build of 15.0.4 on your 3820 - since 15.0.4 is in a pre-release beta/testing phase you should probably report this to Roku CS. Check Settings/System/Software update for the build of 15.0.4.
Otherwise I'd suggest verifying your B4 has Pass Through enabled (default is Auto which transcodes HDMI/Internal app audio to the highest Dolby level supported via ARC/eARC - which is DD+ in your case): Settings/Sound/Advanced Settings/Digital Sound Output = Pass Through
AppleTV+ uses DD/AC3 for 5.1 and DD+/EAC3 for Atmos - the fact that your AVR is receiving DD+ from an AppleTV+ 5.1 preview indicates your TV is transcoding the DD from HDMI to DD+ for ARC; see above about changing your B4 to Pass Through mode.
Try playing content from The Roku Channel app (e.g. Babylon 5, Prey , etc - most of it is 5.1) and see what your AVR gets - if it gets DD+5.1 that indicates that the DD5.1 from TRC content is being transcoded to DD+5.1 via the TV (dont forget to check/turn off any Volume Mode during playback of TRC content - a bug in 14.6.4 that may still exist in 15.0.4); again see above about the B4's Pass Through mode.
From your general behavior description it seems that DD/AC3 is being output/handled properly, but DD+/EAC3 isnt - make sure to check the B4's audio settings and report this issue to Roku CS.
I also recommend temporarily connecting the other 3820 (w/ OS 14.6.4) to this TV+AVR and see if DD+ 5.1 is being properly output from all DD+ apps/services (e.g. NetFlix/Prime/Hulu/Disney+/HBO Max/Peacock) - if it is that confirms/indicates a bug in OS 15.0.4 (build unknown) that should be reported to Roku CS.