Testing methodology
Which hardware, operating system versions and network conditions our guidance is based on.
What we test
Our hands-on testing covers platform behaviour rather than unofficial applications. We verify how Android, Fire OS, Google TV and ChromeOS handle storage pressure, permissions, install policy, codec support and network conditions, because those are the mechanisms behind the failures readers report.
Android versions covered
- Android 7 and 9 on legacy handsets and TV boxes.
- Android 11 for scoped-storage behaviour.
- Android 13 for notification permission changes.
- Android 14 and 15 for target SDK install enforcement.
Fire TV hardware
- Fire TV Stick Lite and 3rd generation — 1 GB RAM behaviour under memory pressure.
- Fire TV Stick 4K and 4K Max — decode headroom and Wi-Fi performance.
- Fire TV Cube — Ethernet and HDMI handshake behaviour.
Google TV and Android TV
- Chromecast with Google TV HD and 4K — storage exhaustion thresholds.
- Android TV boxes on Android 9 through 14 — leanback focus handling and codec support.
- Emulated Android TV images for install-policy checks only.
Network conditions
Buffering guidance is validated against throttled connections at 3, 5, 15 and 25 Mbps, on 2.4 GHz Wi-Fi, 5 GHz Wi-Fi and Ethernet, to separate bandwidth limits from Wi-Fi path problems and from source-side throttling.
What we deliberately do not test
We do not install, run or benchmark unofficial streaming applications, and we do not evaluate builds circulating on mirror sites. Doing so would require obtaining unverified binaries and accessing unlicensed sources, which conflicts with this site's editorial limits. Where we describe such an app's behaviour, we attribute it to community reports rather than presenting it as our own measurement.