1# BetoCQ test suite release history 2 3## 2.3 (05/28/2024) 4 5## New 6* Skip test if wifi_chipset is empty. 7* Add MCC Aware test case with STAs connected to 2G/5G. 8* Make connection, advertising/discovery mediums configurable. 9* Allow the two devices connect to different SSIDs. 10* Raise NC speed bar back to 40MB/s except for WLAN. 11* Generate per-test openwrt syslog. 12* Add 3p api function into nearby_connections_function_test.py. 13* Report the suite name to the test summary. 14* Enable individual test selection from the command-line. 15 16### Bug fixes 17* Add 10s delay after sta connection to allow scan, DHCP and internet 18 validation to complete. 19* Fix the bug that it can not run the test cases of eSIM and Quick Share. 20* Clarify the failure reasons for some test failures. 21* Fix the issue that wlan1 is not correctly detected. 22* Fix the timestamp in failed iteration logs. 23* Reduce wait time between iteration from 13s to 3s. 24 25## 2.2 (05/10/2024) 26 27## New 28* Add iperf test for Aware, hotspot modes. 29* Disable WLAN deny list so that the past failure won't affect the new runs. 30* Add the key test info in test summary. 31* Add the STA and medium info of failed iterations. 32* Add P2P frequency check for MCC test cases. 33* Add more failure triage tips. 34 35### Bug fixes 36* Improve the format of common triaging tips. 37* Don't check max link speed for the disconnection check. 38* Fix the format of triaging tips. 39* Fix the control in test config. 40* Fall back to use "adb shell cmd wifi status" when wifiGetConnectionInfo() fails. 41 42## 2.1 (05/02/2024) 43 44## New 45* Add iperf test for WFD mode. iperf test speed requirement is 40MB/s while Nearby 46 Connections speed requirement is 20MB/s in 2-stream 80MHz mode. 47* Add the BT coex performance test. 48* Add the support of BLE scan throttling during 2G transfer (enabled by default) 49* Change the success rate target to 98%. 50* Add Aware test case and enable it for QuickShare CUJ. 51* Enable scc_2g_wfd_sta_tests for all devices. 52 53### Bug fixes 54* Fix the missing data of failed test cases by replacing all "sponge_properties" 55 with "properties". 56* Remove the unnecessary flag overriding and rely on the production config instead. 57* Add the check of AP connection. If AP is disconnected or connect to a wrong 58 frequency on the target side, mark the test as failed. 59* Consolidate AP connection and speed check codes to one function. 60* Add P2P frequency check for WFD/HS SCC test cases. 61* Reduce 2G speed check from 3 to 1 MB/s until it is improved in NC. 62* Remove AP frequency check for the test cases with empty wifi_ssid. 63* Fix typo in DFS test cases and reduce BT transfer size by 50%. 64* Skip p2p frequency check if wifi speed check is disabled or it is a DBS test. 65* Add the method overriding annotation. 66* Add more triaging tips for AP disconnected, wrong AP frequency and P2P/STA 67 frequency mismatch cases. 68 69## 2.0 (04/10/2024) 70 71### New 72* BetoCQ test suite: improved test coverage with the right quality bar taking into 73 device capabilities 74 * CUJ tests: Connectivity performance evaluation for the specific CUJs, such 75 as Quickstart, Quickshare, etc. 76 * Directed tests: Performance test with fixed D2D medium. 77 * Function tests: Tests for the basic functions used by D2D connection. 78 79## 1.6 80 81### New 82* `nearby_share_stress_test.py` for testing Nearby Share using Wifi only. 83 84### Fixes 85* Change discovery medium to BLE only. 86* Increase 1G file transfer timeout to 400s. 87* Disable GMS auto-updates for the duration of the test. 88 89## 1.5 90 91### New 92* `esim_transfer_stress_test.py` for testing eSIM transfer using Bluetooth only. 93* `quick_start_stress_test.py` for testing the Quickstart flow using both 94 Bluetooth and Wifi. 95