[STS-R-202010]CtsSecurityTestCases#android.security.cts.StagefrightTest#testStagefright_bug_65717533

问题描述

CtsSecurityTestCases

android.security.cts.StagefrightTest#testStagefright_bug_65717533
FAILURE: org.junit.runners.model.TestTimedOutException: test timed out after 900000 milliseconds

[STS_8.1-202009] RuntimeException in android.appsecurity.cts.AppSecurityTests#testPermissionDiffCert

Background

Broadcast timeout happens in customer MT6580 projects. Reproducing ratio = 100%.

It’s OK in customer MT6739 projects.

Not reproduced in Mediatek internal projects.

 

Testing Condition
STS Tool Version: 8.1-202009/6731883

TestCase: CtsAppSecurityHostTestCases

Fail Type: android.appsecurity.cts.AppSecurityTests#testPermissionDiffCert fail

继续阅读“[STS_8.1-202009] RuntimeException in android.appsecurity.cts.AppSecurityTests#testPermissionDiffCert”

[STS10-202009]android.appsecurity.cts.LocationPolicyTest#testLocationPolicyPermissions Fail

问题描述

CtsAppSecurityHostTestCases
android.appsecurity.cts.LocationPolicyTest#testLocationPolicyPermissions
Fail:
java.lang.AssertionError: on-device tests failed:
android.appsecurity.cts.locationpolicy.LocationPolicyTest#testLocationPolicyPermissions:
java.lang.AssertionError: ACCESS_FINE_LOCATION and ACCESS_COARSE_LOCATION Permissions not granted. Should have received a security exception when invoking getCellLocation().

[STS10-06]android.security.cts.StagefrightTest#testStagefright_cve_2019_2334

问题描述

CtsSecurityTestCases
android.security.cts.StagefrightTest#testStagefright_cve_2019_2334
Fail:
org.junit.runners.model.TestTimedOutException: test timed out after 900000 milliseconds

[STS8.1]testStagefright_bug_110435401 and testStagefright_bug_68664359

问题描述

CtsSecurityTestCases
android.security.cts.StagefrightTest#testStagefright_bug_110435401
android.security.cts.StagefrightTest#testStagefright_bug_68664359
java.lang.AssertionError: operation not completed within timeout of 60000ms

继续阅读“[STS8.1]testStagefright_bug_110435401 and testStagefright_bug_68664359”

[STS11 R0-202007]android.security.sts.Poc18_06#testPocCVE_2018_9409 fail

问题描述

Suite / Build (R)11 202007StsHostTestCases

android.security.sts.Poc18_06#testPocCVE_2018_9409

Fail:

com.android.tradefed.device.DeviceUnresponsiveException: Attempted shell (vndservice) > /dev/null 2>&1; echo $? multiple times on device 055552502L000912 without communication success. Aborting.

继续阅读“[STS11 R0-202007]android.security.sts.Poc18_06#testPocCVE_2018_9409 fail”

[STS9.0-4月]android.security.cts.AssetManagerTest#testCloseThenFinalize fail

问题描述

CtsSecurityTestCases
android.security.cts.AssetManagerTest#testCloseThenFinalize
Test failed to run to completion. Reason: 'Instrumentation run failed due to 'Process crashed.''. Check device logcat for details
android.security.cts.ActivityManagerTest#testActivityManager_attachNullApplication
Fail Details:Test failed to run to completion. Reason: 'Failed to receive adb shell test output within 990000 ms. Test may have timed out, or adb connection to device became unresponsive'. Check device logcat for details

[STS]android.security.cts.StagefrightTest#testStagefright_cve_2018_9423

问题描述

 android.security.cts.StagefrightTest#testStagefright_cve_2018_9423

解决方案

请参考对应平台并申请patch. 如果拿到的patch只有source code 没有libvcodecdrv.so ,请按照表格再重新申请一次patch.

继续阅读“[STS]android.security.cts.StagefrightTest#testStagefright_cve_2018_9423”

[STS201902]MT6580 / MT6739 STS遇到lowmemorykiller detected的大量測试fail

问题描述

MT6580 / MT6739 STS遇到lowmemorykiller detected的大量測试fail,报错信息常常为java.lang.AssertionError: Phone has had a hard reset,查看下host_log是否出現「lowmemorykiller detected」,如下所示

继续阅读“[STS201902]MT6580 / MT6739 STS遇到lowmemorykiller detected的大量測试fail”

[STS-8.1-2019010]run sts-engbuild -m CtsSecurityTestCases -t android.security.cts.SeccompTest#testCTSSwapOnOffBlocked

问题描述

 CtsSecurityTestCases -t android.security.cts.SeccompTest#testCTSSwapOnOffBlocked test fail
03-19 15:16:56 D/ModuleListener: ModuleListener.testFailed(android.security.cts.SeccompTest#testCTSSwapOnOffBlocked, junit.framework.AssertionFailedError: Syscall 224 allowed

STS 测试信息更新及豁免流程

4月份起,SECUTITY PATCH 2019-05-01及之后的版本需要通过所有STS测试。

如有失败项需申请豁免,请参考后文描述;

We’re starting the waiver process for STS from April

We appreciate your collaboration with the new process to roll out the STS (Security Test Suite), a test suite that helps validate whether your Android Software build is vulnerable to  CVEs (common vulnerabilities and exposures) that were reported in the security bulletins up to the reported SECURITY_PATCH.

Starting April, all software builds declaring the SECURITY_PATCH 2019-05-01 or later will only be approved when every STS failure is addressed. We recognize there will be cases where waivers will be needed, so we are planning to align the process dealing with the STS test failures with the process you already are familiar with for other test suites (CTS, GTS) as below.

继续阅读“STS 测试信息更新及豁免流程”

6739在Android P / O / N沒打上patch前確實會大量報出一些STS fail

问题描述

1.請問每次重跑「run sts-engbuild」,每次的STS report中fail的項目都是一模一樣的?

2.請確認這筆patch有正確的合入「ALPS04281123」

我司測試該patch合入後理應就不會有此問題,目前我司內部測試都是全pass的

3.請問是用這包STS測試的?「android-sts-8.1_201902-linux-arm.zip」

继续阅读“6739在Android P / O / N沒打上patch前確實會大量報出一些STS fail”

[STS 201901]android.security.cts.StagefrightTest#testStagefright_bug_110435401

问题描述

 CtsSecurityTestCases
android.security.cts.StagefrightTest#testStagefright_bug_110435401
fail
junit.framework.AssertionFailedError: operation not completed within timeout of 60000ms

继续阅读“[STS 201901]android.security.cts.StagefrightTest#testStagefright_bug_110435401”

[STS]android.security.sts.Poc16_07#testPocCVE_2016_3807 fail:

问题描述


10-22 15:27:56 I/ConsoleReporter: [7/10 arm64-v8a StsHostTestCases C4ATAS000000] android.security.sts.Poc16_07#testPocCVE_2016_3807 fail: com.android.tradefed.device.DeviceNotAvailableException: Could not find device C4ATAS000000

继续阅读“[STS]android.security.sts.Poc16_07#testPocCVE_2016_3807 fail:”