ITS test effects 测试fail 处理办法

问题描述

对于scene2/test_effects测试fail。
EFFECTS = {0: 'OFF',
           1: 'MONO',
           2: 'NEGATIVE',
           3: 'SOLARIZE',
           4: 'SEPIA',
           5: 'POSTERIZE',
           6: 'WHITEBOARD',
           7: 'BLACKBOARD',
           8: 'AQUA'}
这些effects mode 目前平台并没有支持,ISP中有对应的flow,但是并没有做实际的处理
     因此测试中会出现一些effect 没有效果导致fail

[GTS7.0r3]GtsWebViewHostTestCases 4 cases failed

问题描述

更新GMS r11包,GtsWebViewHostTestCases出现4项fail:
com.google.android.gts.webview.WebViewDisablingHostTest#testWebViewDisablingPrimaryUser fail java.lang.AssertionError: Failed to successfully run device tests for com.google.android.gts.webview: Instrumentation run failed due to 'Process crashed.'
com.google.android.gts.webview.WebViewDisablingHostTest#testUpdateAndDisableMonochrome fail java.lang.AssertionError: Failed to successfully run device tests for com.google.android.gts.webview: Instrumentation run failed due to 'Process crashed.'
com.google.android.gts.webview.WebViewDisablingHostTest#testWebViewDisablingSecondaryUser fail java.lang.AssertionError: Failed to successfully run device tests for com.google.android.gts.webview: Instrumentation run failed due to 'Process crashed.'
com.google.android.gts.webview.DisableChromeInManagedProfileTest#testWebViewDisablingManagedProfile fail java.lang.AssertionError: Failed to successfully run device tests for com.google.android.gts.webview: Instrumentation run failed due to 'Process crashed.'

Q版本刷GSI注意事项

问题描述

 Q版本要跑cts-on-gsi和跑VTS的机器刷GSI方式有差异,请参考下表。
 前提条件:
 adb和fastboot需要升级到最新版本,否则执行fastboot reboot fastboot会出现unknown command的错误。
 Google官网最新platform tools下载路径如下:

[GTS7.0r3]GtsStagedInstallHostTestCases com.google.android.stagedinstall.gts.host.StagedInstallTest#testSamegradeSystemTzdataApex fail

问题描述

com.google.android.stagedinstall.gts.host.StagedInstallTest#testSamegradeSystemTzdataApex fail:
java.lang.AssertionError: on-device tests failed:
com.google.android.stagedinstall.gts.StagedInstallTest#testSamegradeSystemTzdataApex_VerifyPostReboot:
java.lang.AssertionError: Not true that <"/system/apex/com.google.android.tzdata.apex"> starts with <"/data/apex/active">
at com.google.common.truth.FailureStrategy.fail(FailureStrategy.java:24)
at com.google.common.truth.FailureStrategy.fail(FailureStrategy.java:20)
at com.google.common.truth.Subject.failComparingToStrings(Subject.java:295)
at com.google.common.truth.Subject.fail(Subject.java:272)
at com.google.common.truth.StringSubject.startsWith(StringSubject.java:169)
at com.google.android.stagedinstall.gts.StagedInstallTest.testSamegradeSystemTzdataApex_VerifyPostReboot(StagedInstallTest.java:135)

解决方案

继续阅读“[GTS7.0r3]GtsStagedInstallHostTestCases com.google.android.stagedinstall.gts.host.StagedInstallTest#testSamegradeSystemTzdataApex fail”

[GTSR3]com.google.android.assistant.gts.AssistantTest#testAssistantOpenFrontCameraWithVoiceInteraction fail

问题描述

GtsAssistantHostTestCases
com.google.android.assistant.gts.AssistantTest#testAssistantOpenFrontCameraWithVoiceInteraction
Fail:
java.lang.AssertionError

AOSP camera 无法响应Intent,参考log:

12-12 11:44:59.390 13034 13034 I MainInteractionSession: starting_voiceactivity: Intent { act=android.media.action.STILL_IMAGE_CAMERA flg=0x10018000 (has extras) }

12-12 11:44:59.392  1163  7135 I ActivityTaskManager: START u0 {act=android.media.action.STILL_IMAGE_CAMERA cat=[android.intent.category.VOICE] flg=0x18018000 (has extras)} from uid 10185

继续阅读“[GTSR3]com.google.android.assistant.gts.AssistantTest#testAssistantOpenFrontCameraWithVoiceInteraction fail”

[GTSR3]com.google.android.gts.audio.AudioHostTest#testTwoChannelCapturing fail

问题描述

GtsGmscoreHostTestCases
com.google.android.gts.audio.AudioHostTest#testTwoChannelCapturing
Fail:
junit.framework.AssertionFailedError: com.google.android.gts.audio.AudioPolicyTest.testTwoChannelCapturing failed.

解决方案

继续阅读“[GTSR3]com.google.android.gts.audio.AudioHostTest#testTwoChannelCapturing fail”

[CTS10.0r2]CtsIncidentHostTestCases com.android.server.cts.ErrorsTest#testANR failed

问题描述

com.android.server.cts.ErrorsTest#testANR fail:
java.lang.AssertionError
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertTrue(Assert.java:52)
at com.android.server.cts.errors.ErrorsTests.testANR(ErrorsTests.java:99)

解决方案

继续阅读“[CTS10.0r2]CtsIncidentHostTestCases com.android.server.cts.ErrorsTest#testANR failed”

[CTS-10.0_r1]android.appsecurity.cts.AdoptableHostTest#testEjected

问题描述

android.appsecurity.cts.AdoptableHostTest#testEjected
Fail:
com.android.tradefed.device.DeviceUnresponsiveException: Attempted shell sm partition disk:7,9 public multiple times on device px5222222222 without communication success. Aborting.
注意:kernel 4.14 才会发生

解决方案

继续阅读“[CTS-10.0_r1]android.appsecurity.cts.AdoptableHostTest#testEjected”

[CTS10.0]CtsTelephonyTestCases--android.telephony.cts.VisualVoicemailServiceTest#testGetVisualVoicemailPackageName_isSelf failed

问题描述

CtsTelephonyTestCases
android.telephony.cts.VisualVoicemailServiceTest#testGetVisualVoicemailPackageName_isSelf failed:
12-09 09:50:43.140  2910  2932 E TestRunner: java.lang.NullPointerException: Attempt to invoke virtual method 'java.lang.String android.telephony.TelephonyManager.getVisualVoicemailPackageName()' on a null object reference
12-09 09:50:43.140  2910  2932 E TestRunner:     at android.telephony.cts.VisualVoicemailServiceTest.testGetVisualVoicemailPackageName_isSelf(VisualVoicemailServiceTest.java:486)

解决方案

继续阅读“[CTS10.0]CtsTelephonyTestCases--android.telephony.cts.VisualVoicemailServiceTest#testGetVisualVoicemailPackageName_isSelf failed”

[GTS R3]com.google.android.exoplayer.gts.DashTest#testWidevineH264Adaptive fail

问题描述

com.google.android.exoplayer.gts.DashTest#testWidevineH264Adaptive
Fail:
 java.lang.Error: com.google.android.exoplayer2.ExoPlaybackException

解决方案

继续阅读“[GTS R3]com.google.android.exoplayer.gts.DashTest#testWidevineH264Adaptive fail”

[VTS 10.0-R2]VtsTrebleFrameworkVintfTest VtsTrebleFrameworkVintfTest#SystemVendorTest.ServedHwbinderHalsAreInManifest_32bit fail

问题描述

VtsTrebleFrameworkVintfTest VtsTrebleFrameworkVintfTest#SystemVendorTest.ServedHwbinderHalsAreInManifest_32bit fail
VtsTrebleFrameworkVintfTest#SystemVendorTest.ServedHwbinderHalsAreInManifest_64bit fail
test/vts-testcase/hal/treble/vintf/SystemVendorTest.cpp:131
Expected: (manifest_hwbinder_hals.find(name)) != (manifest_hwbinder_hals.end()), actual: 8-byte object <98-F6 9A-D4 7F-00 00-00> vs 8-byte object <98-F6 9A-D4 7F-00 00-00>

[CTS10.0r2]CtsWindowManagerDeviceTestCases testDeviceConfig & testDeviceConfigWithSecondaryDisplay fail

问题描述

android.server.wm.ActivityManagerGetConfigTests#testDeviceConfig fail:
java.lang.AssertionError: Expected number of locales does not match expected:<1> but was:<0>
android.server.wm.ActivityManagerGetConfigTests#testDeviceConfigWithSecondaryDisplay fail:
java.lang.AssertionError: Expected number of locales does not match expected:<1> but was:<0>

解决方案

继续阅读“[CTS10.0r2]CtsWindowManagerDeviceTestCases testDeviceConfig & testDeviceConfigWithSecondaryDisplay fail”

[CTS10.0r1]CtsAlarmManagerTestCases android.alarmmanager.cts.AppStandbyTests#testNeverDelay single run fail

问题描述

CtsAlarmManagerTestCases
android.alarmmanager.cts.AppStandbyTests#testNeverDelay failed when single run.
java.lang.AssertionError: Alarm received when app was in never bucket
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertFalse(Assert.java:64)
at android.alarmmanager.cts.AppStandbyTests.testNeverDelay(AppStandbyTests.java:257)
However it can pass in full run with following command:
run cts -m CtsAlarmManagerTestCases -t android.alarmmanager.cts.AppStandbyTests

[CTS10.0R1]CtsMediaTestCases android.media.cts.VideoEncoderTest#testOtherH264FlexNearMaxMax fail

问题描述

CtsMediaTestCases
android.media.cts.VideoEncoderTest#testOtherH264FlexNearMaxMax fail:
java.nio.BufferOverflowException
at java.nio.ByteBuffer.put(ByteBuffer.java:611)
at java.nio.DirectByteBuffer.put(DirectByteBuffer.java:256)
at android.media.cts.VideoEncoderTest$VideoStorage$1.onInputBufferAvailable(VideoEncoderTest.java:116)

[CTS10.0r1]CtsPermissionTestCases android.permission.cts.ProviderPermissionTest#testManageDocuments fail

问题描述

CtsPermissionTestCases  android.permission.cts.ProviderPermissionTest#testManageDocuments fail:
junit.framework.AssertionFailedError: Exactly one package (must be com.google.android.documentsui) can request the MANAGE_DOCUMENTS permission; found package com.mediatek.dataprotection which must be revoked for security reasons

[CTS10.0R1]CtsLibcoreTestCases模块4项fail

问题描述

org.apache.harmony.tests.java.nio.charset.CharsetEncoder2Test#testUtf8Encoding fail:
junit.framework.AssertionFailedError: expected:<3> but was:<1>
org.apache.harmony.tests.javax.security.auth.x500.X500PrincipalTest#testValidDN fail:
junit.framework.AssertionFailedError:
RFC2253: 139 parm: 'CN="\E0\90\AF"' expected: 'CN=���' returned: 'CN=Я'
RFC1779: 139 parm: 'CN="\E0\90\AF"' expected: 'CN=���' returned: 'CN=Я'
Unexpected encoding for: 139, dn= 'CN="\E0\90\AF"'
RFC2253: 140 parm: 'CN="\F0\80\90\AF"' expected: 'CN=����' returned: 'CN=Я'
RFC1779: 140 parm: 'CN="\F0\80\90\AF"' expected: 'CN=����' returned: 'CN=Я'
Unexpected encoding for: 140, dn= 'CN="\F0\80\90\AF"'
libcore.java.lang.StringTest#testFastPathString_illFormedUtf8Sequence fail:
junit.framework.ComparisonFailure: Fast-path UTF-8 decoder decodes sequence [c0 b1] into unexpected String expected:<[��]> but was:<[1]>
libcore.java.lang.StringTest#test_69599767 fail:
junit.framework.ComparisonFailure: expected:<��[�]!> but was:<��[]!>

解决方案

继续阅读“[CTS10.0R1]CtsLibcoreTestCases模块4项fail”

[GTS7.0r2]GtsPermissionTestCases com.google.android.permission.gts.ManageDocumentsPermissionTest#manageDocuments_theOnlyOneHolder_isDocumentsUi fail

问题描述

com.google.android.permission.gts.ManageDocumentsPermissionTest#manageDocuments_theOnlyOneHolder_isDocumentsUi fail
java.lang.AssertionError: Not true that <2> is at most <1>

[CTS10.0r1]android.carrierapi.cts.CarrierApiTest#testAddSubscriptionToExistingGroupForMultipleSims fail

问题描述

双卡项目android.carrierapi.cts.CarrierApiTest#testAddSubscriptionToExistingGroupForMultipleSims 测试fail:
junit.framework.AssertionFailedError
at junit.framework.Assert.fail(Assert.java:48)
at junit.framework.Assert.assertTrue(Assert.java:20)
at junit.framework.Assert.assertTrue(Assert.java:27)
at android.carrierapi.cts.CarrierApiTest.testAddSubscriptionToExistingGroupForMultipleSims(CarrierApiTest.java:970)