com.google.android.placement.gts.CoreGmsAppsTest#testCoreGmsAppsPreloaded fail

[DESCRIPTION]

com.google.android.placement.gts.CoreGmsAppsTest#testCoreGmsAppsPreloaded
fail

9-21 17:57:28 D/ModuleListener: ModuleListener.testStarted(com.google.android.placement.gts.CoreGmsAppsTest#testCoreGmsAppsPreloaded)
09-21 17:57:29 I/ModuleListener: [1/1] com.google.android.placement.gts.CoreGmsAppsTest#testCoreGmsAppsPreloaded fail:
java.lang.AssertionError: Mandatory core GMS packages not found as system apps:
com.google.android.videos
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at com.google.android.placement.gts.CoreGmsAppsTest.checkGeneralCoreGmsAppsPreloaded(CoreGmsAppsTest.java:198)
at com.google.android.placement.gts.CoreGmsAppsTest.testCoreGmsAppsPreloaded(CoreGmsAppsTest.java:402)
at java.lang.reflect.Method.invoke(Native Method)

[SOLUTION]

继续阅读“com.google.android.placement.gts.CoreGmsAppsTest#testCoreGmsAppsPreloaded fail”

GtsWebViewTestCases com.google.android.webview.gts.WebViewTest#testChromeAndWebViewSimilarVersions fail

[DESCRIPTION]
 com.google.android.webview.gts.WebViewTest#testChromeAndWebViewSimilarVersions
fail

09-26 10:54:58 I/TestFailureListener: FailureListener.testFailed com.google.android.webview.gts.WebViewTest#testChromeAndWebViewSimilarVersions false false false
09-26 10:54:59 D/GranularRetriableTestWrapper: The test has reached its max number of run attempt: 1 time(s)
09-26 10:54:59 D/TestDevice: Uninstalling com.google.android.webview.gts
09-26 10:55:00 I/ConsoleReporter: [reef00000000001] Starting arm64-v8a GtsWebViewTestCases with 1 test
09-26 10:55:00 I/ConsoleReporter: [1/1 arm64-v8a GtsWebViewTestCases reef00000000001] com.google.android.webview.gts.WebViewTest#testChromeAndWebViewSimilarVersions fail: junit.framework.AssertionFailedError: WebView and Chrome must have the same version codes. expected:<3396> but was:<3497>

 [SOLUTION]

继续阅读“GtsWebViewTestCases com.google.android.webview.gts.WebViewTest#testChromeAndWebViewSimilarVersions fail”

GTS CarrierServiceTest

As part of the GTS v6.0r2 release, we will check for the presence of Android Messages (CarrierServiceTest) by default against all devices for any ACSA (Agreement to preload Carrier Services and Android Messages) partner.

In addition, for any device with Android Message installed, regardless of ACSA status, the GTS tests will run to check proper system permissions for Android Message, as well as checking system permission and privileges for Carrier Services.

The only way to exempt devices/builds from the above tests is for the Google Comms OEM team to write an exemption.  

继续阅读“GTS CarrierServiceTest”

【GTS6.0_r1】 com.google.android.xts.permissions.InitialRuntimePermissionStateTest — testAllSystemAppsUsingRuntimePermissionsTargetMncAndAboveSdk fail

[DESCRIPTION]

GTS 3.0R2在M平台上运行时会报如下错误:
com.google.android.xts.permissions.InitialRuntimePermissionStateTest
— testAllSystemAppsUsingRuntimePermissionsTargetMncAndAboveSdk fail junit.framework.AssertionFailedError: testAllSystemAppsUsingRuntimePermissionsTargetMncAndAboveSdk errors: Package:com.mediatek.voicecommand.overlay uses runtime permissions but doesn’t target 23+ SDK

com.google.android.xts.permissions.InitialRuntimePermissionStateTest
— testAllSystemAppsUsingRuntimePermissionsTargetMncAndAboveSdk fail junit.framework.AssertionFailedError: testAllSystemAppsUsingRuntimePermissionsTargetMncAndAboveSdk errors: Package:com.mobisystems.office uses runtime permissions but doesn’t target 23+ SDK

[SOLUTION]

继续阅读“【GTS6.0_r1】 com.google.android.xts.permissions.InitialRuntimePermissionStateTest — testAllSystemAppsUsingRuntimePermissionsTargetMncAndAboveSdk fail”

GTS 5.1_R3 GtsPackageManagerHostTestCases—com.google.android.pm.gts.PackageManagerHostTest#testSettingsReadable

[DESCRIPTION]
GtsPackageManagerHostTestCases—com.google.android.pm.gts.PackageManagerHostTest#testSettingsReadable

[SOLUTION]

继续阅读“GTS 5.1_R3 GtsPackageManagerHostTestCases—com.google.android.pm.gts.PackageManagerHostTest#testSettingsReadable”

GTS com.google.android.gts.backup.LocaleSettingsRestoreHostSideTest#testLocaleRestore

[DESCRIPTION]
run gts -m GtsBackupHostTestCases -t com.google.android.gts.backup.LocaleSettingsRestoreHostSideTest#testLocaleRestore

junit.framework.AssertionFailedError: Locales after restore are not as expected. expected:<[en-US, gl-ES, ga-IE, af-ZA]> but was:<[en-US, gl-ES]>
at junit.framework.Assert.fail(Assert.java:50)
at junit.framework.Assert.failNotEquals(Assert.java:287)
at junit.framework.Assert.assertEquals(Assert.java:67)
at com.google.android.gts.backup.testscontainerapp.LocaleSettingsRestoreTest.checkLocales(LocaleSettingsRestoreTest.java:105)
at java.lang.reflect.Method.invoke(Native Method)

[SOLUTION]

继续阅读“GTS com.google.android.gts.backup.LocaleSettingsRestoreHostSideTest#testLocaleRestore”

【GTS_All version】GTS测试失败网络确认

[DESCRIPTION]
GTS测试是云测试测试之前要检查网络,两个基础指标要确认:
1、测试机所连接网络可正常访问google官网;
2、测试机连接网络后可以正常播放youtube官网视频;

测试过程中如有遇到如下现象:
1、测试周期拉长,比如32位项目GTS测试完正常时间一般6-8小时;有时超过这个时间仍然没有生成一次full run的结果;
2、一些视频相关的case失败;

继续阅读“【GTS_All version】GTS测试失败网络确认”

Google Android Partnership Boot Camp -Shenzhen- Sep 2018 深圳研讨会

相关主题如下:

Android P CTS Hightlight, CTS Instant, Waiver Process

CTS and GTS Best Practice

Android P GMS Req.

Treble Compliance/VTS

Secutiry

OTA

Android Go

Camera Image Test Suite (ITS)

Branding Approval

How to get Android tech help

继续阅读“Google Android Partnership Boot Camp -Shenzhen- Sep 2018 深圳研讨会”

GMS认证中常见的fail项及解决方法-清妮

##########################################################

cts测试的一些命令:

##########################################################

cts测试前需要注意的事项:

继续阅读“GMS认证中常见的fail项及解决方法-清妮”

GTS Business Logic authentication 业务逻辑影响 GtsPlacementTestCases fail

GTS Business Logic authentication

Google enforces GTS Business Logic (BL) authentication. GTS will fail if the testing environment is not configured correctly. To configure the testing environment, you need to obtain a key file from your TAM. If you are a 3PL partner, please contact your 3PL directly.

Google强制执行GTS业务逻辑(BL)身份验证。 如果未正确配置测试环境,GTS将失败。 要配置测试环境,您需要从TAM获取密钥文件。 如果您是第三方物流合作伙伴,请直接联系您的3PL。

BL authentication affects the tests below. More tests will require BL authentication in the future.

  • com.google.android.placement.gts.DefaultIntentTest#testDefaultIntentHandlers
  • com.google.android.placement.gts.HomescreenLayoutTest#testShortcutPlacement
  • com.google.android.placement.gts.HomescreenLayoutTest#testFolderPlacement
  • com.google.android.placement.gts.HomescreenLayoutTest#testWidgetPlacement
  • com.google.android.placement.gts.InstalledAppsTest#testAppsInstalled
  • com.google.android.placement.gts.InstalledAppsTest#testSystemAppsInstalled

Troubleshooting GMS BL authentication

继续阅读“GTS Business Logic authentication 业务逻辑影响 GtsPlacementTestCases fail”

【8.1R7】GtsPlacementTestCases 下6条CaseFail

[DESCRIPTION]
GtsPlacementTestCases 下6条CaseFail
com.google.android.placement.gts.DefaultIntentTest#testDefaultIntentHandlers
com.google.android.placement.gts.HomescreenLayoutTest#testFolderPlacement
com.google.android.placement.gts.HomescreenLayoutTest#testShortcutPlacement
com.google.android.placement.gts.HomescreenLayoutTest#testWidgetPlacement
com.google.android.placement.gts.InstalledAppsTest#testAppsInstalled
com.google.android.placement.gts.InstalledAppsTest#testSystemAppsInstalled

第一种报错信息:
java.lang.AssertionError: Unable to execute because authorization failed, please ensure the service account key is properly installed..

继续阅读“【8.1R7】GtsPlacementTestCases 下6条CaseFail”

针对CTS,GTS测试过程中,在profile_provisioning流程分析与常见解决方案

[DESCRIPTION]

由于目前所有的手机都要求支持Android for work, 客户在测试CTS,GTS过程中,经常在profile_provisioning的过程中出错,这边对经常出错的地方进行分析,并提供对应的解决方案

[SOLUTION]

继续阅读“针对CTS,GTS测试过程中,在profile_provisioning流程分析与常见解决方案”

com.google.android.permission.gts.PreloadAppsTargetSdkVersionTest#testPreloadedAppsTargetSdkVersion fail

[DESCRIPTION]
使用GTS新工具GTS6.0R1测试 module:GtsPermissionTestCases,com.google.android.permission.gts.PreloadAppsTargetSdkVersionTest#testPreloadedAppsTargetSdkVersion fail
java.lang.AssertionError:All preloaded apps must target SDK 26 or higher:
com.mediatek.ppl targets 24,
com.mediatek.ygps targets 23,
com.mediatek.simprocessor targets 25,
com.mediatek.engineermode targets 23,
com.mediatek.omacp targets 25,
com.mediatek.emcamera targets 23,
com.mediatek.duraspeed targets 24,
com.mediatek.lbs.em2.ui targets 23,
com.mediatek.mtklogger targets 23,
com.mediatek.mtklogger.proxy targets 23,

继续阅读“com.google.android.permission.gts.PreloadAppsTargetSdkVersionTest#testPreloadedAppsTargetSdkVersion fail”

[GTS_6.0.R1]GtsPackageManagerHostTestCases中com.google.android.pm.gts.PackageManagerHostTest#testSoundPool FAIL

[DESCRIPTION]
GtsPackageManagerHostTestCases中com.google.android.pm.gts.PackageManagerHostTest#testSoundPool Fail]

Fail:
07-07 11:24:13 I/RemoteAndroidTest: Running am instrument -w -r –user 0 -e timeout_msec 600000 -e class ‘com.google.android.gts.packagemanager.InstantAppTestCases#testSoundPool’ com.google.android.gts.packagemanager.instant/android.support.test.runner.AndroidJUnitRunner on alps-k80_bsp-0123456789ABCDEF
07-07 11:24:19 I/XtsHostTestBase: Test com.google.android.gts.packagemanager.InstantAppTestCases#testSoundPool: FAILURE
07-07 11:24:19 W/XtsHostTestBase: java.lang.AssertionError: Instant App should be able to access Media / DrmManager.
Please apply patches r.android.com/502604, SHA d2b3a45, and SHA b93f049
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)

继续阅读“[GTS_6.0.R1]GtsPackageManagerHostTestCases中com.google.android.pm.gts.PackageManagerHostTest#testSoundPool FAIL”

Test suites GMS July release GMS Client ID update

These versions will be required for GMS approvals as described in the table below:

Release Release version Required-use date
CTS 8.1 R7, 8.0 R11, 7.1 R19, 7.0 R23, 6.0 R30 2018-8-21
VTS 8.1_r4 and 8.0_r8 w August SPLs 2018-8-21
GMS 8.1_201807, 8.0_201807 2018-9-18

GMS Client ID update
Updated H3G country list to include ITWe’ve updated the GMS Client ID mapping (direct link), effective for new devices only. Check with specific carriers to confirm which values to set. Here’s a summary of the changes:

  • Removed AT, BE, CH, FR from Vodafone list of countries
  • Added a row for Vodafone AU

com.google.android.permission.gts.DefaultPermissionGrantPolicyTest#testDefaultGrantsWithRemoteExceptions test fail

[DESCRIPTION]
 com.google.android.permission.gts.DefaultPermissionGrantPolicyTest#testDefaultGrantsWithRemoteExceptions test fail
java.lang.AssertionError: Permission:android.permission.WRITE_EXTERNAL_STORAGE cannot be granted by default to package:com.google.android.talk  
[SOLUTION]

继续阅读“com.google.android.permission.gts.DefaultPermissionGrantPolicyTest#testDefaultGrantsWithRemoteExceptions test fail”

com.google.android.os.gts.SysConfigTest#testValidSysConfigPresent fail

[DESCRIPTION]

低于内存是512MB的android go项目,maps go是optional app.(参考GMS Go Requirements – 2018-02-23.pdf第3页),
但是移除掉的话,会出现如下GTS fail:
Module:GtsOsTestCases
Test:com.google.android.os.gts.SysConfigTest#testValidSysConfigPresent

com.google.android.os.gts.SysConfigTest#testValidSysConfigPresent
fail
java.lang.AssertionError: Modification of required config file: Missing elements for tag linkedApps: ‘com.google.android.apps.maps’ . required={com.android.vending, com.google.android.music, com.google.android.apps.docs, com.google.android.apps.maps, com.google.android.videos, com.google.android.apps.photos, com.google.android.calendar, com.google.android.apps.tycho, com.google.android.talk, com.google.android.apps.youtube.mango} . all={com.google.android.apps.docs.editors.docs, com.google.android.apps.mapslite, com.google.android.apps.docs.editors.sheets, com.google.android.apps.docs.editors.slides, com.android.vending, com.google.android.music, com.google.android.apps.docs, com.google.android.apps.plus, com.google.android.videos, com.google.android.apps.photos, com.google.android.calendar, com.google.android.apps.tycho, com.google.android.talk, com.google.android.apps.youtube.mango} at org.junit.Assert.fail(Assert.java:88) at com.google.android.os.gts.SysConfigTest.assertSystemConfigEquals(SysConfigTest.java:424) at com.google.android.os.gts.SysConfigTest.testValidSysConfigPresent(SysConfigTest.java:112)

[SOLUTION]

继续阅读“com.google.android.os.gts.SysConfigTest#testValidSysConfigPresent fail”