Test Report for Build android-lcr-reference-x15-o-80

                                                                    
54 55 56 57 58 59 60 61 62 63 64 65 66 68 69 70 74 75 76 77 78 79 80

Build Summary

Build Name android-lcr-reference-x15-o
Build Number 80
Build Config lcr-reference-x15-o
Android Version android-8.1.0_r29
Kernel Version 4.14.42
Toolchain Android clang version 5.0.300080 (based on LLVM 5.0.300080) for userspace and Linaro GCC 7.2 32bit version for kernel and u-boot
Firmware Info ti-u-boot-2018.01
Images http://releases.linaro.org/android/reference-lcr/x15/8.1-18.05/
Cached In Base
Job Name Job Ids Resubmit latest bug link
vellamo3 226753: Complete
Report Android Bug
Report LAVA Bug
rl-sqlite 226752: Incomplete
Report Android Bug
Report LAVA Bug
   Job Submission

Basic Weekly

Index Job Name Test Name Base(69) Current Build Bugs Operations
Pass Fail Total Pass Fail Skip Total PassRate
1 basic meminfo-first 40 0 40 40 0 0 40 100.00
2 basic meminfo-second 40 0 40 40 0 0 40 100.00
3 basic busybox 10 0 10 10 0 0 10 100.00
4 basic ping 1 0 1 1 0 0 1 100.00
5 basic linaro-android-kernel-tests 54 0 54 45 1 0 46 97.00 2970
Add Bug
Report Android Bug 
6 basic tjbench 24 0 24 24 0 0 24 100.00
7 weekly media-codecs 6 6 12 6 6 0 12 50.00 2768
Add Bug
Report Android Bug 
8 weekly piglit-gles2 3 0 3 3 0 0 3 100.00
9 weekly piglit-gles3 0 0 11 0 0 11 11 0.00 3448
Add Bug
Report Android Bug 
10 weekly piglit-glslparser 18 81 99 18 81 0 99 18.00 Add Bug
Report Android Bug 
11 weekly piglit-shader-runner 4 0 15 4 0 11 15 26.00 Add Bug
Report Android Bug 
12 weekly stringbench 13 0 13 13 0 0 13 100.00
13 weekly libc-bench 108 0 108 108 0 0 108 100.00

Benchmarks

Index Benchmarks Test Suite Test Cases Unit Base(69) Current Difference(%) Bugs Operations
1 antutu6 antutu6 antutu6-sum-mean points 37767.00 39195.00 3.78
2 basic meminfo-first MemTotal kb 2058264.00 2058660.00 0.02
3 basic meminfo-first MemFree kb 1259896.00 1198968.00 -4.84
4 basic meminfo-first MemAvailable kb 1722124.00 1586680.00 -7.86
5 basic meminfo-second MemTotal kb 2058264.00 2058660.00 0.02
6 basic meminfo-second MemFree kb 1400560.00 1473280.00 5.19
7 basic meminfo-second MemAvailable kb 1701388.00 1687628.00 -0.81
8 benchmarkpi benchmarkpi benchmarkpi-mean miliseconds 139.40 152.60 -9.47
9 boottime boottime-first-analyze KERNEL_BOOT_TIME_avg s 3.70 4.12 -11.35
10 boottime boottime-first-analyze ANDROID_BOOT_TIME_avg s 22.99 68.08 -196.13 3851
Add Bug
Report Android Bug 
11 boottime boottime-first-analyze TOTAL_BOOT_TIME_avg s 26.69 72.20 -170.51 3851
Add Bug
Report Android Bug 
12 boottime boottime-second-analyze KERNEL_BOOT_TIME_avg s 3.69 4.13 -11.92
13 boottime boottime-second-analyze ANDROID_BOOT_TIME_avg s 13.77 51.44 -273.57 3851
Add Bug
Report Android Bug 
14 boottime boottime-second-analyze TOTAL_BOOT_TIME_avg s 17.47 55.57 -218.09 3851
Add Bug
Report Android Bug 
15 caffeinemark caffeinemark Caffeinemark-Collect-score-mean points 434044.80 429597.80 -1.02
16 caffeinemark caffeinemark Caffeinemark-Float-score-mean points 45909.60 46167.40 0.56
17 caffeinemark caffeinemark Caffeinemark-Loop-score-mean points 102710.00 103364.00 0.64
18 caffeinemark caffeinemark Caffeinemark-Method-score-mean points 42222.80 43597.40 3.26
19 caffeinemark caffeinemark Caffeinemark-score-mean points 82467.20 83123.00 0.80
20 caffeinemark caffeinemark Caffeinemark-Sieve-score-mean points 57959.60 57667.20 -0.50
21 caffeinemark caffeinemark Caffeinemark-String-score-mean points 62851.80 64030.00 1.87
22 cf-bench cf-bench cfbench-Overall-Score-mean points 16647.60 16477.20 -1.02
23 cf-bench cf-bench cfbench-Java-Score-mean points 12925.80 12731.80 -1.50
24 cf-bench cf-bench cfbench-Native-Score-mean points 22231.40 22096.20 -0.61
25 gearses2eclair gearses2eclair gearses2eclair fps 59.67 59.67 0.00
26 geekbench3 geekbench3 geekbench-multi-core-mean points 1451.20 1432.80 -1.27
27 geekbench3 geekbench3 geekbench-single-core-mean points 842.40 840.60 -0.21
28 glbenchmark25 glbenchmark25 Fill-rate-C24Z16-mean texels/sec 1280042419.20 1341769548.80 4.82
29 glbenchmark25 glbenchmark25 Fill-rate-C24Z16-Offscreen-mean texels/sec 1364017715.20 1554475827.20 13.96
30 glbenchmark25 glbenchmark25 GLBenchmark-2.1-Egypt-Classic-C16Z16-mean frames 3393.26 3374.75 -0.55
31 glbenchmark25 glbenchmark25 GLBenchmark-2.1-Egypt-Classic-C16Z16-Offscreen-mean frames 4803.08 5642.42 17.48
32 glbenchmark25 glbenchmark25 GLBenchmark-2.5-Egypt-HD-C24Z16-Fixed-timestep-mean msec 17709.00 16020.40 -9.54
33 glbenchmark25 glbenchmark25 GLBenchmark-2.5-Egypt-HD-C24Z16-Fixed-timestep-Offscreen-mean msec 26150.90 22038.30 -15.73
34 glbenchmark25 glbenchmark25 GLBenchmark-2.5-Egypt-HD-C24Z16-mean frames 2132.98 2284.96 7.13
35 glbenchmark25 glbenchmark25 GLBenchmark-2.5-Egypt-HD-C24Z16-Offscreen-mean frames 1433.11 1694.61 18.25
36 glbenchmark25 glbenchmark25 Triangle-throughput-Textured-C24Z16-Fragment-lit-mean triangles/sec 67186696.00 83506195.20 24.29
37 glbenchmark25 glbenchmark25 Triangle-throughput-Textured-C24Z16-Offscreen-Fragment-lit-mean triangles/sec 23103758.80 32463014.80 40.51
38 glbenchmark25 glbenchmark25 Triangle-throughput-Textured-C24Z16-mean triangles/sec 82546859.20 105566312.00 27.89
39 glbenchmark25 glbenchmark25 Triangle-throughput-Textured-C24Z16-Offscreen-mean triangles/sec 43308674.40 48063756.80 10.98
40 glbenchmark25 glbenchmark25 Triangle-throughput-Textured-C24Z16-Vertex-lit-mean triangles/sec 69165948.80 84715944.00 22.48
41 glbenchmark25 glbenchmark25 Triangle-throughput-Textured-C24Z16-Offscreen-Vertex-lit-mean triangles/sec 36034820.00 39994875.20 10.99
42 javawhetstone javawhetstone javawhetstone-MWIPS-mean MFLOPS 328.91 327.10 -0.55
43 javawhetstone javawhetstone javawhetstone-N1-float-mean MFLOPS 241.72 242.03 0.13
44 javawhetstone javawhetstone javawhetstone-N2-float-mean MFLOPS 208.02 208.40 0.18
45 javawhetstone javawhetstone javawhetstone-N3-if-mean MOPS 406.97 407.55 0.14
46 javawhetstone javawhetstone javawhetstone-N4-fixpt-mean MOPS 770.80 773.66 0.37
47 javawhetstone javawhetstone javawhetstone-N5-cos-mean MOPS 5.65 5.56 -1.59
48 javawhetstone javawhetstone javawhetstone-N6-float-mean MFLOPS 119.74 121.50 1.47
49 javawhetstone javawhetstone javawhetstone-N7-equal-mean MOPS 204.63 205.91 0.63
50 javawhetstone javawhetstone javawhetstone-N8-exp-mean MOPS 4.19 4.18 -0.24
51 jbench jbench jbench-mean points 48868.80 50263.40 2.85
52 linpack linpack Linpack-MFLOPSSingleScore-mean MFLOPS 308.79 290.12 -6.05
53 linpack linpack Linpack-MFLOPSMultiScore-mean MFLOPS 340.47 335.70 -1.40
54 linpack linpack Linpack-TimeSingleScore-mean seconds 0.27 0.29 -7.41
55 linpack linpack Linpack-TimeMultiScore-mean seconds 0.50 0.50 -0.00
56 monkey monkey monkey-network-stats ms 254027.00 54391.00 -78.59 3840
Add Bug
Report Android Bug 
57 quadrantpro quadrantpro quadrandpro-benchmark-memory-mean points 6976.60 7030.60 0.77
58 quadrantpro quadrantpro quadrandpro-benchmark-mean points 8858.20 8903.20 0.51
59 quadrantpro quadrantpro quadrandpro-benchmark-g2d-mean points 996.00 999.20 0.32
60 quadrantpro quadrantpro quadrandpro-benchmark-io-mean points 2585.00 2442.60 -5.51
61 quadrantpro quadrantpro quadrandpro-benchmark-cpu-mean points 31302.60 31601.60 0.96
62 quadrantpro quadrantpro quadrandpro-benchmark-g3d-mean points 2431.40 2442.20 0.44
63 rl-sqlite rl-sqlite RL-sqlite-Overall-mean -- -- -- -100.00 3553
Add Bug
Report Android Bug 
64 scimark scimark scimark-FFT-1024-mean Mflops 246.72 235.29 -4.63
65 scimark scimark scimark-LU-100x100-mean Mflops 444.25 447.15 0.65
66 scimark scimark scimark-SOR-100x100-mean Mflops 325.26 327.27 0.62
67 scimark scimark scimark-Monte-Carlo-mean Mflops 14.89 14.63 -1.75
68 scimark scimark scimark-Composite-Score-mean Mflops 255.50 254.41 -0.43
69 vellamo3 vellamo3 vellamo3-Browser-total-mean -- 2318.57 -- -100.00 3833
Add Bug
Report Android Bug 
70 vellamo3 vellamo3 vellamo3-Metal-total-mean -- 1290.66 -- -100.00 3833
Add Bug
Report Android Bug 
71 vellamo3 vellamo3 vellamo3-Multi-total-mean -- 1261.13 -- -100.00 3833
Add Bug
Report Android Bug 
72 vellamo3 vellamo3 vellamo3-total-score-mean -- 4870.36 -- -100.00 3833
Add Bug
Report Android Bug 

CTS

Only failures in the focused1 and focused2 test plans, and zero pass rate modules will be focused.
Index Plan Module Base(69) Current Bugs Comments Operations
Pass Fail Total Pass Rate Pass Fail Total Done Pass Rate
1 cts-focused1-v7a armeabi-v7a.CtsAndroidAppTestCases 3 0 3 100.00 3 0 3 pass 100.00
2 cts-focused1-v7a armeabi-v7a.CtsAppTestCases 427 2 429 99.00 428 1 429 pass 99.00 3583
  • android.app.cts.SystemFeaturesTest.testCameraFeatures java.lang.RuntimeException: Fail to connect to camera service
Add Comment
 Add Bug
Report Android Bug 
3 cts-focused1-v7a armeabi-v7a.CtsAppWidgetTestCases 11 0 11 100.00 11 0 11 pass 100.00
4 cts-focused1-v7a armeabi-v7a.CtsBionicTestCases 1871 0 1871 100.00 1871 0 1871 pass 100.00
5 cts-focused1-v7a armeabi-v7a.CtsContentTestCases 708 3 711 99.00 709 2 711 pass 99.00 3584
  • android.content.cts.AvailableIntentsTest.testVoiceCommand junit.framework.AssertionFailedError
  • android.content.cts.AvailableIntentsTest.testVoiceSearchHandsFree junit.framework.AssertionFailedError
  • android.content.cts.ContentResolverTest.testCrashOnLaunch junit.framework.AssertionFailedError
Add Comment
 Add Bug
Report Android Bug 
6 cts-focused1-v7a armeabi-v7a.CtsGraphicsTestCases 1553 0 1553 100.00 1553 0 1553 pass 100.00
7 cts-focused1-v7a armeabi-v7a.CtsLibcoreFileIOTestCases 18 0 18 100.00 18 0 18 pass 100.00
8 cts-focused1-v7a armeabi-v7a.CtsLibcoreJsr166TestCases 3365 0 3365 100.00 3365 0 3365 fail 100.00
9 cts-focused1-v7a armeabi-v7a.CtsLibcoreLegacy22TestCases 5 0 5 100.00 5 0 5 pass 100.00
10 cts-focused1-v7a armeabi-v7a.CtsLibcoreOkHttpTestCases 1995 0 1995 100.00 1995 0 1995 pass 100.00
11 cts-focused1-v7a armeabi-v7a.CtsLibcoreTestCases 22851 7 22858 99.00 22851 7 22858 pass 99.00 3586
  • libcore.io.OsTest.test_xattr_Errno junit.framework.AssertionFailedError: expected:<95> but was:<13>
  • libcore.java.net.ConcurrentCloseTest.test_connect junit.framework.AssertionFailedError: connect returned: Socket[address=/192.0.2.0,port=80,localPort=46790]!
  • libcore.java.net.ConcurrentCloseTest.test_connect_nonBlocking junit.framework.AssertionFailedError: connect returned: java.nio.channels.SocketChannel[connected local=/10.15.33.42:46792 remote=/192.0.2.0:80]!
  • libcore.java.net.InetAddressTest.test_getByName_invalid[1] java.lang.AssertionError: Invalid IP address incorrectly recognized as valid: 1.2.3.4.
  • libcore.java.net.SocketTest.testCloseDuringConnect junit.framework.AssertionFailedError: connectUnblocked=[false], workerFailure=[Connect returned unexpectedly for: /192.0.2.0:80]
  • libcore.java.nio.file.Files2Test.test_createLink java.lang.AssertionError
  • libcore.java.net.ConcurrentCloseTest.test_connect_timeout junit.framework.AssertionFailedError: connect returned: Socket[address=/192.0.2.0,port=80,localPort=46794]!
Add Comment
 Add Bug
Report Android Bug 
12 cts-focused1-v7a armeabi-v7a.CtsWidgetTestCases 1495 5 1500 99.00 1495 5 1500 pass 99.00 3587
  • android.widget.cts.ListPopupWindowTest.testAnchoringWithVerticalOffset java.lang.AssertionError: expected:<121> but was:<13>
  • android.widget.cts.ListPopupWindowTest.testPromptViewAbove java.lang.AssertionError
  • android.widget.cts.TextViewTest.testAutoSizeUniform_equivalentConfigurations java.lang.AssertionError: Expected the granularity and preset configured auto-sized TextViews to have identical available sizes for auto-sizing.
  • android.widget.cts.ListPopupWindowTest.testDismissalOutsideModal Wanted but not invoked:
  • android.widget.cts.ListPopupWindowTest.testDismissalOutsideNonModal Wanted but not invoked:
Add Comment
 Add Bug
Report Android Bug 
13 cts-focused2-v7a armeabi-v7a.CtsSecurityHostTestCases 648 19 667 97.00 651 16 667 pass 97.00 3588
  • some failed because it's userdebug build and does not have selinux enabled.
  • some of the failure were caused by that the build is in permissive mode, and is an eng build.
Add Comment
 Add Bug
Report Android Bug 
14 cts-focused2-v7a armeabi-v7a.CtsSecurityTestCases 185 9 194 95.00 191 7 198 pass 96.00 3589
  • android.security.cts.BannedFilesTest.testNoSu junit.framework.AssertionFailedError: /system/xbin/su
  • android.security.cts.BannedFilesTest.testNoSuInPath junit.framework.AssertionFailedError: /system/xbin/su exists
  • android.security.cts.EncryptionTest.testEncryption junit.framework.AssertionFailedError: Device encryption is required
  • android.security.cts.PackageSignatureTest.testPackageSignatures junit.framework.AssertionFailedError: These packages should not be signed with a well known key:
  • android.security.cts.SeccompTest.testCTSSwapOnOffBlocked junit.framework.AssertionFailedError: Syscall 87 allowed
  • android.security.cts.SeccompTest.testCTSSyscallBlocked junit.framework.AssertionFailedError: Syscall 309 allowed
  • android.security.cts.ServicePermissionsTest.testDumpProtected junit.framework.AssertionFailedError: dump() for media.extractor produced several lines of output; this may be leaking sensitive data. At most, services should emit a single line when the caller doesn't have DUMP permission.
Add Comment
 Add Bug
Report Android Bug 
15 cts-focused2-v7a armeabi-v7a.CtsViewTestCases 898 9 907 99.00 894 13 907 fail 98.00 3590
  • android.view.cts.DragDropTest.testNoExtraEvents junit.framework.AssertionFailedError: Couldn't start drag
  • android.view.cts.DragDropTest.testOverNowhere junit.framework.AssertionFailedError: Couldn't start drag
  • android.view.cts.HoverTest.testHoverMoveMultiple org.mockito.exceptions.verification.NoInteractionsWanted:
  • android.view.cts.PixelCopyTest.testVideoProducer java.lang.AssertionError: Top left
  • android.view.cts.SurfaceViewSyncTest.testEmptySurfaceView java.lang.AssertionError: Error: 1 incorrect frames observed - incorrect positioning
  • android.view.cts.SurfaceViewSyncTest.testSmallRect java.lang.AssertionError: Error: 30 incorrect frames observed - incorrect positioning
  • android.view.cts.SurfaceViewSyncTest.testSurfaceViewBigScale java.lang.AssertionError: Error: 2 incorrect frames observed - incorrect positioning
  • android.view.cts.SurfaceViewSyncTest.testVideoSurfaceViewEdgeCoverage java.lang.AssertionError: Error: 2 incorrect frames observed - incorrect positioning
  • android.view.cts.SurfaceViewSyncTest.testVideoSurfaceViewRotated java.lang.AssertionError: Error: 1 incorrect frames observed - incorrect positioning
  • android.view.cts.TextureViewCameraTest.testTextureViewActivity java.lang.RuntimeException: Fail to connect to camera service
  • android.view.cts.DragDropTest.testBlackHole junit.framework.AssertionFailedError: Couldn't start drag
  • android.view.cts.DragDropTest.testDrawableState junit.framework.AssertionFailedError: Couldn't start drag
  • android.view.cts.SurfaceViewSyncTest.testVideoSurfaceViewCornerCoverage java.lang.AssertionError: Error: 1 incorrect frames observed - incorrect positioning
Add Comment
 Add Bug
Report Android Bug 
16 cts-focused2-v7a armeabi-v7a.CtsVmTestCases 118 0 118 100.00 118 0 118 pass 100.00
17 cts-focused2-v7a armeabi-v7a.CtsWebkitTestCases 220 1 221 99.00 221 0 221 pass 100.00
18 cts-focused2-v7a armeabi-v7a.vm-tests-tf 3126 0 3126 100.00 3126 0 3126 pass 100.00
19 cts-media-v7a armeabi-v7a.CtsMediaStressTestCases 1 119 120 0.00 1 119 120 fail 0.00 3442
  • we do not copy media files to the device.
Add Comment
 Add Bug
Report Android Bug 
20 cts-media-v7a armeabi-v7a.CtsMediaTestCases 74 19 93 79.00 626 6 632 fail 99.00
  • android.media.cts.AudioRecordTest.testAudioRecordAuditChannelIndex2 junit.framework.AssertionFailedError: expected:<60000.0> but was:<62464.0>
  • android.media.cts.AudioTrackLatencyTest.testPlayPauseSmallBuffer java.lang.IllegalArgumentException: Invalid audio buffer size.
  • android.media.cts.AudioTrackLatencyTest.testPlaySmallBuffer java.lang.IllegalArgumentException: Invalid audio buffer size.
  • android.media.cts.CamcorderProfileTest.testGet java.lang.RuntimeException: Fail to connect to camera service
  • android.media.cts.CamcorderProfileTest.testGetWithId java.lang.RuntimeException: Fail to connect to camera service
  • android.media.cts.DecodeAccuracyTest.testGLViewDecodeAccuracy[56] Test failed to run to completion. Reason: 'Test run failed to complete. Expected 1920 tests, received 631'. Check device logcat for details
Add Comment
 Add Bug
Report Android Bug 
21 cts-media-v7a armeabi-v7a.CtsMidiTestCases 7 0 7 100.00 7 0 7 pass 100.00
22 cts-media-v7a armeabi-v7a.CtsNativeMediaSlTestCases 9 1 10 90.00 10 0 10 pass 100.00
23 cts-media-v7a armeabi-v7a.CtsNativeMediaXaTestCases 2 0 2 100.00 2 0 2 pass 100.00
24 cts-media-v7a armeabi-v7a.CtsVideoTestCases 290 15 305 95.00 295 10 305 pass 96.00
  • android.video.cts.VideoEncoderDecoderTest.testAvcGoog0Qual0320x0240 junit.framework.AssertionFailedError: rms error is bigger than the limit
  • android.video.cts.VideoEncoderDecoderTest.testAvcGoog0Qual0720x0480 junit.framework.AssertionFailedError: rms error is bigger than the limit
  • android.video.cts.VideoEncoderDecoderTest.testAvcGoog0Qual1280x0720 junit.framework.AssertionFailedError: rms error is bigger than the limit
  • android.video.cts.VideoEncoderDecoderTest.testAvcGoog0Qual1920x1080 junit.framework.AssertionFailedError: rms error is bigger than the limit
  • android.video.cts.VideoEncoderDecoderTest.testAvcOther0Qual0320x0240 junit.framework.AssertionFailedError: rms error is bigger than the limit
  • android.video.cts.VideoEncoderDecoderTest.testAvcOther0Qual0720x0480 junit.framework.AssertionFailedError: rms error is bigger than the limit
  • android.video.cts.VideoEncoderDecoderTest.testAvcOther0Qual1280x0720 junit.framework.AssertionFailedError: rms error is bigger than the limit
  • android.video.cts.VideoEncoderDecoderTest.testH263Goog0Qual0176x0144 junit.framework.AssertionFailedError: rms error is bigger than the limit
  • android.video.cts.VideoEncoderDecoderTest.testMpeg4Goog0Qual0176x0144 junit.framework.AssertionFailedError: rms error is bigger than the limit
  • android.video.cts.VideoEncoderDecoderTest.testAvcOther0Perf1280x0720 junit.framework.AssertionFailedError: Expected achievable frame rates for OMX.TI.DUCATI1.VIDEO.H264E video/avc 1280x720: [96.0, 98.0].
Add Comment
 Add Bug
Report Android Bug 
25 cts-media2-v7a armeabi-v7a.CtsMediaBitstreamsTestCases 6931 0 6931 100.00 6931 0 6931 pass 100.00
26 cts-media2-v7a armeabi-v7a.CtsMediaHostTestCases 4 0 4 100.00 4 0 4 pass 100.00
27 cts-opengl-v7a armeabi-v7a.CtsDeqpTestCases 318983 0 318983 100.00 318983 0 318983 pass 100.00
28 cts-opengl-v7a armeabi-v7a.CtsOpenGLTestCases 55 0 55 100.00 55 0 55 pass 100.00
29 cts-opengl-v7a armeabi-v7a.CtsOpenGlPerf2TestCases 9 0 9 100.00 9 0 9 pass 100.00
30 cts-opengl-v7a armeabi-v7a.CtsOpenGlPerfTestCases 3 0 3 100.00 3 0 3 pass 100.00
31 cts-opengl-v7a armeabi-v7a.CtsUiRenderingTestCases 200 6 206 97.00 203 3 206 pass 98.00
  • android.uirendering.cts.testclasses.HardwareBitmapTests.testBitmapRegionDecode java.lang.AssertionError: CanvasClient : no debug string given
  • android.uirendering.cts.testclasses.HardwareBitmapTests.testCreateScaledBitmap java.lang.AssertionError: CanvasClient : no debug string given
  • android.uirendering.cts.testclasses.HardwareBitmapTests.testHardwareExtractAlpha java.lang.AssertionError
Add Comment
 Add Bug
Report Android Bug 
32 cts-part1-v7a armeabi-v7a.CtsAadbHostTestCases 11 0 11 100.00 11 0 11 pass 100.00
33 cts-part1-v7a armeabi-v7a.CtsAbiOverrideHostTestCases 1 0 1 100.00 1 0 1 pass 100.00
34 cts-part1-v7a armeabi-v7a.CtsAccelerationTestCases 6 0 6 100.00 6 0 6 pass 100.00
35 cts-part1-v7a armeabi-v7a.CtsAccessibilityServiceTestCases 115 5 120 95.00 119 1 120 pass 99.00
  • android.accessibilityservice.cts.AccessibilityGestureDispatchTest.testClickWhenMagnified_matchesActualTouch java.lang.AssertionError:"
Add Comment
 Add Bug
Report Android Bug 
36 cts-part1-v7a armeabi-v7a.CtsAccessibilityTestCases 44 0 44 100.00 44 0 44 pass 100.00
37 cts-part1-v7a armeabi-v7a.CtsAccountManagerTestCases 151 0 151 100.00 151 0 151 pass 100.00
38 cts-part1-v7a armeabi-v7a.CtsAdminTestCases 77 0 77 100.00 77 0 77 pass 100.00
39 cts-part1-v7a armeabi-v7a.CtsAlarmClockTestCases 3 0 3 100.00 3 0 3 pass 100.00
40 cts-part1-v7a armeabi-v7a.CtsAnimationTestCases 143 0 143 100.00 143 0 143 pass 100.00
41 cts-part1-v7a armeabi-v7a.CtsAppUsageHostTestCases 1 0 1 100.00 1 0 1 pass 100.00
42 cts-part1-v7a armeabi-v7a.CtsAslrMallocTestCases 1 0 1 100.00 1 0 1 pass 100.00
43 cts-part1-v7a armeabi-v7a.CtsAssistTestCases 14 0 14 100.00 14 0 14 pass 100.00
44 cts-part1-v7a armeabi-v7a.CtsAtraceHostTestCases 3 0 3 100.00 0 3 3 pass 0.00 3841
  • android.atrace.cts.AtraceHostTest.testCategories junit.framework.AssertionFailedError
  • android.atrace.cts.AtraceHostTest.testSimpleRun junit.framework.ComparisonFailure: expected:<[capturing trace... done]> but was:<[Error: Did not find trace folder]>
  • android.atrace.cts.AtraceHostTest.testTracingContent junit.framework.AssertionFailedError
Add Comment
 Add Bug
Report Android Bug 
45 cts-part1-v7a armeabi-v7a.CtsBackupTestCases 6 0 6 100.00 6 0 6 pass 100.00
46 cts-part1-v7a armeabi-v7a.CtsBluetoothTestCases 45 0 45 100.00 45 0 45 pass 100.00
47 cts-part1-v7a armeabi-v7a.CtsCalendarcommon2TestCases 1 0 1 100.00 1 0 1 pass 100.00
48 cts-part1-v7a armeabi-v7a.CtsCameraTestCases 22 200 222 9.00 22 200 222 fail 9.00
  • because we we do not have camera feature enabled for the build.
Add Comment
 Add Bug
Report Android Bug 
49 cts-part1-v7a armeabi-v7a.CtsCarrierApiTestCases 4 0 4 100.00 4 0 4 pass 100.00
50 cts-part1-v7a armeabi-v7a.CtsCompilationTestCases 5 0 5 100.00 5 0 5 pass 100.00
51 cts-part1-v7a armeabi-v7a.CtsCppToolsTestCases 1 0 1 100.00 1 0 1 pass 100.00
52 cts-part1-v7a armeabi-v7a.CtsDatabaseTestCases 245 0 245 100.00 245 0 245 pass 100.00
53 cts-part1-v7a armeabi-v7a.CtsDevicePolicyManagerTestCases 266 6 272 97.00 139 133 272 pass 51.00 3842
  • looks like failed because we do not some feature enabled. typical failure are: com.android.cts.devicepolicy.AccountCheckHostSideTest.testInheritTestOnly java.lang.NullPointerException and com.android.cts.devicepolicy.AccountCheckHostSideTest.testAccountCheck junit.framework.AssertionFailedError: \\\"Error:\\\" expected to have format feature:{FEATURE_VALUE}
Add Comment
 Add Bug
Report Android Bug 
54 cts-part1-v7a armeabi-v7a.CtsDisplayTestCases 13 0 13 100.00 13 0 13 pass 100.00
55 cts-part1-v7a armeabi-v7a.CtsDpiTestCases 8 0 8 100.00 8 0 8 pass 100.00
56 cts-part1-v7a armeabi-v7a.CtsDpiTestCases2 6 0 6 100.00 6 0 6 pass 100.00
57 cts-part2-v7a armeabi-v7a.CtsLibcoreOjTestCases 3974 0 3974 100.00 3974 0 3974 pass 100.00
58 cts-part2-v7a armeabi-v7a.CtsNdefTestCases 11 0 11 100.00 11 0 11 pass 100.00
59 cts-part2-v7a armeabi-v7a.CtsNetSecConfigAttributeTestCases 1 0 1 100.00 1 0 1 pass 100.00
60 cts-part2-v7a armeabi-v7a.CtsNetSecConfigBasicDebugDisabledTestCases 1 0 1 100.00 1 0 1 pass 100.00
61 cts-part2-v7a armeabi-v7a.CtsNetSecConfigBasicDebugEnabledTestCases 1 0 1 100.00 1 0 1 pass 100.00
62 cts-part2-v7a armeabi-v7a.CtsNetSecConfigBasicDomainConfigTestCases 3 0 3 100.00 3 0 3 pass 100.00
63 cts-part2-v7a armeabi-v7a.CtsNetSecConfigCleartextTrafficTestCases 3 0 3 100.00 3 0 3 pass 100.00
64 cts-part2-v7a armeabi-v7a.CtsNetSecConfigInvalidPinTestCases 2 0 2 100.00 2 0 2 pass 100.00
65 cts-part2-v7a armeabi-v7a.CtsNetSecConfigNestedDomainConfigTestCases 2 0 2 100.00 2 0 2 pass 100.00
66 cts-part2-v7a armeabi-v7a.CtsNetSecConfigResourcesSrcTestCases 5 0 5 100.00 5 0 5 pass 100.00
67 cts-part2-v7a armeabi-v7a.CtsNetSecPolicyUsesCleartextTrafficFalseTestCases 6 0 6 100.00 6 0 6 pass 100.00
68 cts-part2-v7a armeabi-v7a.CtsNetSecPolicyUsesCleartextTrafficTrueTestCases 6 0 6 100.00 6 0 6 pass 100.00
69 cts-part2-v7a armeabi-v7a.CtsNetSecPolicyUsesCleartextTrafficUnspecifiedTestCases 6 0 6 100.00 6 0 6 pass 100.00
70 cts-part2-v7a armeabi-v7a.CtsNetTestCases 134 30 164 81.00 131 33 164 fail 79.00 3844
  • 9 failures in android.net.cts.ConnectivityManagerTest
  • android.net.cts.DnsTest.testDnsWorks junit.framework.AssertionFailedError: [RERUN] DNS could not resolve ipv6.google.com, check the network supports IPv6
  • android.net.cts.TrafficStatsTest.testTrafficStatsForLocalhost Test failed to run to completion. Reason: 'Instrumentation run failed due to 'Process crashed.''. Check device logcat for details
  • android.net.cts.TrafficStatsTest.testValidTotalStats junit.framework.AssertionFailedError
  • android.net.wifi.cts.ConcurrencyTest.testConcurrency junit.framework.AssertionFailedError
  • android.net.wifi.cts.ScanResultTest.testScanResultProperties junit.framework.AssertionFailedError
  • /android.net.wifi.cts.ScanResultTest.testScanResultTimeStamp junit.framework.AssertionFailedError
  • android.net.wifi.cts.WifiEnterpriseConfigTest.testAddEapNetwork junit.framework.AssertionFailedError
  • android.net.wifi.cts.WifiEnterpriseConfigTest.testEnterpriseConfigDoesNotPrintPassword junit.framework.AssertionFailedError
  • android.net.wifi.cts.WifiEnterpriseConfigTest.testSettersAndGetters junit.framework.AssertionFailedError
  • android.net.wifi.cts.WifiInfoTest.testWifiInfoProperties junit.framework.AssertionFailedError
  • 13 failure in android.net.wifi.cts.WifiManagerTest
Add Comment
 Add Bug
Report Android Bug 
71 cts-part2-v7a armeabi-v7a.CtsNetTestCasesLegacyApi22 3 0 3 100.00 3 0 3 pass 100.00
72 cts-part2-v7a armeabi-v7a.CtsNetTestCasesLegacyPermission22 3 0 3 100.00 3 0 3 pass 100.00
73 cts-part2-v7a armeabi-v7a.CtsOsHostTestCases 21 1 22 95.00 21 1 22 pass 95.00
  • android.os.cts.OsHostTests.testNonExportedActivities junit.framework.AssertionFailedError
Add Comment
 Add Bug
Report Android Bug 
74 cts-part2-v7a armeabi-v7a.CtsOsTestCases 460 3 463 99.00 455 8 463 pass 98.00
  • android.os.cts.BuildTest.testIsSecureUserBuild junit.framework.ComparisonFailure: Must be a user build expected:<user[]> but was:<user[debug]>
  • android.os.cts.BuildVersionTest.testBuildFingerprint junit.framework.ComparisonFailure: Variant expected:<user[]> but was:<user[debug]>
  • android.os.cts.StrictModeTest.testCleartextNetwork java.lang.IllegalStateException: command '34 strict set_uid_cleartext_policy 10081 log' failed with '400 34 Strict command failed'
  • android.os.cts.StrictModeTest.testEncryptedNetwork java.lang.IllegalStateException: command '35 strict set_uid_cleartext_policy 10081 log' failed with '400 35 Strict command failed'
  • android.os.cts.UsbDebuggingTest.testUsbDebugging junit.framework.ComparisonFailure: expected:<[1]> but was:<[]>
  • android.os.storage.cts.StorageManagerTest.testOpenProxyFileDescriptor java.lang.IllegalStateException: command '58 appfuse mount 10081 294 0' failed with '400 58 Command failed'
  • android.os.storage.cts.StorageManagerTest.testOpenProxyFileDescriptor_async java.lang.IllegalStateException: command '59 appfuse mount 10081 294 1' failed with '400 59 Command failed'
  • android.os.storage.cts.StorageManagerTest.testOpenProxyFileDescriptor_error java.lang.IllegalStateException: command '60 appfuse mount 10081 294 2' failed with '400 60 Command failed'
Add Comment
 Add Bug
Report Android Bug 
75 cts-part2-v7a armeabi-v7a.CtsPermission2TestCases 11 3 14 78.00 13 1 14 pass 92.00
  • android.permission2.cts.PrivappPermissionsTest.testPrivappPermissionsEnforcement junit.framework.AssertionFailedError: Not whitelisted permissions are granted for package android.ext.services: [android.permission.PROVIDE_RESOLVER_RANKER_SERVICE]
Add Comment
 Add Bug
Report Android Bug 
76 cts-part2-v7a armeabi-v7a.CtsPermissionTestCases 155 6 161 96.00 151 10 161 pass 93.00
  • android.permission.cts.Camera2PermissionTest.testCameraOpen android.hardware.camera2.CameraAccessException: CAMERA_ERROR (3): connectHelper:1399: Failed to initialize camera \"0\": Function not implemented (-38)
  • android.permission.cts.FileSystemPermissionTest.testDevHwRandomLockedDown junit.framework.AssertionFailedError: stat permitted on /dev/hw_random
  • android.permission.cts.FileSystemPermissionTest.testDevPortSane junit.framework.AssertionFailedError
  • android.permission.cts.FileSystemPermissionTest.testDevQtaguidSane junit.framework.AssertionFailedError
  • android.permission.cts.FileSystemPermissionTest.testProcInterruptsNotReadable junit.framework.AssertionFailedError
  • android.permission.cts.FileSystemPermissionTest.testProcQtaguidCtrlSane junit.framework.AssertionFailedError
  • android.permission.cts.FileSystemPermissionTest.testProcQtaguidStatsSane junit.framework.AssertionFailedError
  • android.permission.cts.FileSystemPermissionTest.testProcSelfOomAdjSane junit.framework.AssertionFailedError
  • android.permission.cts.FileSystemPermissionTest.testProcSelfOomScoreAdjSane junit.framework.AssertionFailedError
  • android.permission.cts.FileSystemPermissionTest.testProcStatNotReadable junit.framework.AssertionFailedError
Add Comment
 Add Bug
Report Android Bug 
77 cts-part2-v7a armeabi-v7a.CtsPreference2TestCases 136 1 137 99.00 136 1 137 pass 99.00
  • android.preference2.cts.PreferenceActivityLegacyFlowTest.legacyActivityRecreateTest java.lang.AssertionError: Screenshots do not match!
Add Comment
 Add Bug
Report Android Bug 
78 cts-part2-v7a armeabi-v7a.CtsPreferenceTestCases 4 0 4 100.00 4 0 4 pass 100.00
79 cts-part2-v7a armeabi-v7a.CtsPrintTestCases 367 0 367 100.00 367 0 367 pass 100.00
80 cts-part2-v7a armeabi-v7a.CtsProviderTestCases 344 1 345 99.00 344 1 345 pass 99.00
  • android.provider.cts.MediaStoreUiTest.testImageCapture junit.framework.AssertionFailedError: Expected to get a IMAGE_CAPTURE result; your camera app should respond to the CAMERA and DPAD_CENTER keycodes
Add Comment
 Add Bug
Report Android Bug 
81 cts-part2-v7a armeabi-v7a.CtsRenderscriptLegacyTestCases 11 0 11 100.00 11 0 11 pass 100.00
82 cts-part2-v7a armeabi-v7a.CtsRenderscriptTestCases 744 0 744 100.00 744 0 744 pass 100.00
83 cts-part2-v7a armeabi-v7a.CtsRsBlasTestCases 198 0 198 100.00 198 0 198 pass 100.00
84 cts-part2-v7a armeabi-v7a.CtsRsCppTestCases 123 0 123 100.00 123 0 123 pass 100.00
85 cts-part2-v7a armeabi-v7a.CtsSaxTestCases 2 0 2 100.00 2 0 2 pass 100.00
86 cts-part2-v7a armeabi-v7a.CtsServicesHostTestCases 259 1 260 99.00 260 0 260 pass 100.00
87 cts-part2-v7a armeabi-v7a.CtsShortcutHostTestCases 5 0 5 100.00 5 0 5 pass 100.00
88 cts-part2-v7a armeabi-v7a.CtsShortcutManagerTestCases 60 0 60 100.00 60 0 60 pass 100.00
89 cts-part2-v7a armeabi-v7a.CtsSimpleCpuTestCases 8 0 8 100.00 8 0 8 pass 100.00
90 cts-part2-v7a armeabi-v7a.CtsSimpleperfTestCases 158 0 158 100.00 151 7 158 pass 95.00
  • kmem_cmd.record_and_report CtsSimpleperfTestCases E 05-21 02:20:01 3655 3655 event_type.cpp:131] Unknown event_type 'kmem:kmalloc', try `simpleperf list` to list all possible event type names
  • kmem_cmd.record_and_report_callgraph CtsSimpleperfTestCases E 05-21 02:20:01 3655 3655 event_type.cpp:131] Unknown event_type 'kmem:kmalloc', try `simpleperf list` to list all possible event type names
  • kmem_cmd.record_fp_callchain_sampling CtsSimpleperfTestCases E 05-21 02:20:01 3655 3655 event_type.cpp:131] Unknown event_type 'kmem:kmalloc', try `simpleperf list` to list all possible event type names
  • kmem_cmd.record_slab CtsSimpleperfTestCases E 05-21 02:20:01 3655 3655 event_type.cpp:131] Unknown event_type 'kmem:kmalloc', try `simpleperf list` to list all possible event type names
  • record_cmd.dump_regs_for_tracepoint_events CtsSimpleperfTestCases E 05-21 02:23:59 3655 3655 event_type.cpp:131] Unknown event_type 'sched:sched_switch', try `simpleperf list` to list all possible event type names
  • record_cmd.tracepoint_event CtsSimpleperfTestCases E 05-21 02:23:20 3655 3655 event_type.cpp:131] Unknown event_type 'sched:sched_switch', try `simpleperf list` to list all possible event type names
  • stat_cmd.tracepoint_event CtsSimpleperfTestCases E 05-21 02:24:03 3655 3655 event_type.cpp:131] Unknown event_type 'sched:sched_switch', try `simpleperf list` to list all possible event type names
Add Comment
 Add Bug
Report Android Bug 
91 cts-part2-v7a armeabi-v7a.CtsSpeechTestCases 6 3 9 66.00 9 0 9 pass 100.00
92 cts-part2-v7a armeabi-v7a.CtsSustainedPerformanceHostTestCases 1 0 1 100.00 1 0 1 pass 100.00
93 cts-part2-v7a armeabi-v7a.CtsSystemIntentTestCases 1 0 1 100.00 1 0 1 pass 100.00
94 cts-part2-v7a armeabi-v7a.CtsSystemUiHostTestCases 11 0 11 100.00 11 0 11 pass 100.00
95 cts-part2-v7a armeabi-v7a.CtsSystemUiTestCases 3 0 3 100.00 3 0 3 pass 100.00
96 cts-part2-v7a armeabi-v7a.CtsTelecomTestCases 225 0 225 100.00 225 0 225 pass 100.00
97 cts-part2-v7a armeabi-v7a.CtsTelecomTestCases2 7 0 7 100.00 0 0 0 fail 0.00 3850
Add Comment
 Add Bug
Report Android Bug 
98 cts-part2-v7a armeabi-v7a.CtsTelephony2TestCases 1 0 1 100.00 1 0 1 pass 100.00
99 cts-part2-v7a armeabi-v7a.CtsTelephonyTestCases 111 0 111 100.00 111 0 111 pass 100.00
100 cts-part2-v7a armeabi-v7a.CtsTextTestCases 966 0 966 100.00 966 0 966 pass 100.00
101 cts-part2-v7a armeabi-v7a.CtsThemeDeviceTestCases 21 0 21 100.00 21 0 21 pass 100.00
102 cts-part2-v7a armeabi-v7a.CtsThemeHostTestCases 0 1 1 0.00 0 1 1 pass 0.00 3368
  • android.theme.cts.ThemeHostTest.testThemes junit.framework.AssertionFailedError: 960 failures in theme test
Add Comment
 Add Bug
Report Android Bug 
103 cts-part2-v7a armeabi-v7a.CtsToastLegacyTestCases 8 0 8 100.00 8 0 8 pass 100.00
104 cts-part2-v7a armeabi-v7a.CtsToastTestCases 3 0 3 100.00 3 0 3 pass 100.00
105 cts-part2-v7a armeabi-v7a.CtsTransitionTestCases 102 1 103 99.00 102 1 103 fail 99.00
  • android.transition.cts.FadeTest.testFadeOutTransition java.lang.IllegalArgumentException: x must be >= 0
  • android.transition.cts.TransitionManagerTest.testDefaultGo java.lang.AssertionError
Add Comment
 Add Bug
Report Android Bug 
106 cts-part2-v7a armeabi-v7a.CtsTrustedVoiceHostTestCases 1 0 1 100.00 1 0 1 pass 100.00
107 cts-part2-v7a armeabi-v7a.CtsTvProviderTestCases 2 0 2 100.00 2 0 2 pass 100.00
108 cts-part2-v7a armeabi-v7a.CtsTvTestCases 75 0 75 100.00 75 0 75 pass 100.00
109 cts-part2-v7a armeabi-v7a.CtsUiAutomationTestCases 8 1 9 88.00 8 1 9 pass 88.00
  • android.app.uiautomation.cts.UiAutomationTest.testWindowAnimationFrameStats junit.framework.AssertionFailedError
Add Comment
 Add Bug
Report Android Bug 
110 cts-part2-v7a armeabi-v7a.CtsUiDeviceTestCases 3 0 3 100.00 3 0 3 pass 100.00
111 cts-part2-v7a armeabi-v7a.CtsUiHostTestCases 2 0 2 100.00 2 0 2 pass 100.00
112 cts-part2-v7a armeabi-v7a.CtsUidIsolationTestCases 2 0 2 100.00 2 0 2 pass 100.00
113 cts-part2-v7a armeabi-v7a.CtsUsageStatsTestCases 7 7 14 50.00 7 7 14 pass 50.00
  • android.app.usage.cts.NetworkUsageStatsTest.testAppDetails junit.framework.AssertionFailedError: android.hardware.wifi is a reported system feature, however no corresponding connected network interface was found or the attempt to connect has timed out (timeout = 15000ms). Please make sure you are connected to a WiFi access point.
  • android.app.usage.cts.NetworkUsageStatsTest.testAppSummary junit.framework.AssertionFailedError: android.hardware.wifi is a reported system feature, however no corresponding connected network interface was found or the attempt to connect has timed out (timeout = 15000ms). Please make sure you are connected to a WiFi access point.
  • android.app.usage.cts.NetworkUsageStatsTest.testCallback junit.framework.AssertionFailedError: android.hardware.wifi is a reported system feature, however no corresponding connected network interface was found or the attempt to connect has timed out (timeout = 15000ms). Please make sure you are connected to a WiFi access point.
  • android.app.usage.cts.NetworkUsageStatsTest.testDeviceSummary junit.framework.AssertionFailedError: android.hardware.wifi is a reported system feature, however no corresponding connected network interface was found or the attempt to connect has timed out (timeout = 15000ms). Please make sure you are connected to a WiFi access point.
  • android.app.usage.cts.NetworkUsageStatsTest.testTagDetails junit.framework.AssertionFailedError: android.hardware.wifi is a reported system feature, however no corresponding connected network interface was found or the attempt to connect has timed out (timeout = 15000ms). Please make sure you are connected to a WiFi access point.
  • android.app.usage.cts.NetworkUsageStatsTest.testUidDetails junit.framework.AssertionFailedError: android.hardware.wifi is a reported system feature, however no corresponding connected network interface was found or the attempt to connect has timed out (timeout = 15000ms). Please make sure you are connected to a WiFi access point.
  • android.app.usage.cts.NetworkUsageStatsTest.testUserSummary junit.framework.AssertionFailedError: android.hardware.wifi is a reported system feature, however no corresponding connected network interface was found or the attempt to connect has timed out (timeout = 15000ms). Please make sure you are connected to a WiFi access point.
Add Comment
 Add Bug
Report Android Bug 
114 cts-part2-v7a armeabi-v7a.CtsUsbTests 0 1 1 0.00 0 1 1 pass 0.00 3367
  • com.android.cts.usb.TestUsbTest.testUsbSerial junit.framework.ComparisonFailure: usb serial != adb serial expected:<[]> but was:<[0f01901022dc0122]>
Add Comment
 Add Bug
Report Android Bug 
115 cts-part2-v7a armeabi-v7a.CtsUtilTestCases 286 0 286 100.00 286 0 286 pass 100.00
116 cts-part2-v7a armeabi-v7a.CtsVoiceInteractionTestCases 2 0 2 100.00 2 0 2 pass 100.00
117 cts-part2-v7a armeabi-v7a.CtsVoiceSettingsTestCases 2 0 2 100.00 2 0 2 pass 100.00
118 cts-part2-v7a armeabi-v7a.CtsVrTestCases 13 0 13 100.00 13 0 13 pass 100.00
119 cts-part3-v7a armeabi-v7a.CtsAppSecurityHostTestCases 213 5 218 97.00 216 2 218 pass 99.00
  • android.appsecurity.cts.AppSecurityTests.testAppFailAccessPrivateData java.lang.AssertionError: on-device tests failed
  • android.appsecurity.cts.AppSecurityTests.testUninstallRemovesData java.lang.AssertionError: on-device tests failed:
Add Comment
 Add Bug
Report Android Bug 
120 cts-part3-v7a armeabi-v7a.CtsFileSystemTestCases 5 0 5 100.00 5 0 5 pass 100.00
121 cts-part3-v7a armeabi-v7a.CtsIcuTestCases 2784 1 2785 99.00 2785 0 2785 pass 100.00
122 cts-part4-v7a armeabi-v7a.CtsDramTestCases 26 0 26 100.00 26 0 26 pass 100.00
123 cts-part4-v7a armeabi-v7a.CtsDreamsTestCases 3 0 3 100.00 3 0 3 pass 100.00
124 cts-part4-v7a armeabi-v7a.CtsDrmTestCases 42 0 42 100.00 42 0 42 pass 100.00
125 cts-part4-v7a armeabi-v7a.CtsDumpsysHostTestCases 4 0 4 100.00 4 0 4 pass 100.00
126 cts-part4-v7a armeabi-v7a.CtsEffectTestCases 6 0 6 100.00 6 0 6 pass 100.00
127 cts-part4-v7a armeabi-v7a.CtsExternalServiceTestCases 9 0 9 100.00 9 0 9 pass 100.00
128 cts-part4-v7a armeabi-v7a.CtsFragmentTestCases 155 0 155 100.00 155 0 155 pass 100.00
129 cts-part4-v7a armeabi-v7a.CtsGestureTestCases 29 0 29 100.00 29 0 29 pass 100.00
130 cts-part4-v7a armeabi-v7a.CtsHardwareTestCases 14 0 14 100.00 13 1 14 pass 92.00
  • android.hardware.input.cts.tests.GamepadTestCase.testButtonA java.lang.AssertionError: Timed out waiting for KEYCODE_BUTTON_A with action DOWN
Add Comment
 Add Bug
Report Android Bug 
131 cts-part4-v7a armeabi-v7a.CtsHostsideNetworkTests 37 0 37 100.00 32 5 37 pass 86.00
  • com.android.cts.net.HostsideRestrictBackgroundNetworkTests.testDataSaverMode_blacklisted java.lang.AssertionError: on-device tests failed:
  • com.android.cts.net.HostsideRestrictBackgroundNetworkTests.testDataSaverMode_enabled java.lang.AssertionError: on-device tests failed:
  • com.android.cts.net.HostsideRestrictBackgroundNetworkTests.testDataSaverMode_reinstall junit.framework.AssertionFailedError: whitelist check for uid 10108 failed: expected false, got true
  • com.android.cts.net.HostsideRestrictBackgroundNetworkTests.testDataSaverMode_requiredWhitelistedPackages java.lang.AssertionError: on-device tests failed:
  • com.android.cts.net.HostsideRestrictBackgroundNetworkTests.testDataSaverMode_whitelisted java.lang.AssertionError: on-device tests failed:
Add Comment
 Add Bug
Report Android Bug 
132 cts-part4-v7a armeabi-v7a.CtsHostsideNumberBlockingTestCases 1 0 1 100.00 1 0 1 pass 100.00
133 cts-part4-v7a armeabi-v7a.CtsHostsideTvTests 1 0 1 100.00 1 0 1 pass 100.00
134 cts-part4-v7a armeabi-v7a.CtsJankDeviceTestCases 1 0 1 100.00 1 0 1 pass 100.00
135 cts-part4-v7a armeabi-v7a.CtsJdwpSecurityHostTestCases 1 0 1 100.00 1 0 1 pass 100.00
136 cts-part4-v7a armeabi-v7a.CtsJdwpTestCases 401 0 401 100.00 401 0 401 pass 100.00
137 cts-part4-v7a armeabi-v7a.CtsJniTestCases 64 0 64 100.00 64 0 64 pass 100.00
138 cts-part4-v7a armeabi-v7a.CtsJobSchedulerTestCases 24 0 24 100.00 24 0 24 pass 100.00
139 cts-part4-v7a armeabi-v7a.CtsKeystoreTestCases 882 2 884 99.00 882 2 884 pass 99.00
  • android.keystore.cts.KeyAttestationTest.testEcAttestation_KeyStoreExceptionWhenRequestingUniqueId junit.framework.AssertionFailedError: Attestation should have failed.
  • android.keystore.cts.KeyChainTest.testIsBoundKeyAlgorithm_RequiredAlgorithmsSupported junit.framework.AssertionFailedError: RSA must be hardware-backed by a hardware-specific Keymaster HAL
Add Comment
 Add Bug
Report Android Bug 
140 cts-part4-v7a armeabi-v7a.CtsLeanbackJankTestCases 1 0 1 100.00 1 0 1 pass 100.00
141 cts-part4-v7a armeabi-v7a.CtsLocation2TestCases 12 0 12 100.00 12 0 12 pass 100.00
142 cts-part4-v7a armeabi-v7a.CtsLocationTestCases 135 0 135 100.00 135 0 135 pass 100.00
143 cts-part4-v7a armeabi-v7a.CtsMonkeyTestCases 10 0 10 100.00 10 0 10 pass 100.00
144 cts-part4-v7a armeabi-v7a.CtsMultiUserHostTestCases 5 0 5 100.00 5 0 5 pass 100.00
145 cts-part4-v7a armeabi-v7a.CtsMultiUserTestCases 1 0 1 100.00 1 0 1 pass 100.00
146 cts-part5-v7a armeabi-v7a.CtsAdminPackageInstallerTestCases 6 0 6 100.00 6 0 6 pass 100.00
147 cts-part5-v7a armeabi-v7a.CtsAutoFillServiceTestCases 317 0 317 100.00 317 0 317 pass 100.00
148 cts-part5-v7a armeabi-v7a.CtsBackgroundRestrictionsTestCases 2 0 2 100.00 2 0 2 pass 100.00
149 cts-part5-v7a armeabi-v7a.CtsBootStatsTestCases 0 1 1 0.00 0 1 1 pass 0.00
  • android.bootstats.cts.BootStatsHostTest.testBootStats junit.framework.AssertionFailedError: did not find boot logs
  • since we disabled the reboot during cts execution, the test would fail to get the boot log
Add Comment
 Add Bug
Report Android Bug 
150 cts-part5-v7a armeabi-v7a.CtsCameraApi25TestCases 0 1 1 0.00 0 1 1 pass 0.00 3473
  • android.camera.cts.api25test.EnableZslTest.testEnableZslValue android.hardware.camera2.CameraAccessException: CAMERA_ERROR (3): connectHelper:1399: Failed to initialize camera \"0\": Function not implemented (-38)
Add Comment
 Add Bug
Report Android Bug 
151 cts-part5-v7a armeabi-v7a.CtsColorModeTestCases 3 0 3 100.00 3 0 3 pass 100.00
152 cts-part5-v7a armeabi-v7a.CtsContactsProviderWipe 3 0 3 100.00 3 0 3 pass 100.00
153 cts-part5-v7a armeabi-v7a.CtsDebugTestCases 3 0 3 100.00 3 0 3 pass 100.00
154 cts-part5-v7a armeabi-v7a.CtsEdiHostTestCases 1 0 1 100.00 1 0 1 pass 100.00
155 cts-part5-v7a armeabi-v7a.CtsExternalSourcesTestCases 4 0 4 100.00 4 0 4 pass 100.00
156 cts-part5-v7a armeabi-v7a.CtsHostsideWebViewTests 4 0 4 100.00 4 0 4 pass 100.00
157 cts-part5-v7a armeabi-v7a.CtsIncidentHostTestCases 27 6 33 81.00 25 6 31 pass 80.00
  • com.android.server.cts.BatteryIncidentTest.testBatteryServiceDump junit.framework.AssertionFailedError
  • com.android.server.cts.NetstatsIncidentTest.testSanityCheck com.google.protobuf.InvalidProtocolBufferException: Protocol message tag had invalid wire type.
Add Comment
 Add Bug
Report Android Bug 
158 cts-part5-v7a armeabi-v7a.CtsIncidentTestCases 10 0 10 100.00 10 0 10 pass 100.00
159 cts-part5-v7a armeabi-v7a.CtsInputMethodServiceHostTestCases 6 0 6 100.00 5 0 5 pass 100.00
160 cts-part5-v7a armeabi-v7a.CtsInputMethodTestCases 38 0 38 100.00 38 0 38 pass 100.00
161 cts-part5-v7a armeabi-v7a.CtsJvmtiRedefineClassesHostTestCases 0 1 1 0.00 1 0 1 pass 100.00
162 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest902HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
163 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest903HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
164 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest904HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
165 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest905HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
166 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest906HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
167 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest907HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
168 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest908HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
169 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest910HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
170 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest911HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
171 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest913HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
172 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest914HostTestCases 1 0 1 100.00 0 1 1 pass 0.00 3556
  • android.jvmti.cts.JvmtiHostTest914.testJvmti junit.framework.AssertionFailedError: [android.jvmti.cts.JvmtiRunTestBasedTest#testRunTest java.lang.reflect.InvocationTargetException
Add Comment
 Add Bug
Report Android Bug 
173 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest915HostTestCases 1 0 1 100.00 0 1 1 pass 0.00 3556
  • android.jvmti.cts.JvmtiHostTest915.testJvmti junit.framework.AssertionFailedError: [android.jvmti.cts.JvmtiRunTestBasedTest#testRunTest java.lang.reflect.InvocationTargetException
Add Comment
 Add Bug
Report Android Bug 
174 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest917HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
175 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest918HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
176 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest919HostTestCases 1 0 1 100.00 0 1 1 pass 0.00 3556
  • android.jvmti.cts.JvmtiHostTest919.testJvmti junit.framework.AssertionFailedError: [android.jvmti.cts.JvmtiRunTestBasedTest#testRunTest java.lang.reflect.InvocationTargetException
Add Comment
 Add Bug
Report Android Bug 
177 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest920HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
178 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest922HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
179 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest923HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
180 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest924HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
181 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest926HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
182 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest927HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
183 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest928HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
184 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest930HostTestCases 0 1 1 0.00 1 0 1 pass 100.00
185 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest931HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
186 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest932HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
187 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest940HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
188 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest942HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
189 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest944HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
190 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest945HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
191 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest947HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
192 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest951HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
193 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest982HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
194 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest984HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
195 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest985HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
196 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest986HostTestCases 1 0 1 100.00 1 0 1 pass 100.00
197 cts-part5-v7a armeabi-v7a.CtsJvmtiTaggingHostTestCases 1 0 1 100.00 1 0 1 pass 100.00
198 cts-part5-v7a armeabi-v7a.CtsJvmtiTrackingHostTestCases 0 1 1 0.00 0 1 1 pass 0.00 3556
  • android.jvmti.cts.JvmtiHostTestAllocationTracking.testJvmti junit.framework.AssertionFailedError: [android.jvmti.cts.JvmtiTrackingTest#testTracking java.lang.UnsatisfiedLinkError: No implementation found for void art.Main.bindAgentJNI(java.lang.String, java.lang.ClassLoader) (tried Java_art_Main_bindAgentJNI and Java_art_Main_bindAgentJNI__Ljava_lang_String_2Ljava_lang_ClassLoader_2)
Add Comment
 Add Bug
Report Android Bug 
199 cts-part5-v7a armeabi-v7a.CtsKernelConfigTestCases 5 0 5 100.00 5 0 5 pass 100.00
200 cts-part5-v7a armeabi-v7a.CtsLiblogTestCases 157 0 157 100.00 156 0 156 pass 100.00
201 cts-part5-v7a armeabi-v7a.CtsNativeHardwareTestCases 1 0 1 100.00 1 0 1 pass 100.00
202 cts-part5-v7a armeabi-v7a.CtsNativeMediaAAudioTestCases 47 54 101 46.00 101 0 101 pass 100.00
203 cts-part5-v7a armeabi-v7a.CtsPdfTestCases 5239 0 5239 100.00 5239 0 5239 pass 100.00
204 cts-part5-v7a armeabi-v7a.CtsProtoTestCases 156 0 156 100.00 156 0 156 pass 100.00
205 cts-part5-v7a armeabi-v7a.CtsSelinuxTargetSdk2TestCases 1 1 2 50.00 1 1 2 pass 50.00
  • armeabi-v7a.CtsSelinuxTargetSdk2TestCases/android.selinuxtargetsdk2.cts.SELinuxTargetSdk2Test.testNoDns junit.framework.ComparisonFailure: DNS properties may not be readable by apps past targetSdkVersion 26 expected:<[10.0.0.2]> but was:<[]>
Add Comment
 Add Bug
Report Android Bug 
206 cts-part5-v7a armeabi-v7a.CtsSelinuxTargetSdkTestCases 1 0 1 100.00 1 0 1 pass 100.00
207 cts-part5-v7a armeabi-v7a.CtsSensorTestCases 300 0 300 100.00 300 0 300 pass 100.00
208 cts-part5-v7a armeabi-v7a.CtsSyncContentHostTestCases 2 1 3 66.00 2 1 3 pass 66.00
  • android.content.cts.InvalidSyncAuthoritiesHostTest.testInvalidEntriesClearedOnBoot java.lang.AssertionError: on-device tests failed:
Add Comment
 Add Bug
Report Android Bug 
209 cts-part5-v7a armeabi-v7a.CtsTelecomTestCases3 3 0 3 100.00 3 0 3 pass 100.00
210 cts-part5-v7a armeabi-v7a.CtsWindowManagerHostTestCases 34 0 34 100.00 34 0 34 pass 100.00
211 cts-part5-v7a armeabi-v7a.CtsWrapNoWrapTestCases 1 0 1 100.00 1 0 1 pass 100.00
212 cts-part5-v7a armeabi-v7a.CtsWrapWrapDebugTestCases 1 0 1 100.00 1 0 1 pass 100.00
213 cts-part5-v7a armeabi-v7a.CtsWrapWrapNoDebugTestCases 1 0 1 100.00 1 0 1 pass 100.00
214 Summary Total -- -- -- -- 388097 623 388720 99.00
Add Comment
 Add Bug
Report Android Bug 

VTS

Index Plan Base(69) Current Current Failed Test Cases Bugs Operations
Pass Fail Total Pass Rate Pass Fail Total Pass Rate
1 vts-hal 2 62 64 3.00 2 62 64 3.00 armeabi-v7a.VtsHalWifiV1_1Target/VtsHalWifiV1_1Target.setup_class
armeabi-v7a.VtsHalWifiV1_0Host/VtsHalWifiV1_0Host.setup_class
armeabi-v7a.VtsHalWifiSupplicantV1_0Target/VtsHalWifiSupplicantV1_0Target.setup_class
armeabi-v7a.VtsHalWifiOffloadV1_0Target/VtsHalWifiOffloadV1_0Target.setup_class
armeabi-v7a.VtsHalWifiNanV1_0Target/VtsHalWifiNanV1_0Target.setup_class
armeabi-v7a.VtsHalWeaverV1_0Target/VtsHalWeaverV1_0Target.setup_class
armeabi-v7a.VtsHalVrV1_0Target/VtsHalVrV1_0Target.setup_class
armeabi-v7a.VtsHalVrV1_0Host/VtsHalVrV1_0Host.testVrBasic
armeabi-v7a.VtsHalVrV1_0Host/VtsHalVrV1_0Host.setup_class
armeabi-v7a.VtsHalVibratorV1_1Target/VtsHalVibratorV1_1Target.setup_class
armeabi-v7a.VtsHalVibratorV1_0Target/VtsHalVibratorV1_0Target.setup_class
armeabi-v7a.VtsHalVibratorV1_0Host/VtsHalVibratorV1_0Host.testVibratorBasic
armeabi-v7a.VtsHalVibratorV1_0Host/VtsHalVibratorV1_0Host.setup_class
armeabi-v7a.VtsHalUsbV1_1Target/VtsHalUsbV1_1Target.setup_class
armeabi-v7a.VtsHalUsbV1_0Target/VtsHalUsbV1_0Target.setup_class
armeabi-v7a.VtsHalThermalV1_1Target/VtsHalThermalV1_1Target.setup_class
armeabi-v7a.VtsHalThermalV1_0Target/VtsHalThermalV1_0Target.setup_class
armeabi-v7a.VtsHalTetherOffloadControlV1_0Target/VtsHalTetherOffloadControlV1_0Target.setup_class
armeabi-v7a.VtsHalTetherOffloadConfigV1_0Target/VtsHalTetherOffloadConfigV1_0Target.setup_class
armeabi-v7a.VtsHalSoundtriggerV2_0Target/VtsHalSoundtriggerV2_0Target.setup_class
armeabi-v7a.VtsHalSensorsV1_0Target/VtsHalSensorsV1_0Target.setup_class
armeabi-v7a.VtsHalSensorsV1_0Host/VtsHalSensorsV1_0Host.testSensorsBasic
armeabi-v7a.VtsHalSensorsV1_0Host/VtsHalSensorsV1_0Host.setup_class
armeabi-v7a.VtsHalSapV1_0Target/VtsHalSapV1_0Target.setup_class
armeabi-v7a.VtsHalRenderscriptV1_0Target/VtsHalRenderscriptV1_0Target.setup_class
armeabi-v7a.VtsHalRadioV1_1Target/VtsHalRadioV1_1Target.setup_class
armeabi-v7a.VtsHalRadioV1_0Target/VtsHalRadioV1_0Target.setup_class
armeabi-v7a.VtsHalRadioV1_0Host/VtsHalRadioV1_0Host.testHelloWorld
armeabi-v7a.VtsHalRadioV1_0Host/VtsHalRadioV1_0Host.setup_class
armeabi-v7a.VtsHalPowerV1_1Target/VtsHalPowerV1_1Target.setup_class
armeabi-v7a.VtsHalPowerV1_0Target/VtsHalPowerV1_0Target.setup_class
armeabi-v7a.VtsHalOemLockV1_0Target/VtsHalOemLockV1_0Target.setup_class
armeabi-v7a.VtsHalNfcV1_0Target/VtsHalNfcV1_0Target.setup_class
armeabi-v7a.VtsHalNfcV1_0HostPassthrough/VtsHalNfcV1_0HostPassthrough.testBase
armeabi-v7a.VtsHalNfcV1_0HostPassthrough/VtsHalNfcV1_0HostPassthrough.setup_class
armeabi-v7a.VtsHalNfcV1_0HostBinderize/VtsHalNfcV1_0HostBinderize.testBase
armeabi-v7a.VtsHalNfcV1_0HostBinderize/VtsHalNfcV1_0HostBinderize.setup_class
armeabi-v7a.VtsHalMemtrackV1_0Target/VtsHalMemtrackV1_0Target.setup_class
armeabi-v7a.VtsHalMediaOmxV1_0Host/VtsHalMediaOmxV1_0Host.setup_class
armeabi-v7a.VtsHalLightV2_0Target/VtsHalLightV2_0Target.setup_class
armeabi-v7a.VtsHalKeymasterV3_0Target/VtsHalKeymasterV3_0Target.setup_class
armeabi-v7a.VtsHalIrV1_0Target/VtsHalIrV1_0Target.setup_class
armeabi-v7a.VtsHalHealthV1_0Target/VtsHalHealthV1_0Target.setup_class
armeabi-v7a.VtsHalGraphicsMapperV2_0Target/VtsHalGraphicsMapperV2_0Target.setup_class
armeabi-v7a.VtsHalGraphicsComposerV2_1Target/VtsHalGraphicsComposerV2_1Target.setup_class
armeabi-v7a.VtsHalGnssV1_0Target/VtsHalGnssV1_0Target.setup_class
armeabi-v7a.VtsHalGnssV1_0HostBinderize/VtsHalGnssV1_0HostBinderize.testExtensionPresenceForUnimplementedOnes
armeabi-v7a.VtsHalGnssV1_0HostBinderize/VtsHalGnssV1_0HostBinderize.testExtensionPresence
armeabi-v7a.VtsHalGnssV1_0HostBinderize/VtsHalGnssV1_0HostBinderize.setup_class
armeabi-v7a.VtsHalGatekeeperV1_0Target/VtsHalGatekeeperV1_0Target.setup_class
armeabi-v7a.VtsHalDumpstateV1_0Target/VtsHalDumpstateV1_0Target.setup_class
armeabi-v7a.VtsHalDrmV1_0Target/VtsHalDrmV1_0Target.setup_class
armeabi-v7a.VtsHalContexthubV1_0Target/VtsHalContexthubV1_0Target.setup_class
armeabi-v7a.VtsHalConfigstoreV1_0Target/VtsHalConfigstoreV1_0Target.setup_class
armeabi-v7a.VtsHalCasV1_0Target/VtsHalCasV1_0Target.setup_class
armeabi-v7a.VtsHalCameraProviderV2_4Target/VtsHalCameraProviderV2_4Target.setup_class
armeabi-v7a.VtsHalBroadcastradioV1_0Target/VtsHalBroadcastradioV1_0Target.setup_class
armeabi-v7a.VtsHalBootV1_0Target/VtsHalBootV1_0Target.setup_class
armeabi-v7a.VtsHalBluetoothV1_0Target/VtsHalBluetoothV1_0Target.setup_class
armeabi-v7a.VtsHalBiometricsFingerprintV2_1Target/VtsHalBiometricsFingerprintV2_1Target.setup_class
armeabi-v7a.VtsHalAudioV2_0Target/VtsHalAudioV2_0Target.setup_class
armeabi-v7a.VtsHalAudioEffectV2_0Target/VtsHalAudioEffectV2_0Target.setup_class
3445
Add Bug
2 vts-kernel-kselftest 9 0 9 100.00 9 0 9 100.00 Add Bug
3 vts-kernel-ltp 734 61 795 92.00 734 61 795 92.00 armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.write01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.waitpid13_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.waitpid12_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.waitpid11_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.waitpid10_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.waitpid09_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.waitpid08_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.waitpid07_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.waitpid06_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.umask01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.times03_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.syscall01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.socketpair02_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.socketpair01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.socket02_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.recvmsg02_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.read01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.pwritev02_64_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.pwritev01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.preadv02_64_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.preadv01_64_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.preadv01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.ppoll01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.pipe03_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.pipe02_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.pipe01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.pause01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.nice03_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.nice02_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.nice01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.madvise05_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.socket01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.fcntl04_64_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.fcntl04_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.fcntl03_64_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.fcntl03_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.fcntl02_64_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.fcntl02_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.epoll_ctl02_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.epoll_create1_01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.creat07_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.creat05_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.creat04_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.creat03_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.creat01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.clock_nanosleep2_01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.clock_getres01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.alarm06_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.access03_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.access01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.mm.mtest06_3_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.math.fptest02_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.math.fptest01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.gettimeofday02_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.getrandom04_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.getrandom03_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.getrandom02_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.getrandom01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.getpriority02_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.getpriority01_32bit
armeabi-v7a.VtsKernelLtp/VtsKernelLtp.syscalls.getcwd04_32bit
3554
Add Bug
4 vts-kernel-part1 32 6 38 84.00 29 9 38 76.00 armeabi-v7a.VtsQtaguidTest/VtsQtaguidTest.setup_class
armeabi-v7a.VtsKernelTunTest/VtsKernelTunTest.setup_class
armeabi-v7a.VtsKernelNetdTest/VtsKernelNetdTest.setup_class
armeabi-v7a.VtsKernelLibcutilsTest/VtsKernelLibcutilsTest.setup_class
armeabi-v7a.VtsKernelConfig/VtsKernelConfig.testKernelConfigs
armeabi-v7a.VtsKernelBinderTest/VtsKernelBinderTest.setup_class
armeabi-v7a.KernelProcFileApiTest/KernelProcFileApiTest.testProcZoneInfoTest
armeabi-v7a.KernelProcFileApiTest/KernelProcFileApiTest.testProcVmallocInfoTest
armeabi-v7a.KernelProcFileApiTest/KernelProcFileApiTest.testProcQtaguidCtrlTest
3555
Add Bug
5 vts-library 0 12 12 0.00 0 12 12 0.00 armeabi-v7a.VtsHidlUnitTests/VtsHidlUnitTests.hidl_test
armeabi-v7a.VtsFmqUnitTests/VtsFmqUnitTests.fmq_test
armeabi-v7a.LibcTest/LibcTest.testOpenCloseLocalSocketStream
armeabi-v7a.LibcTest/LibcTest.testOpenCloseLocalSocketSequential
armeabi-v7a.LibcTest/LibcTest.testOpenCloseLocalSocketRaw
armeabi-v7a.LibcTest/LibcTest.testOpenCloseLocalSocketDatagram
armeabi-v7a.LibcTest/LibcTest.testOpenCloseINETSocketStream
armeabi-v7a.LibcTest/LibcTest.testOpenCloseINETSocketDatagram
armeabi-v7a.LibcTest/LibcTest.setup_class
armeabi-v7a.CpuProfilingTest/CpuProfilingTest.setup_class
armeabi-v7a.BionicUnitTestsStatic/BionicUnitTestsStatic.setup_class
armeabi-v7a.BionicUnitTests/BionicUnitTests.setup_class
3446
Add Bug
Report Android Bug 
6 vts-performance 0 9 9 0.00 0 9 9 0.00 armeabi-v7a.HwBinderPassthroughThroughputTest/HwBinderPassthroughThroughputTest.testRunBenchmark32Bit
armeabi-v7a.HwBinderPassthroughPerformanceTest/HwBinderPassthroughPerformanceTest.testRunBenchmark32Bit
armeabi-v7a.HwBinderPassthroughLatencyTest/HwBinderPassthroughLatencyTest.testRunBenchmark32Bit
armeabi-v7a.HwBinderBinderizeThroughputTest/HwBinderBinderizeThroughputTest.testRunBenchmark32Bit
armeabi-v7a.HwBinderBinderizePerformanceTest/HwBinderBinderizePerformanceTest.testRunBenchmark32Bit
armeabi-v7a.HwBinderBinderizeLatencyTest/HwBinderBinderizeLatencyTest.testRunBenchmark32Bit
armeabi-v7a.FmqPerformanceTest/FmqPerformanceTest.testRunBenchmark32Bit
armeabi-v7a.BinderThroughputBenchmark/BinderThroughputBenchmark.testRunBenchmark32Bit
armeabi-v7a.BinderPerformanceTest/BinderPerformanceTest.testRunBenchmark32Bit
3447
Add Bug
Report Android Bug 
7 Summary -- -- -- -- 774 153 927 83.00 Add Bug

Bug Status:

Index Bug Id Plan/TestSuite Module/TestCase Subject Status Comments
1 3840 monkey monkey-network-stats X15-4.14: monkey test failed to run to complete unconfirmed --
2 3833 vellamo3 vellamo3-Browser-total-mean X15-4.14: vellamo3 test failed to run with PVR_K info printed on serial console unconfirmed --
3 3833 vellamo3 vellamo3-Metal-total-mean X15-4.14: vellamo3 test failed to run with PVR_K info printed on serial console unconfirmed --
4 3833 vellamo3 vellamo3-Multi-total-mean X15-4.14: vellamo3 test failed to run with PVR_K info printed on serial console unconfirmed --
5 3833 vellamo3 vellamo3-total-score-mean X15-4.14: vellamo3 test failed to run with PVR_K info printed on serial console unconfirmed --
6 3553 rl-sqlite RL-sqlite-Overall-mean X15/HiKey: rl-sqlite failed with 8.1.0_r2 builds unconfirmed --
7 3583 cts-focused1-v7a armeabi-v7a.CtsAppTestCases X15: armeabi-v7a.CtsAppTestCases has failures unconfirmed --
8 3584 cts-focused1-v7a armeabi-v7a.CtsContentTestCases X15: armeabi-v7a.CtsContentTestCases has failures unconfirmed --
9 3586 cts-focused1-v7a armeabi-v7a.CtsLibcoreTestCases X15: armeabi-v7a.CtsLibcoreTestCases has failures unconfirmed --
10 3587 cts-focused1-v7a armeabi-v7a.CtsWidgetTestCases X15: armeabi-v7a.CtsWidgetTestCases has failures unconfirmed --
11 3588 cts-focused2-v7a armeabi-v7a.CtsSecurityHostTestCases X15: armeabi-v7a.CtsSecurityHostTestCases has failures unconfirmed --
12 3590 cts-focused2-v7a armeabi-v7a.CtsViewTestCases X15: armeabi-v7a.CtsViewTestCases unconfirmed --
13 3589 cts-focused2-v7a armeabi-v7a.CtsSecurityTestCases X15: armeabi-v7a.CtsSecurityTestCases has failures unconfirmed --
14 3442 cts-media-v7a armeabi-v7a.CtsMediaStressTestCases X15: oreo build cts test armeabi-v7a.CtsMediaStressTestCases only has 1 pass of 120 test cases unconfirmed --
15 3473 cts-part5-v7a armeabi-v7a.CtsCameraApi25TestCases X15: armeabi-v7a.CtsCameraApi25TestCases has 0 pass with oreo build unconfirmed --
16 3448 piglit-gles3 piglit-gles3 HiKey/X15: piglit-gles3 has 0 pass with oreo build unconfirmed --
17 2970 linaro-android-kernel-tests linaro-android-kernel-tests Hikey/X15: linaro_android_kernel_test sync_basic_try_open FAILED unconfirmed --
18 2768 media-codecs media-codecs X15: Media codecs functional has failures unconfirmed --
19 3841 cts-part1-v7a armeabi-v7a.CtsAtraceHostTestCases X15-4.14: armeabi-v7a.CtsAtraceHostTestCases has 3 failures unconfirmed --
20 3842 cts-part1-v7a armeabi-v7a.CtsDevicePolicyManagerTestCases X15-4.14: armeabi-v7a.CtsDevicePolicyManagerTestCases has 189 failures unconfirmed --
21 3446 vts-library vts-library X15: vts-library has failures with the oreo build unconfirmed --
22 3447 vts-performance vts-performance X15: vts-performance has failures with oreo build unconfirmed --
23 3445 vts-hal vts-hal X15: vts-hal has failures with the oreo build unconfirmed --
24 3555 vts-kernel-part1 vts-kernel-part1 X15: vts-kernel-part1 has failures with oreo build unconfirmed --
25 3554 vts-kernel-ltp vts-kernel-ltp X15: vts-kernel-ltp has failures with oreo build unconfirmed --
35 3556 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest915HostTestCases X15: some armeabi-v7a.CtsJvmtiXXX series test cases failed unconfirmed --
37 3844 cts-part2-v7a armeabi-v7a.CtsNetTestCases X15: armeabi-v7a.CtsNetTestCases has failures related to connectivity and wifi unconfirmed --
38 3368 cts-part2-v7a armeabi-v7a.CtsThemeHostTestCases HiKey/X15: CtsThemeHostTestCases failed with hikey/x15 oreo reference builds unconfirmed --
39 3367 cts-part2-v7a armeabi-v7a.CtsUsbTests HiKey/X15: CtsUsbTests failed on lava unconfirmed --
42 3556 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest914HostTestCases X15: some armeabi-v7a.CtsJvmtiXXX series test cases failed unconfirmed --
43 3556 cts-part5-v7a armeabi-v7a.CtsJvmtiRunTest919HostTestCases X15: some armeabi-v7a.CtsJvmtiXXX series test cases failed unconfirmed --
44 3556 cts-part5-v7a armeabi-v7a.CtsJvmtiTrackingHostTestCases X15: some armeabi-v7a.CtsJvmtiXXX series test cases failed unconfirmed --
45 3850 cts-part2-v7a armeabi-v7a.CtsTelecomTestCases2 X15-4.14: armeabi-v7a.CtsTelecomTestCases2 failed to run to complete unconfirmed --
46 3851 boottime-first-analyze ANDROID_BOOT_TIME_avg X15-4.14: TOTAL_BOOT_TIME regression with about 200% slow unconfirmed --
47 3851 boottime-first-analyze TOTAL_BOOT_TIME_avg X15-4.14: TOTAL_BOOT_TIME regression with about 200% slow unconfirmed --
48 3851 boottime-second-analyze ANDROID_BOOT_TIME_avg X15-4.14: TOTAL_BOOT_TIME regression with about 200% slow unconfirmed --
49 3851 boottime-second-analyze TOTAL_BOOT_TIME_avg X15-4.14: TOTAL_BOOT_TIME regression with about 200% slow unconfirmed --

Jobs Duration:

Index Job Id Job Name Duration
1 226738 basic 0:16:13
2 227266 weekly 0:33:14
3 226755 antutu6 1:15:57
4 226743 benchmarkpi 0:11:26
5 227051 boottime 0:26:56
6 226754 caffeinemark 0:14:07
7 226744 cf-bench 0:51:01
8 226745 gearses2eclair 0:08:35
9 226746 geekbench3 0:15:18
10 226771 glbenchmark25 1:25:58
11 226747 javawhetstone 0:12:06
12 226748 jbench 0:12:00
13 226749 linpack 0:11:14
14 226740 monkey 0:10:35
15 226750 quadrantpro 0:15:35
16 226751 scimark 0:15:55
17 226769 vts-hal 1:16:39
18 226765 vts-kernel-kselftest 0:19:45
19 226766 vts-kernel-ltp 1:36:50
20 226764 vts-kernel-part1 0:27:38
21 226767 vts-library 0:23:10
22 226768 vts-performance 0:26:13
23 226741 cts-focused1-v7a 4:02:08
24 226742 cts-focused2-v7a 3:37:55
25 226763 cts-media-v7a 2:37:14
26 226762 cts-media2-v7a 0:17:23
27 226761 cts-opengl-v7a 1:47:15
28 227267 cts-part1-v7a 2:05:28
29 227268 cts-part2-v7a 5:29:49
30 227073 cts-part3-v7a 1:59:18
31 226759 cts-part4-v7a 1:13:38
32 226760 cts-part5-v7a 1:22:52
-- -- Total 1 day, 11:59:25