1*61046927SAndroid Build Coastguard WorkerSkQP 2*61046927SAndroid Build Coastguard Worker==== 3*61046927SAndroid Build Coastguard Worker 4*61046927SAndroid Build Coastguard Worker`SkQP <https://skia.org/docs/dev/testing/skqp/>`__ stands for SKIA Quality 5*61046927SAndroid Build Coastguard WorkerProgram conformance tests. Basically, it has sets of rendering tests and unit 6*61046927SAndroid Build Coastguard Workertests to ensure that `SKIA <https://skia.org/>`__ is meeting its design specifications on a specific 7*61046927SAndroid Build Coastguard Workerdevice. 8*61046927SAndroid Build Coastguard Worker 9*61046927SAndroid Build Coastguard WorkerThe rendering tests have support for GL, GLES and Vulkan backends and test some 10*61046927SAndroid Build Coastguard Workerrendering scenarios. 11*61046927SAndroid Build Coastguard WorkerAnd the unit tests check the GPU behavior without rendering images, using any of the GL/GLES or Vulkan drivers. 12*61046927SAndroid Build Coastguard Worker 13*61046927SAndroid Build Coastguard WorkerSkQP reports 14*61046927SAndroid Build Coastguard Worker------------ 15*61046927SAndroid Build Coastguard Worker 16*61046927SAndroid Build Coastguard WorkerSkQP generates reports after finishing its execution, and deqp-runner collects 17*61046927SAndroid Build Coastguard Workerthem in the job artifacts results directory under the test name. Click the 18*61046927SAndroid Build Coastguard Worker'Browse' button from a failing job to get to them. 19*61046927SAndroid Build Coastguard Worker 20*61046927SAndroid Build Coastguard WorkerSkQP failing tests 21*61046927SAndroid Build Coastguard Worker------------------ 22*61046927SAndroid Build Coastguard Worker 23*61046927SAndroid Build Coastguard WorkerSkQP rendering tests will have a range of pixel values allowed for the driver's 24*61046927SAndroid Build Coastguard Workerrendering for a given test. This can make the "expected" image in the result 25*61046927SAndroid Build Coastguard Workeroutput look rather strange, but you should be able to make sense of it knowing 26*61046927SAndroid Build Coastguard Workerthat. 27*61046927SAndroid Build Coastguard Worker 28*61046927SAndroid Build Coastguard WorkerIn SkQP itself, testcases can have increased failing pixel thresholds added to 29*61046927SAndroid Build Coastguard Workerthem to keep CI green when the rendering is "correct" but out of normal range. 30*61046927SAndroid Build Coastguard WorkerHowever, we don't support changing the thresholds in our testing. Because any 31*61046927SAndroid Build Coastguard Workerdriver rendering not meeting the normal thresholds will trigger Android CTS 32*61046927SAndroid Build Coastguard Workerfailures, we treat them as failures and track them as expected failures the 33*61046927SAndroid Build Coastguard Worker```*-fails.txt`` file.` 34