xref: /aosp_15_r20/tools/asuite/atest/docs/atest_structure.md (revision c2e18aaa1096c836b086f94603d04f4eb9cf37f5)

# Atest Developer Guide

You're here because you'd like to contribute to atest. To start off, we'll
explain how atest is structured and where the major pieces live and what they
do. If you're more interested in how to use atest, go to the [README](../README.md).

##### Table of Contents
1. [Overall Structure](#overall-structure)
2. [Major Files and Dirs](#major-files-and-dirs)
3. [Test Finders](#test-finders)
4. [Test Runners](#test-runners)
5. [Constants Override](#constants-override)

## <a name="overall-structure">Overall Structure</a>

Atest is primarily composed of 2 components: [test finders](#test-finders) and
[test runners](#test-runners). At a high level, atest does the following:
1. Parse args and verify environment
2. Find test(s) based on user input
3. Build test dependencies
4. Run test(s)

Let's walk through an example run and highlight what happens under the covers.

> ```# atest hello_world_test```

Atest will first check the environment is setup and then load up the
module-info.json file (and build it if it's not detected or we want to rebuild
it). That is a critical piece that atest depends on. Module-info.json contains a
list of all modules in the android repo and some relevant info (e.g.
compatibility_suite, auto_gen_config, etc) that is used during the test finding
process. We create the results dir for our test runners to dump results in and
proceed to the first juicy part of atest, finding tests.

The tests specified by the user are passed into the ```CLITranslator``` to
transform the user input into a ```TestInfo``` object that contains all of the
required and optional bits used to run the test as how the user intended.
Required info would be the test name, test dependencies, and the test runner
used to run the test. Optional bits would be additional args for the test and
method/class filters.

Once ```TestInfo``` objects have been constructed for all the tests passed in
by the user, all of the test dependencies are built. This step can by bypassed
if the user specifies only _-t_ or _-i_.

The final step is to run the tests which is where the test runners do their job.
All of the ```TestInfo``` objects get passed into the ```test_runner_handler```
which invokes each ```TestInfo``` specified test runner. In this specific case,
the ```AtestTradefedTestRunner``` is used to kick off ```hello_world_test```.

Read on to learn more about the classes mentioned.

## <a name="major-files-and-dirs">Major Files and Dirs</a>

Here is a list of major files and dirs that are important to point out:
* ```atest.py``` - Main entry point.
* ```cli_translator.py``` - Home of ```CLITranslator``` class. Translates the
  user input into something the test runners can understand.
* ```test_finder_handler.py``` - Module that collects all test finders,
  determines which test finder methods to use and returns them for
  ```CLITranslator``` to utilize.
* ```test_finders/``` - Location of test finder classes. More details on test
  finders [below](#test-finders).
* ```test_finders/test_info.py``` - Module that defines ```TestInfo``` class.
* ```test_runner_handler.py``` - Module that collects all test runners and
  contains logic to determine what test runner to use for a particular
  ```TestInfo```.
* ```test_runners/``` - Location of test runner classes. More details on test
  runners [below](#test-runners).
* ```constants_default.py``` - Location of constant defaults. Need to override
  some of these constants for your private repo? [Instructions below](#constants-override).

## <a name="test-finders">Test Finders</a>

Test finders are classes that host find methods. The find methods are called by
atest to find tests in the android repo based on the user's input (path,
filename, class, etc).  Find methods will also find the corresponding test
dependencies for the supplied test, translating it into a form that a test
runner can understand, and specifying the test runner.

For more details and instructions on how to create new test finders,
[go here](./develop_test_finders.md)

## <a name="test-runners">Test Runners</a>

Test Runners are classes that execute the tests. They consume a ```TestInfo```
and execute the test as specified.

For more details and instructions on how to create new test runners, [go here](./develop_test_runners.md)

## <a name="constants-override">Constants Override</a>

You'd like to override some constants but not sure how?  Override them with your
own constants_override.py that lives in your own private repo.

1. Create new ```constants_override.py``` (or whatever you'd like to name it) in
  your own repo. It can live anywhere but just for example purposes, let's
  specify the path to be ```<private repo>/path/to/constants_override/constants_override.py```.
2. Add a ```vendorsetup.sh``` script in ```//vendor/<somewhere>``` to export the
  path of ```constants_override.py``` base path into ```PYTHONPATH```.
```bash
# This file is executed by build/envsetup.sh
_path_to_constants_override="$(gettop)/path/to/constants_override"
if [[ ! $PYTHONPATH == *${_path_to_constants_override}* ]]; then
  export PYTHONPATH=${_path_to_constants_override}:$PYTHONPATH
fi
```
3. Try-except import ```constants_override``` in ```constants.py```.
```python
try:
    from constants_override import *
except ImportError:
    pass
```
4. You're done! To pick up the override, rerun build/envsetup.sh to kick off the
  vendorsetup.sh script.