1# `android_bench_suite`
2
3This is a Android Toolchain benchmark suite.
4
5Where to find this suite:
6
7This suite locates at google3, please create a google3 branch first, then run:
8
9```
10$ cd experimental/users/zhizhouy/benchtoolchain
11```
12
13Copy this directory to the place you want to put it.
14
15To use this suite:
161.  Configure the basic envrionment in `env_setting` file.
17
182.  Run `./apply_patches.py`, which will:
19
20    1.  Patch all the android benchmarks in the android tree.
21        Benchmark Panorama does not exist in android tree, so perftests/
22        gets copied into the top-level of android tree.
23
24    2.  Apply patch autotest.diff to `android_root/external/autotest`, which
25        includes all the test scripts for benchmarks. Copy testcases to
26        related autotest directory.
27
28    If you have applied the patch partially and hope to discard the
29    patch, just run `discard_patches.py`
30
313.  Build and run benchmark on the device using ./run.py. You can either
32    use test configuration file (-t `test_config`), or set all the variables
33    manually.
34
354.  The raw results locate at `bench_result_*` in bench suite home
36    directory.
37
385.  The JSON format result will be generated for crosperf report.
39
40Utility tools:
41
421.  Autotest is a test framework located in android exteranl/autotest
43    Before first time running it, please run
44    `utils/build_externals.py` first to ensure all the environments
45    and tools needed are installed.
46
472.  Crosperf is a report generating tool in ChromeOS toolchain utilities.
48    Please look for it in chromium source:
49    `src/third_party/toolchain-utils/crosperf`.
50