Lines Matching full:suite
10 The desired test suite will be scheduled with autotest. By default,
15 dynamic suite infrastructure in server/cros/dynamic_suite.py.
18 0 - OK: Suite finished successfully
24 * Suite job issues, like bug in dynamic suite,
25 user aborted the suite, lose a drone/all devservers/rpc server,
30 4 - SUITE_TIMEOUT: Suite timed out, some tests ran,
31 none failed by the time the suite job was aborted. This will cover,
34 * No DUTs available midway through a suite
76 # E.g. if we have a test failure and the suite also timed out,
105 help="Address of a webserver to receive suite requests.")
136 "suite, and creates report.")
138 # --no_wait is passed in to the suite rpc itself and affects the suite,
142 help="Create the suite and print the job id, then "
157 action="store", help="Priority of suite")
163 'allowed at suite level. No limit if not specified.')
167 'healthy machines, otherwise suite will not run. '
173 'the suite when it is competing with another suite '
178 help="Argument string for suite control file.")
186 help='Advanced. Run the suite based on ATTRIBUTES of '
187 'control files, rather than SUITE.')
214 print ('When using -m, need to specify build, board and suite '
225 print 'Need to specify suite name'
243 print ('The new suite control file cannot parse the suite_args: %s.'
258 new style suite control file, suite_attr_wrapper. Then, change the
269 attr_filter_val = 'suite:%s' % options.name
271 attr_filter_val = ' or '.join(['suite:%s' % x for x in options.name])
302 """Get the original suite name when running suite_attr_wrapper.
304 @param suite_name: the name of the suite launched in afe. When it is
305 suite_attr_wrapper, the suite that actually running is
307 @param suite_args: the parsed option which contains the original suite name.
309 @returns: the original suite name.
315 if x and x.startswith('suite:')])
362 @param server The hostname of the server this suite ran on.
440 """Timings for important events during a suite.
444 @var suite_job_id: the afe job id of the suite job for which
454 @var suite_start_time: the time the suite started.
467 # suite instead of an individual test.
479 info about the various parts of a suite run. This method can take
536 'Suite timings:\n'
539 'Suite started at %s\n'
550 def SendResultsToStatsd(self, suite, build, board): argument
554 1. Makes a data_key of the form: run_suite.$board.$branch.$suite
555 eg: stats/gauges/<hostname>/run_suite/<board>/<branch>/<suite>/
559 @param suite: scheduled suite that we want to record the results of.
560 @param build: the build that this suite ran on.
562 @param board: the board that this suite ran on.
570 data_key = utils.get_data_key('run_suite', suite, build, board)
606 Return the hostname of the server that should be used to service a suite
609 @param pool_name: The pool (without 'pool:' to schedule the suite against.
610 @return: The correct host that should be used to service this suite run.
621 SUITE_PREP = 'Suite prep'
632 @param suite_name: The name of the suite
636 @param solo_test_run: This is a solo test run not part of a suite.
648 # usually indicates suite has timed out (unless aborted by user).
679 Remove 'build/suite' prefix if any. And append 'experimental' prefix
689 1) A test view is for the suite job's SERVER_JOB.
690 In this case, this method will return 'Suite prep'.
693 suite, and for a SERVER_JOB or CLIENT_JOB.
694 In this case, we will take the job name, remove the build/suite
702 3) A test view is of a suite job and its status is ABORT.
715 4) A test view's status is of a suite job and its status is TEST_NA.
732 # Rename suite job's SERVER_JOB to 'Suite prep'.
743 # Remove the build and suite name from testname if any.
756 """Checks whether this is a suite view we should care about.
801 that belongs to a suite job and are determined as irrelevant
803 to the suite job, whose job start/finished time make no sense
811 # Any relevant suite test view except SUITE_PREP
830 For suite prep and child job test views, we check job keyval
833 For relevant suite job test views, we only check test status
834 because the suite job keyval won't make sense to individual
891 will be stored in the suite job's keyvals. This method attempts to
896 @param suite_job_keyvals: The job keyval dictionary of the suite job.
898 suite job's keyvals.
922 For suite prep view, show buildbot link if it fails.
929 suite has timed out).
959 """Collect test results of a suite or a single test run.
961 Once a suite job has finished, use this class to collect test results.
969 1) Collect the suite job's results from tko_test_view_2.
970 For the suite job, we only pull test views without a 'subdir'.
981 4) Compute timings of the suite run.
985 to service the suite.
988 @var _build: The build for which the suite is run,
990 @var _board: The target board for which the suite is run,
992 @var _suite_name: The suite name, e.g. 'bvt', 'dummy'.
993 @var _suite_job_id: The job id of the suite for which we are going to
995 @var _original_suite_name: The suite name we record timing would be
999 test views of the suite job.
1011 @var is_aborted: Whether the suite was aborted or not.
1013 @var timings: A Timing object that records the suite's timings.
1046 """Fetch relevant test views of the suite job.
1048 For the suite job, there will be a test view for SERVER_JOB, and views
1050 a suite job (afe_job_id: 40) that runs dummy_Pass, dummy_Fail,
1053 So the suite job's test views would look like
1062 For a suite job, we only care about
1063 a) The test view for the suite job's SERVER_JOB
1070 test views of the suite job.
1141 # state, we read the test view from the suite job
1143 # suite job's page for the aborted job. Need a fix.
1146 # Bug info are stored in the suite job's keyvals.
1170 """Record suite timings."""
1187 return 'Suite job failed or provisioning failed.'
1190 ' suite must have timed out.')
1223 # This gurantees that the suite has timed out.
1228 # because the suite has timed out, but may
1230 # Since suite timing out is determined by checking
1231 # the suite prep view, we simply ignore this view here.
1240 # The test/suite job raised a wanrning.
1269 # Output suite timings
1320 # Write the suite timings into |output_dict|
1349 Fetch relevent test views of the suite job.
1351 Check whether the suite was aborted.
1353 Calculate suite timings.
1367 # This can happen when a suite job in Starting status is aborted. When
1369 # max_jobs_started_per_cycle, a suite job can stays in Starting status.
1389 # Record suite runtime in metadata db.
1404 """Create a suite with retries.
1406 @param afe: The afe object to insert the new suite job into.
1407 @param options: The options to use in creating the suite.
1409 @return: The afe_job_id of the new suite job.
1462 # If indicate to use the new style suite control file, convert the args
1520 logging.info('%s Created suite job: %s',
1524 logging.info(GetBuildbotStepLink('Suite created', job_url))
1546 logging.info('The suite job has another %s till timeout.',
1550 # a suite has timed out by checking information in the test view.
1554 # the suite finishes to make it as accurate as possible.
1564 # Extract the original suite name to record timing.
1583 # Do not record stats if the suite was aborted (either by a user
1591 # There are two possible cases when a suite times out.
1592 # 1. the suite job was aborted due to timing out
1593 # 2. the suite job succeeded, but some child jobs
1594 # were already aborted before the suite job exited.
1601 return_message = 'Suite job timed out.'
1603 'because suite job has timed out.',
1610 # aborting the suite or checking for results.
1616 logging.warning('Unable to diagnose suite abort.')
1626 logging.info('Created suite job: %r', job_id)