Added perf expectations and corrected existing tests to remove spaces from series names.

The make_expectations.py script is copied from Chrome. It can look at a test's result history and automagically compute good regress/improve values.

This patch comes into play together with https://chromereviews.googleplex.com/6242014/.

NOTE TO SELF: save history on master when deploying!

Review URL: https://webrtc-codereview.appspot.com/1019005

git-svn-id: http://webrtc.googlecode.com/svn/trunk@3339 4adac7df-926f-26a2-2b94-8c16560cd09d
This commit is contained in:
phoglund@webrtc.org 2013-01-07 12:05:53 +00:00
parent c38eef896a
commit acc54b41da
4 changed files with 9 additions and 1 deletions

View File

@ -122,7 +122,7 @@ def main(argv):
value = ''.join(re.findall(options.regexp, output))
perf.perf_utils.PrintPerfResult(graph_name='audio_e2e_score',
series_name='e2e score',
series_name='e2e_score',
data_point=value,
units='MOS') # Assuming we run PESQ.

View File

@ -0,0 +1 @@
See https://sites.google.com/a/google.com/rtc-platform/engineering/managing-performance-expectations.

View File

@ -0,0 +1,3 @@
{"linux-large-tests/audio_e2e_test/audio_e2e_score/e2e_score": {"reva": 3268, "revb": 3329, "type": "absolute", "better": "higher", "improve": 4.6557, "regress": 3.83895, "sha1": "c10a1507"},
"load": true
}

View File

@ -0,0 +1,4 @@
{
"base_url": "http://www.corp.google.com/~webrtc-cb/perf/",
"perf_file": "perf_expectations.json"
}