Added perf expectations and corrected existing tests to remove spaces from series names.
The make_expectations.py script is copied from Chrome. It can look at a test's result history and automagically compute good regress/improve values. This patch comes into play together with https://chromereviews.googleplex.com/6242014/. NOTE TO SELF: save history on master when deploying! Review URL: https://webrtc-codereview.appspot.com/1019005 git-svn-id: http://webrtc.googlecode.com/svn/trunk@3339 4adac7df-926f-26a2-2b94-8c16560cd09d
This commit is contained in:
parent
c38eef896a
commit
acc54b41da
@ -122,7 +122,7 @@ def main(argv):
|
||||
value = ''.join(re.findall(options.regexp, output))
|
||||
|
||||
perf.perf_utils.PrintPerfResult(graph_name='audio_e2e_score',
|
||||
series_name='e2e score',
|
||||
series_name='e2e_score',
|
||||
data_point=value,
|
||||
units='MOS') # Assuming we run PESQ.
|
||||
|
||||
|
1
tools/perf_expectations/README
Normal file
1
tools/perf_expectations/README
Normal file
@ -0,0 +1 @@
|
||||
See https://sites.google.com/a/google.com/rtc-platform/engineering/managing-performance-expectations.
|
3
tools/perf_expectations/perf_expectations.json
Normal file
3
tools/perf_expectations/perf_expectations.json
Normal file
@ -0,0 +1,3 @@
|
||||
{"linux-large-tests/audio_e2e_test/audio_e2e_score/e2e_score": {"reva": 3268, "revb": 3329, "type": "absolute", "better": "higher", "improve": 4.6557, "regress": 3.83895, "sha1": "c10a1507"},
|
||||
"load": true
|
||||
}
|
4
tools/perf_expectations/webrtc_perf_expectations.cfg
Normal file
4
tools/perf_expectations/webrtc_perf_expectations.cfg
Normal file
@ -0,0 +1,4 @@
|
||||
{
|
||||
"base_url": "http://www.corp.google.com/~webrtc-cb/perf/",
|
||||
"perf_file": "perf_expectations.json"
|
||||
}
|
Loading…
x
Reference in New Issue
Block a user