Added perf summary pages to the dashboard server.

The purpose is to make the WebRTC performance metrics easier to overview.

BUG=
R=kjellander@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2081004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4583 4adac7df-926f-26a2-2b94-8c16560cd09d
This commit is contained in:
phoglund@webrtc.org 2013-08-21 16:31:12 +00:00
parent 1a65d6c36b
commit 17018ed39c
8 changed files with 124 additions and 2 deletions

View File

@ -8,6 +8,11 @@ handlers:
# Serve stylesheets statically.
- url: /stylesheets
static_dir: stylesheets
# Serve perf dashboard files statically.
- url: /perf
static_dir: static
# This magic file is here to prove to the Google Account Domain Management
# that we own this domain. It needs to stay there so the domain management
# doesn't get suspicious.

View File

@ -32,8 +32,8 @@ class OAuthPostRequestHandler(webapp2.RequestHandler):
The handler will accept an OAuth request if it is correctly formed and
the consumer is acting on behalf of an administrator for the dashboard.
"""
def __init__(self):
pass
def __init__(self, request=None, response=None):
webapp2.RequestHandler.__init__(self, request, response)
def post(self):
try:

View File

@ -0,0 +1,15 @@
<html>
<head>
<title>WebRTC Performance Metrics - Audio Quality</title>
<link rel="stylesheet" href="../stylesheets/perf.css" type="text/css">
</head>
<body>
<p>Audio Quality WebAudio -> PeerConnection call (PESQ) Linux/Win</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-linux&tests=webrtc_manual_browser_tests_test/audio_pesq/mos_lqo,webrtc_manual_browser_tests_test/audio_pesq/raw_mos"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-7&tests=webrtc_manual_browser_tests_test/audio_pesq/mos_lqo,webrtc_manual_browser_tests_test/audio_pesq/raw_mos"></iframe>
<p>Audio Quality Voice Engine E2E test (PESQ) Linux</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-linux-large-tests&tests=audio_e2e_test/audio_e2e_score/e2e_score"></iframe>
<p>Audio Processing time per 10 ms frame (ms) Linux</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-linux-large-tests&tests=audioproc_perf/audioproc/time_per_10ms_frame"></iframe>
</body>
</html>

View File

@ -0,0 +1,24 @@
<html>
<head>
<title>WebRTC Performance Metrics - Audio Quality Chrome</title>
<link rel="stylesheet" href="../stylesheets/perf.css" type="text/css">
</head>
<body>
<p>Chrome Audio: WebRTC Loopback With Signal Processing (ms) Linux/Win/Mac</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-linux&tests=webrtc_perf_content_unittests_test/webrtc_loopback_with_signal_processing (100 packets)/t"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-7&tests=webrtc_perf_content_unittests_test/webrtc_loopback_with_signal_processing (100 packets)/t"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-mac&tests=webrtc_perf_content_unittests_test/webrtc_loopback_with_signal_processing (100 packets)/t"></iframe>
<p>Chrome Audio: WebRTC Loopback Without Signal Processing (ms) Linux/Win/Mac</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-linux&tests=webrtc_perf_content_unittests_test/webrtc_loopback_without_sigal_processing (100 packets)/t"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-7&tests=webrtc_perf_content_unittests_test/webrtc_loopback_without_sigal_processing (100 packets)/t"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-mac&tests=webrtc_perf_content_unittests_test/webrtc_loopback_without_sigal_processing (100 packets)/t"></iframe>
<p>Chrome Audio: WebRTC playout setup time (ms) Linux/Win/Mac</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-linux&tests=webrtc_perf_content_unittests_test/webrtc_playout_setup_c/t"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-7&tests=webrtc_perf_content_unittests_test/webrtc_playout_setup_c/t"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-mac&tests=webrtc_perf_content_unittests_test/webrtc_playout_setup_c/t"></iframe>
<p>Chrome Audio: WebRTC recording setup time (ms) Linux/Win/Mac</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-linux&tests=webrtc_perf_content_unittests_test/webrtc_recording_setup_c/t"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-7&tests=webrtc_perf_content_unittests_test/webrtc_recording_setup_c/t"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-mac&tests=webrtc_perf_content_unittests_test/webrtc_recording_setup_c/t"></iframe>
</body>
</html>

View File

@ -0,0 +1,13 @@
<html>
<head>
<title>WebRTC Performance Metrics</title>
<link rel="stylesheet" href="../stylesheets/perf.css" type="text/css">
</head>
<body>
<h1>WebRTC Performance Metrics</h1>
<p><a href="video_perf.html">Video</a></p>
<p><a href="audio_perf.html">Audio</a></p>
<p><a href="audio_perf_chrome.html">Chrome Audio Path</a></p>
<p><a href="vie_auto_test_perf.html">vie_auto_test</a></p>
</body>
</html>

View File

@ -0,0 +1,20 @@
<html>
<head>
<title>WebRTC Performance Metrics - Video Quality</title>
<link rel="stylesheet" href="../stylesheets/perf.css" type="text/css">
</head>
<body>
<p>Video Quality (PSNR) Linux/Win/Mac</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-linux&tests=webrtc_manual_browser_tests_test/PSNR/VGA"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-7&tests=webrtc_manual_browser_tests_test/PSNR/VGA"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-mac&tests=webrtc_manual_browser_tests_test/PSNR/VGA"></iframe>
<p>Video Quality (SSIM) Linux/Win/Mac</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-linux&tests=webrtc_manual_browser_tests_test/SSIM/VGA"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-7&tests=webrtc_manual_browser_tests_test/SSIM/VGA"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-mac&tests=webrtc_manual_browser_tests_test/SSIM/VGA"></iframe>
<p>Video Quality (Unique frame count) Linux/Win/Mac</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-linux&tests=webrtc_manual_browser_tests_test/Unique_frames_count/VGA"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-7&tests=webrtc_manual_browser_tests_test/Unique_frames_count/VGA"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=ChromiumWebRTC&bots=chromium-webrtc-rel-mac&tests=webrtc_manual_browser_tests_test/Unique_frames_count/VGA"></iframe>
</body>
</html>

View File

@ -0,0 +1,24 @@
<html>
<head>
<title>WebRTC Performance Metrics - Video Engine</title>
<link rel="stylesheet" href="../stylesheets/perf.css" type="text/css">
</head>
<body>
<p>Video quality at different delays and packet loss rates (PSNR) Linux/Win/Mac</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-linux-large-tests&tests=vie_auto_test/psnr/net_delay_0_0_plr_0,vie_auto_test/psnr/net_delay_100_10_plr_0,vie_auto_test/psnr/net_delay_100_10_plr_5_gilbert_elliot,vie_auto_test/psnr/net_delay_50_5_plr_5"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-win-large-tests&tests=vie_auto_test/psnr/net_delay_0_0_plr_0,vie_auto_test/psnr/net_delay_100_10_plr_0,vie_auto_test/psnr/net_delay_100_10_plr_5_gilbert_elliot,vie_auto_test/psnr/net_delay_50_5_plr_5"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-mac-large-tests&tests=vie_auto_test/psnr/net_delay_0_0_plr_0,vie_auto_test/psnr/net_delay_100_10_plr_0,vie_auto_test/psnr/net_delay_100_10_plr_5_gilbert_elliot,vie_auto_test/psnr/net_delay_50_5_plr_5"></iframe>
<p>Video quality at different delays and packet loss rates (SSIM) Linux/Win/Mac</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-linux-large-tests&tests=vie_auto_test/ssim/net_delay_0_0_plr_0,vie_auto_test/ssim/net_delay_100_10_plr_0,vie_auto_test/ssim/net_delay_100_10_plr_5_gilbert_elliot,vie_auto_test/ssim/net_delay_50_5_plr_5"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-win-large-tests&tests=vie_auto_test/ssim/net_delay_0_0_plr_0,vie_auto_test/ssim/net_delay_100_10_plr_0,vie_auto_test/ssim/net_delay_100_10_plr_5_gilbert_elliot,vie_auto_test/ssim/net_delay_50_5_plr_5"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-mac-large-tests&tests=vie_auto_test/ssim/net_delay_0_0_plr_0,vie_auto_test/ssim/net_delay_100_10_plr_0,vie_auto_test/ssim/net_delay_100_10_plr_5_gilbert_elliot,vie_auto_test/ssim/net_delay_50_5_plr_5"></iframe>
<p>Time between rendered frames (ms) Linux/Win/Mac</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-linux-large-tests&tests=vie_auto_test/time_between_rendered_frames/net_delay_0_0_plr_0,vie_auto_test/time_between_rendered_frames/net_delay_100_10_plr_0,vie_auto_test/time_between_rendered_frames/net_delay_100_10_plr_5_gilbert_elliot,vie_auto_test/time_between_rendered_frames/net_delay_50_5_plr_5"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-win-large-tests&tests=vie_auto_test/time_between_rendered_frames/net_delay_0_0_plr_0,vie_auto_test/time_between_rendered_frames/net_delay_100_10_plr_0,vie_auto_test/time_between_rendered_frames/net_delay_100_10_plr_5_gilbert_elliot,vie_auto_test/time_between_rendered_frames/net_delay_50_5_plr_5"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-mac-large-tests&tests=vie_auto_test/time_between_rendered_frames/net_delay_0_0_plr_0,vie_auto_test/time_between_rendered_frames/net_delay_100_10_plr_0,vie_auto_test/time_between_rendered_frames/net_delay_100_10_plr_5_gilbert_elliot,vie_auto_test/time_between_rendered_frames/net_delay_50_5_plr_5"></iframe>
<p>Time between rendered frames (ms) Linux/Win/Mac</p>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-linux-large-tests&tests=vie_auto_test/total_delay_incl_network/net_delay_0_0_plr_0,vie_auto_test/total_delay_incl_network/net_delay_100_10_plr_0,vie_auto_test/total_delay_incl_network/net_delay_100_10_plr_5_gilbert_elliot,vie_auto_test/total_delay_incl_network/net_delay_50_5_plr_5"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-win-large-tests&tests=vie_auto_test/total_delay_incl_network/net_delay_0_0_plr_0,vie_auto_test/total_delay_incl_network/net_delay_100_10_plr_0,vie_auto_test/total_delay_incl_network/net_delay_100_10_plr_5_gilbert_elliot,vie_auto_test/total_delay_incl_network/net_delay_50_5_plr_5"></iframe>
<iframe src="https://chromeperf.appspot.com/embed?masters=WebRTC&bots=webrtc-mac-large-tests&tests=vie_auto_test/total_delay_incl_network/net_delay_0_0_plr_0,vie_auto_test/total_delay_incl_network/net_delay_100_10_plr_0,vie_auto_test/total_delay_incl_network/net_delay_100_10_plr_5_gilbert_elliot,vie_auto_test/total_delay_incl_network/net_delay_50_5_plr_5"></iframe>
</body>
</html>

View File

@ -0,0 +1,21 @@
/********************************************************************
*
* Copyright (c) 2012 The WebRTC project authors. All Rights Reserved.
*
* Use of this source code is governed by a BSD-style license
* that can be found in the LICENSE file in the root of the source
* tree. An additional intellectual property rights grant can be found
* in the file PATENTS. All contributing project authors may
* be found in the AUTHORS file in the root of the source tree.
*
*********************************************************************/
iframe {
width: 33%; /* We'll generally present 3 platforms. */
border: 0;
}
p {
font-family: verdana;
font-size: xx-large;
}