Commit Graph

34 Commits

Author SHA1 Message Date
phoglund@webrtc.org
6adfad1768 Optimized coverage computations and fixed coverage on the integration bot.
The coverage report will no longer get written to NFS but rather to the bot's own web server. This speeds up the  computation from 25 minutes to 8 seconds.

BUG=
TEST=

Review URL: https://webrtc-codereview.appspot.com/392007

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1676 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-13 12:16:50 +00:00
kjellander@webrtc.org
486a3baabd Enabling video_codecs_test_framework_integrationtests.
Since Issue 262 is now fixed.

BUG=
TEST=None.

Review URL: https://webrtc-codereview.appspot.com/388004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1662 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-10 11:00:28 +00:00
kjellander@webrtc.org
a1e9e3f0d8 Enabling rtp_rtcp_unittests since issue 268 is now fixed and commited.
BUG=
TEST=None.

Review URL: https://webrtc-codereview.appspot.com/388006

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1660 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-10 10:59:18 +00:00
kjellander@webrtc.org
bf0333801c Enable lcov on LinuxVideo and disable on others except Linux32DBG.
BUG=
TEST=Tested on local master.

Review URL: https://webrtc-codereview.appspot.com/394003

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1655 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-09 14:56:24 +00:00
phoglund@webrtc.org
cde1c0b519 Fixed bad gtest filter.
BUG=
TEST=

Review URL: https://webrtc-codereview.appspot.com/389004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1650 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-09 11:13:12 +00:00
phoglund@webrtc.org
0da6c85cfa Introduced the new Mac Release bot.
NOTE: Possibly rename slave folder on master to mac-slave-3 from mac-slave-1 to keep history. Not sure if it is a good idea.

BUG=
TEST=

Review URL: https://webrtc-codereview.appspot.com/395001

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1642 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-08 14:36:22 +00:00
kjellander@webrtc.org
eaaccb7626 Enabling fixed tests and correcting error.
- video_coding_unittests on Windows
- signal_processing_unittests on Window
- audioproc_unittest for Valgrind Linux
- corrected error in LinuxVideo configuration

BUG=
TEST=Tested on local master.

Review URL: https://webrtc-codereview.appspot.com/392003

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1640 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-08 13:18:00 +00:00
kjellander@webrtc.org
646fa2c5f2 Added Valgrind buildbot slave.
Renamed and reordered some of the bots in the configuration.

BUG=
TEST=Tested on personal build master.

Review URL: http://webrtc-codereview.appspot.com/389001

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1625 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-07 15:51:18 +00:00
phoglund@webrtc.org
2726cd22c9 Reconfigured which tests run on the integration test build bot.
The VoE Volume Test is flaky and is probably very hard to fix. The video auto tests are ready to be enabled, except the full stack test.

BUG=
TEST=

Review URL: https://webrtc-codereview.appspot.com/391001

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1622 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-07 12:13:58 +00:00
kjellander@webrtc.org
4ef5d493c7 Enabling and disabling tests
* audio_coding_module_test: enabling on Windows.
* audio_conference_mixer_unittests: enabling on Windows.
* audio_device_test_api: disabling on Mac, since this test is failing but not reporting failure. See issue 257 for more details.
* media_file_unittests: enabling on Windows.
* rtp_rtcp_unittests: enabling on Windows.
* test_bwe: enabling on Windows.
* test_fec: enabling on all platforms. See CL 369008 and 379010.
* test_support_unittests: enabling on all platforms.
* udp_transport_unittests: enabling on Windows.
* video_codecs_test_framework_unittests: adding disabled test on all platforms.
* video_codecs_test_framework_integrationtests: enabling on all platforms.
* video_processing_unittests: enabling on Windows, since issue 247 is fixed.

BUG=
TEST=Tried out on the master during after-office hours.

Review URL: http://webrtc-codereview.appspot.com/379011

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1621 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-07 08:33:47 +00:00
phoglund@webrtc.org
86ce46d4ff Cleaned up and completed current dashboard milestone.
Left to do:
- Directory reorganization.

BUG=
TEST=

Review URL: https://webrtc-codereview.appspot.com/384003

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1605 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-06 10:55:12 +00:00
kjellander@webrtc.org
5eeaa38573 Improved readability of tests in master.cfg and enabling some tests
Focused responsibility of supported tests in master.cfg instead of being in utils.py (hard to overview and maintain).

Enabled the following empty tests on all platforms:
- audio_conference_mixer_unittests
- cng_unittests
- g711_unittests
- g722_unittests
- pcm16b_unittests
- media_file_unittests
- udp_transport_unittests
- webrtc_utility_unittests

Removed "headless tests" concept since everything is now compiled in the make all step (no need for compile only, no execution tests).
Removed audio_device_test_func test since not a proper test (dev tool) that was configured as headless.

BUG=
TEST=Ran local master and successfully built and executed all tests with Mac build slave.

Review URL: http://webrtc-codereview.appspot.com/384002

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1603 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-04 09:41:26 +00:00
phoglund@webrtc.org
2b87891901 Implemented build status tracking.
Left to do:
- UI for presenting the data
- Directory structure reorganization

BUG=
TEST=

Review URL: https://webrtc-codereview.appspot.com/382003

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1588 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-01 17:08:03 +00:00
phoglund@webrtc.org
d4f0a0e2bc Refactored the dashboard in order to add new functionality and added some new functionality.
Note that all files were moved to a new directory. The diffs won't be 100% friendly because of this.

Extracted common handling for OAuth on both sides of the connection in order to add a new build status
data handler. This data handler will be used to report build status data. Don't look too closely at the
details of what data is transferred as this will change in the next patch. We will also extract data from
a different page in a slightly different way, but there won't be huge differences.

In particular, we won't look at the /one_box_per_builder page on the master but rather at the transposed
grid (/tgrid) on the build master since we also need the revision number. The regular expressions to
extract the data will be slightly more complex.

BUG=
TEST=

Review URL: https://webrtc-codereview.appspot.com/367023

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1586 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-02-01 10:59:23 +00:00
phoglund@webrtc.org
31ba407ac2 Enabled GCC 4.6 bot.
BUG=
TEST=

Review URL: https://webrtc-codereview.appspot.com/369019

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1565 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-01-27 15:40:21 +00:00
andrew@webrtc.org
96bc9c420f Enable audioproc_unittest on Windows.
BUG=none
TEST=none

Review URL: https://webrtc-codereview.appspot.com/373009

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1550 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-01-25 17:59:03 +00:00
ivinnichenko@webrtc.org
76fa8c956d disable failing win tests.
BUG=
TEST=

Review URL: http://webrtc-codereview.appspot.com/367011

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1540 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-01-24 21:06:38 +00:00
ivinnichenko@webrtc.org
d22430662d enable video_processing_unittests for Win
BUG=
TEST=

Review URL: http://webrtc-codereview.appspot.com/368006

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1539 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-01-24 19:28:21 +00:00
andrew@webrtc.org
24f1c90577 Enable audioproc_unittest on more platforms.
Also, re-enable the floating point profile on Linux, and disable test_fec until we can reduce the running time.

BUG=none
TEST=none

Review URL: https://webrtc-codereview.appspot.com/372003

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1536 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-01-24 17:40:21 +00:00
phoglund@webrtc.org
96c39d1f73 Completed implementation of oauth in coverage scripts.
The access token is now transferred between the request and track scripts.

Almost completed the implementation, using oauth2.

Initial, incomplete implementation of the permission-request script.

The coverage tracking is broken temporarily, but it can now make OAuth requests.

BUG=
TEST=

Review URL: https://webrtc-codereview.appspot.com/366002

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1530 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-01-24 14:44:51 +00:00
ivinnichenko@webrtc.org
52c9d47b09 Android, Chrome, cleanup, etc.
BUG=
TEST=

Review URL: http://webrtc-codereview.appspot.com/369006

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1526 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-01-24 13:38:42 +00:00
andrew@webrtc.org
e2ed5baf47 Enable audioproc_unittest on all platforms.
But, for the time being, limit the bit-exact test to 64-bit Linux debug.

TEST=build and run all configs on Linux, and standard configs on Win and Mac.

Review URL: https://webrtc-codereview.appspot.com/343005

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1500 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-01-20 19:06:38 +00:00
phoglund@webrtc.org
bd88f39767 Initial version of code coverage tracker / dashboard for WebRTC.
BUG=
TEST=

Review URL: https://webrtc-codereview.appspot.com/350001

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1440 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-01-17 12:21:15 +00:00
kjellander@webrtc.org
401045a0d4 Resources are now always downloaded if version differs.
Changed so that a new resources bundle will always downloaded if the currently downloaded version differs from the one in DEPS.

BUG=
TEST=gclient sync with different revisions in the /resources/webrtc-resouces-revision file.

Review URL: http://webrtc-codereview.appspot.com/330033

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1343 4adac7df-926f-26a2-2b94-8c16560cd09d
2012-01-05 08:05:07 +00:00
ivinnichenko@webrtc.org
b43d4b3a60 Continuous Build code for WebRTC.
BUG=
TEST=

Review URL: http://webrtc-codereview.appspot.com/322008

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1265 4adac7df-926f-26a2-2b94-8c16560cd09d
2011-12-21 12:29:42 +00:00
kjellander@webrtc.org
b5b155b8a9 This CL introduces a new directory for WebRTC utility scripts for Valgrind: tools/valgrind-webrtc
To be able to re-use as much as possible from Chromium's scripts, I've created two customized scripts for running tests:
- webrtc_tests.py: a customized version of chrome_tests.py with WebRTC tests instead.
- webrtc_tests.sh: a customized version of the chrome_tests.sh wrapper script, to launch the above script.

The webrtc_tests.sh script is setting up PYTHONPATH so that tools/valgrind is available for the webrtc_tests.py script.
The webrtc_tests.py script inherits the chrome_tests.py script as much as possible, to minimize maintenance and maximize readability.
Having this mirrored setup of directories, allows us to use the same directory hierarchy for suppression files too. This CL only adds suppression files for memcheck, but we can add files for tsan later easily.

The suppression file is currently empty for Linux. For Mac I copied all the Chromium third-party suppressions. We will need a lot more added for Mac before Valgrind runs becomes usable for that platform.
The platform specific naming of the suppression files are handled automatically when webrtc_tests.sh  is used to launch the tests.

Example:
Plain memcheck (default tool): tools/valgrind-webrtc/webrtc_tests.sh -t system_wrappers
Run ThreadSanitizer: tools/valgrind-webrtc/webrtc_tests.sh  --tool=tsan -t system_wrappers

Previously mentioned AddressSanitizer requires additional scripts to be added and it not covered in this CL.

BUG=
TEST=

Review URL: http://webrtc-codereview.appspot.com/322010

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1240 4adac7df-926f-26a2-2b94-8c16560cd09d
2011-12-20 08:53:41 +00:00
andrew@webrtc.org
c853aa1735 Swap colheaders for textdata in parseLog.m.
- colheaders doesn't appear in the struct returned from importdata for me.
- Add a new error check for empty/malformed files.

Review URL: http://webrtc-codereview.appspot.com/318001

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1137 4adac7df-926f-26a2-2b94-8c16560cd09d
2011-12-08 20:56:53 +00:00
kjellander@webrtc.org
418bce5ccc Added displaying of configurations at the top of the page.
A table on the top of the page displays the test configurations of the input files present.
The displayed string in the legend of each graph is now fetched from test configuration name instead of using the filename.

Review URL: http://webrtc-codereview.appspot.com/279006

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1104 4adac7df-926f-26a2-2b94-8c16560cd09d
2011-12-05 16:29:21 +00:00
kjellander@webrtc.org
3379b0cf85 Fixing resources script on Windows
Invalid concatenation of the URL to the download file made it fail downloading on Windows.

Review URL: http://webrtc-codereview.appspot.com/290003

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1005 4adac7df-926f-26a2-2b94-8c16560cd09d
2011-11-23 15:24:44 +00:00
kjellander@webrtc.org
0c80c7fec8 Script for automatic download of resources.
Tested successfully on Linux, Mac and Windows (Python 2.6)

The script works executing from different working directories too (like project root vs. location of script).

Review URL: http://webrtc-codereview.appspot.com/280002

git-svn-id: http://webrtc.googlecode.com/svn/trunk@1003 4adac7df-926f-26a2-2b94-8c16560cd09d
2011-11-23 14:11:16 +00:00
andrew@webrtc.org
3d1ef0c943 Add an OWNERS file for python_charts.
Review URL: http://webrtc-codereview.appspot.com/276009

git-svn-id: http://webrtc.googlecode.com/svn/trunk@953 4adac7df-926f-26a2-2b94-8c16560cd09d
2011-11-16 07:09:14 +00:00
kjellander@webrtc.org
689cb300b5 First version of PythonCharts.
The reason why it is so simple is that I wanted to get something into the project that people can use to compare different test runs easily. More functionality will come later.

tools/python_charts/src/gviz_api.py is a copy of the Google visualization Python API available from http://google-visualization-python.googlecode.com/svn/trunk/

Review URL: http://webrtc-codereview.appspot.com/257003

git-svn-id: http://webrtc.googlecode.com/svn/trunk@893 4adac7df-926f-26a2-2b94-8c16560cd09d
2011-11-07 15:25:47 +00:00
stefan@webrtc.org
eb74a371c9 Matlab scripts useful for parsing the output from DataLog
parseLog.m parses DataLog files.
maxUnwrap.m unwraps number sequences, useful for unwrapping e.g. 
RTP timestamp sequences and RTP sequence numbers.
Review URL: http://webrtc-codereview.appspot.com/135006

git-svn-id: http://webrtc.googlecode.com/svn/trunk@521 4adac7df-926f-26a2-2b94-8c16560cd09d
2011-09-02 13:24:38 +00:00
niklase@google.com
47bdc463db git-svn-id: http://webrtc.googlecode.com/svn/trunk@8 4adac7df-926f-26a2-2b94-8c16560cd09d 2011-05-30 11:42:35 +00:00