Commit Graph

88 Commits

Author SHA1 Message Date
tina.legrand@webrtc.org
125a66adc2 Memory and Tsan tests: Turn off the new-ACM tests
In this CL https://webrtc-codereview.appspot.com/8829004/, I splitted the tests so that new-ACM runs in separate tests. Almost all of these tests are too slow for the memory and tsan bots, and were already excluded from them. This CL turns off the new-ACM tests from these bots.

BUG=https://code.google.com/p/webrtc/issues/detail?id=2951
R=kjellander@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/8999004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@5594 4adac7df-926f-26a2-2b94-8c16560cd09d
2014-02-21 14:12:00 +00:00
stefan@webrtc.org
505f2a0348 Disabling WebRtcSessionTest.TestIceStatesBundle under memcheck.
BUG=2924
R=kjellander@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/8699005

git-svn-id: http://webrtc.googlecode.com/svn/trunk@5552 4adac7df-926f-26a2-2b94-8c16560cd09d
2014-02-14 12:38:06 +00:00
kjellander@webrtc.org
9cba2e4802 Exclude libjingle_p2p_unittest tests failing TSan Race verifier.
These tests have been failing for a long time at
http://build.chromium.org/p/client.webrtc.fyi/builders/Linux%20TsanRV
This bot runs a tool called TSan Race Verifier.
More info about Race Verifiers can be found at
https://code.google.com/p/data-race-test/wiki/RaceVerifier

By excluding the tests like this, they will also be disabled
for the normal TSan bot, where they currently pass. This shouldn't
be a problem since we have a TSan v2 bot running too (which uses
a different set of suppressions), so it should catch any newly
introduced race conditions. The TSan v2 bot will soon replace the
old TSan bot, as v1 is being deprecated.

TBR=mallinath@webrtc.org
BUG=2396
TEST=Passing run on Linux of:
GYP_DEFINES=build_with_tool=tsan gclient runhooks
ninja -C out/Release libjingle_p2p_unittest
tools/valgrind-webrtc/webrtc_tests.sh --tool=tsan_rv -b out/Release -t libjingle_p2p_unittest

Review URL: https://webrtc-codereview.appspot.com/8329005

git-svn-id: http://webrtc.googlecode.com/svn/trunk@5515 4adac7df-926f-26a2-2b94-8c16560cd09d
2014-02-10 12:43:40 +00:00
wu@webrtc.org
ca5ff9972e Re-enable webrtcvoice/videoengine unittests.
TEST=try bots
BUG=
R=mallinath@webrtc.org

Committed: https://code.google.com/p/webrtc/source/detail?r=5387

Review URL: https://webrtc-codereview.appspot.com/7149004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@5427 4adac7df-926f-26a2-2b94-8c16560cd09d
2014-01-24 17:37:46 +00:00
pbos@webrtc.org
1d096901ac Move realtime tests to webrtc_perf_tests.
New binary not to be run on our VMs as they result in flaky tests. These
will instead be run on baremetal machines.

BUG=2710
R=kjellander@webrtc.org, mflodman@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/5679004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@5283 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-12-13 12:48:05 +00:00
stefan@webrtc.org
7e9315b42e Adds support for sending redundant payloads over RTX.
TEST=trybots
BUG=1812
R=mflodman@webrtc.org, pbos@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/4169004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@5209 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-12-04 10:24:26 +00:00
wu@webrtc.org
364f204d16 Update talk to 56698267.
TBR=sergeyu@chromium.org

Review URL: https://webrtc-codereview.appspot.com/4119004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@5143 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-11-20 21:49:41 +00:00
pbos@webrtc.org
9c5fb76662 Exclude AV-sync test from Valgrind platforms.
Test is performance-dependent and was observed to never sync on the
linux_memcheck bot.

BUG=
R=stefan@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/3999004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@5131 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-11-18 16:22:50 +00:00
stefan@webrtc.org
b082ade3db Hook up audio/video sync to Call.
Adds an end-to-end audio/video sync test.

BUG=2530, 2608
TEST=trybots
R=henrika@webrtc.org, mflodman@webrtc.org, pbos@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/3699004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@5128 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-11-18 11:45:11 +00:00
mallinath@webrtc.org
50bc553852 Reenable DTLS renegotiation unittest in libjingle.
This test is failing on memcheck bots. After investigation problem per
say is not in this particular unittest and rather is in suite. So this test
is added to memcheck exclude list.

R=wu@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2689004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@5011 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-10-21 17:58:35 +00:00
kjellander@webrtc.org
83e9c89eeb Exclude more tests for TSan on Windows.
Apparently more tests were also too slow for the bot
(but ran fine on my own machine). Adding a bunch now
so it should run fine from now on.

TEST=none
BUG=none
TBR=phoglund@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2412004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4978 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-10-16 17:32:05 +00:00
pbos@webrtc.org
9401524211 Run FullStack tests without render windows.
Also disables test on valgrind platforms, it has no chance to keep up.

BUG=2278
R=stefan@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2159008

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4972 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-10-16 11:05:37 +00:00
kjellander@webrtc.org
662b1c59c1 Add suppressions for DrMemory and TSan on Windows.
BUG=2515,2516
TEST=locally running the test as described in the bug.
The TSan excluded test was verified to be the only remaining
test that is too slow for TSan on Windows.

R=phoglund@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2405004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4970 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-10-16 10:46:37 +00:00
kjellander@webrtc.org
8b7ec82cf4 Exclude P2PTransportChannelSameNatTest.TestConesBehindSameCone for TSan Linux
I cannot reproduce locally but I can see 10+ consecutive
failing runs at the TSan RV bot at
http://build.chromium.org/p/client.webrtc.fyi/waterfall

TEST=verified the new exclude file is picked up by running:
tools/valgrind-webrtc/webrtc_tests.sh --tool=tsan_rv -b out/Release -t libjingle_p2p_unittest --gtest_filter=P2PTransportChannel*Test.*
(which runs the test if this file does not exist)
BUG=2396
TBR=mallinath@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2320004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4869 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-27 20:03:03 +00:00
kjellander@webrtc.org
6e86349273 Disable tests that crash the OS X kernel when run under memcheck.
These libjingle tests crashes the OS X kernel when run under
memcheck on Mac 10.6. I didn't file bugs for them since it's unlikely
we can fix this anyway. There are several other tests disabled
in the libjingle code with similar comments, without bugs
assigned to them.
See talk/base/physicalsocketserver_unittest.cc for examples.

Affected waterfall: http://build.chromium.org/p/client.webrtc.fyi/waterfall

TEST=none
BUG=none
R=phoglund@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2278006

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4825 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-24 12:34:51 +00:00
jiayl@webrtc.org
dd57cd6ed5 Removing the tsan text exclusion since the tests should be passing now.
BUG=2299, 2290, 2291
R=wu@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2260004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4799 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-20 00:51:53 +00:00
stefan@webrtc.org
5f1051631a Fix disabling of tests.
BUG=2378
R=pbos@webrtc.org
TBR=wu@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2244005

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4778 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-18 15:28:10 +00:00
stefan@webrtc.org
da79008ab4 Disabling crashing or flaky tests in peerconnection_unittest.
R=kjellander@webrtc.org
TBR=wu@webrtc.org
TESTS=trybots
BUG=2378

Review URL: https://webrtc-codereview.appspot.com/2227004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4767 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-17 13:11:38 +00:00
kjellander@webrtc.org
f6ae62ffa3 Add Win TSan exclude and Dr Memory suppressions
To green up the FYI builders.

BUG=2323,2382
TEST=passing local run.
TBR=phoglund

Review URL: https://webrtc-codereview.appspot.com/2218005

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4755 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-16 21:16:48 +00:00
stefan@webrtc.org
ab800f64bc Disable flaky libjingle tests under tsan and memcheck.
BUG=2380, 2379
TBR=wu@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2218004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4752 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-16 15:22:32 +00:00
pbos@webrtc.org
0181b5f8dd ExternalVideoDecoder for new VideoEngine API.
Implements the ExternalVideoDecoder interface for VideoReceiveStream.
Also adds a FakeDecoder used in tests, removing the overhead of running
the EngineTest tests with VP8 under Memcheck/TSan, allowing us to enable
them under Memcheck/TSan as well.

BUG=2346,2312
R=stefan@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2172004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4702 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-09 08:26:30 +00:00
mflodman@webrtc.org
e2d4da6586 Enable EngineTest.ReceivesPliAndRecoversWithNack and fix memcheck suppression filter.
BUG=2346
R=pbos@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2169004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4677 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-04 14:21:57 +00:00
mikhal@webrtc.org
3abb82d8df Suppress video engine test
BUG=2346
R=wu@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2161005

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4670 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-03 22:19:31 +00:00
kjellander@webrtc.org
5aedb295d5 Add TSan and Dr Memory suppressions for Windows
This works enables us to add add more memory tools bots to the
WebRTC FYI waterfall at
http://build.chromium.org/p/client.webrtc.fyi/waterfall
These suppressions will be needed to get the bots green initially.

This CL also updates the PRESUBMIT.py scripts for the previous
memcheck and TSan suppression directories with the trybots we
currently have. It also adds a PRESUBMIT.py script for the
Dr Memory suppressions.

BUG=1938,2319,2321,2322,2323,2324,2328,2329,2330,2333
TEST=Local execution of the tests passes when these suppressions
are used.

R=niklas.enbom@webrtc.org, phoglund@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2149004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4653 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-02 11:50:46 +00:00
pbos@webrtc.org
2b325e8394 TSan suppression for RampUpTest/* and EngineTest/*Nack*.
BUG=2312
R=kjellander@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2132004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4633 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-28 10:29:10 +00:00
tina.legrand@webrtc.org
89502c1ca8 Memory and tsan tests: Turning off renamned tests
In r4625 AudioCodingModuleTest.RunAllTests was broken down to a number of
smaller tests. This CL turns off these tests, as RunAllTests was turned off
before.

TBR=kjellander@webrtc.org

BUG=issue2173

Review URL: https://webrtc-codereview.appspot.com/2121004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4626 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-27 09:38:10 +00:00
henrike@webrtc.org
442709ea96 Disable broken test and add suppressions.
BUG=2299,1205

TBR=wu@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2101004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4606 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-23 21:42:01 +00:00
henrike@webrtc.org
61b262c427 Disable tests according to issues: 1205,2272,2288,2290,2291
BUG=1205,2272,2288,2290,2291
R=wu@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2069005

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4596 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-22 20:27:49 +00:00
phoglund@webrtc.org
32fe90b3f9 Made all integration tests use consistent naming.
After decision by pbos@, mflodman@ et. al.

BUG=
R=kjellander@webrtc.org, mflodman@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/2041004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4565 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-19 11:40:19 +00:00
wu@webrtc.org
94349552de Disable P2PTransportChannelTest.* on memcheck and tsan bots due to issue 1972.
TBR=mallinath
BUG=1972
RISK=P3
TEST=with below cmd lines and disabled tests won't run
tools/valgrind-webrtc/webrtc_tests.sh --build_dir out/Debug --test libjingle_p2p_unittest --gtest_filter=P2PTransportChannelTest* --tool tsan
tools/valgrind-webrtc/webrtc_tests.sh --build_dir out/Debug --test libjingle_p2p_unittest --gtest_filter=P2PTransportChannelTest* --tool memcheck

Review URL: https://webrtc-codereview.appspot.com/1954004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4479 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-02 23:30:50 +00:00
wu@webrtc.org
6abb750993 Delete gtest_exclude for asan which doesn't have effect with how the bots are setup now
Add gtest_exclude for tsan to disable some flakey tests.
Change tsan suppression since the function name has been changed from DecodeWithErrors to DecodeErrorMode.

TBR=mallinath

Review URL: https://webrtc-codereview.appspot.com/1930004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4465 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-01 18:00:02 +00:00
wu@webrtc.org
d40b4d9685 Fix libjingle memory bots by suppressing some of the errors.
BUG=1205,2153
R=mallinath@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/1923004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4453 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-07-31 17:32:36 +00:00
wu@webrtc.org
9c9fc767b1 Fixing the memory check bots by suppressing some of the tests.
BUG=1205,2078,2080
R=mallinath@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/1913004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4438 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-07-30 22:54:08 +00:00
wu@webrtc.org
0342e65f8d Disable peerconnection tests that are failing on memcheck.
R=mallinath@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/1910006

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4436 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-07-30 22:28:14 +00:00
wu@webrtc.org
ae7bf1525b Disable p2p tests that are failing on memory test.
BUG=1972
R=mallinath@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/1911004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4435 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-07-30 21:40:39 +00:00
henrike@webrtc.org
5e44b8fac1 Add libjingle's valgrind suppressions
BUG=2104
R=kjellander@webrtc.org, wu@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/1834004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4375 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-07-19 16:00:41 +00:00
kjellander@webrtc.org
63e988856e Merge more tests into modules_{unit,integration}tests.
A new test target named 'modules_integrationtests' is created
and the following test targets were merged into it:
* audio_coding_module_test
* test_fec
* video_coding_integrationtests
* vp8_integrationtests

A couple of other targets were merged into modules_unittests:
* audio_coding_unittests
* audioproc_unittest
* common_unittests
* video_coding_unittests
* video_processing_unittests
* vp8_unittests

I wasn't able to merge audio_decoder_unittests and neteq_unittests due to
conflicts with different defines in these tests.

Some tests that have special requirements aren't merged into
modules_integrationtests yet. I took the opportunity to rename them
since the bot configs will need to be update anyway:
* audio_device_test_api -> audio_device_integrationtests
* video_capture_module_test -> video_capture_integrationtests
* video_render_module_test -> video_render_integrationtests

Exclude files were added for modules_integrationtests to make sure
the memcheck and tsan bots doesn't tests that are too slow
(audio_coding_module_test and vp8_integrationtests were previously
disabled on those bots).

Suppressions for AudioCodingModuleTest needed to be added to get
modules_integrationtests to pass memcheck (even if the test is
excluded from execution).

BUG=1843
TEST=local execution on Linux and trybots (passing except the merged tests of course)
R=andrew@webrtc.org, tina.legrand@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/1656004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4228 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-06-14 20:09:44 +00:00
kjellander@webrtc.org
6d6d95e2b8 Add support for test disable files in webrtc_tests.py
Adding support for text files in
tools/valgrind-webrtc/gtest_exclude that are used by the
wrapper script for memory tool execution (webrtc_tests.py).

This allows fine-grained disabling of tests using checked in
text files instead of maintaining such in the buildbot config.

For more details on naming of these text files and what to put
in them, see:
http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium/memory-sheriff#TOC-Excluding-tests

TEST=local execution of tsan and memcheck on Linux, using an
exclude file (done during development of http://review.webrtc.org/1647005)
BUG=none
R=andrew@webrtc.org

Review URL: https://webrtc-codereview.appspot.com/1648004

git-svn-id: http://webrtc.googlecode.com/svn/trunk@4212 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-06-11 06:03:32 +00:00