tina.legrand@webrtc.org
125a66adc2
Memory and Tsan tests: Turn off the new-ACM tests
...
In this CL https://webrtc-codereview.appspot.com/8829004/ , I splitted the tests so that new-ACM runs in separate tests. Almost all of these tests are too slow for the memory and tsan bots, and were already excluded from them. This CL turns off the new-ACM tests from these bots.
BUG=https://code.google.com/p/webrtc/issues/detail?id=2951
R=kjellander@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/8999004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@5594 4adac7df-926f-26a2-2b94-8c16560cd09d
2014-02-21 14:12:00 +00:00
stefan@webrtc.org
505f2a0348
Disabling WebRtcSessionTest.TestIceStatesBundle under memcheck.
...
BUG=2924
R=kjellander@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/8699005
git-svn-id: http://webrtc.googlecode.com/svn/trunk@5552 4adac7df-926f-26a2-2b94-8c16560cd09d
2014-02-14 12:38:06 +00:00
kjellander@webrtc.org
9cba2e4802
Exclude libjingle_p2p_unittest tests failing TSan Race verifier.
...
These tests have been failing for a long time at
http://build.chromium.org/p/client.webrtc.fyi/builders/Linux%20TsanRV
This bot runs a tool called TSan Race Verifier.
More info about Race Verifiers can be found at
https://code.google.com/p/data-race-test/wiki/RaceVerifier
By excluding the tests like this, they will also be disabled
for the normal TSan bot, where they currently pass. This shouldn't
be a problem since we have a TSan v2 bot running too (which uses
a different set of suppressions), so it should catch any newly
introduced race conditions. The TSan v2 bot will soon replace the
old TSan bot, as v1 is being deprecated.
TBR=mallinath@webrtc.org
BUG=2396
TEST=Passing run on Linux of:
GYP_DEFINES=build_with_tool=tsan gclient runhooks
ninja -C out/Release libjingle_p2p_unittest
tools/valgrind-webrtc/webrtc_tests.sh --tool=tsan_rv -b out/Release -t libjingle_p2p_unittest
Review URL: https://webrtc-codereview.appspot.com/8329005
git-svn-id: http://webrtc.googlecode.com/svn/trunk@5515 4adac7df-926f-26a2-2b94-8c16560cd09d
2014-02-10 12:43:40 +00:00
wu@webrtc.org
ca5ff9972e
Re-enable webrtcvoice/videoengine unittests.
...
TEST=try bots
BUG=
R=mallinath@webrtc.org
Committed: https://code.google.com/p/webrtc/source/detail?r=5387
Review URL: https://webrtc-codereview.appspot.com/7149004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@5427 4adac7df-926f-26a2-2b94-8c16560cd09d
2014-01-24 17:37:46 +00:00
pbos@webrtc.org
1d096901ac
Move realtime tests to webrtc_perf_tests.
...
New binary not to be run on our VMs as they result in flaky tests. These
will instead be run on baremetal machines.
BUG=2710
R=kjellander@webrtc.org , mflodman@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/5679004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@5283 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-12-13 12:48:05 +00:00
stefan@webrtc.org
7e9315b42e
Adds support for sending redundant payloads over RTX.
...
TEST=trybots
BUG=1812
R=mflodman@webrtc.org , pbos@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/4169004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@5209 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-12-04 10:24:26 +00:00
wu@webrtc.org
364f204d16
Update talk to 56698267.
...
TBR=sergeyu@chromium.org
Review URL: https://webrtc-codereview.appspot.com/4119004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@5143 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-11-20 21:49:41 +00:00
pbos@webrtc.org
9c5fb76662
Exclude AV-sync test from Valgrind platforms.
...
Test is performance-dependent and was observed to never sync on the
linux_memcheck bot.
BUG=
R=stefan@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/3999004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@5131 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-11-18 16:22:50 +00:00
stefan@webrtc.org
b082ade3db
Hook up audio/video sync to Call.
...
Adds an end-to-end audio/video sync test.
BUG=2530, 2608
TEST=trybots
R=henrika@webrtc.org , mflodman@webrtc.org , pbos@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/3699004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@5128 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-11-18 11:45:11 +00:00
mallinath@webrtc.org
50bc553852
Reenable DTLS renegotiation unittest in libjingle.
...
This test is failing on memcheck bots. After investigation problem per
say is not in this particular unittest and rather is in suite. So this test
is added to memcheck exclude list.
R=wu@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2689004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@5011 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-10-21 17:58:35 +00:00
kjellander@webrtc.org
83e9c89eeb
Exclude more tests for TSan on Windows.
...
Apparently more tests were also too slow for the bot
(but ran fine on my own machine). Adding a bunch now
so it should run fine from now on.
TEST=none
BUG=none
TBR=phoglund@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2412004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4978 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-10-16 17:32:05 +00:00
pbos@webrtc.org
9401524211
Run FullStack tests without render windows.
...
Also disables test on valgrind platforms, it has no chance to keep up.
BUG=2278
R=stefan@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2159008
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4972 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-10-16 11:05:37 +00:00
kjellander@webrtc.org
662b1c59c1
Add suppressions for DrMemory and TSan on Windows.
...
BUG=2515,2516
TEST=locally running the test as described in the bug.
The TSan excluded test was verified to be the only remaining
test that is too slow for TSan on Windows.
R=phoglund@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2405004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4970 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-10-16 10:46:37 +00:00
kjellander@webrtc.org
8b7ec82cf4
Exclude P2PTransportChannelSameNatTest.TestConesBehindSameCone for TSan Linux
...
I cannot reproduce locally but I can see 10+ consecutive
failing runs at the TSan RV bot at
http://build.chromium.org/p/client.webrtc.fyi/waterfall
TEST=verified the new exclude file is picked up by running:
tools/valgrind-webrtc/webrtc_tests.sh --tool=tsan_rv -b out/Release -t libjingle_p2p_unittest --gtest_filter=P2PTransportChannel*Test.*
(which runs the test if this file does not exist)
BUG=2396
TBR=mallinath@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2320004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4869 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-27 20:03:03 +00:00
kjellander@webrtc.org
6e86349273
Disable tests that crash the OS X kernel when run under memcheck.
...
These libjingle tests crashes the OS X kernel when run under
memcheck on Mac 10.6. I didn't file bugs for them since it's unlikely
we can fix this anyway. There are several other tests disabled
in the libjingle code with similar comments, without bugs
assigned to them.
See talk/base/physicalsocketserver_unittest.cc for examples.
Affected waterfall: http://build.chromium.org/p/client.webrtc.fyi/waterfall
TEST=none
BUG=none
R=phoglund@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2278006
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4825 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-24 12:34:51 +00:00
jiayl@webrtc.org
dd57cd6ed5
Removing the tsan text exclusion since the tests should be passing now.
...
BUG=2299, 2290, 2291
R=wu@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2260004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4799 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-20 00:51:53 +00:00
stefan@webrtc.org
5f1051631a
Fix disabling of tests.
...
BUG=2378
R=pbos@webrtc.org
TBR=wu@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2244005
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4778 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-18 15:28:10 +00:00
stefan@webrtc.org
da79008ab4
Disabling crashing or flaky tests in peerconnection_unittest.
...
R=kjellander@webrtc.org
TBR=wu@webrtc.org
TESTS=trybots
BUG=2378
Review URL: https://webrtc-codereview.appspot.com/2227004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4767 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-17 13:11:38 +00:00
kjellander@webrtc.org
f6ae62ffa3
Add Win TSan exclude and Dr Memory suppressions
...
To green up the FYI builders.
BUG=2323,2382
TEST=passing local run.
TBR=phoglund
Review URL: https://webrtc-codereview.appspot.com/2218005
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4755 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-16 21:16:48 +00:00
stefan@webrtc.org
ab800f64bc
Disable flaky libjingle tests under tsan and memcheck.
...
BUG=2380, 2379
TBR=wu@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2218004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4752 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-16 15:22:32 +00:00
pbos@webrtc.org
0181b5f8dd
ExternalVideoDecoder for new VideoEngine API.
...
Implements the ExternalVideoDecoder interface for VideoReceiveStream.
Also adds a FakeDecoder used in tests, removing the overhead of running
the EngineTest tests with VP8 under Memcheck/TSan, allowing us to enable
them under Memcheck/TSan as well.
BUG=2346,2312
R=stefan@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2172004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4702 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-09 08:26:30 +00:00
mflodman@webrtc.org
e2d4da6586
Enable EngineTest.ReceivesPliAndRecoversWithNack and fix memcheck suppression filter.
...
BUG=2346
R=pbos@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2169004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4677 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-04 14:21:57 +00:00
mikhal@webrtc.org
3abb82d8df
Suppress video engine test
...
BUG=2346
R=wu@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2161005
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4670 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-03 22:19:31 +00:00
kjellander@webrtc.org
5aedb295d5
Add TSan and Dr Memory suppressions for Windows
...
This works enables us to add add more memory tools bots to the
WebRTC FYI waterfall at
http://build.chromium.org/p/client.webrtc.fyi/waterfall
These suppressions will be needed to get the bots green initially.
This CL also updates the PRESUBMIT.py scripts for the previous
memcheck and TSan suppression directories with the trybots we
currently have. It also adds a PRESUBMIT.py script for the
Dr Memory suppressions.
BUG=1938,2319,2321,2322,2323,2324,2328,2329,2330,2333
TEST=Local execution of the tests passes when these suppressions
are used.
R=niklas.enbom@webrtc.org , phoglund@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2149004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4653 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-09-02 11:50:46 +00:00
pbos@webrtc.org
2b325e8394
TSan suppression for RampUpTest/* and EngineTest/*Nack*.
...
BUG=2312
R=kjellander@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2132004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4633 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-28 10:29:10 +00:00
tina.legrand@webrtc.org
89502c1ca8
Memory and tsan tests: Turning off renamned tests
...
In r4625 AudioCodingModuleTest.RunAllTests was broken down to a number of
smaller tests. This CL turns off these tests, as RunAllTests was turned off
before.
TBR=kjellander@webrtc.org
BUG=issue2173
Review URL: https://webrtc-codereview.appspot.com/2121004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4626 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-27 09:38:10 +00:00
henrike@webrtc.org
442709ea96
Disable broken test and add suppressions.
...
BUG=2299,1205
TBR=wu@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2101004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4606 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-23 21:42:01 +00:00
henrike@webrtc.org
61b262c427
Disable tests according to issues: 1205,2272,2288,2290,2291
...
BUG=1205,2272,2288,2290,2291
R=wu@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2069005
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4596 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-22 20:27:49 +00:00
phoglund@webrtc.org
32fe90b3f9
Made all integration tests use consistent naming.
...
After decision by pbos@, mflodman@ et. al.
BUG=
R=kjellander@webrtc.org , mflodman@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/2041004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4565 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-19 11:40:19 +00:00
wu@webrtc.org
94349552de
Disable P2PTransportChannelTest.* on memcheck and tsan bots due to issue 1972.
...
TBR=mallinath
BUG=1972
RISK=P3
TEST=with below cmd lines and disabled tests won't run
tools/valgrind-webrtc/webrtc_tests.sh --build_dir out/Debug --test libjingle_p2p_unittest --gtest_filter=P2PTransportChannelTest* --tool tsan
tools/valgrind-webrtc/webrtc_tests.sh --build_dir out/Debug --test libjingle_p2p_unittest --gtest_filter=P2PTransportChannelTest* --tool memcheck
Review URL: https://webrtc-codereview.appspot.com/1954004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4479 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-02 23:30:50 +00:00
wu@webrtc.org
6abb750993
Delete gtest_exclude for asan which doesn't have effect with how the bots are setup now
...
Add gtest_exclude for tsan to disable some flakey tests.
Change tsan suppression since the function name has been changed from DecodeWithErrors to DecodeErrorMode.
TBR=mallinath
Review URL: https://webrtc-codereview.appspot.com/1930004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4465 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-08-01 18:00:02 +00:00
wu@webrtc.org
d40b4d9685
Fix libjingle memory bots by suppressing some of the errors.
...
BUG=1205,2153
R=mallinath@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/1923004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4453 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-07-31 17:32:36 +00:00
wu@webrtc.org
9c9fc767b1
Fixing the memory check bots by suppressing some of the tests.
...
BUG=1205,2078,2080
R=mallinath@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/1913004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4438 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-07-30 22:54:08 +00:00
wu@webrtc.org
0342e65f8d
Disable peerconnection tests that are failing on memcheck.
...
R=mallinath@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/1910006
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4436 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-07-30 22:28:14 +00:00
wu@webrtc.org
ae7bf1525b
Disable p2p tests that are failing on memory test.
...
BUG=1972
R=mallinath@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/1911004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4435 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-07-30 21:40:39 +00:00
henrike@webrtc.org
5e44b8fac1
Add libjingle's valgrind suppressions
...
BUG=2104
R=kjellander@webrtc.org , wu@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/1834004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4375 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-07-19 16:00:41 +00:00
kjellander@webrtc.org
63e988856e
Merge more tests into modules_{unit,integration}tests.
...
A new test target named 'modules_integrationtests' is created
and the following test targets were merged into it:
* audio_coding_module_test
* test_fec
* video_coding_integrationtests
* vp8_integrationtests
A couple of other targets were merged into modules_unittests:
* audio_coding_unittests
* audioproc_unittest
* common_unittests
* video_coding_unittests
* video_processing_unittests
* vp8_unittests
I wasn't able to merge audio_decoder_unittests and neteq_unittests due to
conflicts with different defines in these tests.
Some tests that have special requirements aren't merged into
modules_integrationtests yet. I took the opportunity to rename them
since the bot configs will need to be update anyway:
* audio_device_test_api -> audio_device_integrationtests
* video_capture_module_test -> video_capture_integrationtests
* video_render_module_test -> video_render_integrationtests
Exclude files were added for modules_integrationtests to make sure
the memcheck and tsan bots doesn't tests that are too slow
(audio_coding_module_test and vp8_integrationtests were previously
disabled on those bots).
Suppressions for AudioCodingModuleTest needed to be added to get
modules_integrationtests to pass memcheck (even if the test is
excluded from execution).
BUG=1843
TEST=local execution on Linux and trybots (passing except the merged tests of course)
R=andrew@webrtc.org , tina.legrand@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/1656004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4228 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-06-14 20:09:44 +00:00
kjellander@webrtc.org
6d6d95e2b8
Add support for test disable files in webrtc_tests.py
...
Adding support for text files in
tools/valgrind-webrtc/gtest_exclude that are used by the
wrapper script for memory tool execution (webrtc_tests.py).
This allows fine-grained disabling of tests using checked in
text files instead of maintaining such in the buildbot config.
For more details on naming of these text files and what to put
in them, see:
http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium/memory-sheriff#TOC-Excluding-tests
TEST=local execution of tsan and memcheck on Linux, using an
exclude file (done during development of http://review.webrtc.org/1647005 )
BUG=none
R=andrew@webrtc.org
Review URL: https://webrtc-codereview.appspot.com/1648004
git-svn-id: http://webrtc.googlecode.com/svn/trunk@4212 4adac7df-926f-26a2-2b94-8c16560cd09d
2013-06-11 06:03:32 +00:00