vpx/vp8/encoder
John Koleszar 0a49747b01 quantizer: fix assertion in fast quantizer path
The fast quantizer assembly code has not been updated to match the new
exact quantizer, which was made the default in commit 6adbe09.
Specifically, they are not aware of the potential for the coefficient
to be scaled, which results in the quantized result exceeding the range
of the DCT. This patch restores the previous behavior of using the
non-shifted coefficients when in the fast quantizer code path, but
unfortunately requires rebuilding the tables when switching between the
two.

Change-Id: I0a33f5b3850335011a06906f49fafed54dda9546
2010-11-11 13:05:20 -05:00
..
arm Fix half-pixel variance RTCD functions 2010-10-27 13:00:30 -04:00
generic Full search SAD function optimization in SSE4.1 2010-10-27 13:36:31 -04:00
ppc Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
x86 Revert "Remove stack shadowing for x86-64" 2010-11-11 08:20:02 -08:00
bitstream.c Fix loopfilter delta zero transitions 2010-09-29 13:04:04 -04:00
bitstream.h Add runtime CPU detection support for ARM. 2010-10-25 09:23:29 -04:00
block.h Convert [4][4] matrices to [16] arrays. 2010-10-21 17:04:30 -07:00
boolhuff.c Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
boolhuff.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
dct.c Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
dct.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
encodeframe.c quantizer: fix assertion in fast quantizer path 2010-11-11 13:05:20 -05:00
encodeintra.c make vp8_recon16x16mb{,y} RTCD functions 2010-10-26 13:23:36 -04:00
encodeintra.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
encodemb.c make vp8_recon16x16mb{,y} RTCD functions 2010-10-26 13:23:36 -04:00
encodemb.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
encodemv.c Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
encodemv.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
ethreading.c Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
firstpass.c Relax rate control for last few frames 2010-11-10 10:09:45 +00:00
firstpass.h Move firstpass motion map to stats packet 2010-10-21 14:04:20 -04:00
mcomp.c Full search SAD function optimization in SSE4.1 2010-10-27 13:36:31 -04:00
mcomp.h Full search SAD function optimization in SSE4.1 2010-10-27 13:36:31 -04:00
modecosts.c Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
modecosts.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
onyx_if.c quantizer: fix assertion in fast quantizer path 2010-11-11 13:05:20 -05:00
onyx_int.h Relax rate control for last few frames 2010-11-10 10:09:45 +00:00
parms.cpp Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
pickinter.c Add half-pixel variance RTCD functions 2010-10-26 20:00:56 -07:00
pickinter.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
picklpf.c Add runtime CPU detection support for ARM. 2010-10-25 09:23:29 -04:00
preproc.c Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
psnr.c Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
psnr.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
quantize.c quantizer: fix assertion in fast quantizer path 2010-11-11 13:05:20 -05:00
quantize.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
ratectrl.c safety check to avoid divide by 0s 2010-10-14 16:19:06 -04:00
ratectrl.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
rdopt.c Tuning for the more exact quantizer. 2010-11-10 09:52:58 +00:00
rdopt.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
sad_c.c Full search SAD function optimization in SSE4.1 2010-10-27 13:36:31 -04:00
segmentation.c Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
segmentation.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
ssim.c Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
temporal_filter.c Add half-pixel variance RTCD functions 2010-10-26 20:00:56 -07:00
temporal_filter.h isolate new temporal filtering code 2010-10-25 09:11:03 -04:00
tokenize.c Centralize mb skip state calculation 2010-10-12 09:03:19 -04:00
tokenize.h Reduce size of tokenizer tables 2010-09-16 10:00:04 -04:00
treewriter.c Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
treewriter.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
variance_c.c Fix half-pixel variance RTCD functions 2010-10-27 13:00:30 -04:00
variance.h Full search SAD function optimization in SSE4.1 2010-10-27 13:36:31 -04:00