generic-library/ffmpeg
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

avcodec/simple_idct10: improve precision

Browse Source 
omse goes from 0.03060703 (which fails for dct-test) to 0.01663750.
This also actually improve the error of decoding the sample generated
by fate-vsynth3-dnxhd1080i-10bit using simple_idct10 to FAANI, which
goes (when resampled to yuv422p) from:
stddev:    0.06 PSNR: 72.28 MAXDIFF:    1
to identical.

Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
This commit is contained in:
Christophe Gisquet
2015-10-12 19:37:45 +02:00
committed by Michael Niedermayer
parent e9a68b0316
commit 2fd14dd8eb
6 changed files with 41 additions and 19 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
tests/ref/fate/dnxhr-444
View File

@@ -1,2 +1,2 @@
#tb 0: 1/24
0, 0, 0, 1, 9665280, 0x238a023e
0, 0, 0, 1, 9665280, 0x19ef4057