generic-library/vpx
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Bug fix in ssse3 quantize function

Browse Source 
A bug was reported in Issue 702: "SIGILL (Illegal instruction) when
transcoding with vp9 - using FFmpeg". It was reproduced and fixed.

Change-Id: Ie32c149a89af02856084aeaf289e848a905c7700
This commit is contained in:
Yunqing Wang 2014-02-07 14:27:07 -08:00
parent 4f8a30b116
commit 0d43bd77e5
1 changed files with 3 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
vp9/encoder/x86/vp9_quantize_ssse3.asm
View File

@ -188,7 +188,8 @@ cglobal quantize_%1, 0, %2, 15, coeff, ncoeff, skip, zbin, round, quant, \
pmaxsw m8, m7 pmaxsw m8, m7
pshuflw m7, m8, 0x1 pshuflw m7, m8, 0x1
pmaxsw m8, m7 pmaxsw m8, m7
pextrw [r2], m8, 0 pextrw r6, m8, 0
mov [r2], r6
RET RET
; skip-block, i.e. just write all zeroes ; skip-block, i.e. just write all zeroes
@ -214,5 +215,5 @@ cglobal quantize_%1, 0, %2, 15, coeff, ncoeff, skip, zbin, round, quant, \
%endmacro %endmacro
INIT_XMM ssse3 INIT_XMM ssse3
QUANTIZE_FN b, 6 QUANTIZE_FN b, 7
QUANTIZE_FN b_32x32, 7 QUANTIZE_FN b_32x32, 7