generic-library/vpx
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

change to avoid IOC

Browse Source 
SSE for a 64x64 block with 3 planes can go as high as 3*2^28. So left
shift by 4 may overflow 32 bit int.

Change-Id: I63c84aa56894788bb987299badabbd7cc6fd0be6
This commit is contained in:
Yaowu Xu 2014-01-24 12:06:39 -08:00
parent e5034f65e5
commit 8971338c6b
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vp9/encoder/vp9_rdopt.c
View File

@ -428,7 +428,7 @@ static void model_rd_for_sb(VP9_COMP *cpi, BLOCK_SIZE bsize,
}
*out_rate_sum = rate_sum;
*out_dist_sum = dist_sum << 4;
*out_dist_sum = (int64_t)dist_sum << 4;
}
static void model_rd_for_sb_y_tx(VP9_COMP *cpi, BLOCK_SIZE bsize,