18311 Commits

Author SHA1 Message Date
Jingning Han
4be3214fec Merge "Properly schedule the transform block recursion order" into nextgenv2 2016-11-04 17:53:53 +00:00
Jingning Han
641b1ad5ad Clean up write_tx_type()
Remove repeated mbmi->tx_size calls.

Change-Id: I3e4e03b69b2efffd860cc1ea34e150f4257bf081
2016-11-04 10:36:20 -07:00
Jingning Han
ab7163db08 Refactor tx_type reader
Factor out common codes. Remove repeated mbmi->tx_size calls.

Change-Id: Id5de35e88f1a5f16223eaa06fc2c9f69124061ef
2016-11-04 10:35:34 -07:00
Jingning Han
2a4da9476b Factor out common tx_type writing codes from inter/intra frame
Change-Id: Id2626bd19db2504756d9a1dee709c2d08c79f771
2016-11-04 10:33:12 -07:00
Yue Chen
95a3898cbd Merge "Remove duplicated variables in EXT_INTER" into nextgenv2 2016-11-04 17:11:08 +00:00
Jingning Han
98d6a1f247 Properly schedule the transform block recursion order
This commit replaces the offset based block index calculation with
incremental based one. It does not change the coding statistics.

Change-Id: I3789294eb45416bd0823e773ec30f05ed41ba0dc
2016-11-04 09:06:49 -07:00
Jingning Han
137b2671eb Fix format issue in handle_inter_mode()
Change-Id: I681fd799cf46991de419cc867ccb649a6990c19d
2016-11-04 08:31:24 -07:00
Debargha Mukherjee
68d695b7ca Merge "Further work on 64x64 fwd/inv transform support" into nextgenv2 2016-11-04 09:32:07 +00:00
Angie Chiang
e89ea0ceb7 Merge "Refactor: Replace rate dist sse skip by RD_STATS in VAR_TX" into nextgenv2 2016-11-04 05:42:59 +00:00
Debargha Mukherjee
21378b8ad0 Merge "Fix bilateral filter asan error for highbitdepth" into nextgenv2 2016-11-04 05:25:49 +00:00
James Zern
5d54c175c2 warped_motion.c: delete unused filter_4tap[]
Change-Id: I139808f492a9e9dcac44a36237b61231ede7edc3
2016-11-03 20:12:20 -07:00
James Zern
4846e446c6 warped_motion.c: quiet float-conversion warnings
Change-Id: I3d97d8db51a5a5d6b2c1cae47492b53ab37100a7
2016-11-03 20:11:06 -07:00
James Zern
005ff81598 Merge "warped_motion: Fix ubsan warning for signed integer overflow" into nextgenv2 2016-11-04 00:58:07 +00:00
James Zern
9371394492 Merge "Fix ubsan divide by zero warning in ransac" into nextgenv2 2016-11-04 00:56:23 +00:00
Sarah Parker
db92635745 warped_motion: Fix ubsan warning for signed integer overflow
Change-Id: Ie698aa02ef56128759c71079e9bfa1af25149644
2016-11-04 00:54:25 +00:00
Angie Chiang
b5dda4887b Refactor: Replace rate dist sse skip by RD_STATS in VAR_TX
This is to facilitate implementation of rd_debug tool; it doesn't change
coding behavior.

Change-Id: I0eb82b31473883ba6652ed11dca09b9ec4530183
2016-11-03 17:51:26 -07:00
Debargha Mukherjee
c57924cb9e Fix bilateral filter asan error for highbitdepth
BUG=webm:1334

Change-Id: I5886eec0a22a8cc056e1bdb493d2faf183816656
2016-11-03 16:23:09 -07:00
James Zern
97a2c675e7 Merge "rdopt,global-motion: Fix -1 indexing ubsan warning" into nextgenv2 2016-11-03 22:59:34 +00:00
Sarah Parker
182953b299 rdopt,global-motion: Fix -1 indexing ubsan warning
Change-Id: I1b3caf3543ab385f39f5f253c9949ad89ea5af7d
2016-11-03 22:58:47 +00:00
Alex Converse
5cb72a2dba Merge "Use TX_SIZES in intra_high_pred_fn declarations" into nextgenv2 2016-11-03 22:13:34 +00:00
Yue Chen
9d3e478e72 Remove duplicated variables in EXT_INTER
Introduced by merge commit 141f7a9

Change-Id: Idd68e09a6cd925d97466eabebe0e4905b5031340
2016-11-03 15:12:42 -07:00
Sarah Parker
b60c138cdf Merge "Make inline function static to fix clang compile error" into nextgenv2 2016-11-03 22:09:46 +00:00
Alex Converse
9613758e71 Merge "Don't use a TX_SIZE as a TX_TYPE" into nextgenv2 2016-11-03 21:44:21 +00:00
Debargha Mukherjee
6a47cff882 Further work on 64x64 fwd/inv transform support
For higher level fwd and inv transform functions.

Change-Id: I91518250a0be7d94aada7519f6c9e7ed024574fb
2016-11-03 14:32:54 -07:00
Sarah Parker
fa75ae0663 Fix ubsan divide by zero warning in ransac
Change-Id: I8c736ff665a27ce8307fd62571b9728333756d7e
2016-11-03 13:03:45 -07:00
Debargha Mukherjee
d65708a375 Merge "Replace hard coded numbers with TX_SIZES macro" into nextgenv2 2016-11-03 19:59:10 +00:00
Jingning Han
a504e77a98 Merge "Fix txb_w/h use case in av1_tx_block_rd_b()" into nextgenv2 2016-11-03 19:31:48 +00:00
Yaowu Xu
565f788de9 Merge "fix build issue with --enable-delta-q" into nextgenv2 2016-11-03 18:45:57 +00:00
Sarah Parker
fb3971e55a Make inline function static to fix clang compile error
Change-Id: I0432b8274a2764ba978dd6c4ed532fb7e4b7b519
2016-11-03 10:50:50 -07:00
Alex Converse
86b56742fb Use TX_SIZES in intra_high_pred_fn declarations
Change-Id: I078bb5244dbff153bcfab226206540ca6cebdad0
2016-11-03 10:28:11 -07:00
Alex Converse
f0ede18718 Don't use a TX_SIZE as a TX_TYPE
Change-Id: I26b02e6578ad2d82aadfe1df2aeb84e6c11a747b
2016-11-03 10:28:05 -07:00
Angie Chiang
2b10128a55 Add rd_debug flag
rd_debug is a debug tool aim at finding discrepancy between rate-distortion
loop and bitstream packing.

Change-Id: I751c4121516c5e6368668229c77778880a9dcb9d
2016-11-03 10:25:50 -07:00
Jingning Han
4b47c937d0 Fix txb_w/h use case in av1_tx_block_rd_b()
Match them with block_row/col index.

Change-Id: Idf0f924a093e5312b0a36b765d295e52d033eb5a
2016-11-03 09:20:08 -07:00
Yaowu Xu
5bb8f5b705 fix build issue with --enable-delta-q
BUG=webm:1330

Change-Id: I120ce8ea3581018b232b19ca7ffbb07d3e99d8d0
2016-11-03 09:03:39 -07:00
Debargha Mukherjee
e04fdb2308 Replace hard coded numbers with TX_SIZES macro
Replaces a couple of hard coded numbers with TX_SIZES macro
in common/reconiontra.c

Change-Id: I8a2a53ca16bc3ab51409cec340bea55292ff2dee
2016-11-03 08:51:42 -07:00
Jingning Han
1b5bbf8e97 Merge "Refactor recursive transform block partition search" into nextgenv2 2016-11-03 15:41:57 +00:00
Jingning Han
07cfa29031 Merge "Make bit-stream support rectangular tx_size" into nextgenv2 2016-11-03 15:41:46 +00:00
Yaowu Xu
c1ca945ce5 Merge changes from topic 'update_dering' into nextgenv2
* changes:
  Reformatting the deringing code
  Introducing OD_DERING_SIZE_LOG2 constant (3)
  Renaming deringing blockwise write-back functions to make code clearer
  Deringing refactoring: replace last_sbc with simpler dering_left flag
  Getting rid of the od_dering_in type
2016-11-03 14:03:25 +00:00
Yaowu Xu
7036aee1a4 Merge "Refactoring deringed block list code" into nextgenv2 2016-11-03 13:48:58 +00:00
Yaowu Xu
71c72561fa Merge "Deringing line buffer no longer depends on holding OD_DERING_VERY_LARGE" into nextgenv2 2016-11-03 05:02:32 +00:00
Jingning Han
e60d3294ea Merge "Make recursive txfm encoding process support rectangular tx_size" into nextgenv2 2016-11-03 04:36:55 +00:00
Jingning Han
141f7a9757 Merge "Fix a merge bug between dual_filter and sub8x8mc" into nextgenv2 2016-11-03 01:06:39 +00:00
Jingning Han
1e477f9833 Merge "Remove redundant experimental flags from common_data.h" into nextgenv2 2016-11-03 01:04:45 +00:00
Jingning Han
18482fe32d Refactor recursive transform block partition search
This commit refactors the recursive transform block partition
search process to make it support rectangular transform block size
coding.

Change-Id: I0207ae40d83c7eae3cb5d460e403f470747590d3
2016-11-02 17:03:09 -07:00
Jingning Han
f64062f36f Make bit-stream support rectangular tx_size
Allow the transform size writing, reading, and the reconstruction
process to support rectangular transform block size coding.

Change-Id: I57393c73ec60835a088d785ca838d7e3d7eb29a4
2016-11-02 16:24:20 -07:00
Jean-Marc Valin
39d92a071d Reformatting the deringing code
Manally removed the "clang-format off" lines. The rest is done by clang

Change-Id: I88a2028b55a541729b4e8896cdf66b544e9898bb
2016-11-02 15:51:00 -07:00
Jean-Marc Valin
e04650347c Refactoring deringed block list code
Using a struct named dlist rather than an array named bskip. Simplified some
code.

No change in output

Change-Id: Id40d40b19b5d8f2ebafe347590fa1bb8cb80e6e1
2016-11-02 15:51:00 -07:00
Jean-Marc Valin
01b7780154 Deringing line buffer no longer depends on holding OD_DERING_VERY_LARGE
The OD_DERING_VERY_LARGE values are now explicitly copied to the buffer instead
of being read from the line buffer when we're on the edge of the frame. This
will make it possible to make the line buffer 8-bit for non-high-bitdepth.

No change in output

Change-Id: I1a4134d67ac7f8c239f08d73941405c56f01050b
2016-11-02 15:51:00 -07:00
Jean-Marc Valin
e254241ce7 Introducing OD_DERING_SIZE_LOG2 constant (3)
Also cleans up the size of the deringing destination buffer.

No change in output.

Change-Id: I7fc50d862d3906ce809c1031bf0789acdf39cf34
2016-11-02 15:51:00 -07:00
Jean-Marc Valin
58fdec2cbf Renaming deringing blockwise write-back functions to make code clearer
No change in output.

Change-Id: Ifa5df3adce9f24ef6dcd89a5f33a744bfb57194d
2016-11-02 15:51:00 -07:00