Go to file
Ronald S. Bultje f64725a009 Improved coding using 8x8 transform
In summary, this commit encompasses a series of changes in attempt to
improve the 8x8 transform based coding to help overall compression
quality, please refer to the detailed commit history below for what
are the rationale underly the series of changes:

a. A frame level flag to indicate if 8x8 transform is used at all.
b. 8x8 transform is not used for key frames and small image size.
c. On inter coded frame, macroblocks using modes B_PRED, SPLIT_MV
and I8X8_PRED are forced to using 4x4 transform based coding, the
rest uses 8x8 transform based coding.
d. Encoder and decoder has the same assumption on the relationship
between prediction modes and transform size, therefore no signaling
is encoded in bitstream.
e. Mode decision process now calculate the rate and distortion scores
using their respective transforms.

Overall test results:
1. HD set
http://www.corp.google.com/~yaowu/no_crawl/t8x8/HD_t8x8_20120206.html
(avg psnr: 3.09% glb psnr: 3.22%, ssim: 3.90%)
2. Cif set:
http://www.corp.google.com/~yaowu/no_crawl/t8x8/cif_t8x8_20120206.html
(avg psnr: -0.03%, glb psnr: -0.02%, ssim: -0.04%)
It should be noted here, as 8x8 transform coding itself is disabled
for cif size clips, the 0.03% loss is purely from the 1 bit/frame
flag overhead on if 8x8 transform is used or not for the frame.

---patch history for future reference---
Patch 1:
this commit tries to select transform size based on macroblock
prediction mode. If the size of a prediction mode is 16x16, then
the macroblock is forced to use 8x8 transform. If the prediction
mode is B_PRED, SPLITMV or I8X8_PRED, then the macroblock is forced
to use 4x4 transform. Tests on the following HD clips showed mixed
results: (all hd clips only used first 100 frames in the test)

http://www.corp.google.com/~yaowu/no_crawl/t8x8/hdmodebased8x8.html
http://www.corp.google.com/~yaowu/no_crawl/t8x8/hdmodebased8x8_log.html

while the results are mixed and overall negative, it is interesting to
see 8x8 helped a few of the clips.

Patch 2:
this patch tries to hard-wire selection of transform size based on
prediction modes without using segmentation to signal the transform size.
encoder and decoder both takes the same assumption that all macroblocks
use 8x8 transform except when prediciton mode is B_PRED, I8X8_PRED or
SPLITMV. Test results are as follows:

http://www.corp.google.com/~yaowu/no_crawl/t8x8/cifmodebase8x8_0125.html
http://www.corp.google.com/~yaowu/no_crawl/t8x8/hdmodebased8x8_0125log.html

Interestingly, by removing the overhead or coding the segmentation, the
results on this limited HD set have turn positive on average.

Patch 3:
this patch disabled the usage of 8x8 transform on key frames, and kept the
logic from patch 2 for inter frames only. test results on HD set turned
decidedly positive with 8x8 transform enabled on inter frame with 16x16
prediction modes: (avg psnr: .81% glb psnr: .82 ssim: .55%)

http://www.corp.google.com/~yaowu/no_crawl/t8x8/hdintermode8x8_0125.html
results on cif set still negative overall

Patch 4:
continued from last patch, but now in mode decision process, the rate and
distortion estimates are computed based on 8x8 transform results for MBs
with modes associated with 8x8 transform. This patch also fixed a problem
related to segment based eob coding when 8x8 transform is used. The patch
significantly improved the results on HD clips:

http://www.corp.google.com/~yaowu/no_crawl/t8x8/hd8x8RDintermode.html
(avg psnr: 2.70% glb psnr: 2.76% ssim: 3.34%)
results on cif also improved, though they are still negative compared to
baseline that uses 4x4 transform only:
http://www.corp.google.com/~yaowu/no_crawl/t8x8/cif8x8RDintermode.html
(avg psnr: -.78% glb psnr: -.86% ssim: -.19%)

Patch 5:
This patch does 3 things:
a. a bunch of decoder bug fixes, encodings and decodings were verified
to have matched recon buffer on a number of encodes on cif size mobile and
hd version of _pedestrian.
b. the patch further improved the rate distortion calculation of MBS that
use 8x8 transform. This provided some further gain on compression.
c. the patch also got the experimental work SEG_LVL_EOB to work with 8x8
transformed macroblock, test results indicates it improves the cif set
but hurt the HD set slightly.

Tests results on HD clips:
http://www.corp.google.com/~yaowu/no_crawl/t8x8/HD_t8x8_20120201.html
(avg psnr: 3.19% glb psnr: 3.30% ssim: 3.93%)

Test results on cif clips:
http://www.corp.google.com/~yaowu/no_crawl/t8x8/cif_t8x8_20120201.html
(avg psnr: -.47% glb psnr: -.51% ssim: +.28%)

Patch 6:
Added a frame level flag to indicate if 8x8 transform is allowed at all.
temporarily the decision is based on frame size, can be optimized later
one. This get the cif results to basically unchanged, with one bit per
frame overhead on both cif and hd clips.

Patch 8:
Rebase and Merge to head by PGW.
Fixed some suspect 4s that look like hey should be 64s in regard
to segmented EOB. Perhaps #defines would be bette.
Bulit and tested without T8x8 enabled and produces unchanged
output.

Patch 9:
Corrected misalligned code/decode of "txfm_mode" bit.
Limited testing for correct encode and decode with
T8x8 configured on derf clips.

Change-Id: I156e1405d25f81579d579dff8ab9af53944ec49c
2012-02-10 14:23:27 +00:00
build Merge "build error fix - obj_int_extract.bat" into cayuga 2011-08-01 13:56:32 -07:00
examples Fix odd-sized image support in decoder examples 2011-09-14 11:25:24 -04:00
libmkv Fix vpxenc encoding incorrect webm file header on big endian machines(Issue 331) 2011-07-12 14:49:57 -04:00
nestegg ivfdec: webm reader support 2010-10-25 22:01:40 -04:00
tools tools: author_first_release.sh 2011-08-19 15:44:45 -04:00
vp8 Improved coding using 8x8 transform 2012-02-10 14:23:27 +00:00
vpx Merge remote branch 'origin/master' into experimental 2011-07-30 00:05:09 -04:00
vpx_mem Remove rotting NDS_NITRO code. 2011-07-12 16:29:15 -07:00
vpx_ports Properly use GET_GOT/RESTORE_GOT when using GLOBAL(). 2011-06-30 14:04:27 -07:00
vpx_scale Adds support for enhanced interpolation for subpel motion 2012-01-26 10:24:47 -08:00
.gitattributes Initial WebM release 2010-05-18 11:58:33 -04:00
.gitignore update gitignore 2010-09-28 10:09:01 -04:00
.mailmap Update .mailmap entry for Ralph Giles 2011-08-02 10:09:36 -04:00
all_builds.py Add script to test all builds. 2011-12-22 16:05:23 -08:00
args.c Add psnr/ssim tuning option 2010-12-17 10:01:05 -05:00
args.h Add psnr/ssim tuning option 2010-12-17 10:01:05 -05:00
AUTHORS Update AUTHORS 2011-08-02 10:09:59 -04:00
CHANGELOG Update CHANGELOG for v0.9.7-p1 2011-08-15 17:02:45 -04:00
configure Merge dualpred (compound prediction) experiment. 2012-02-09 16:29:18 -08:00
docs.mk Remove examples.doxy dep w/--disable-examples 2011-02-24 15:11:05 -08:00
example_xma.c Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
examples.mk configure: add --enable-static option 2011-07-25 15:40:36 -07:00
keywords.dox Initial WebM release 2010-05-18 11:58:33 -04:00
libs.doxy_template Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00
libs.mk Reduce grep match when generating offset files. 2011-09-20 15:36:44 -07:00
LICENSE LICENSE: update with latest text 2010-06-04 16:19:40 -04:00
mainpage.dox documentation: minor cosmetics 2011-02-16 17:59:33 -08:00
md5_utils.c Adds "armvX-none-rvct" targets 2011-01-28 12:47:39 +02:00
md5_utils.h Use public domain implementation for MD5 algorithm 2010-06-14 08:48:22 -04:00
PATENTS LICENSE: update with latest text 2010-06-04 16:19:40 -04:00
README purge wince configuration 2011-02-22 14:42:00 -05:00
solution.mk obj_int_extract for Visual Studio 2011-03-10 18:49:54 -05:00
tools_common.c fix pipe support on windows 2010-11-02 09:14:24 -04:00
tools_common.h fix pipe support on windows 2010-11-02 09:14:24 -04:00
usage_cx.dox Initial WebM release 2010-05-18 11:58:33 -04:00
usage_dx.dox Initial WebM release 2010-05-18 11:58:33 -04:00
usage.dox documentation: minor cosmetics 2011-02-16 17:59:33 -08:00
vp8_api1_migration.txt Initial WebM release 2010-05-18 11:58:33 -04:00
vpxdec.c Adding error-concealment to the decoder. 2011-05-19 13:46:33 -04:00
vpxenc.c Merge remote branch 'internal/upstream-experimental' into HEAD 2011-08-11 13:01:45 -04:00
y4minput.c clean up unused variable warnings 2011-05-09 12:56:20 -04:00
y4minput.h Use WebM in copyright notice for consistency 2010-09-09 10:01:21 -04:00

vpx Multi-Format Codec SDK
README - 19 May 2010

Welcome to the WebM VP8 Codec SDK!

COMPILING THE APPLICATIONS/LIBRARIES:
  The build system used is similar to autotools. Building generally consists of
  "configuring" with your desired build options, then using GNU make to build
  the application.

  1. Prerequisites

    * All x86 targets require the Yasm[1] assembler be installed.
    * All Windows builds require that Cygwin[2] be installed.
    * Building the documentation requires PHP[3] and Doxygen[4]. If you do not
      have these packages, you must pass --disable-install-docs to the
      configure script.

    [1]: http://www.tortall.net/projects/yasm
    [2]: http://www.cygwin.com
    [3]: http://php.net
    [4]: http://www.doxygen.org

  2. Out-of-tree builds
  Out of tree builds are a supported method of building the application. For
  an out of tree build, the source tree is kept separate from the object
  files produced during compilation. For instance:

    $ mkdir build
    $ cd build
    $ ../libvpx/configure <options>
    $ make

  3. Configuration options
  The 'configure' script supports a number of options. The --help option can be
  used to get a list of supported options:
    $ ../libvpx/configure --help

  4. Cross development
  For cross development, the most notable option is the --target option. The
  most up-to-date list of supported targets can be found at the bottom of the
  --help output of the configure script. As of this writing, the list of
  available targets is:

    armv5te-linux-rvct
    armv5te-linux-gcc
    armv5te-symbian-gcc
    armv6-darwin-gcc
    armv6-linux-rvct
    armv6-linux-gcc
    armv6-symbian-gcc
    iwmmxt-linux-rvct
    iwmmxt-linux-gcc
    iwmmxt2-linux-rvct
    iwmmxt2-linux-gcc
    armv7-linux-rvct
    armv7-linux-gcc
    mips32-linux-gcc
    ppc32-darwin8-gcc
    ppc32-darwin9-gcc
    ppc64-darwin8-gcc
    ppc64-darwin9-gcc
    ppc64-linux-gcc
    x86-darwin8-gcc
    x86-darwin8-icc
    x86-darwin9-gcc
    x86-darwin9-icc
    x86-linux-gcc
    x86-linux-icc
    x86-solaris-gcc
    x86-win32-vs7
    x86-win32-vs8
    x86_64-darwin9-gcc
    x86_64-linux-gcc
    x86_64-solaris-gcc
    x86_64-win64-vs8
    universal-darwin8-gcc
    universal-darwin9-gcc
    generic-gnu

  The generic-gnu target, in conjunction with the CROSS environment variable,
  can be used to cross compile architectures that aren't explicitly listed, if
  the toolchain is a cross GNU (gcc/binutils) toolchain. Other POSIX toolchains
  will likely work as well. For instance, to build using the mipsel-linux-uclibc
  toolchain, the following command could be used (note, POSIX SH syntax, adapt
  to your shell as necessary):

    $ CROSS=mipsel-linux-uclibc- ../libvpx/configure

  In addition, the executables to be invoked can be overridden by specifying the
  environment variables: CC, AR, LD, AS, STRIP, NM. Additional flags can be
  passed to these executables with CFLAGS, LDFLAGS, and ASFLAGS.

  5. Configuration errors
  If the configuration step fails, the first step is to look in the error log.
  This defaults to config.err. This should give a good indication of what went
  wrong. If not, contact us for support.

SUPPORT
  This library is an open source project supported by its community. Please
  please email webm-users@webmproject.org for help.