1c495b0bf6
thats how the specification defines it, this also improves numerical accuracy of the integer wavelet implementation. It otherwise should be equivalent, in case of overflows this can be reverted. Signed-off-by: Michael Niedermayer <michaelni@gmx.at>
61 lines
3.6 KiB
Plaintext
61 lines
3.6 KiB
Plaintext
5/3i, decomp:15 border 151 170 140 183 milli-err2: 0
|
|
9/7i, decomp:15 border 151 170 140 183 milli-err2: 5407
|
|
9/7f, decomp:15 border 151 170 140 183 err2: 0.0001
|
|
5/3i, decomp:21 border 173 201 81 189 milli-err2: 0
|
|
9/7i, decomp:21 border 173 201 81 189 milli-err2: 8289
|
|
9/7f, decomp:21 border 173 201 81 189 err2: 0.0001
|
|
5/3i, decomp:22 border 213 227 76 245 milli-err2: 0
|
|
9/7i, decomp:22 border 213 227 76 245 milli-err2: 7210
|
|
9/7f, decomp:22 border 213 227 76 245 err2: 0.0001
|
|
5/3i, decomp:13 border 134 157 184 203 milli-err2: 0
|
|
9/7i, decomp:13 border 134 157 184 203 milli-err2: 17748
|
|
9/7f, decomp:13 border 134 157 184 203 err2: 0.0001
|
|
5/3i, decomp: 1 border 204 237 6 106 milli-err2: 0
|
|
9/7i, decomp: 1 border 204 237 6 106 milli-err2: 824
|
|
9/7f, decomp: 1 border 204 237 6 106 err2: 0.0000
|
|
5/3i, decomp:28 border 76 211 13 210 milli-err2: 0
|
|
9/7i, decomp:28 border 76 211 13 210 milli-err2: 11710
|
|
9/7f, decomp:28 border 76 211 13 210 err2: 0.0002
|
|
5/3i, decomp:21 border 76 99 43 123 milli-err2: 0
|
|
9/7i, decomp:21 border 76 99 43 123 milli-err2: 8555
|
|
9/7f, decomp:21 border 76 99 43 123 err2: 0.0001
|
|
5/3i, decomp:15 border 192 243 174 204 milli-err2: 0
|
|
9/7i, decomp:15 border 192 243 174 204 milli-err2: 7769
|
|
9/7f, decomp:15 border 192 243 174 204 err2: 0.0001
|
|
5/3i, decomp:21 border 17 68 93 204 milli-err2: 0
|
|
9/7i, decomp:21 border 17 68 93 204 milli-err2: 7727
|
|
9/7f, decomp:21 border 17 68 93 204 err2: 0.0001
|
|
5/3i, decomp:11 border 142 168 82 174 milli-err2: 0
|
|
9/7i, decomp:11 border 142 168 82 174 milli-err2: 12277
|
|
9/7f, decomp:11 border 142 168 82 174 err2: 0.0001
|
|
5/3i, decomp:23 border 142 209 171 235 milli-err2: 0
|
|
9/7i, decomp:23 border 142 209 171 235 milli-err2: 6570
|
|
9/7f, decomp:23 border 142 209 171 235 err2: 0.0001
|
|
5/3i, decomp:30 border 37 185 79 245 milli-err2: 0
|
|
9/7i, decomp:30 border 37 185 79 245 milli-err2: 12266
|
|
9/7f, decomp:30 border 37 185 79 245 err2: 0.0002
|
|
5/3i, decomp: 5 border 129 236 30 243 milli-err2: 0
|
|
9/7i, decomp: 5 border 129 236 30 243 milli-err2: 8686
|
|
9/7f, decomp: 5 border 129 236 30 243 err2: 0.0001
|
|
5/3i, decomp:10 border 5 160 146 247 milli-err2: 0
|
|
9/7i, decomp:10 border 5 160 146 247 milli-err2: 12231
|
|
9/7f, decomp:10 border 5 160 146 247 err2: 0.0002
|
|
5/3i, decomp: 5 border 104 162 6 47 milli-err2: 0
|
|
9/7i, decomp: 5 border 104 162 6 47 milli-err2: 7794
|
|
9/7f, decomp: 5 border 104 162 6 47 err2: 0.0001
|
|
5/3i, decomp:24 border 78 250 102 218 milli-err2: 0
|
|
9/7i, decomp:24 border 78 250 102 218 milli-err2: 11632
|
|
9/7f, decomp:24 border 78 250 102 218 err2: 0.0002
|
|
5/3i, decomp:28 border 86 98 56 79 milli-err2: 0
|
|
9/7i, decomp:28 border 86 98 56 79 milli-err2: 11105
|
|
9/7f, decomp:28 border 86 98 56 79 err2: 0.0001
|
|
5/3i, decomp: 6 border 95 238 197 214 milli-err2: 0
|
|
9/7i, decomp: 6 border 95 238 197 214 milli-err2: 8308
|
|
9/7f, decomp: 6 border 95 238 197 214 err2: 0.0001
|
|
5/3i, decomp:17 border 77 169 93 165 milli-err2: 0
|
|
9/7i, decomp:17 border 77 169 93 165 milli-err2: 8820
|
|
9/7f, decomp:17 border 77 169 93 165 err2: 0.0001
|
|
5/3i, decomp:22 border 178 187 7 119 milli-err2: 0
|
|
9/7i, decomp:22 border 178 187 7 119 milli-err2: 5554
|
|
9/7f, decomp:22 border 178 187 7 119 err2: 0.0000
|