lagarith: Correctly compute hash_shift

Message ID 20151102200516.3745A5DAAE@aruru.libav.org
State New
Headers show

Commit Message

Janne Grunau Nov. 2, 2015, 8:05 p.m.
Module: libav
Branch: master
Commit: 0b699920f3c0b2e30969b38ce59226653f9d80ec

Author:    Luca Barbato <lu_zero@gentoo.org>
Committer: Luca Barbato <lu_zero@gentoo.org>
Date:      Sun Nov  1 14:46:17 2015 +0100

lagarith: Correctly compute hash_shift

All the values are unsigned.

Bug-Id: 907
CC: libav-stable@libav.org

Signed-off-by: Luca Barbato <lu_zero@gentoo.org>

---

 libavcodec/lagarithrac.c |    2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

Patch

diff --git a/libavcodec/lagarithrac.c b/libavcodec/lagarithrac.c
index edfb18f..f9e4e5c 100644
--- a/libavcodec/lagarithrac.c
+++ b/libavcodec/lagarithrac.c
@@ -45,7 +45,7 @@  void ff_lag_rac_init(lag_rac *l, GetBitContext *gb, int length)
 
     l->range        = 0x80;
     l->low          = *l->bytestream >> 1;
-    l->hash_shift   = FFMAX(l->scale - 8, 0);
+    l->hash_shift   = FFMAX(l->scale, 8) - 8;
 
     for (i = j = 0; i < 256; i++) {
         unsigned r = i << l->hash_shift;