浏览代码

Update cache_utils.py

Allen 1 年之前
父节点
当前提交
bc5d495cf9
共有 1 个文件被更改,包括 1 次插入0 次删除
  1. 1 0
      research/long-context-llama/H2O/cache_utils.py

+ 1 - 0
research/long-context-llama/H2O/cache_utils.py

@@ -364,6 +364,7 @@ class HHCache(Cache):
         Support for backwards-compatible `past_key_value` indexing, e.g. `past_key_value[0][0].shape[2]` to get the
         Support for backwards-compatible `past_key_value` indexing, e.g. `past_key_value[0][0].shape[2]` to get the
         sequence length.
         sequence length.
         """
         """
+        print(layer_idx, len(self))
         if layer_idx < len(self):
         if layer_idx < len(self):
             return (self.key_cache[layer_idx], self.value_cache[layer_idx])
             return (self.key_cache[layer_idx], self.value_cache[layer_idx])
         else:
         else: