Search results

Why don't we use the pruned tokens to compute attention in the prefill stage?

Status: Open.

#51 In FMInference/H2O;

· Ppaddington opened on Jul 29, 2025

Inquiry about the H2O version under llama cookbook folder

Status: Open.

#50 In FMInference/H2O;

· DeadCardassian opened on Mar 27, 2025

ValueError: The current <code>device_map</code> had weights offloaded to the disk.

Status: Open.

#49 In FMInference/H2O;

· Winddfall opened on Mar 11, 2025

version is not match

Status: Open.

#48 In FMInference/H2O;

· KeBbboy opened on Mar 1, 2025

How to reproduce the result of infinite-length inputs?

Status: Open.

#47 In FMInference/H2O;

· shuhao02 opened on Dec 3, 2024

For model generation，I fail with ERROR:KeyError: 'Cache only has 0 layers, attempted to access layer with index 0'

Status: Open.

#45 In FMInference/H2O;

· liyanboSustech opened on Aug 29, 2024

For HELM testing, is an API, like togetherApiKey, necessary?

Status: Open.

#44 In FMInference/H2O;

· DOG-wooooof opened on Aug 19, 2024

<code>TypeError: forward() got an unexpected keyword argument 'cache_position'</code>

Status: Open.

#42 In FMInference/H2O;

· benja-matic opened on Jul 25, 2024

ModuleNotFoundError: No module named 'streaming_llm'

Status: Open.

#40 In FMInference/H2O;

· benja-matic opened on Jul 25, 2024

Undefined functions

Status: Open.

#39 In FMInference/H2O;

· XdertodX opened on Jul 24, 2024

Current transformers version v4.40 is not supported

Status: Open.

#38 In FMInference/H2O;

· maxjeblick opened on Jul 16, 2024

Evaluation on discrimative datasets with short prompt.

Status: Open.

#37 In FMInference/H2O;

· yinwangsong opened on Jun 24, 2024