Search results

when q_len == 1,using “apply_rotary_pos_emb(None, key_states, cos, -sin, position_ids)”, why using -sin?

Status: Open.

#22 In bojone/rerope;

· zhenghuawang6 opened on Nov 26, 2024

Generating same token

Status: Open.

#21 In bojone/rerope;

· Madhu000 opened on May 30, 2024

"position_ids_q - position_ids_k < window" without abs()

Status: Open.

#20 In bojone/rerope;

· wzhcz8902 opened on May 20, 2024

请问在推理阶段，为什么需要对input部份计算注意力呢？

Status: Open.

#11 In bojone/rerope;

· Anditty opened on Nov 9, 2023

运行 test.py 显存爆了

Status: Open.

#6 In bojone/rerope;

· liyi-ff opened on Aug 17, 2023

ntk_rope_mixed_init 中old_init是否可以简化，省略inv_freq、_set_cos_sin_cache()步骤

Status: Open.

#5 In bojone/rerope;

· samantha0-ops opened on Aug 15, 2023

Monkey patch for original LLaMA2 code.

Status: Open.

#4 In bojone/rerope;

· WeixuanXiong opened on Aug 14, 2023

rerope：为什么对大于train_seqlength的query token要稍微放大一点

Status: Open.

#3 In bojone/rerope;

· Liu20210916 opened on Aug 11, 2023

测了一下千问

Status: Open.

#2 In bojone/rerope;

· af-74413592 opened on Aug 9, 2023

Excellent Idea！！！！

Status: Open.

#1 In bojone/rerope;

· 0three opened on Aug 8, 2023