Search results

Add support for native asymmetric quantization to AQTv2.

Status: Open.

#725 In google/aqt;

· phoenix-meadowlark opened on Sep 19, 2024

Reduce checkpoint size for Flax models

Status: Open.

#720 In google/aqt;

· liamclarkza opened on Sep 17, 2024

Best practices to reduce memory usage in SERVE mode

Status: Open.

#706 In google/aqt;

· mar-muel opened on Sep 5, 2024

Support Python versions <3.10

Status: Open.

#703 In google/aqt;

· mar-muel opened on Aug 28, 2024

Gradient quantization support

Status: Open.

#691 In google/aqt;

· lixcli opened on Aug 9, 2024

generalized einsum or matmul api for pure jax

Status: Open.

#600 In google/aqt;

· sh0416 opened on Apr 27, 2024

NormalFloat4 support

Status: Open.

#599 In google/aqt;

· sh0416 opened on Apr 27, 2024

How to use it with jnp.einsum?

Status: Open.

#595 In google/aqt;

· sh0416 opened on Apr 23, 2024

Embedded inference or tflite compatibility on the roadmap?

Status: Open.

#579 In google/aqt;

· soren-halter opened on Apr 10, 2024

Binary quantization?

Status: Open.

#548 In google/aqt;

· kishorenc opened on Mar 25, 2024

Can AQT be used to calculate qk score?

Status: Open.

#514 In google/aqt;

· Lisennlp opened on Mar 4, 2024

Implement backprop quantization for convolution.

feature

Status: Open.

#285 In google/aqt;

· lukaszlew opened on Nov 7, 2023