nielsr HF Staff commited on
Commit
10c6f23
·
verified ·
1 Parent(s): b8b399d

Add metadata and usage example

Browse files

This PR adds the correct metadata (license and pipeline tag) and includes a usage example from the official GitHub README. It also keeps the existing links to the paper and code.

Files changed (1) hide show
  1. README.md +15 -1
README.md CHANGED
@@ -1,3 +1,17 @@
 
 
 
 
 
1
  This is the official MatGPTQ checkpoint of `Qwen/Qwen3-8B`, produced as described in the [**"MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization"**](https://arxiv.org/abs/2602.03537) paper.
2
 
3
- This model can be run via vLLM. Checkout our integration at [IST-DASLab/MatGPTQ](https://github.com/IST-DASLab/MatGPTQ)
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: text-generation
4
+ ---
5
+
6
  This is the official MatGPTQ checkpoint of `Qwen/Qwen3-8B`, produced as described in the [**"MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization"**](https://arxiv.org/abs/2602.03537) paper.
7
 
8
+ This model can be run via vLLM. Checkout our integration at [IST-DASLab/MatGPTQ](https://github.com/IST-DASLab/MatGPTQ)
9
+
10
+ ## Usage
11
+
12
+ ```python
13
+ import vllm_matgptq
14
+ from vllm import LLM
15
+
16
+ llm = LLM(model="your-model", quantization="my_quant")
17
+ ```