quantization-gptq
Compiling INT4/INT8 models with GPTQ algorithms.
SKILL.mdskills/model-serving/quantization-gptq/SKILL.md
GitHubQuantization Gptq
Overview
Compiling INT4/INT8 models with GPTQ algorithms.
When to Use
- Standard workflow tasks related to quantization gptq.
When NOT to Use
- Out-of-scope scenarios.
Prompt Template
Execute the quantization-gptq process targeting the parameters below.
Parameters: {{parameters}}
Evaluation Checklist
- Task matches structural schemas.
- Output is clean and formatted.