quantization-awq
Quantizing models to INT4 using Activation-aware Weight Quantization.
SKILL.mdskills/model-serving/quantization-awq/SKILL.md
GitHubQuantization Awq
Overview
Quantizing models to INT4 using Activation-aware Weight Quantization.
When to Use
- Standard workflow tasks related to quantization awq.
When NOT to Use
- Out-of-scope scenarios.
Prompt Template
Execute the quantization-awq process targeting the parameters below.
Parameters: {{parameters}}
Evaluation Checklist
- Task matches structural schemas.
- Output is clean and formatted.