quantization-awq

Quantizing models to INT4 using Activation-aware Weight Quantization.

SKILL.md

GitHub

Quantization Awq

Overview

Quantizing models to INT4 using Activation-aware Weight Quantization.

When to Use

  • Standard workflow tasks related to quantization awq.

When NOT to Use

  • Out-of-scope scenarios.

Prompt Template

Execute the quantization-awq process targeting the parameters below.
Parameters: {{parameters}}

Evaluation Checklist

  • Task matches structural schemas.
  • Output is clean and formatted.