quantization-gptq

Compiling INT4/INT8 models with GPTQ algorithms.

SKILL.md

GitHub

Quantization Gptq

Overview

Compiling INT4/INT8 models with GPTQ algorithms.

When to Use

  • Standard workflow tasks related to quantization gptq.

When NOT to Use

  • Out-of-scope scenarios.

Prompt Template

Execute the quantization-gptq process targeting the parameters below.
Parameters: {{parameters}}

Evaluation Checklist

  • Task matches structural schemas.
  • Output is clean and formatted.