kv-cache-tuning
Setting cache block allocations based on request volume.
SKILL.mdskills/model-serving/kv-cache-tuning/SKILL.md
GitHubKv Cache Tuning
Overview
Setting cache block allocations based on request volume.
When to Use
- Standard workflow tasks related to kv cache tuning.
When NOT to Use
- Out-of-scope scenarios.
Prompt Template
Execute the kv-cache-tuning process targeting the parameters below.
Parameters: {{parameters}}
Evaluation Checklist
- Task matches structural schemas.
- Output is clean and formatted.