Skip to content
edge
329 installs on skills.sh

Sglang

Fast structured generation and serving for LLMs with RadixAttention prefix caching.

davila7/claude-code-templates
Security state: reviewed

3 static scans, 0 counted findings.

Edge checks it again each time your agent loads it.

SKILL.md4 files · 44.8 KB

From the davila7 public repository. Edge did not write or edit this skill.

What it does

  • Fast structured generation and serving for LLMs with RadixAttention prefix caching.
  • Use for JSON/regex outputs, constrained decoding, agentic workflows with tool calls, or when you need 5× faster inference than vLLM with prefix sharing.
  • Powers 300,000+ GPUs at xAI, AMD, NVIDIA, and LinkedIn.
DA

Why Daniel Avila

Co-founder of CodeGPT. Each fact links its public source.

  • 32k+ GitHub stars on claude-code-templates

    His CLI for configuring and monitoring Claude Code has over 32,000 stars.

    GitHub
  • Co-founder of CodeGPT, 2M+ downloads

    He co-founded CodeGPT, which has over 2 million downloads.

    Personal site

Public sources, checked Oct 26, 2026.

How it works

  1. 1
    Copy

    Try for free gives you one prompt.

  2. 2
    Paste

    Paste it into Claude Code, Codex or Cursor.

  3. 3
    Ask

    Ask for the outcome. Your agent loads Sglang.

Questions about Sglang

What does Sglang do?

Fast structured generation and serving for LLMs with RadixAttention prefix caching. Published by Daniel Avila (davila7/claude-code-templates).

Is Sglang safe to use?

Edge security state: Reviewed (3 Edge-run static scans, scanned Sep 30, 2026). The Evidence tab shows the scan.

How do I use Sglang in Claude Code, Codex or Cursor?

Click Try for free, pick your agent and follow its one step. Edge is free, with no Edge account.

Give your agent Sglang.

Free. No Edge account.

Use Sglang in your agent

Claude app

Add to Claude

Opens claude.ai in your browser. Add it once, and Edge is in the Claude desktop and phone apps too.
Then click Continue Add Connect and open a new chat.

Already added? Open a new chat in Claude.

ChatGPT

Add to ChatGPT

Opens the Edge plugin in ChatGPT. Click Install plugin, then start a new chat.

Claude Code or Codex

Free · No Edge accountOther agents