Skip to content
@Inferact

Inferact

Our mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster.

Popular repositories Loading

  1. vllm-frontend-rs vllm-frontend-rs Public archive

    Early-stage Rust drop-in alternative frontend for vLLM

    Rust 69 9

  2. xgrammar-structural-tag xgrammar-structural-tag Public

    Rust builders for xgrammar structural_tag tool-calling constraints

    Rust

  3. openai-harmony openai-harmony Public

    Forked from openai/harmony

    Renderer for the harmony response format to be used with gpt-oss

    Rust

Repositories

Showing 3 of 3 repositories

Sponsoring

  • @lightseekorg

Top languages

Loading…

Most used topics

Loading…