Pinned Loading

1. mlc-llm mlc-llm Public

   Universal LLM Deployment Engine with ML Compilation

   Python 21k 1.8k

2. web-llm web-llm Public

   High-performance In-browser LLM Inference Engine

   TypeScript 16k 1.1k

3. mlc-zh mlc-zh Public

   Python 611 66

4. mlc-en mlc-en Public

   Python 422 51

5. web-llm-chat web-llm-chat Public

   Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

   TypeScript 798 138

6. xgrammar xgrammar Public

   Fast, Flexible and Portable Structured Generation

   C++ 1.1k 76