A lightweight LiteLLM server boilerplate pre-configured with uv and Docker for hosting your own OpenAI- and Anthropic-compatible endpoints. Includes LibreChat as an optional web UI.

Function-calling API for LLM from multiple providers

API server for `llm` CLI tool

PHP Frontend for Hosting local LLM's (run via VSCode or basic php execution methods/ add to project)

A flexible FastAPI-based framework for handling AI tasks using Large Language Models (LLMs). Supports multiple providers, extensible tasks and routers, Redis caching, and OpenAI integration. Easily scalable for various LLM-based applications.