Scalable Infrastructure for Running Your AI Workloads at Scale

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

[deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications

A diverse, simple, and secure all-in-one LLMOps platform

An AI assisted kubectl helper

Implement RAG (using LangChain and PostgreSQL) for Go applications to improve the accuracy and relevance of LLM outputs

Go package and example utilities for using Ollama / LLMs

Interactive Fiction in the Age of AI

AWS Go SDK examples for Amazon Bedrock

Inference Llama 2 in one file of pure go

Go framework for language model-powered applications with composability and chaining. Inspired by LangChain.

A simple Read-It-Later and link collection tool, AI-powered for text and images, multi-platform, open-source. A browser extension available for one-click bookmarking. My undergraduate thesis at HUST.

LLM Prompt Injection Detection API Service PoC.

With an emphasis on pluggable architecture and platform flexibility, Thor is a highly modular chat engine integrated into Go.

This repository is a work in progress (WIP).

🧠 Cache implementation for storing and retrieving results of language model (LLM) requests

Vectoria is an embedded vector database.

LLM + temphia

A declarative DSL (domain-specific language) for IDD (Inference-Driven-Development) and testing on any codebase in any programming language