A lightweight Python API wrapper and CLI for Groq’s offering of language models using their ultra fast LPU Inference Engine.
artificial-intelligence language-processing lpu groq large-language-models mixtral-8x7b groqapi groqai groq-ai groq-api groqaiapi groq-ai-api lpu-inference-engine language-processing-unit languageprocessingunit large-laguage-model llama3 llama-3 llama3-70b-8192
-
Updated
Sep 12, 2024 - Python