Mixture of experts architecture for speech-to-text and language identification, built in PyTorch
-
Updated
Mar 11, 2025 - Python
Mixture of experts architecture for speech-to-text and language identification, built in PyTorch
🧠 Research repository exploring DeepSeek AI's model evolution and architectures (2023-2025). Analyzes language, code, math, and vision models using HuggingFace collections. 📚 A personal learning journey into understanding these advanced AI systems.
Add a description, image, and links to the moe-architecture topic page so that developers can more easily learn about it.
To associate your repository with the moe-architecture topic, visit your repo's landing page and select "manage topics."