🐢 Open-Source Evaluation & Testing for AI & LLM systems

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

A Python package to assess and improve fairness of machine learning models.

moDel Agnostic Language for Exploration and eXplanation

Deliver safe & effective language models

A toolkit that streamlines and automates the generation of model cards

LangFair is a Python library for conducting use-case level LLM bias and fairness assessments

[ICCV 2023 Oral, Best Paper Finalist] ITI-GEN: Inclusive Text-to-Image Generation

PyTorch package to train and audit ML models for Individual Fairness

Credo AI Lens is a comprehensive assessment framework for AI systems. Lens standardizes model and data assessment, and acts as a central gateway to assessments created in the open source community.

Oracle Guardian AI Open Source Project is a library consisting of tools to assess fairness/bias and privacy of machine learning models and data sets.

Official code of "StyleT2I: Toward Compositional and High-Fidelity Text-to-Image Synthesis" (CVPR 2022)

AWS Certified AI Practitioner (AIF-C01) exam preparation

Python labs demonstrating various techniques for reducing hallucinations in apps using large language models

Official code of "Discover and Mitigate Unknown Biases with Debiasing Alternate Networks" (ECCV 2022)

🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.

Open-source toolkit to help companies implement responsible AI workflows.

Package for evaluating the performance of methods which aim to increase fairness, accountability and/or transparency

Open-source test generation SDK for LLM applications. Access curated test sets. Build context-specific test sets and collaborate with subject matter experts.

Metadata encoding and extraction for AI-generated content