Lists (6)
Stars
Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
🐙 Guides, papers, lecture, notebooks and resources for prompt engineering
Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and l…
Samples for Responsible AI training modules
A collection of software installations scripts for Windows systems that allows you to easily setup and maintain a reverse engineering environment on a VM.
An informational repo about hunting for adversaries in your IT environment.
Learn about AI hacking and utilize AI tools to hack!
A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.
AI Red Teaming playground labs to run AI Red Teaming trainings including infrastructure.
🍯 T-Pot - The All In One Multi Honeypot Platform 🐝
The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.
Detect Tactics, Techniques & Combat Threats
Finds Instagram location IDs near a specified latitude and longitude.
A "line-network" geolocation tool created for Bellingcat's September 2022 Hackathon: https://www.bellingcat.com/resources/2022/10/06/automated-map-searches-scam-busting-tools-and-twitter-search-tra…
Parse CSS and add vendor prefixes to rules by Can I Use