Parlant is the open-source framework for safe, compliant, and custom generative AI conversations. It gives you the power of LLMs without the unpredictability.
-
Updated
May 5, 2025 - Python
#
ai-alignment
Here are 57 public repositories matching this topic...
A curated list of trustworthy deep learning papers. Daily updating...
security privacy deep-learning backdoor uncertainty ownership causality fairness watermarking poisoning robustness adversarial-machine-learning machine-unlearning interpretable-deep-learning ai-alignment green-ai membership-inference-attack hallucinations gradient-leakage out-of-distribution-generalization
-
Updated
Apr 28, 2025
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Safety Workshop 2022
machine-learning agi language-models ai-safety adversarial-attacks ai-alignment ml-safety gpt-3 large-language-models prompt-engineering chain-of-thought agi-alignment
-
Updated
Feb 26, 2024 - Python
Code accompanying the paper Pretraining Language Models with Human Preferences
reinforcement-learning gpt language-models ai-safety ai-alignment pretraining decision-transformers rlhf
-
Updated
Feb 13, 2024 - Python
📚 A curated list of papers & technical articles on AI Quality & Safety
machine-learning natural-language-processing awesome ai computer-vision ml artificial-intelligence awesome-list ai-safety model-validation robustness mlops ai-alignment model-testing ml-safety ethical-ai ml-testing llm llmops ai-quality
-
Updated
Apr 14, 2025
How to Make Safe AI? Let's Discuss! 💡|💬|🙌|📚
-
Updated
Mar 29, 2023
[AAAI'25 Oral] "MIA-Tuner: Adapting Large Language Models as Pre-training Text Detector".
-
Updated
Mar 17, 2025 - Python
Reading list for adversarial perspective and robustness in deep reinforcement learning.
deep-reinforcement-learning ai-safety machine-learning-security ai-security robust-machine-learning ai-alignment safe-reinforcement-learning robust-reinforcement-learning responsible-ai adversarial-reinforcement-learning explainable-machine-learning adversarial-policies ml-security safe-rlhf machine-learning-safety reinforcement-learning-safety artificial-intelligence-security artificial-intelligence-alignment robust-deep-reinforcement-learning rlhf-security
-
Updated
Apr 10, 2025
A curated list of awesome academic research, books, code of ethics, data sets, institutes, maturity models, newsletters, principles, podcasts, reports, tools, regulations and standards related to Responsible, Trustworthy, and Human-Centered AI.
ai awesome-list ai-safety interpretable-ai explainable-ai xai ai-alignment fairness-ai responsible-ai ethical-ai trustworthy-ai ai-regulation ai-governance ai-standards
-
Updated
May 3, 2025
A curated list of awesome resources for Artificial Intelligence Alignment research
-
Updated
Jul 14, 2023
Sparse probing paper full code.
-
Updated
Dec 17, 2023 - Jupyter Notebook
Website to track people, organizations, and products (tools, websites, etc.) in AI safety
-
Updated
May 5, 2025 - HTML
[TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
-
Updated
Sep 15, 2023 - Python
Official Implementation of Nabla-GFlowNet (ICLR 2025)
-
Updated
May 3, 2025 - Python
An initiative to create concise and widely shareable educational resources, infographics, and animated explainers on the latest contributions to the community AI alignment effort. Boosting the signal and moving the community towards finding and building solutions.
-
Updated
Jul 9, 2023
Code and materials for the paper S. Phelps and Y. I. Russell, Investigating Emergent Goal-Like Behaviour in Large Language Models Using Experimental Economics, working paper, arXiv:2305.07970, May 2023
economics ai-safety gametheory experimental-economics behavioral-economics prisoners-dilemma ai-alignment experimental-psychology social-dilemmas gpt-3 gpt-4 llm principal-agent-problem
-
Updated
Dec 11, 2024 - Python
Scan your AI/ML models for problems before you put them into production.
-
Updated
Mar 31, 2025 - Python
Community list of awesome projects, apps, tools and more related to Polis.
civictech democracy pca civic-tech awesome-list collective-intelligence kmeans-clustering participation participatory-democracy polis ai-alignment wikisurvey
-
Updated
Apr 30, 2025 - JavaScript
Improve this page
Add a description, image, and links to the ai-alignment topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ai-alignment topic, visit your repo's landing page and select "manage topics."