salesforce/AuditNLG: AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness
github.com · 1,403 words · saved by 1 readers
AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness
Introduction AuditNLG is an open-source library that can help reduce the risks associated with using generative AI systems for language. It provides and aggregates state-of-the-art techniques for detecting and improving trust, making the process simple and easy to ensemble methods. The library supports three aspects of trust detection and improvement: Factualness, Safety, and Constraint. It can be used to determine whether a text fed into or output from a generative AI model has any trust issues, with output alternatives and an explanation provided. Factualness: Determines whether a text…
saved by
related reading
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
- Modifying LLM Beliefs with Synthetic Document Finetuningalignment.anthropic.com
- [2312.06942] AI Control: Improving Safety Despite Intentional Subversionarxiv.org
- GitHub - guidance-ai/guidance: A guidance language for controlling large language models.github.com
- [2604.16812] Introspection Adapters: Training LLMs to Report Their Learned Behaviorsarxiv.org
- Auditing language models for hidden objectives — LessWronglesswrong.com
- Claude Sonnet 4.5 System Cardassets.anthropic.com
- GitHub - assafelovic/gpt-researcher: An autonomous agent that conducts deep research on any data using any LLM providersgithub.com
- Langfuselangfuse.com
- GitHub - SoyGema/pulling_acegithub.com
- Compare AI Models: Pricing, Context & Benchmarks | OpenRouteropenrouter.ai
- Advanced AI Workflow Automation Software & Tools - n8nn8n.io