Guardrails

The LLM Mesh provides an extensible set of Guardrails designed to ensure that queries submitted to LLMs and responses are safe and correct.

• Introduction to guardrails
  • Guardrails pipeline
  • Connection-level guardrails
  • Agent-level guardrails
  • Usage-time guardrails
• PII detection
  • Initial setup
  • Enable PII detection
  • Detected PII types
  • Details
• Prompt injection detection
• Toxicity detection
• Topics Boundaries
• Bias Detection
• Custom Guardrails