Academy
Join the Academy
Benefit from guided learning opportunities →
Quick Starts
Learning Paths
Certifications
Academy Discussions
Community
Explore the Community
Discover, share, and contribute →
Learn About Us
Ask A Question
What's New?
Discuss Dataiku
Using Dataiku
Setup And Configuration
General Discussion
Plugins & Extending Dataiku
Product Ideas
Programs
Frontrunner Awards
Dataiku Neurons
Community Resources
Community Feedback
User Research
Documentation
Dataiku
Reference Documentation
User's Guide
Specific Data Processing
Automation & Deployment
APIs
Installation & Administration
Other Topics
Agent Management
Reference Documentation
User's Guide
Automation & Deployment
APIs
Installation & Administration
Knowledge
Knowledge Base
Articles and tutorials on Dataiku features →
Get Started
User Guide
Dataiku Cloud
Additional Offerings
Admin Guide
Developer
Developer Guide
Tutorials and articles for developers and coder users →
Getting Started
What's new
Concepts and Examples
Tutorials
API Reference
Tech blog
Practical tools and ideas for developers
User's Guide
Concepts
Platforms
Supported platforms
Inventory
Monitoring
KPIs
Cost Management
Risk Management
Alerting
Dataiku AI in Agent Management
User's Guide
Data Management concepts
Connecting to data
Exploring data
The Flow
Data preparation
Visual recipes
Code recipes
Generative AI and LLM Mesh
Introduction
LLM connections
Running Hugging Face models
Prompt Studios
Prompt Recipe
Adding Knowledge to LLMs
Guardrails
LLM Mesh API
Multimodal capabilities
Fine-tuning
Cost Control
Rate Limiting
Evaluating LLMs & GenAI use cases
Automated Prompt Optimization
AI Agents
Semantic Models
Charts
Schemas, storage types and meanings
Code notebooks
Collaboration
Catalog
Data Lineage
Working with partitions
Agent Management and SQL
Agent Management and Python
Code environments
Automation & Deployment
Metrics, checks and Data Quality
Automation scenarios
APIs
Python APIs
Public REST API
Installation & Administration
Installing and setting up
Operating Agent Management
Security
User Isolation
Formula language
Custom variables expansion
Sampling methods
Accessibility
Troubleshooting
Release notes
Other Documentation
Third-party acknowledgements
Dataiku Agent Management
You are viewing the documentation for version
15
of DSS.
»
Generative AI and LLM Mesh
Open page in a new tab
Generative AI and LLM Mesh
¶
Introduction
Dataiku Generative AI Capabilities
Using the LLM Mesh
LLM connections
Hosted LLM APIs
Locally-running HuggingFace models
Running Hugging Face models
Setup & prerequisites
Text generation
Text embedding
Text reranking
Other model types
Monitoring model instances
The model cache
Prompt Studios
Prompt Recipe
When to use a Prompt Recipe
Prompt Recipes in the LLM Mesh ecosystem
Adding Knowledge to LLMs
Introduction to Knowledge Banks and RAG
Initial setup
Working with Vector stores
Embedding & searching datasets
Embedding and searching documents
Search settings
RAG guardrails
Document-Level Security
GraphRAG
Automated RAG Optimization
Guardrails
Introduction to guardrails
PII detection
Prompt injection detection
Toxicity detection
Topics Boundaries
Bias Detection
Custom Guardrails
LLM Mesh API
OpenAI-compatible API
Persisted conversations
Multimodal capabilities
Image input
Image output
Fine-tuning
Setup
Using the Fine-tuning recipe
Using Python code
Cost Control
Concepts
Limitations
Permissions and Visibility
Setup (Admin only)
Rate Limiting
Concepts
Rule Configuration
Limitations
Setup
Evaluating LLMs & GenAI use cases
Overview
Recipe configuration
Automated Prompt Optimization
Inputs
Output
Parameters