Documentation
Academy
Join the Academy
Benefit from guided learning opportunities →
Quick Starts
Learning Paths
New Features
Certifications
Academy Discussions
Community
Explore the Community
Discover, share, and contribute →
Learn About Us
Ask A Question
What's New?
Discuss Dataiku
Using Dataiku
Setup And Configuration
General Discussion
Plugins & Extending Dataiku
Product Ideas
Programs
Frontrunner Awards
Dataiku Neurons
Community Resources
Community Feedback
User Research
Documentation
Reference Documentation
Comprehensive specifications of Dataiku →
User's Guide
Specific Data Processing
Automation & Deployment
APIs
Installation & Administration
Other Topics
Knowledge
Knowledge Base
Articles and tutorials on Dataiku features →
User Guide
Admin Guide
Dataiku Solutions
Dataiku Cloud
Developer
Developer Guide
Tutorials and articles for developers and coder users →
Getting Started
Concepts and Examples
Tutorials
API Reference
User's Guide
DSS concepts
Connecting to data
Exploring data
Charts
The Flow
Data preparation
Visual recipes
Code recipes
Schemas, storage types and meanings
Generative AI and LLM Mesh
Introduction
LLM connections
Running Hugging Face models
The Prompt Studio
Adding Knowledge to LLMs
Chat UI
Building Agents
Guardrails
LLM Mesh API
Multimodal capabilities
Fine-tuning
Cost Control
Evaluating GenAI use cases
Machine learning
MLOps
Interactive statistics
Code notebooks
Code Studios
Webapps
Collaboration
AI Assistants
Dashboards
Workspaces
Stories
Data Catalog
Dataiku Applications
Working with partitions
DSS and SQL
DSS and Python
DSS and R
DSS and Spark
Code environments
Specific Data Processing
Time Series
Geographic data
Text & Natural Language Processing
Images
Audio
Video
Automation & Deployment
Metrics, checks and Data Quality
Automation scenarios
Production deployments and bundles
API Node & API Deployer: Real-time APIs
Governance
APIs
Python APIs
R API
Public REST API
Additional APIs
Installation & Administration
Installing and setting up
Elastic AI computation
DSS in the cloud
DSS and Hadoop
Metastore catalog
Operating DSS
Security
User Isolation
Email Notifications
Other topics
Plugins
Streaming data
Formula language
Custom variables expansion
Sampling methods
Accessibility
Troubleshooting
Release notes
Other Documentation
Third-party acknowledgements
Dataiku DSS
You are viewing the documentation for version
13
of DSS.
»
Generative AI and LLM Mesh
Open page in a new tab
Generative AI and LLM Mesh
¶
Introduction
Dataiku Generative AI Capabilities
Using the LLM Mesh
LLM connections
Hosted LLM APIs
Locally-running HuggingFace models
Running Hugging Face models
Cautions
Pre-requisites
Configuring a text generation model
Test
The model cache
The Prompt Studio
Adding Knowledge to LLMs
Introduction to Knowledge and RAG
Initial setup
Your first RAG
Working with Vector stores
Advanced Search
Embedding and searching documents
RAG guardrails
GraphRAG
Chat UI
Answers
Agent Connect
Building Agents
Introduction to Agents in Dataiku
Visual Agents
Code Agents
Managed tools
Tracing
Guardrails
Introduction to guardrails
PII detection
Prompt injection detection
Toxicity detection
Topics Boundaries
Bias Detection
Custom Guardrails
LLM Mesh API
Multimodal capabilities
Image input
Image output
Fine-tuning
Setup
Using the Fine-tuning recipe
Using Python code
Cost Control
Concepts
Limitations
Setup
Evaluating GenAI use cases