The Flow

In Dataiku DSS, the datasets and the recipes together make up the flow. We have created a visual grammar for data science, so users can quickly understand a data pipeline through the flow.

Using the flow, Dataiku DSS knows the lineage of every dataset in the flow. Dataiku DSS, therefore, is able to dynamically rebuild datasets whenever one of their parent datasets or recipes has been modified.

Dataiku DSS can limit the resource usage of jobs building datasets. Users can configure their recipes and administrators can configure Dataiku DSS to prevent some users, projects, recipes or plugins from consuming too many resources.

• Visual Grammar
  • Datasets
  • Visual Recipes
  • Machine Learning
  • Code Recipes
  • Plugin Recipes
• Flow zones
  • Use cases
  • Usage
  • Manual positioning
• Rebuilding Datasets
  • Build modes
  • Rebuild behavior
  • Propagate schema across Flow from here
• Inserting and deleting recipes
  • Inserting a recipe
  • Removing a recipe
• Limiting Concurrent Executions
  • Global and per-job limits
  • Per-recipe limits
  • Per-connection limits
  • Additional limits
• Exporting the Flow to PDF or images
  • Setup
  • Manual usage
  • Settings
• How to Manage Large Flows with Flow Folding
  • Folding and Unfolding a Flow
• Flow Document Generator
  • Generate a flow document
  • Custom templates
• Flow explanations
  • Generating project Flow explanations
  • Generating Flow zone explanations
  • Explanation options