Operating Agent Management

This section covers various operations that you may need to perform during day-to-day usage of Agent Management.

• Agent Management global settings
  • Auditability
• dsscli tool
  • Running dsscli
  • dsscli vs dssadmin
  • Security-related commands
  • Jobs-related commands
  • Scenarios-related commands
  • Projects-related commands
  • Enterprise Asset Library-related commands
  • Datasets related commands
  • Managed folders related commands
  • Connections-related commands
  • Code env related commands
  • API services related commands
  • Code studio templates related commands
  • Controlling dsscli output
• The data directory
  • Finding the data directory
  • Main folders of the data directory
  • Dataiku Agent Management is using too much space on disk
  • Managing temporary files
• Backing up
  • Full Backup
  • Other Backup Methods
  • Restoring A Backup
  • Running An Automatic Backup
  • What Can Be Excluded From The Backup
  • Govern database
• Audit trail
  • Viewing the audit trail in Agent Management
  • Default storage of audit trail
  • Audit centralization and dispatch
  • The Agent Management Event Server
  • Configuration for API nodes
  • Audit data
  • Audit trail on Dataiku Cloud
• The runtime databases
  • Managing internally-hosted runtime databases
  • Externally hosting runtime databases
• Logging in Dataiku Agent Management
  • Introduction
  • Configuring log file rotation
  • Customizing log levels
• Dataiku Agent Management Macros
• Managing Dataiku Agent Management disk usage
  • Automating cleanup tasks through Dataiku Agent Management macros
  • Job logs
  • Scenario logs
  • Saved models
  • Analysis data
  • Temporary files
  • Caches
  • Exports
  • Pre-migration backups
  • On Dataiku Cloud
• Understanding and tracking Agent Management processes
  • supervisord
  • The backend
  • The JEKs
  • The FEKs
  • Jupyter notebook server
  • Jupyter notebook kernels
  • Python / R recipes processes
  • Spark recipes
  • In-memory machine learning
  • Webapps
  • The governserver
• Tuning and controlling memory usage
  • The backend
  • The JEK
  • The FEKs
  • Jupyter notebook kernels
  • Python and R recipes
  • SparkSQL and visual recipes with Spark engine
  • PySpark, SparkR and sparklyr recipes
  • In-memory machine learning
  • Webapps
  • API node
  • Govern node
• Using cgroups for resource control
  • Prerequisites
  • Recommended configuration (cgroups v2)
  • Recommended configuration (cgroups v1)
  • Additional details and examples
• Monitoring Agent Management
  • Concepts
  • Historizing metrics
  • Raising alerts
  • Uninstall monitoring integration
• HTTP proxies
  • When to configure HTTP proxies
  • About WebSocket
  • Configuring a global proxy to allow Agent Management to access external resources
• Agent Management license
• Compute resource usage reporting
  • Concepts
  • Enabling CRU generation and audit
  • Cluster-level reporting for Kubernetes jobs
  • Examples