A Delta Live Table pipeline includes two datasets defined using streaming live table. Three datasets are defined against Delta Lake table sources…

In Delta Live Tables (DLT), when configured to run in Continuous Pipeline Mode, particularly in a

production environment, the system is designed to continuously process and update data as it

becomes available. This mode keeps the compute resources active to handle ongoing data

processing and automatically updates all datasets defined in the pipeline at predefined intervals.

Once the pipeline is manually stopped, the compute resources are terminated to conserve resources

and reduce costs. This mode is suitable for production environments where datasets need to be kept

up-to-date with the latest data.

Reference:

Databricks documentation on Delta Live Tables: Delta Live Tables Guide