Intro to Data Engineering in Databricks Flashcards

(5 cards)

1
Q

An end-to-end data engineering solution that empowers data engineers, software developers, SQL developers, analysts, and data scientists to deliver high-quality data for downstream analytics, AI, and operational applications.

A

Lakeflow

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

A set of efficient ingestion connectors that simplify data ingestions from popular enterprise applications, databases, cloud storage, message buses, and local files.

A

Lakeflow Connect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

A framework for building batch and streaming data pipelines using SQL and Python, designed to accelerate ETL development.

A

Lakeflow Declarative Pipelines

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

A workflow automation tool for Databricks that orchestrates data processing workloads. It enables coordination of multiple tasks within complex workflows, allowing for the scheduling, optimization, and management of repeatable processes.

A

Lakeflow Jobs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What does DAG stand for?

A

Directed
Acyclic
Graph

How well did you know this?
1
Not at all
2
3
4
5
Perfectly