Certified Data Engineer Professional Certification Exam Questions with AI Explanations

QUESTION: 57

Which REST API call can be used to review the notebooks configured to run as tasks in a multi-task job?

/jobs/runs/list
/jobs/runs/get-output
/jobs/runs/get
/jobs/get
/jobs/list

Answer(s): D

A Databricks job has been configured with 3 tasks, each of which is a Databricks notebook. Task A does not depend on other tasks. Tasks B and C run in parallel, with each having a serial dependency on task A.

If tasks A and B complete successfully but task C fails during a scheduled run, which statement describes the resulting state?

All logic expressed in the notebook associated with tasks A and B will have been successfully completed; some operations in task C may have completed successfully.
All logic expressed in the notebook associated with tasks A and B will have been successfully completed; any changes made in task C will be rolled back due to task failure.
All logic expressed in the notebook associated with task A will have been successfully completed; tasks B and C will not commit any changes because of stage failure.
Because all tasks are managed as a dependency graph, no changes will be committed to the Lakehouse until all tasks have successfully been completed.
Unless all tasks complete successfully, no changes will be committed to the Lakehouse; because task C failed, all commits will be rolled back automatically.

Answer(s): A

Reveal Solution Next Question

QUESTION: 59

A Delta Lake table was created with the below query:

Realizing that the original query had a typographical error, the below code was executed:

ALTER TABLE prod.sales_by_stor RENAME TO prod.sales_by_store

Which result will occur after running the second command?

The table reference in the metastore is updated and no data is changed.
The table name change is recorded in the Delta transaction log.
All related files and metadata are dropped and recreated in a single ACID transaction.
The table reference in the metastore is updated and all data files are moved.
A new Delta transaction log is created for the renamed table.

Answer(s): A

Reveal Solution Next Question

QUESTION: 60

The data engineering team maintains a table of aggregate statistics through batch nightly updates. This includes total sales for the previous day alongside totals and averages for a variety of time periods including the 7 previous days, year-to-date, and quarter-to-date. This table is named store_saies_summary and the schema is as follows:

The table daily_store_sales contains all the information needed to update store_sales_summary. The schema for this table is:

store_id INT, sales_date DATE, total_sales FLOAT

If daily_store_sales is implemented as a Type 1 table and the total_sales column might be adjusted after manual data auditing, which approach is the safest to generate accurate reports in the store_sales_summary table?

Implement the appropriate aggregate logic as a batch read against the daily_store_sales table and overwrite the store_sales_summary table with each Update.
Implement the appropriate aggregate logic as a batch read against the daily_store_sales table and append new rows nightly to the store_sales_summary table.
Implement the appropriate aggregate logic as a batch read against the daily_store_sales table and use upsert logic to update results in the store_sales_summary table.
Implement the appropriate aggregate logic as a Structured Streaming read against the daily_store_sales table and use upsert logic to update results in the store_sales_summary table.
Use Structured Streaming to subscribe to the change data feed for daily_store_sales and apply changes to the aggregates in the store_sales_summary table with each update.

Answer(s): C

Reveal Solution Next Question

QUESTION: 61

A member of the data engineering team has submitted a short notebook that they wish to schedule as part of a larger data pipeline. Assume that the commands provided below produce the logically correct results when run as presented.

Which command should be removed from the notebook before scheduling it as a job?

Cmd 2
Cmd 3
Cmd 4
Cmd 5
Cmd 6

Answer(s): E

Reveal Solution Next Question

QUESTION: 62

The business reporting team requires that data for their dashboards be updated every hour. The total processing time for the pipeline that extracts, transforms, and loads the data for their pipeline runs in 10 minutes.

Assuming normal operating conditions, which configuration will meet their service-level agreement requirements with the lowest cost?

Manually trigger a job anytime the business reporting team refreshes their dashboards
Schedule a job to execute the pipeline once an hour on a new job cluster
Schedule a Structured Streaming job with a trigger interval of 60 minutes
Schedule a job to execute the pipeline once an hour on a dedicated interactive cluster
Configure a job that executes every time new data lands in a given directory

Answer(s): B

Reveal Solution Next Question

QUESTION: 63

A Databricks SQL dashboard has been configured to monitor the total number of records present in a collection of Delta Lake tables using the following query pattern:

SELECT COUNT (*) FROM table

Which of the following describes how results are generated each time the dashboard is updated?

The total count of rows is calculated by scanning all data files
The total count of rows will be returned from cached results unless REFRESH is run
The total count of records is calculated from the Delta transaction logs
The total count of records is calculated from the parquet file metadata
The total count of records is calculated from the Hive metastore

Answer(s): C

Reveal Solution Next Question

QUESTION: 64

A Delta Lake table was created with the below query:

Consider the following query:

DROP TABLE prod.sales_by_store

If this statement is executed by a workspace admin, which result will occur?

Nothing will occur until a COMMIT command is executed.
The table will be removed from the catalog but the data will remain in storage.
The table will be removed from the catalog and the data will be deleted.
An error will occur because Delta Lake prevents the deletion of production data.
Data will be marked as deleted but still recoverable with Time Travel.

Answer(s): C

Reveal Solution Next Question

Databricks Certified Data Engineer Professional Certified Data Engineer Professional Dumps in PDF

Free Databricks Certified Data Engineer Professional Real Questions (page: 17)

QUESTION: 57

QUESTION: 58

QUESTION: 59

QUESTION: 60

QUESTION: 61

QUESTION: 62

QUESTION: 63

QUESTION: 64