Valid Databricks-Certified-Professional-Data-Engineer Dumps shared by EduDump.com for Helping Passing Databricks-Certified-Professional-Data-Engineer Exam! EduDump.com now offer the newest Databricks-Certified-Professional-Data-Engineer exam dumps, the EduDump.com Databricks-Certified-Professional-Data-Engineer exam questions have been updated and answers have been corrected get the newest EduDump.com Databricks-Certified-Professional-Data-Engineer dumps with Test Engine here:
A data engineer is creating a data ingestion pipeline to understand where customers are taking their rented bicycles during use. The engineer noticed that over time, data being transmitted from the bicycle sensors fails to include key details like latitude and longitude. Downstream analysts need both the clean records and the quarantined records available for separate processing. The data engineer already has this code: import dlt from pyspark.sql.functions import expr rules = { " valid_lat " : " (lat IS NOT NULL) " , " valid_long " : " (long IS NOT NULL) " } quarantine_rules = " NOT({0}) " .format( " AND " .join(rules.values())) @dlt.view def raw_trips_data(): return spark.readStream.table( " ride_and_go.telemetry.trips " ) How should the data engineer meet the requirements to capture good and bad data?
Correct Answer: A
Databricks documents a quarantine pattern for Lakeflow Spark Declarative Pipelines in which you create a dataset containing both valid and invalid rows, add an is_quarantined flag based on your rule set, and then use that dataset for separate downstream processing paths. The documented pattern uses a boolean quarantine expression and preserves all rows while tracking quality metrics through expectations. ( Databricks Documentation ) Option A is the only choice that matches that documented design: it keeps all records, marks invalid rows with is_quarantined , and applies expectations to capture data quality metrics. Option B drops invalid rows, which fails the requirement to keep quarantined records available. Option C captures only bad rows and loses the clean path. Option D also drops invalid rows and therefore does not preserve both good and quarantined records for separate downstream use. ( Databricks Documentation ) ======