Databricks-Certified-Professional-Data-Engineer Exam Dumps | A data engineering team is in the process of converting their existing data pipeline to utilize Auto

<< Prev Question Next Question >>

Question 17/20

A data engineering team is in the process of converting their existing data pipeline to utilize Auto Loader for
incremental processing in the ingestion of JSON files. One data engineer comes across the following code
block in the Auto Loader documentation:
1. (streaming_df = spark.readStream.format("cloudFiles")
2. .option("cloudFiles.format", "json")
3. .option("cloudFiles.schemaLocation", schemaLocation)
4. .load(sourcePath))
Assuming that schemaLocation and sourcePath have been set correctly, which of the following changes does
the data engineer need to make to convert this code block to use Auto Loader to ingest the data?

A. The data engineer needs to change the format("cloudFiles") line to format("autoLoader")

B. There is no change required. The data engineer needs to ask their administrator to turn on Auto Loader

C. The data engineer needs to add the .autoLoader line before the .load(sourcePath) line

D. There is no change required. The inclusion of format("cloudFiles") enables the use of Auto Loader

E. There is no change required. Databricks automatically uses Auto Loader for streaming reads

Question 17/20

LEAVE A REPLY

Download PDF File