<< Prev Question Next Question >>
Question 43/47
You need to design a data pipeline to process large volumes of raw server log data stored in Cloud Storage.
The data needs to be cleaned, transformed, and aggregated before being loaded into BigQuery for analysis.
The transformation involves complex data manipulation using Spark scripts that your team developed. You need to implement a solution that leverages your team's existing skillset, processes data at scale, and minimizes cost. What should you do?
The data needs to be cleaned, transformed, and aggregated before being loaded into BigQuery for analysis.
The transformation involves complex data manipulation using Spark scripts that your team developed. You need to implement a solution that leverages your team's existing skillset, processes data at scale, and minimizes cost. What should you do?
