Professional Data Engineer Free Practice Questions — Page 7
Question 60
You designed a data warehouse in BigQuery to analyze sales data. You want a self-serving, low-maintenance, and cost- effective solution to share the sales dataset to other business units in your organization. What should you do?
A. Create an Analytics Hub private exchange, and publish the sales dataset.
B. Enable the other business units’ projects to access the authorized views of the sales dataset.
C. Create and share views with the users in the other business units.
D. Use the BigQuery Data Transfer Service to create a schedule that copies the sales dataset to the other business units’ projects.
Show Answer
Correct Answer: A
Explanation: Analytics Hub is designed for self-service, low-maintenance, and cost-effective sharing of BigQuery datasets across teams. A private exchange allows publishers to share datasets centrally while consumers can subscribe without copying data. Authorized views (B) are useful for controlled access but require ongoing management of views and permissions, making them less self-service at organizational scale. Shared views (C) have similar maintenance drawbacks, and copying data with BigQuery Data Transfer Service (D) duplicates storage and increases maintenance and cost.
Question 61
You are designing a messaging system by using Pub/Sub to process clickstream data with an event-driven consumer app that relies on a push subscription. You need to configure the messaging system that is reliable enough to handle temporary downtime of the consumer app. You also need the messaging system to store the input messages that cannot be consumed by the subscriber. The system needs to retry failed messages gradually, avoiding overloading the consumer app, and store the failed messages after a maximum of 10 retries in a topic. How should you configure the Pub/Sub subscription?
A. Increase the acknowledgement deadline to 10 minutes.
B. Use immediate redelivery as the subscription retry policy, and configure dead lettering to a different topic with maximum delivery attempts set to 10.
C. Use exponential backoff as the subscription retry policy, and configure dead lettering to the same source topic with maximum delivery attempts set to 10.
D. Use exponential backoff as the subscription retry policy, and configure dead lettering to a different topic with maximum delivery attempts set to 10.
Show Answer
Correct Answer: D
Explanation: Exponential backoff gradually increases the delay between redelivery attempts, reducing the risk of overwhelming a temporarily unavailable or recovering push consumer. A dead-letter topic stores messages that still cannot be processed after the configured maximum delivery attempts. Setting the maximum delivery attempts to 10 satisfies the requirement to retry up to 10 times before routing failed messages to a separate topic.
Question 62
You have data located in BigQuery that is used to generate reports for your company. You have noticed some weekly executive report fields do not correspond to format according to company standards. For example, report errors include different telephone formats and different country code identifiers. This is a frequent issue, so you need to create a recurring job to normalize the data. You want a quick solution that requires no coding. What should you do?
A. Use Cloud Data Fusion and Wrangler to normalize the data, and set up a recurring job.
B. Use Dataflow SQL to create a job that normalizes the data, and that after the first run of the job, schedule the pipeline to execute recurrently.
C. Create a Spark job and submit it to Dataproc Serverless.
D. Use BigQuery and GoogleSQL to normalize the data, and schedule recurring queries in BigQuery.
Show Answer
Correct Answer: A
Explanation: Cloud Data Fusion with Wrangler is the Google Cloud no-code/low-code data preparation tool designed for visually cleaning and standardizing data. It supports building recurring pipelines without writing transformation code. The other options require SQL or programming (BigQuery scheduled queries, Dataflow SQL, Spark), which do not best satisfy the explicit 'requires no coding' requirement.
Question 63
You are part of a healthcare organization where data is organized and managed by respective data owners in various storage services. As a result of this decentralized ecosystem, discovering and managing data has become difficult. You need to quickly identify and implement a cost-optimized solution to assist your organization with the following:
• Data management and discovery
• Data lineage tracking
• Data quality validation
How should you build the solution?
A. Use BigLake to convert the current solution into a data lake architecture.
B. Build a new data discovery tool on Google Kubernetes Engine that helps with new source onboarding and data lineage tracking.
C. Use BigQuery to track data lineage, and use Dataprep to manage data and perform data quality validation.
D. Use Dataplex to manage data, track data lineage, and perform data quality validation.
Show Answer
Correct Answer: D
Explanation: Dataplex is Google Cloud's unified data fabric and data management service designed for decentralized data environments. It provides centralized data discovery and governance across storage systems, supports data lineage tracking, and includes built-in data quality capabilities, making it the most complete and cost-optimized managed solution. BigLake focuses on unified storage access rather than governance, building a custom GKE tool is unnecessary and costly, and BigQuery with Dataprep does not provide the integrated governance and lineage capabilities that Dataplex offers.
Question 64
You are administering shared BigQuery datasets that contain views used by multiple teams in your organization. The marketing team is concerned about the variability of their monthly BigQuery analytics spend using the on-demand billing model. You need to help the marketing team establish a consistent BigQuery analytics spend each month. What should you do?
A. Create a BigQuery Enterprise reservation with a baseline of 250 slots and autoscaling set to 500 for the marketing team, and bill them back accordingly.
B. Establish a BigQuery quota for the marketing team, and limit the maximum number of bytes scanned each day.
C. Create a BigQuery reservation with a baseline of 500 slots with no autoscaling for the marketing team, and bill them back accordingly.
D. Create a BigQuery Standard pay-as-you go reservation with a baseline of 0 slots and autoscaling set to 500 for the marketing team, and bill them back accordingly.
Show Answer
Correct Answer: C
Explanation: A fixed-capacity BigQuery reservation without autoscaling provides the most predictable monthly cost because you pay for a fixed number of reserved slots regardless of query volume. Option A introduces variable costs through autoscaling. Option B keeps on-demand pricing and merely caps usage, which can interrupt workloads rather than provide consistent spending. Option D also uses autoscaling, resulting in variable costs.
Question 65
You have thousands of Apache Spark jobs running in your on-premises Apache Hadoop cluster. You want to migrate the jobs to Google Cloud. You want to use managed services to run your jobs instead of maintaining a long-lived Hadoop cluster yourself. You have a tight timeline and want to keep code changes to a minimum. What should you do?
A. Move your data to BigQuery. Convert your Spark scripts to a SQL-based processing approach.
B. Rewrite your jobs in Apache Beam. Run your jobs in Dataflow.
C. Copy your data to Compute Engine disks. Manage and run your jobs directly on those instances.
D. Move your data to Cloud Storage. Run your jobs on Dataproc.
Show Answer
Correct Answer: D
Explanation: Dataproc is Google Cloud's managed service for Apache Spark and Hadoop workloads. Migrating data to Cloud Storage and running existing Spark jobs on Dataproc minimizes code changes while avoiding management of a long-lived Hadoop cluster, matching the requirements for a managed service and a tight migration timeline.
Question 66
You have a network of 1000 sensors. The sensors generate time series data: one metric per sensor per second, along with a timestamp. You already have 1 TB of data, and expect the data to grow by 1 GB every day. You need to access this data in two ways. The first access pattern requires retrieving the metric from one specific sensor stored at a specific timestamp, with a median single-digit millisecond latency. The second access pattern requires running complex analytic queries on the data, including joins, once a day. How should you store this data?
A. Store your data in BigQuery. Concatenate the sensor ID and timestamp, and use it as the primary key.
B. Store your data in Bigtable. Concatenate the sensor ID and timestamp and use it as the row key. Perform an export to BigQuery every day.
C. Store your data in Bigtable. Concatenate the sensor ID and metric, and use it as the row key. Perform an export to BigQuery every day.
D. Store your data in BigQuery. Use the metric as a primary key.
Show Answer
Correct Answer: B
Explanation: Bigtable is the appropriate choice for low-latency point lookups using a row key. A row key composed of sensor ID and timestamp efficiently supports retrieving a specific sensor's metric at an exact time with single-digit millisecond latency. BigQuery is designed for analytical workloads rather than low-latency key-based retrieval, so exporting the data daily from Bigtable to BigQuery satisfies the once-per-day complex analytics and join requirements.
Question 67
You work for a large ecommerce company. You store your customer's order data in Bigtable. You have a garbage collection policy set to delete the data after 30 days and the number of versions is set to 1. When the data analysts run a query to report total customer spending, the analysts sometimes see customer data that is older than 30 days. You need to ensure that the analysts do not see customer data older than 30 days while minimizing cost and overhead. What should you do?
A. Set the expiring values of the column families to 29 days and keep the number of versions to 1.
B. Use a timestamp range filter in the query to fetch the customer's data for a specific range.
C. Schedule a job daily to scan the data in the table and delete data older than 30 days.
D. Set the expiring values of the column families to 30 days and set the number of versions to 2.
Show Answer
Correct Answer: B
Explanation: Bigtable garbage collection is asynchronous and can take days after data expires before it is physically removed. Therefore, GC policies alone do not guarantee that reads exclude expired data. To ensure analysts never see data older than 30 days while minimizing cost and operational overhead, apply a timestamp range filter on read queries that matches the retention window. Changing the GC age or scheduling deletion jobs does not provide the same read-time guarantee.
Question 68
You are running a streaming pipeline with Dataflow and are using hopping windows to group the data as the data arrives. You noticed that some data is arriving late but is not being marked as late data, which is resulting in inaccurate aggregations downstream. You need to find a solution that allows you to capture the late data in the appropriate window. What should you do?
A. Use watermarks to define the expected data arrival window. Allow late data as it arrives.
B. Change your windowing function to tumbling windows to avoid overlapping window periods.
C. Change your windowing function to session windows to define your windows based on certain activity.
D. Expand your hopping window so that the late data has more time to arrive within the grouping.
Show Answer
Correct Answer: A
Explanation: Watermarks determine event-time progress and when windows are expected to be complete. If data arrives after the watermark, configuring allowed lateness enables those late elements to still be assigned to their correct event-time window and update aggregations. Changing the window type or simply enlarging hopping windows does not address late-event handling.
Question 69
You want to store your team’s shared tables in a single dataset to make data easily accessible to various analysts. You want to make this data readable but unmodifiable by analysts. At the same time, you want to provide the analysts with individual workspaces in the same project, where they can create and store tables for their own use, without the tables being accessible by other analysts. What should you do?
A. Give analysts the BigQuery Data Viewer role at the project level. Create one other dataset, and give the analysts the BigQuery Data Editor role on that dataset.
B. Give analysts the BigQuery Data Viewer role at the project level. Create a dataset for each analyst, and give each analyst the BigQuery Data Editor role at the project level.
C. Give analysts the BigQuery Data Viewer role on the shared dataset. Create a dataset for each analyst, and give each analyst the BigQuery Data Editor role at the dataset level for their assigned dataset.
D. Give analysts the BigQuery Data Viewer role on the shared dataset. Create one other dataset and give the analysts the BigQuery Data Editor role on that dataset.
Show Answer
Correct Answer: C
Explanation: Grant read-only access only to the shared dataset using the BigQuery Data Viewer role. Create a separate dataset for each analyst and grant each analyst the BigQuery Data Editor role only on their own dataset. This provides private workspaces while preventing modification of the shared dataset and preventing access to other analysts' personal datasets.
$19
Get all 332 questions with detailed answers and explanations
Instant download HTML + PDF delivered the moment payment clears.
Secure Stripe checkout we never see or store your card details.
7-day refund if files are defective see our refund policy.