Databricks Databricks-Certified-Data-Engineer-Associate Question Answer
A data engineer is cleaning a Bronze table that receives the same customer records from multiple source systems. Duplicate rows have the same customer_id and email values but different ingestion_timestamp values. The Silver table should contain only one record for each unique combination of customer_id and email.
Which PySpark operation correctly deduplicates the records based on the business keys?

