Delta Lake is the optimized storage layer that provides the foundation for storing data and tables in the Databricks lakehouse.
Delta Lake is fully compatible with Apache Spark APIs, and was developed for tight integration with Structured Streaming, allowing you to easily use a single copy of data for both batch and streaming operations and providing incremental processing at scale1. Delta Lake supports upserts using the merge operation, which enables you to efficiently update existing data or insert new data into your Delta tables2. Delta Lake also provides time travel capabilities, which allow you to query previous versions of your data or roll back to a specific point in time3. References: 1: What is Delta Lake? | Databricks on AWS 2: Upsert into a table using merge | Databricks on AWS 3: [Query an older snapshot of a table (time travel) | Databricks on AWS] Learn more
1blob:https://www.bing.com/a746b4b4-48d0-4f44-9736-44d1ce0c4228learn.microsoft.com2blob:https://www.bing.com/525fbb0f-e02f-4a70-8085-22c065fe0ca0 medium.com3blob:https://www.bing.com/5cb5bd07-1008-4cf7-9fa3-42a5a689c7d5 slideshare.net4blob:https://www.bing.com/9a7e8352-30c1-4356-a73f-a7253b607ef7 docs.databricks.com5blob:https://www.bing.com/3f65cc27-d573-4810-b272-01238a431c03 github.com6blob:https://www.bing.com/334f6880-dfeb-4e61-bd9a-76efae0a2d01 key2consulting.com