From the course: End-to-End Real-World Data Engineering Project with Databricks

Unlock this course with a free trial

Join today to access over 24,900 courses taught by industry experts.

Create a Databricks notebook to load the Silver layer: Order delta table

Create a Databricks notebook to load the Silver layer: Order delta table

From the course: End-to-End Real-World Data Engineering Project with Databricks

Start my 1-month free trial Buy for my team

Create a Databricks notebook to load the Silver layer: Order delta table

“

- [Instructor] Let's move to the third table. So I'm just, this time, creating another notebook. I call it Silverlayer_transactions_load. Like we did it in all of them, we just, first, create our table. I have already written the code to speed up this demonstration. You can find the same code into the exercise file attached with this course. So I create a table, Silverlayer orders table. Before this, let's add this line to use the current database as a globalretail_silver and execute. This will going to create a silver order table for us. I have already written the code to speed up this demonstration. You can find the same code into the exercise file attached with this course. Now, we need to run it for only the incremental, so we are, again, going to use the same way. We are going to get the last updated timestamp. Right now, our table at the start is empty, so it'll come none, and then we'll set this very old date. Otherwise, it'll pull the last updated timestamp from the table…

Contents