Things You Wish You Had Known Earlier About Databricks Performance

Agenda:
11am: Intro – Rodney Joyce
11:05am: Speeding up Databricks – Gin Jia, Databricks Solutions Architect
11:45am: Q&A – Win an UberEats voucher for best question!

In this session Gin will cover practical techniques for diagnosing Databricks performance and Spark cluster’s performance issue and how to easily fix them.

He’ll explain how scale-up and scale-out impacts Databricks cluster’s job cost performance and demonstrate simple steps to achieve 10x-100x query performance with the new Spark 3.0.

Finally, he’ll deep dive into Delta Lake’s performance optimization technologies and share both best practices and things to avoid when using them

Meetup Host:

Data-Driven AI provides tailored end-to-end consulting services and solutions to help businesses transform their data into actionable insights and drive their business decisions.