Anjana Rupasinghege

Anjana Rupasinghege is the Technical Director and Lead Architect at Data Driven, specialised in Cloud, Security, Data and Analytics. With a background in Azure modern data architecture, he has over 15 years of experience working in Information Technology in industries such as Government, Banking, Telecommunication and Consulting.

Anjana Rupasinghege

Databricks Performance: Fixing the Small File Problem with Delta Lake

Leave a Comment / Data Lake, Advanced, Delta Lake, Spark / performance

A common Databricks performance problem we see in enterprise data lakes are that of the “Small Files” issue. One of our customers is a great example – we ingest 0.5TB …

Databricks Performance: Fixing the Small File Problem with Delta Lake Read More »

Anjana Rupasinghege

Databricks Performance: Fixing the Small File Problem with Delta Lake

Would you like to get insights from your data?

Sitemap

Get In Touch

Follow Us

Subscribed! We'll let you know when we have new blogs and events...