Data Lake • Data-Driven

Marketing and Sales Director @Data-Driven. I am a passionate professional who strives to deliver excellent customer service, solve problems using modern technology and deliver practical solutions under resource and time constraints.

Sofia Oropeza

Databricks Performance: Fixing the Small File Problem with Delta Lake

Leave a Comment / Data Lake, Advanced, Delta Lake, Spark / performance

About
Latest Posts

Anjana Rupasinghege

Anjana Rupasinghege is the Technical Director and Lead
Architect at Data Driven, specialised in Cloud, Security, Data
and Analytics.

With a background in Azure modern data architecture, he
has over 15 years of experience working in Information
Technology in industries such as Government, Banking,
Telecommunication and Consulting.

Anjana Rupasinghege

Latest posts by Anjana Rupasinghege (see all)

Databricks Performance:Fixing the Small File Problem with Delta Lake - August 24, 2020

A common Databricks performance problem we see in enterprise data lakes are that of the “Small Files” issue. One of our customers is a great example – we ingest 0.5TB …

Databricks Performance: Fixing the Small File Problem with Delta Lake Read More »

Advanced Analytics with Microsoft Synapse – All you need to know – Series Overview

Leave a Comment / Azure Synapse, Advanced Analytics, Business Intelligence, Data Lake, Data Warehouse, Machine Learning, Service Review / Analytics with Microsoft Synapse, Data LakeHouse, Unified Analytics

About
Latest Posts

Rodney Joyce

Azure-certified Data Architect with a focus on delivering business value and guiding customers through the maze of analytical architectures, design and implementation activities.

Experienced in setting up modern data platforms with advanced predictive analytic workloads. Brings strong people skills and a devops-centric, entrepreneurial approach to Enterprise software delivery.

Rodney Joyce