Data Lake

Databricks Meetup - Enabling Self-Service Analytics & ML at Transport for NSW with Databricks

Enabling Self-Service Analytics & ML at Transport for NSW with Databricks

Leave a Comment / Databricks Meetup, Data Lake, Databricks, Delta Lake / ,
Avatar of Sofia Oropeza
Sofia Oropeza
Marketing and Sales Director @Data-Driven. I am a passionate professional who strives to deliver excellent customer service, solve problems using modern technology and deliver practical solutions under resource and time constraints.
Avatar of Sofia Oropeza
Latest posts by Sofia Oropeza (see all)

Enabling Self-Service Analytics & ML at Transport for NSW with Databricks Sydney Databricks Meetup – December 2020 In this business-focused Databricks Meetup, Shelby Ferson (Sr. Manager ANZ – Databricks), Sandeep Mathur (Program Manager – TfNSW) and Rodney Joyce (Practice Director – Data-Driven) discuss how Transport for NSW (TfNSW) leveraged Databricks to enable Self-Service Analytics and …

Enabling Self-Service Analytics & ML at Transport for NSW with Databricks Read More »

Delta Lake Performance

Databricks Performance: Fixing the Small File Problem with Delta Lake

Leave a Comment / Data Lake, Advanced, Delta Lake, Spark /
Avatar of Anjana Rupasinghege
Anjana Rupasinghege
Anjana Rupasinghege is the Technical Director and Lead
Architect at Data Driven, specialised in Cloud, Security, Data
and Analytics.

With a background in Azure modern data architecture, he
has over 15 years of experience working in Information
Technology in industries such as Government, Banking,
Telecommunication and Consulting.

Anjana Rupasinghege
Avatar of Anjana Rupasinghege
Latest posts by Anjana Rupasinghege (see all)

A common Databricks performance problem we see in enterprise data lakes are that of the “Small Files” issue.  One of our customers is a great example – we ingest 0.5TB of JSON and CSV data per day made of 5kb files which equates to millions of files a week in the data lake Raw zone. …

Databricks Performance: Fixing the Small File Problem with Delta Lake Read More »

Microsoft Azure Analytics - Unified Analytics Platform

Advanced Analytics with Microsoft Synapse – All you need to know – Series Overview

Leave a Comment / Azure Synapse, Advanced Analytics, Business Intelligence, Data Lake, Data Warehouse, Machine Learning, Service Review / , ,
Avatar of Rodney Joyce
Rodney Joyce
Azure-certified Data Architect with a focus on delivering business value and guiding customers through the maze of analytical architectures, design and implementation activities.

Experienced in setting up modern data platforms with advanced predictive analytic workloads. Brings strong people skills and a devops-centric, entrepreneurial approach to Enterprise software delivery.


Rodney Joyce
Avatar of Rodney Joyce
Latest posts by Rodney Joyce (see all)

This blog series about Microsoft Azure Synapse will start with a 10 000 foot overview about the data analytics service and take you from what it is and how to get started through to a technical deep-dive to kick the tires. It doesn’t matter if you are a CIO or business decision maker, IT Manager, …

Advanced Analytics with Microsoft Synapse – All you need to know – Series Overview Read More »

Subscribed! We'll let you know when we have new blogs and events...

Ok