Media & Entertainment | Database Administration (DBA) Services

SoundCloud increases speed by 84% with Pythian’s on-demand database administration services

SoundCloud faced a significant bottleneck in database support, straining development and impacting their customer experience. Pythian provided on-demand database administration (DBA) services. With extensive Cassandra expertise, Pythian optimized their databases and enabled multi-datacenter migration—improving data availability, dramatically improving read latencies (250ms to 40ms), resulting in faster performance.

With Pythian as their database managed service partner, SoundCloud's teams were able to re-focus on strategic product development and customer experience.

Pythian's on-demand database management and administration (DBA) services helped SoundCloud achieve an 84% increase in system speed and efficiency.
84%

Speed increase

Pythian improved the read latencies, this allowed the SoundCloud team to provide internal customers the support they needed in a timely fashion.

40

Milliseconds

Pythian helped SoundCloud go from 250ms to 40ms—meaning faster performance and an enhanced customer experience for SoundCloud's internal and external users.

5X

Faster response times

With Pythian’s on-demand database administration service, SoundCloud improved their customer experience and response times.

Customer

Industry

Media & entertainment

Location

Berlin, Germany

Platform

Cassandra, DataStax
  

Overview

SoundCloud is one of the world's largest music and audio platforms, known for its diverse community and creator-centric mission—empowering artists and fans to connect and share through music. With over 100 million US listeners, the company aims to become the biggest social sound platform. SoundCloud is an artist-first platform empowering artists to build and grow their careers by providing them with the most progressive tools, services, and resources.

SoundCloud faced a significant bottleneck in database support, with individual teams struggling to manage their own databases and a central engineering team overwhelmed by complex issues. This strained development and production, ultimately impacting customer experience and internal responsiveness.

  

The challenge

SoundCloud’s production engineering team became bottlenecked

At SoundCloud, their IT teams had a split focus between product development and engineering and were responsible for the management of the databases that support their customer-facing application. The teams manage all aspects of their databases, including scaling, schema changes, query performance, optimization, outage planning, capacity planning—everything. Then, if something unusual came up—such as database performance problems or complications building a new database—they would consult their central team.

The central team, called Production Engineering, comprises the veterans who support other teams on specific projects within the company. They build tools to improve the efficiency of the relational databases, and are responsible for any customization that were needed for the environment. 

SoundCloud, like many rapidly growing companies, operated with a lean and agile technology team. While this approach worked well under normal circumstances, it created a significant challenge when unexpected database issues arose—bottlenecking development and customer experience. 

Their capacity-strapped teams struggled to respond quickly enough to customer needs, hindering their ability to provide timely support. While adding a team member could address minor capacity constraints, this solution proved unsustainable as SoundCloud's needs scaled. They faced the growing predicament of needing more support than their current model could provide, making it difficult to maintain responsiveness and customer satisfaction.

Decentralized database management burdens teams

Individual teams were responsible for building, running, and managing all aspects of their own databases.

Overwhelmed central support

Their team was suffering with performance bottlenecks, data inconsistencies, and security vulnerabilities.

Capacity constraints

SoundCloud's agile but lean technology team struggled when unexpected issues arose.

  

The solution

Pythian’s database administration services provided SoundCloud with elasticity to handle their fluctuating support needs

To facilitate immediate collaboration, Pythian and SoundCloud established a shared Slack channel, enabling on-demand communication and on-going database administration (DBA) support. This direct line of communication proved invaluable as SoundCloud's Production Engineering team faced capacity constraints and wasn’t able to respond to internal requests for assistance as quickly as required.

When database performance issues arose, SoundCloud turned to Pythian for database administration support for their Cassandra databases, leveraging the readily available experts within the shared Slack channel—easily able to address critical issues and maintain operational efficiency.

Pythian addressed SoundCloud's challenges with Cassandra Reaper by improving its performance and stability through anti-entropy repairs and a DataStax optimization report, which drastically enhanced internal latencies and cluster availability. Pythian boosted data availability for Cassandra clusters by provisioning a new datacenter while adhering to strict topological constraints.

Our team of Cassandra experts investigated the consistency levels in Cassandra, creating a report explaining how the DataStax Java driver for Cassandra could be optimized while using the multi-cluster.

On-demand database administration service and support

Pythian and SoundCloud established a shared Slack channel, enabling on-demand database administration support.

Optimized SoundCloud’s Cassandra performance with DataStax

We achieved this via anti-entropy repairs and a DataStax optimization report, significantly improving internal latencies and cluster availability.

Migrating Cassandra to a multi-datacenter architecture

Pythian increased data availability for a Cassandra cluster by helping provision a new datacenter.

“We tap into Pythian’s expertise and ask questions about how we should do things.”
Jake Maizel
VP of Infrastructure, SoundCloud
  

Technologies used

  • MySQL
  • Cassandra
  • DataStax
  

Key outcomes

SoundCloud achieved faster performance and improves customer experience

Pythian's Cassandra expertise became an extension of SoundCloud's Production Engineering team, significantly scaling their engineering capacity. This partnership enabled SoundCloud's internal teams to focus on more strategic initiatives rather than day-to-day database management.

Furthermore, Pythian implemented a DataStax optimization report, leading to higher data availability and a more reliable data infrastructure for SoundCloud. This proactive approach ensures consistent access to data and a better user experience by allowing potential issues to be identified and addressed before they impact users.

A key outcome of this collaboration was the dramatic improvement in read latencies. Pythian successfully reduced the 99th percentile read latencies from 250ms to just 40ms, directly translating to faster performance and an enhanced customer experience for SoundCloud's internal and external users.

Scaled engineering capacity

Partnering with Pythian has allowed SoundCloud’s teams to focus on more strategic initiatives, relying on Pythian for their Cassandra expertise to optimize their database performance.

Increased data availability

By implementing a DataStax optimization report, Pythian has enabled SoundCloud to achieve higher data availability.

Improved tail read latencies

Pythian improved the read latencies on the 99th percentile by 84%, allowing the SoundCloud team to provide internal customers the fast support.

“Pythian created a model where we could subscribe to hours over a period of time. The Pythian team is like an extension of our team. They’re like an on-tap consulting company.”
Jake Maizel
VP of Infrastructure, SoundCloud

Free up internal teams with Pythian’s database administration services

Explore our database administration services and discuss with our experts to find the most valuable solution for your organization.