Blog
/
How Spotify turned internal chaos into an industry standard

How Spotify turned internal chaos into an industry standard

Photo of Andrew Zigler
|
Blog_Transforming_developer_experience_2400x1256_5ae9d98cb6

When Tyson Singer joined Spotify as Head of Technology and Platforms, he inherited a challenge familiar to many engineering leaders: brilliant teams, ambitious goals, and a tangled web of dependencies held together by spreadsheets and institutional knowledge.

Spotify's rapid expansion in the 2010s, fueled by a microservices architecture and thousands of engineers, had outpaced its internal tooling. Manual tracking was no longer sustainable. The organization realized it had to move from ad-hoc spreadsheet tracking to a single, managed repository that could organize their entire software catalog.

What happened next didn't just transform Spotify’s internal operations, it redefined how the entire industry thinks about platform engineering. This article explores how Spotify moved from chaos to clarity, building the internal developer platform that eventually became Backstage (and later, Portal), and the cultural philosophies that made it work.

Scaling through internal developer platforms

The microservices revolution created a new problem where dependencies that were once resolved at build time in monolithic applications now had to be managed at runtime across distributed systems. For Spotify, operating at extreme scale with an autonomous culture, this meant engineers were frequently duplicating capabilities simply because they couldn't see what already existed.

To solve this, Spotify needed a system that provided visibility into components, dependencies, and ownership, but could also move as quickly as their team structures changed. The result was Backstage, an internal developer platform that became the foundation for the modern internal developer portal (IDP).

The decision to open-source Backstage was both strategic and practical. Spotify had learned painful lessons from past migrations (like replacing their internal system Helios with Kubernetes) and wanted to avoid future technical debt.

"We basically made the bet that it would be less expensive for us to share our solution, to make it the industry standard... than to try to go out and replace it at some point," Singer explains.

The bet paid off. Backstage became the industry standard, with 40% of contributions coming from the community, a rate far exceeding typical open-source projects.

Accelerating experience through extensibility

Spotify's developer experience strategy was rooted in solving both technical and cultural challenges. The platform needed to be more than just a catalog; it needed to be an ecosystem where engineers could contribute to their own tools. Singer identifies this participatory nature as the primary driver of adoption. By ensuring the platform was something everyone could contribute to, Spotify transformed engineers from passive users into active co-creators.

Through a plugin architecture, Backstage encouraged these internal contributions. This extensibility exploded during internal hack weeks. By the end of 2019, more than a hundred different plugins had emerged from across the organization, each solving specific team needs while contributing to the broader ecosystem.

This philosophy extended to onboarding. Spotify used golden paths, or formalized and standardized workflows, to indoctrinate new hires into best practices from day one. Tools like Soundcheck provided actionable insights, allowing teams to see where they deviated from quality standards and how to close the gap. This reduced ambiguity and fostered consistency without stifling the autonomy that defined Spotify's culture.

Metrics-driven experimentation with privacy

To measure effectiveness, Spotify embedded instrumentation deep into developer workflows, but with a crucial caveat. Data was always aggregated at the squad level or higher.

"We've always been super, super rigorous about saying when we collect metrics, we always represent them at the squad or higher level," Singer emphasizes. "We do not expose individual metrics... because that can change incentives and make people feel fearful."

This privacy-first approach allowed Spotify to optimize for "flow state" rather than surveillance. By combining quantitative data with qualitative feedback, they could run rigorous experiments on new tools.

For example, their internal AI Knowledge Assistant (AiKA) was tested extensively. The results were clear: a 47% reduction in internal support requests and 85% weekly active usage. These signals proved the tool was protecting developer focus by reducing interruptions, validating the investment before rolling it out broadly.

The blueprint for engineering culture

The journey from spreadsheets to Backstage (and now Portal) represents more than a technical evolution. It is a blueprint for how engineering organizations can scale culture alongside infrastructure.

By treating internal developer experience as a product, investing in extensibility, and maintaining rigorous privacy standards around metrics, Spotify created a platform that enables sustainable speed.

For engineering leaders facing similar challenges, the lesson is clear: chaos is inevitable at scale, but clarity is achievable through intentional platform investment. The goal isn't just to build a portal; it's to build a culture where the easiest way to do something is also the right way.

For more on how Spotify turned internal tools into industry standards, listen to Tyson Singer discuss these ideas in depth on the Dev Interrupted podcast.

andrewzigler_4239eb98ca

Andrew Zigler

Andrew Zigler is a developer advocate and host of the Dev Interrupted podcast, where engineering leadership meets real-world insight. With a background in Classics from The University of Texas at Austin and early years spent teaching in Japan, he brings a humanistic lens to the tech world. Andrew's work bridges the gap between technical excellence and team wellbeing.

Connect with

Your next read