Data Engineer at Spotify
Boston, MA, US
What you'll do
Continuously design, develop, and test data-driven solutions
Work with state-of-the-art data processing frameworks and technologies
Help drive the company-wide advancement of Spotify’s data infrastructure, tooling and processes
Improve data quality through testing, tooling and continuously evaluating performance
Collaborate with software engineers, ML experts and others
Work in cross-functional agile teams to regularly experiment, iterate, and deliver on new product objectives with an end-to-end responsibility for your squad’s mission
Work from our office in Boston, Massachusetts


Who you are
You have a proven record of personally taking large data projects from ideation to implementation
You have experience architecting and operating large data pipelines
You know how to work with high volume heterogeneous data with distributed systems such as Hadoop
You are an expert in one or more higher level JVM-based data processing frameworks like Crunch, Scalding, Storm, Spark and Dataflow (not just Pig/Hive/BigQuery/other SQL-like abstractions)
You are knowledgeable about data modeling, data access, and data storage techniques
You care about agile software processes, data-driven development, reliability, and responsible experimentation
You are passionate about creating clean code and have a strong foundation in coding and building data pipelines
You preferably have worked on open source or other data related projects