Senior Data Engineer, Scala
New York City, NY
Boston, MA
Los Angeles, CA
Denver, CO
Seattle, WA
San Francisco, CA
Hybrid Schedule (M/F remote, T/W/TH in-office)
At Magnite, we cultivate an environment of continuous growth and collaboration. Our work impacts what millions of people read, watch, and buy, and we’re looking for people to help us tackle that responsibility with creativity and focus. Magnite (NASDAQ: MGNI) is the world’s largest independent sell-side advertising platform. Publishers use our technology to monetize their content across all screens and formats including CTV / streaming, online video, display, and audio. Our tech fuels billions of transactions per day!
Magnite conducts 400+ billion ad request auctions daily carrying $450+ million of revenue annually. To stand out among competitors, Magnite strategically focuses on being the most efficient, highest scale independent exchange.
About this team:
The Core Data Engineering team sits within the data engineering group and maintains technical involvement across the applications and infrastructure that make up Magnite's data pipelines. Our pipelines collectively handle 400+ billion events per day and generate terabytes of data per hour across both cloud-based and on-prem infrastructure. This data underpins the various business lines - including client reporting, internal data science, account managers, and product + business teams - and as such we need to build systems that remain scalable and efficient at this volume of data while also ensuring data consistency and reliability. We value communication, discussion, and sharing of ideas to come to the best technical solutions to our large-scale data challenges. We are looking for people who want to get things done and value open collaboration (including constructive feedback when brainstorming). The team's mandate is technical development across the three platform-specific data engineering teams in the group. As such they get exposure to all aspects of our data engineering infrastructure and applications including Spark jobs, Java-based real-time event processing, and large-scale data warehousing.
In this role you will:
Get to work on handling internet-scale data problems
Help architect and build systems to process our data volume to empower all consumers
Have hands-on involvement across the group's various data pipelines and related systems for data delivery
Be a part of and promote our culture of collaboration and mentorship
Typical challenges we face in this role include:
Highly-scalable infrastructure: Our traffic has patterns with peak- and off-peak times and seasonal shifts, and our data infrastructure needs to be able to respond accordingly
Cost optimization: Improving profit margins by lowering the infrastructure cost basis through building efficient systems
Technical architecture considerations given various SLAs for data delivery
We’re looking for someone:
With 5+ years of software development experience with a BS/MS Computer Science or equivalent work experience
Who wants to take ownership. We are responsible for the entire software development lifecycle, from requirements gathering to production support
To engage in critical and creative thinking, and constructive brainstorming. We expect engineers to present and discuss tradeoffs to solve the problems we face.
With either existing experience designing and building systems that work with large-scale data volumes and data ingestion systems at scale in a cloud-first setting, OR established technical excellence with a desire to learn and crush the data engineering world
Our current tech stack:
Spark (batch + streaming) data pipelines, currently based both on Databricks and on-prem Spark infrastructure, primarily using Scala
Streaming event processing data pipeline, using Java
Terraform, Docker, Jenkins for CI/CD / infra / application deployment
Airflow for job orchestration
AWS-based cloud infrastructure including RDS, EC2, S3, Kinesis, ECS
Comprehensive Perks and Benefits:
Comprehensive Healthcare Coverage for You and Your Family from Day One
Generous Time Off
Holiday Breaks, Summer Fridays and Quarterly Wellness Days
Equity and Employee Stock Purchase Plan
Family-Focused Benefits and Parental Leave
401k Retirement Savings Plan with Employer Match
Disability and Life Insurance
Cell Phone Subsidy
Fitness and Wellness Reimbursement
Company Culture:
Community Service and Volunteer Events
Company-Matched Charitable Contributions
Wellness Coach and Mental Health Support
Career Development Initiatives and a Career Growth Framework
Culture and Inclusion Programs
Bonusly Peer-to-Peer Recognition Program
About Us
The world's leading agencies and brands trust our platform to access brand-safe, high-quality ad inventory and execute billions of advertising transactions each month. Anchored in bustling New York City, sunny Los Angeles, mile high Denver, historic London, and down under in Sydney, Magnite has offices across North America, EMEA, LATAM, and APAC.
Only candidates in the following states will be eligible for employment: AZ, CA, CO, FL, GA, ID, IL, MA, MI, MT, NE, NJ, NY, NC, OK, OR, PA, SC, TX, UT, VA, WA.
The base salary range for this position, across all United States geographies, is $150,000 - $170,000 per year. The upper portion of the salary range is typically reserved for existing employees who demonstrate strong performance over time.
Magnite is an Equal Opportunity Employer and does not discriminate against applicants due to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, sexual orientation or any other federal, state or local protected class.
Our Commitment: We aim to incorporate a wide range of voices into our Magnite culture, cultivating an environment where employees feel welcomed, cared for, and encouraged to freely share ideas. We are committed to employee growth, collaboration, inclusion, and innovation. We invest in Magnite’s local communities. We seek talent from all backgrounds to champion corporate values of seeing the big picture and being catalysts of change.
Want to learn more about us?
Check out our blog for Magnite announcements and Ad Tech industry news!
Recruiting Agency Notice
Magnite does not accept agency resumes and is not responsible for any fees related to unsolicited resumes.
Top Skills
What the Team is Saying
What We Do
Together, we power advertising that enables billions of people to stay informed, entertained, and connected. We introduce them to new ideas, products, and services that make their lives better. And we help media owners of all sizes realize their full potential.
That’s a lot — that’s the power of advertising. But it’s only possible with great technology. And that’s where Magnite comes in.
Magnite (NASDAQ: MGNI) is the world’s largest independent sell-side advertising platform. Publishers use our technology to monetize their content across all screens and formats including CTV, online video, display, and audio. Our tech fuels billions of transactions per day!
Why Work With Us
At Magnite, our work impacts what millions of people read, watch, and buy. We strive to cultivate an environment of continuous growth and collaboration. We’re seeking out individuals who share an alternative perspective, challenge the status quo, and aren’t afraid to raise the bar!
Gallery
Magnite Offices
Hybrid Workspace
Employees engage in a combination of remote and on-site work.
Magnite’s hybrid schedule includes two days worked remotely (Monday and Friday) and three days on-site (Tuesday, Wednesday and Thursday) in all offices. Our offices provide daily lunches, beverages, snacks, training, development, office events.
