Senior Data Engineer

Posted 3 Days Ago
Hiring Remotely in USA
Remote
140K-175K Annually
Senior level
AdTech • Marketing Tech • Mobile • Social Media
The Role
Design, build, and optimize ETL pipelines and data platform architecture using Airflow, BigQuery, Python, and Spark. Lead technical decisions, mentor engineers, collaborate with product and stakeholders, and improve data-quality and testing frameworks to support data-driven products.
Summary Generated by Built In

About InMarket

Since 2010, InMarket has been the leader in 360-degree consumer intelligence and real-time activation for thousands of today's top brands. Through InMarket's data-driven marketing platform, brands can build targeted audiences, activate media in real time, and measure success in driving return on ad spend. InMarket's proprietary Moments offering outperforms traditional mobile advertising by 6x.* Our LCI attribution platform, which won the MarTech Breakthrough Award for Best Advertising Measurement Platform, was validated by Forrester to drive an average of $40 ROAS for our clients.

*Source: Wordstream US Google Display Benchmarks for Mobile Media

About the Role

We are looking for a talented Senior Data Engineer to join the team that builds the essential data infrastructure at the heart of InMarket's product suite. You should be a quick learner who is enthusiastic about learning new technologies, and a passionate engineer who empowers fellow engineers to write clean and efficient data pipelines. You will implement technical solutions to empower internal and external customers and scale the existing data platform, working closely with end users to define key business questions, leading fellow engineers to define technical solutions, and partnering with Product Managers to build the data sets that answer those questions. You will work with huge datasets and build ETLs that bring data together to answer business questions, drive reporting, and fuel growth.

Core Areas of Responsibility

Pipeline Development & Architecture

  • Design and implement ETL pipelines in Apache Airflow, BigQuery, Python, and Spark to transform upstream source data into curated data assets used across InMarket's data-driven products

  • Architect and plan projects involving highly distributed, high-performance data platform systems

  • Identify areas for improvement in existing pipelines and processes

  • Understand business requirements and convert them into technical solutions

Technical Leadership & Best Practices

  • Stay current with and advocate internally for Data Engineering best practices, technologies, and testing frameworks that shape InMarket's technical future

  • Provide technical guidance to other engineers to help grow their knowledge and technical capabilities

  • Lead fellow engineers in defining technical solutions to business problems

Cross-Functional Collaboration

  • Work closely with end users to define key business questions, and with Product Managers to build the data sets that answer them

  • Communicate complex concepts and analysis results clearly and effectively to Product and Engineering Managers

Impact & Success Indicators

In your first 90 days:

  • Onboard onto InMarket's data stack (Airflow, BigQuery, Python, Spark) and ship your first ETL pipeline improvement or fix

  • Build working relationships with Product Managers and engineering peers across the data team

  • Develop fluency in InMarket's existing data architecture and identify at least one improvement opportunity in current pipelines

  • Actively participate in code reviews and adopt the team's engineering best practices


In your first year:

  • Design and deliver end-to-end ETL pipelines that power one or more of InMarket's data-driven products

  • Serve as a technical mentor, raising the skill level and pipeline quality of fellow engineers

  • Lead architecture decisions for a highly distributed, high-performance data platform initiative

  • Establish or improve a testing and data-quality framework adopted across the team


We're Looking for Someone With

  • Strong SQL experience

  • Expertise in at least one data pipelining orchestration framework (Airflow, Luigi, etc.)

  • Experience building ETL pipelines

  • Strong software engineering skills in an object-oriented language such as Java or Python

  • Experience building and optimizing a data warehouse on a major cloud platform (BigQuery preferred but not required)

  • Deep understanding of Big Data technologies such as Hadoop and Spark

  • Experience building and optimizing large-scale, high-performance systems

  • Extensive knowledge of data-related tools and architecture concepts on a major cloud platform

  • Knowledge of Kubernetes, Docker, Airflow, Git, and CI/CD best practices

  • Strong collaboration and communication skills within and across teams

  • B.S. or M.S. in Computer Science or a related technical field

  • At least 4 years of software engineering experience, ideally in data engineering


Nice to have:

  • Experience optimizing BigQuery performance

  • Experience building a data governance platform in a regulated environment

  • Experience with various data testing frameworks and technologies

  • Familiarity with the digital media/advertising industry

Compensation & Benefits

For candidates in California, Colorado, New York City, Illinois, Minnesota, New Jersey, Vermont, Washington, and Massachusetts, the Targeted Base Salary Range for this role is $140,000 to $175,000.

Actual salaries will vary depending on factors including, but not limited to, work experience, specialized skills and training, performance in the role, business needs, and job requirements. Base salary is subject to change and may be modified in the future. Base salary is just one component of InMarket's total rewards package, which may also include bonuses, equity, and benefits. Ask your recruiter for more information!

Additional perks and benefits:

  • Competitive salary and stock options

  • Flexible vacation / Unlimited PTO (within reason)

  • Medical, dental, and Flexible Spending Account (FSA)

  • Company-matched 401(k)

  • Paid Paternity & Maternity Leave

  • Agile Development Program for continued learning and professional development

Equal Opportunity Employer

At InMarket, diversity is not just a value; it's the very essence of who we are. It's about recognizing and celebrating the unique perspectives each of us brings, from our colleagues to the communities we serve. We are committed to embracing the full spectrum of backgrounds, beliefs, abilities, and life experiences, knowing that this diversity strengthens us. At InMarket, our commitment to Diversity, Equity, and Inclusion means valuing each individual's unique contributions. Together, we thrive.

InMarket is an Equal Opportunity Employer (EOE). Qualified applicants are considered for employment without regard to age, race, color, religion, sex, national origin, sexual orientation, disability, or veteran status.

Privacy Notice for California Job Applicants: https://inmarket.com/ca-notice-for-job-applicants/

All applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment visa at this time.

#LI-Remote

Skills Required

  • Strong SQL experience
  • Expertise in at least one data pipelining orchestration framework (Airflow, Luigi, etc.)
  • Experience building ETL pipelines
  • Strong software engineering skills in an object-oriented language such as Java or Python
  • Experience building and optimizing a data warehouse on a major cloud platform (BigQuery preferred)
  • Deep understanding of Big Data technologies such as Hadoop and Spark
  • Experience building and optimizing large-scale, high-performance systems
  • Extensive knowledge of data-related tools and architecture concepts on a major cloud platform
  • Knowledge of Kubernetes, Docker, Airflow, Git, and CI/CD best practices
  • Strong collaboration and communication skills within and across teams
  • B.S. or M.S. in Computer Science or a related technical field
  • At least 4 years of software engineering experience, ideally in data engineering
  • Experience optimizing BigQuery performance
  • Experience building a data governance platform in a regulated environment
  • Experience with various data testing frameworks and technologies
  • Familiarity with the digital media/advertising industry
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Austin, TX
295 Employees
Year Founded: 2010

What We Do

InMarket is the leader in 360-degree consumer intelligence and real-time activation for thousands of major brands. Since 2010, InMarket has helped its partners to better understand who their customers are, why they make decisions and where to most effectively reach them. Through InMarket's location-based advertising suite, brands activate real-time digital advertising in the moments that matter, generating powerful results that outperform traditional digital advertising by 6.5x (Google Ads Mobile Benchmark for Average CTR, 2019). InMarket, awarded Best Mobile Marketing Platform at the 2019 Digiday Awards, has offices in Los Angeles, Bentonville, Chicago, and New York.

Similar Jobs

Optum Logo Optum

Senior Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
Minnetonka, MN, USA
160000 Employees
92K-164K Annually

Samsara Logo Samsara

Senior Data Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
134K-203K Annually

Cortex Logo Cortex

Senior Data Engineer

Productivity • Software
Remote
USA
90 Employees
175K-205K Annually

General Dynamics Information Technology Logo General Dynamics Information Technology

Senior Data Engineer

Aerospace • Information Technology • Professional Services • Security • Software
Remote
United States
21625 Employees
128K-173K Annually

Similar Companies Hiring

PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account