Data Engineer

Posted 3 Hours Ago
Hiring Remotely in US
Remote
Senior level
AdTech • Artificial Intelligence • Cloud • Edtech • Enterprise Web • Productivity • Software
Empowers the world to develop technology through collecting knowledge.
The Role
Design, build, and operate production data pipelines and shared data foundations using SQL, Python, PySpark, Databricks, and cloud technologies. Develop data models, ingestion and transformation workflows, resilient processing, observability, data-quality controls, and secure customer-aware data flows. Collaborate with engineering and product teams, evaluate architecture and tooling, support analytics and application services, contribute to testing and documentation, and mentor other engineers.
Summary Generated by Built In

Every developer has a tab open on Stack Overflow.  

We are one of the most popular websites in the world - a community-based space focused on increasing productivity, decreasing cycle times, accelerating time to market, and protecting institutional knowledge. 

Innovation is at the heart of everything we do. We embrace collaboration, transparency, and believe in leading with empathy; creating an environment where every Stacker knows they belong. We embrace that the unique contributions and points of view of all Stackers contribute to our success.

We are a Best Company to Work For, in addition to being recognized for Best Company Leadership, Best Company Happiness, Best Company Perks and Benefits, Best Company Work-Life Balance, Best Company Compensation, and Best Company Outlook.

We are a remote-first company with Hiring HUBs based in the US, Canada, UK, and Germany.

At Stack Overflow, our mission is to empower the world’s developers. Every day, millions of developers come to us to get answers to their programming questions, collaborate better with their teams, and find their next dream job. As the world continues to transform with technology as a leading force, we’re driven to make Stack Overflow a place where everyone who codes feels welcome to learn, share their knowledge, and build their careers.

We're looking for a Data Engineer to help design and deliver the data capabilities behind new application features, working closely with software engineers and product partners. We are trying to solve problems from scalable connections to bespoke external systems to crafting data contracts between services which reliably create product value.We believe in taking data and transforming it into consistent models, and making it available to application services securely and reliably.

You'll help shape how those systems work: how data is organized, how changes are processed, how pipelines recover when something fails, and how the architecture scales as we grow. You'll also support the shared data foundations used by analysts, data scientists, and  engineering teams. We measure success by making sure it is accurate, appropriately accessible, ready when the product needs it, and most importantly: provides value to our users.

What you'll do
  • Embed with engineering teams to turn application requirements into data models, pipeline designs, and clear interfaces between systems.
  • Design, build, and operate production data operations using SQL, Python, PySpark and cloud data technologies such as Databricks, integrating APIs, databases, and structured, semi-structured, and unstructured content.
  • Build ingestion and transformation workflows that deliver usable data to application services and downstream capabilities.
  • Design customer-aware data flows that preserve tenant boundaries, source permissions, and data lifecycle requirements, including updates, deletions, and regional constraints.
  • Make pipelines resilient through incremental processing, checkpointing, safe retries, backfills, replay, and data-quality checks.
  • Build observability that helps the team understand data freshness, completeness, processing progress, and failures across the pipeline.
  • Evaluate architecture and tooling choices against product needs, balancing reliability, performance, maintainability, and operating cost.
  • Maintain and improve shared datasets and pipelines that support both application features and internal analytics, avoiding unnecessary duplication of data and processing.
  • Contribute to design reviews, testing, documentation, and deployment practices. Share what you learn and mentor less experienced engineers.
Skills and requirements

We expect to see:

  • 5+ years of relevant engineering experience, including building and operating production data pipelines and contributing to their architecture.
  • Strong SQL and Python skills, with experience in relational databases, data modeling, and query optimization.
  • Experience integrating external APIs and working with changing schemas, imperfect source data, and incremental updates.
  • Experience applying software engineering practices to data systems, including version control, automated testing, code review, CI/CD tooling, observability logging and monitoring.
  • You love solving hard problems with  the ability to investigate issues across ingestion, transformation, and downstream delivery.
  • The ability to explain technical tradeoffs and collaborate with technical and non-technical stakeholders to deliver customer value through reliable, understandable, and maintainable solutions.
  • A track record of sharing knowledge and helping other engineers grow, along with the communication and self-direction needed to work effectively on a distributed team.
  • Experience with Azure/GCP and cloud data platforms such as Databricks, Apache Spark, Delta Lake, or comparable technologies.
Helpful, but not required
  • Experience building data systems for customer-facing applications, particularly multi-tenant products or integrations with third-party services.
  • Experience with document processing, knowledge systems, or pipelines that support AI-powered features.
  • Experience with access controls, data governance, regional data requirements, or customer-data retention and deletion.
  • Experience with event-driven processing, infrastructure as code, and monitoring or optimizing cloud workload costs.
  • Examples of work you're proud of, whether from a previous role, a personal project, open source, or contributions to the Stack Overflow community.

What you’ll get in return:

  • Competitive Base Salary 
  • Generous paid vacation
  • Generous parental leave, family care leave, and unlimited sick days
  • Industry-leading health benefits that are applicable per country of residence for all our full-time employees
  • Company-paid Life Insurance
  • Home Internet stipend
  • Professional allocation for your growth and development
  • One-time allowance to assist with your home office setup
  • Company-paid access to Calm, Prosus Academy and Overdrive

Stack Overflow is proud to be an equal opportunity workplace. We value diversity, inclusion, equity and belonging and these pillars are at the heart of how we work together here at Stack. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or any other applicable legally protected characteristics in the location in which the candidate is applying. 

For individuals based in California, and other locations where required, we will consider employment qualified applicants with arrest and conviction records.

Skills Required

  • 5+ years of relevant engineering experience, including building and operating production data pipelines and contributing to architecture
  • Strong SQL and Python skills
  • Experience with relational databases, data modeling, and query optimization
  • Experience integrating external APIs and handling changing schemas, imperfect source data, and incremental updates
  • Experience applying software engineering practices to data systems, including version control, automated testing, code review, CI/CD, observability logging, and monitoring
  • Ability to investigate issues across ingestion, transformation, and downstream delivery
  • Ability to explain technical tradeoffs and collaborate with technical and non-technical stakeholders
  • Track record of sharing knowledge and helping other engineers grow
  • Communication and self-direction for working effectively on a distributed team
  • Experience with Azure or GCP and cloud data platforms such as Databricks, Apache Spark, Delta Lake, or comparable technologies
  • Experience building data systems for customer-facing or multi-tenant products and third-party integrations
  • Experience with document processing, knowledge systems, or AI-powered feature pipelines
  • Experience with access controls, data governance, regional data requirements, or customer-data retention and deletion
  • Experience with event-driven processing, infrastructure as code, and monitoring or optimizing cloud workload costs
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, New York
514 Employees
Year Founded: 2008

What We Do

Stack Overflow is empowering the world to build for the future. More than 100 million people come to Stack Overflow every month making it one of the most-visited websites in the world. It’s best known for its public platform, which has attracted over 14 million users and helped developers and technologists over 50 billion times since its founding in 2008. Stack Overflow’s Reach & Relevance products include employer branding, content, and advertising, which help technology brands reach developers with content relevant to them. In 2017, Stack Overflow launched a private version of the public Q&A platform so enterprises can capture institutional knowledge, collaborate asynchronously, and boost efficiency across teams. Today, over 10,000 customers partner with Stack Overflow, including Bloomberg, Microsoft, Instacart, Chevron, Expensify, and eBay.

Why Work With Us

Every person we hire makes Stack Overflow an even better place to work. We foster an open and diverse work culture where everyone works together. We believe great ideas can come from anywhere and welcome anyone to champion ideas. We support a culture that’s open to trying new things and is constantly trying to learn from the things we build.

Gallery

Gallery

Similar Jobs

Optum Logo Optum

Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
Schaumburg, IL, USA
160000 Employees
113K-193K Annually

Capital One Logo Capital One

Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Remote or Hybrid
McLean, VA, USA
55000 Employees
209K-262K Annually

Atlassian Logo Atlassian

Data Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
Seattle, WA, USA
11000 Employees
47-64 Hourly

Samsara Logo Samsara

Data Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
99K-167K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account