The Role
Build and maintain large-scale data infrastructure for marketing analytics and realtime recommendations. Design ETL/data pipelines, storage, validation, APIs, and automation; contribute to system architecture and ensure data integrity and accessibility.
Summary Generated by Built In
We are looking for a Data Engineer to join one of the Data Platform teams that works with the Marketing, Growth, partner, and financial data domains.
You will be working with cutting edge cloud technologies (GCP, AWS, BigQuery, Databricks, K8s) and building a large scale data infrastructure for analytics, machine learning, and streaming/CDC data delivery.
You will be working with cutting edge cloud technologies (GCP, AWS, BigQuery, Databricks, K8s) and building a large scale data infrastructure for analytics, machine learning, and streaming/CDC data delivery.
Key Responsibilities
- Build and operate batch and streaming ingestion into a layered BigQuery DWH (raw → ODS → data marts) using Airflow, Debezium CDC over Kafka with protobuf, Pub/Sub, and Dataflow
- Integrate external data sources end-to-end — marketing platforms (GA4, AppsFlyer, TikTok/Meta/Google Ads), payment providers, S3 buckets, and third-party APIs — including schema contracts, backfills, and reconciliation
- Engineer the data platform itself in Python: custom Airflow operators and connectors in a shared ETL framework, Kafka Connect on Strimzi (K8s), Cloud Functions, and API integrations with external providers
- Build CI/CD and change-management tooling for BigQuery: GitHub-based test-and-approval flows, SQL migration engines (Liquibase/Flyway/Bytebase), sandbox validation, backup and rollback
- Own reliability and correctness of pipelines: idempotency, deduplication, late-data handling, backfill and replay, freshness monitoring and alerting; write integration and unit tests
- Drive data governance and compliance: ITGC-compliant change management for BigQuery, IAM and least-privilege access, PII policy tags and DLP, Unity Catalog on Databricks, column-level lineage (OpenMetadata/Dataplex), and disaster-recovery planning
- Build internal data tools and platform services for agentic workflows with data — Streamlit apps, Slack bots, LLM-based agents and MCP servers that help teams find and use data
- Support analysts and business teams with data requests, fostering data-driven decision-making across the company
- Contribute to system design and architecture with the development team
Skills, Knowledge and Expertise
- Strong practical Python: clean, well-structured, and tested code for services, tooling, and data pipelines
- Solid software design skills (OOP, modularity, design patterns) — we build platform tools for agentic workflows with data and plan to develop data-related backend services, so well-designed code is highly valued
- Experience building and operating services in a cloud environment (GCP, AWS or similar): CI/CD, containerization, monitoring and alerting
- Familiarity with Kubernetes and Terraform — our infrastructure runs on GCP/K8s
- Hands-on experience with DWH-related tasks (BigQuery or another cloud warehouse) and confident working SQL
- Clear communication with non-engineering stakeholders — a meaningful share of the work is data requests from analysts and business teams
- Demonstrated ability to take ownership of technologies or services and proactively contribute ideas to the team
Nice to have
- Advanced SQL: complex queries, window functions, partitioning, clustering, and cost optimization
- Experience building reliable pipelines around CDC (e.g., Debezium): idempotency, schema evolution, backfills, and reconciliation
- Analytical data modeling skills: table grain, facts vs dimensions, slowly changing dimensions, and metric definitions
- Experience with stream processing frameworks such as Flink or Apache Beam/Dataflow
- Exposure to data governance and audit compliance (ITGC/SOX), Databricks Unity Catalog, or lineage/catalog tooling (OpenMetadata, Dataplex)
- Interest in building LLM-based agents and AI tooling for data
Why join us
- Help us challenge injustice by creating fair choices for millions of people across 48 countries.
- Develop your professional skills with access to mentoring, career consulting, and learning programs.
- Collaborate with teams around the world and gain international experience through our Global Talent Exchange Program.
- Engage in company-wide challenges, awards, sports activities, employee-led social impact and volunteering projects.
- Work alongside people who take initiative, speak openly, and challenge themselves to grow.
- Improve your language skills through co-financed courses and internal speaking clubs.
Final benefits may vary depending on the location.
About
inDrive is a global tech company on a mission to challenge injustice through fair choices. We started in 2012 in the coldest city on Earth, when a group of friends created a way for people to agree on fair ride prices. That idea grew into one of the world’s top ride-hailing apps, now with 400M installs across 48 countries.Today, we offer more than rides: from freight and delivery to intercity travel and financial services, all designed to put people first. We are committed to having a positive impact on people’s lives both through our core business, which supports local communities via a fair pricing model; and through the work of our impact programs. Ready to ignite your inner drive?
Skills Required
- Advanced proficiency in Python 3.7+ and developing ETL processes using PySpark
- Proven experience developing data flows using Airflow 2
- High level of expertise in SQL, including complex queries and optimization
- Extensive production experience with Kubernetes (K8s)
- Experience with Spark and/or Flink and understanding of data processing algorithms
- Experience building and maintaining infrastructure with Terraform
- Experience creating and optimizing high-load APIs (REST, gRPC)
- Experience with cloud platforms and data services (GCP, AWS, BigQuery)
- Experience with messaging/streaming systems such as Kafka
- Ability to write integration and unit tests and develop automation for data validation and alerting
- Solid understanding of programming concepts, design patterns, OOP, modularity, and software architecture
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
inDrive is a global IT and transportation platform inDrive is one of the world’s fastest growing online ride-hailing services. Its services are available in over 749 cities in 46 countries throughout the world. The Company’s app has been downloaded over 150 million times. inDrive offers other services, including intercity transportation, freight and cargo services, as well as delivery services in different markets of operations. inDrive is based in Mountain View, California, and operates regional hubs in the Americas, Asia, the Middle East, Africa and the countries of the CIS, and employs over 2,000 people. In early 2021, inDrive achieved unicorn status after closing a $140m investment round with Insight Partners, General Catalyst, and Bond Capital, which valued the company at $1.23 billion.
