The Role
Build and maintain large-scale data infrastructure and pipelines for analytics, ML, and real-time recommendations. Design, process, store, validate, and enrich data; develop APIs and high-load data services; implement infrastructure with Kubernetes and Terraform; write tests and automation for data validation and alerting; contribute to system architecture and promote data-driven decision-making across the organization.
Summary Generated by Built In
We are looking for a Data Engineer to join one of the Data Platform teams.
You will be working with cutting edge technologies (GCP, AWS, BigQuery, Kafka, K8s) and building a large scale data infrastructure for analytics, machine learning, and realtime recommendations.
You will be working with cutting edge technologies (GCP, AWS, BigQuery, Kafka, K8s) and building a large scale data infrastructure for analytics, machine learning, and realtime recommendations.
Key Responsibilities
- Foster a culture of working with data across the organization, ensuring data-driven decision-making
- Create and maintain a unified system for processing, storing, and validating data, ensuring data integrity and accessibility
- Design and build processes for processing and enriching data, participating in all stages of the data pipeline from data capture to consumer presentation
- Develop and maintain infrastructure for big data storage and processing using tools like Kubernetes (K8S) and Terraform
- Create and optimize APIs (REST, gRPC) for high-load data access services, enabling efficient data retrieval
- Write integration and unit tests, develop automation tools for data validation and alerting
- Сontribute to system design and architecture with the development team
Skills, Knowledge and Expertise
- Advanced proficiency in Python 3.7+ with strong experience in developing ETL processes using PySpark
- Proven experience in developing data flows using Airflow2
- High level of expertise in SQL, including complex queries and optimization
- Extensive knowledge and industrial experience with Kubernetes (K8S)
- Strong understanding of data processing algorithms and principles, with experience in Spark/Flink
- Solid understanding of general programming concepts, including design patterns, OOP, modularity, and pure architecture
- Demonstrated ability to take ownership of technologies or services and proactively contribute ideas to the team
Why join us
- Help us challenge injustice by creating fair choices for millions of people across 1100+ cities in 48 countries.
- Develop your professional skills with access to mentoring, career consulting, and learning programs.
- Collaborate with teams around the world and gain international experience through our Global Talent Exchange Program.
- Engage in company-wide challenges, awards, sports activities, employee-led social impact and volunteering projects.
- Work alongside people who take initiative, speak openly, and challenge themselves to grow.
- Improve your language skills through co-financed courses and internal speaking clubs.
- Annual salary from 49 100 EUR gross
Final benefits may vary depending on the location.
About
inDrive is a global tech company on a mission to challenge Injustice through fair choices. We started in 2012 in the coldest city on Earth, when a group of friends created a way for people to agree on fair ride prices. That idea grew into one of the world’s top ride-hailing apps, now with 400M installs across 48 countries.Today, we offer more than rides: from freight and delivery to intercity travel and financial services, all designed to put people first. We are committed to having a positive impact on people’s lives both through our core business, which supports local communities via a fair pricing model; and through the work of our impact programs. Ready to ignite your inner drive?
Skills Required
- Advanced proficiency in Python 3.7+ and developing ETL processes using PySpark
- Proven experience developing data flows using Airflow2
- High level of expertise in SQL, including complex queries and optimization
- Extensive knowledge and industrial experience with Kubernetes (K8S)
- Experience with big data processing frameworks Spark and/or Flink
- Experience with cloud platforms and services (GCP, AWS) and BigQuery
- Experience with messaging/streaming systems such as Kafka
- Experience with infrastructure-as-code tools such as Terraform
- Ability to create and optimize APIs for high-load data access (REST, gRPC)
- Ability to write integration and unit tests and develop automation for data validation and alerting
- Solid understanding of programming concepts including design patterns, OOP, modularity, and architecture
- Demonstrated ability to take ownership of technologies or services and proactively contribute ideas
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
inDrive is a global IT and transportation platform inDrive is one of the world’s fastest growing online ride-hailing services. Its services are available in over 749 cities in 46 countries throughout the world. The Company’s app has been downloaded over 150 million times. inDrive offers other services, including intercity transportation, freight and cargo services, as well as delivery services in different markets of operations. inDrive is based in Mountain View, California, and operates regional hubs in the Americas, Asia, the Middle East, Africa and the countries of the CIS, and employs over 2,000 people. In early 2021, inDrive achieved unicorn status after closing a $140m investment round with Insight Partners, General Catalyst, and Bond Capital, which valued the company at $1.23 billion.
