Our Client is developing a high-volume Data Lake on Google BigQuery and expanding their data engineering team. We are seeking a Middle Data Engineer to contribute to data migration and pipeline development using modern GCP technology.
Job DescriptionIn this role, you will help build and maintain data pipelines, implement CDC processes, and support the migration from RDS to BigQuery. You’ll work independently while receiving direction from senior engineers and the Engineering Manager.
Working hours: 14:00–23:00
Responsibilities
- Lead the migration of data from RDS to Google BigQuery.
- Design, construct, test, and maintain highly scalable data management systems.
- Ensure systems meet business requirements and industry practices.
- Integrate new data management technologies and software engineering tools into existing structures.
- Work with messaging systems and data pipelines.
- Employ a variety of technologies and tools to marry systems together.
- Drive the improvements on data reliability, efficiency, and quality.
- 5+ years of hands-on experience with Google Cloud Platform, including: BigQuery, DataStream (CDC), Dataflow, Pub/Sub
- Strong Java development background.
- Experience with Spring Boot.
- Proven expertise in building CDC pipelines and distributed data processing systems.
- Track record of migrating large datasets from relational databases into BigQuery.
- Strong knowledge of automated testing (unit, integration, pipeline tests).
- Ability to work autonomously, make architectural decisions, and own end-to-end delivery.
Similar Jobs
What We Do
Miratech helps visionaries to change the world. We are a global IT services and consulting company that brings together global enterprise innovation and start-up innovation. Today we support digital transformation for the largest enterprises on the planet.
By partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and create technology that helps our clients further enhance their business. Our culture of Relentless Performance enables over 99% of Miratech’s engagements to succeed by meeting or exceeding scope, schedule and/or budget objectives since our inception in 1989.
