The Role
Designs, builds, and optimizes scalable batch and real-time data pipelines on GCP using Dataflow, Apache Beam, Java, and BigQuery. Integrates diverse data sources, improves pipeline performance and reliability, supports data governance and security, troubleshoots production issues, and collaborates with architects, analysts, DevOps, and business stakeholders.
Summary Generated by Built In
We are looking for a highly skilled Senior Data Engineer with strong expertise in Google Cloud Platform (GCP), Apache Beam/Dataflow, Java, and BigQuery. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and cloud-based data processing solutions for enterprise applications.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines using GCP services.
- Build and maintain real-time and batch data processing pipelines using Dataflow and Apache Beam.
- Develop robust backend processing solutions using Java.
- Work extensively with BigQuery for data warehousing, analytics, and performance optimization.
- Integrate data from multiple sources including APIs, databases, and streaming platforms.
- Optimize pipeline performance, cost, scalability, and reliability on GCP.
- Collaborate with cross-functional teams including Architects, Analysts, DevOps, and Business stakeholders.
- Ensure data quality, governance, monitoring, and security best practices.
- Troubleshoot production issues and provide long-term scalable solutions.
Requirements
- Strong hands-on experience with GCP services.
- Expertise in Google Dataflow / Apache Beam.
- Strong programming skills in Java.
- Hands-on experience with BigQuery.
- Experience in building batch and streaming data pipelines.
- Good knowledge of SQL and data modeling concepts.
- Experience with CI/CD, Git, and Agile methodologies.
- Strong problem-solving and debugging skills.
Good to Have
- Experience with Pub/Sub, Cloud Composer, Cloud Storage, Dataproc, or Kafka.
- Exposure to Python or Spark.
- Experience in handling large-scale enterprise data platforms.
Preferred Qualifications
- Bachelor’s/Master’s degree in Computer Science, Engineering, or related field.
- GCP certifications are an added advantage.
Skills Required
- Strong hands-on experience with Google Cloud Platform services
- Expertise in Google Dataflow and Apache Beam
- Strong programming skills in Java
- Hands-on experience with BigQuery
- Experience building batch and streaming data pipelines
- Knowledge of SQL and data modeling concepts
- Experience with CI/CD, Git, and Agile methodologies
- Strong problem-solving and debugging skills
- Experience with Pub/Sub, Cloud Composer, Cloud Storage, Dataproc, or Kafka
- Exposure to Python or Apache Spark
- Experience handling large-scale enterprise data platforms
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- GCP certification
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Cynosure Corporate Solutions is a human capital services company focused on helping clients align their people strategy with business goals. Its offerings include executive search, recruitment, training, temporary staffing, statutory compliance, and other HR-aligned services. The company says it works to understand client objectives and connect human-resource planning with those objectives, supporting organizations’ workforce needs through tailored talent and employment solutions.
.jpg)
