The Role
Design, build, and optimize enterprise-scale data pipelines and modern data platforms. Develop ETL/ELT workflows with Python, PySpark, Scala, SQL, Informatica, Databricks, and cloud services. Manage databases, orchestration, streaming, containers, CI/CD, governance, and multi-cloud environments. Collaborate with BI teams, troubleshoot performance issues, and maintain technical documentation.
Summary Generated by Built In
We are looking for a highly skilled Lead Data Engineer / Architect to design, build, and optimize scalable data pipelines and modern data platforms. This role is critical in transforming raw data into meaningful insights and enabling enterprise-level analytics.
Key Responsibilities
- Design, develop, and optimize ETL/ELT pipelines using Python, PySpark, Scala, and SQL
- Build and manage data workflows using Informatica, Databricks, AWS Glue, Snowflake
- Work across multi-cloud platforms (AWS, Azure, GCP, Microsoft Fabric)
- Manage and optimize databases such as Redshift, SQL Server, AWS RDS
- Orchestrate workflows using Apache Airflow
- Implement real-time streaming solutions using Apache Kafka
- Deploy and manage containerized applications using Kubernetes
- Automate processes using Unix shell scripting
- Implement CI/CD pipelines and ensure data governance
- Collaborate with BI teams for Tableau, Looker, Power BI
- Troubleshoot and optimize performance of pipelines and queries
- Maintain technical documentation
Requirements
- Bachelor’s/Master’s degree in Computer Science or related field
- 7+ years of experience in Data Engineering
- Strong skills in Python, PySpark, Scala, SQL
- Experience with Informatica, Databricks, AWS Glue
- Expertise in Snowflake & Redshift
- Experience in AWS / Azure / GCP
- Experience with Apache Airflow
- Knowledge of Apache Kafka & Kubernetes
- Experience with CI/CD pipelines
- Exposure to BI tools (Tableau, Looker, Power BI)
Skills Required
- Bachelor's or Master's degree in Computer Science or a related field
- 7+ years of experience in Data Engineering
- Strong skills in Python, PySpark, Scala, and SQL
- Experience with Informatica, Databricks, and AWS Glue
- Expertise with Snowflake and Redshift
- Experience with AWS, Azure, or GCP
- Experience with Apache Airflow
- Knowledge of Apache Kafka and Kubernetes
- Experience with CI/CD pipelines
- Exposure to Tableau, Looker, or Power BI
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Cynosure Corporate Solutions is a human capital services company focused on helping clients align their people strategy with business goals. Its offerings include executive search, recruitment, training, temporary staffing, statutory compliance, and other HR-aligned services. The company says it works to understand client objectives and connect human-resource planning with those objectives, supporting organizations’ workforce needs through tailored talent and employment solutions.
.jpg)
