Data Engineer Lead
Overview We are looking for a Lead Data Engineer who will help in implementing data analytics products using on-prem and cloud data platforms. Position Responsibilities:
As a Lead Data Engineer, you will:
• Design and build scalable, cloud-native data platforms for modern data engineering practices.
• Mentor and guide other engineers, sharing knowledge, reviewing code, and fostering a culture of curiosity, growth, and continuous improvement.
• Create robust, maintainable ETL/ELT pipelines that integrate with diverse systems and serve business-critical use cases.
• Lead by example—write high-quality, testable code and participate in architecture and design discussions with a long-term view in mind.
• Decompose complex problems into modular, efficient, and scalable components that align with platform and product goals.
• Support data governance and quality efforts, ensuring data lineage, cataloging, and access management are built into the platform.
• Participate in architectural discussions, iteration planning, and feature sizing meetings
SKILLS:
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem and cloud data platforms - databricks).
• High proficiency in using Python, Spark, Hadoop platforms & tools (Hive, Impala, Airflow, NiFi), SQL to build Big Data products.
• Hands-on experience with cloud data platforms such as databricks, snowflake (databricks preferred)
• Experience with orchestration/integration tools such as Apache Airflow, Apache NiFi, or Talend.
• Working knowledge of DevOps/CI-CD practices: version control (Git), automated testing, release pipelines, and observability.
• Strong problem-solving skills with the ability to debug complex data issues and communicate clearly with technical and non-technical stakeholders.
• Experience developing Java based applications is an added advantage
hybrid GDL offices techM
remote
Skills Required
- Strong hands-on experience building production-grade data engineering pipelines on Hadoop and cloud data platforms
- High proficiency with Python, Spark, Hadoop, Hive, Impala, Airflow, NiFi, and SQL
- Hands-on experience with Databricks or Snowflake cloud data platforms; Databricks preferred
- Experience with orchestration and integration tools such as Apache Airflow, Apache NiFi, or Talend
- Working knowledge of DevOps and CI/CD practices, including Git, automated testing, release pipelines, and observability
- Strong problem-solving and communication skills with technical and non-technical stakeholders
- Experience developing Java-based applications
What We Do
VALCE Talent Solutions is a recruitment agency and consulting firm specializing in IT talent acquisition and nearshoring, primarily in Mexico. They design customized solutions in IT talent and process optimization to help businesses scale intelligently and profitably. Their expertise focuses on specialized industries including Information Technology, Operations Management, and Supply Chain, providing end-to-end talent offerings to attract and retain top professional profiles.
