The Role
Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, and Snowflake. Collaborate with data scientists and analysts to support analytics and machine learning initiatives. Optimize data storage, performance, reliability, and cost. Implement data governance and security practices, troubleshoot pipeline issues, monitor systems, and recommend emerging technologies.
Summary Generated by Built In
Role: Sr Data Engineer
Location: Bangalore/Hyderabad/Mumbai/Gurgaon(Hybride)
Experience: 5+ Years
Role Summary
AuxoAI is seeking a skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have 5+ years of prior experience in data engineering, with a strong background in AWS (Amazon Web Services) Databricks and Snowflake technologies. This role offers an exciting opportunity to work on diverse projects, collaborating with cross-functional teams to design, build, and optimize data pipelines and infrastructure.
Responsibilities:
·Design, develop, and maintain scalable data pipelines and ETL processes leveraging AWS services such as S3, Glue, EMR, Lambda, Data bricks and Snowflake.
·Collaborate with data scientists and analysts to understand data requirements and implement solutions that support analytics and machine learning initiatives.
·Optimize data storage and retrieval mechanisms to ensure performance, reliability, and cost-effectiveness.
·Implement data governance and security best practices to ensure compliance and data integrity.
·Troubleshoot and debug data pipeline issues, providing timely resolution and proactive monitoring.
·Stay abreast of emerging technologies and industry trends, recommending innovative solutions to enhance data engineering capabilities.
Requirements:
·Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
·5+ years of prior experience in data engineering, with a focus on designing and building data pipelines.
·Proficiency in Data bricks, Snowflake, AWS services, particularly S3, Glue, EMR, Lambda, and Redshift.
·Strong programming skills in languages such as Python, Java, or Scala.
·Experience with SQL and NoSQL databases, data warehousing concepts, and big data technologies.
·Familiarity with containerization technologies (e.g., Docker, Kubernetes) and orchestration tools (e.g., Apache Airflow) is a plus.
Skills Required
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- 5+ years of experience in data engineering, focused on designing and building data pipelines
- Proficiency with Databricks, Snowflake, and AWS services including S3, Glue, EMR, Lambda, and Redshift
- Strong programming skills in Python, Java, or Scala
- Experience with SQL and NoSQL databases, data warehousing concepts, and big data technologies
- Familiarity with Docker, Kubernetes, and Apache Airflow
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
AuxoAI partners with enterprise leaders to build AI systems, enabling the creation of AI-first enterprises by moving from AI strategy to production-grade deployed systems in weeks.
