Senior Data Engineer

PURPOSE:

We are looking for a highly skilled Python and Cloud Engineer with strong data engineering expertise to design, build, and maintain scalable, cloud-based solutions. The role involves close collaboration with clients and internal teams to deliver robust, high-quality data and application platforms. 

QUALIFICATIONS, SKILLS, AND EXPERIENCE:

• BS/MS in Computer Science or a related field. 
• Minimum of 5 years of relevant professional experience. 
• Strong expertise in Python, CI/CD pipelines, and AWS services. 
• Solid knowledge of data engineering concepts and SQL, particularly Postgres and Snowflake. 
• Experience with serverless data processing and cloud-native architectures. 
• Exposure to Google Cloud Platform (GCP) with a high-level understanding of services. 
• Experience developing Python APIs using frameworks such as FastAPI and Django. 
• Strong understanding of Git, Git Actions, and CI/CD best practices. 
• Knowledge of data storage and processing concepts including S3, partitioning, and data formats such as Parquet and Iceberg. 
• Proven client communication experience with strong communication skills. 
• Demonstrated team leadership and people management skills. 

KEY RESPONSIBILITIES: 

• Client Collaboration: Work closely with clients and prospects to gather, analyze, and define technical and business requirements. 
• Cloud Solution Development: Design, develop, and maintain scalable solutions using AWS services and serverless data processing. 
  
• Python Development: Build and maintain high-quality Python applications and services following best practices.
• CI/CD Implementation: Develop, manage, and optimize CI/CD pipelines using Git, Git Actions, and related tools. 
• Data Engineering & SQL: Write, optimize, and maintain complex SQL queries using Postgres and Snowflake. 
• Data Architecture: Apply data engineering best practices involving S3, partitioning strategies, and modern data formats such as Parquet and Iceberg. 
• Multi-Cloud Exposure: Leverage and contribute to GCP-based solutions where applicable. 
• API Development: Design and develop Python-based APIs using frameworks such as FastAPI and Django. 
• Team Leadership: Lead, mentor, and support team members while promoting collaboration and technical excellence. 
• Stakeholder Communication: Communicate clearly and effectively with stakeholders to ensure alignment and successful project delivery. 

A Culture of Belonging: At our core, we value diversity and inclusion. As an equal opportunity employer, we are dedicated to creating a workplace where every voice is heard, every person is respected, and everyone has the opportunity to succeed.