Our Client is one of the United States’ largest insurers, providing a wide range of insurance and financial services products with gross written premiums well over US$25 Billion (P&C). They proudly serve more than 10 million U.S. households with more than 19 million individual policies across all 50 states through the efforts of over 48,000 exclusive and independent agents and nearly 18,500 employees. Finally, our Client is part of one the largest Insurance Groups in the world.
Position Overview
We are seeking a skilled and self-driven AWS Data Engineer to design, develop, and maintain scalable data ingestion frameworks that support enterprise analytics and reporting. The ideal candidate will have deep expertise in AWS technologies, data lake architecture, and cross-functional collaboration to deliver high-quality data solutions.
Key Responsibilities
Data Ingestion & Framework Development
- Design, build, and maintain reusable, modular, and configuration-driven frameworks for ingesting both historical and incremental data from diverse sources into Iceberg tables on AWS S3.
- Expose ingested data to Snowflake via Snowflake external tables, ensuring seamless integration and accessibility.
- Implement robust logging mechanisms to monitor all data processes, ensuring completeness, timeliness, accuracy, and validity (ABC metrics).
- Configure automated notifications to alert support teams of process statuses and anomalies.
- Adhere to architectural standards and development best practices throughout the lifecycle.
Solution Design & Execution
- Translate complex business requirements into scalable and efficient technical solutions.
- Independently plan and execute the implementation of new data capabilities, including:
- Development of project plans with clear milestones and delivery timelines.
- Task breakdown, assignment, and management.
- Comprehensive documentation and tracking of work using Rally or equivalent tools.
- Identification and management of dependencies across cross-functional teams.
Cross-Team Collaboration
- Coordinate effectively with internal and external stakeholders, including:
- Cloud Operations
- Information Security
- Business Units
- Other Development Teams
- Facilitate alignment and secure commitment from partner teams to meet project deliverables and dependency timelines.
Proactive, Timely, Concise and Audience Appropriate Communication
- Communicates complex technical concepts to technical and non-technical personnel.
- Delivers routine progress and status to stakeholders.
- Communicates information in line with the target audience experience, background, and expectations; uses terms, examples, and analogies that are meaningful to the audience.
- Ensures accuracy of information communicated to effectively support project leadership decision making.
Continuous Improvement
- Proactively accumulates and maintains knowledge of current and emerging/evolving technologies, concepts, and trends in the IT field.
- Provides input on improving or enhancing existing organizational processes based on lessons learned and experiences from project work.
- Performs root cause analysis to quickly identify and resolve issues causing recurring technical problems.
Self-Driven Problem Solving & Initiative
- Demonstrates a high degree of independence and ownership in driving initiatives from concept to completion.
- Proactively identifies challenges and inefficiencies, and takes swift action to resolve them without waiting for direction.
- Navigates complex organizational structures to engage the right stakeholders and ensure timely delivery.
- Maintains a solution-oriented mindset, continuously seeking opportunities to improve processes, enhance collaboration, and deliver value.
Requirements
Professional Experience
- Minimum of 2–4 years of hands-on experience in data engineering within the AWS ecosystem.
- At least 4 years of total IT experience including demonstrated success as a software developer.
- Full English Fluency
Technical Proficiency
- Data Processing & Orchestration: Spark, AWS Glue, AWS Step Functions, and EMR. (MUST)
- Storage & Lakehouse Architecture: S3, Iceberg, and Snowflake External Tables.
- Security & Access Management: IAM and Lake Formation.
- Monitoring & Logging: CloudWatch for operational visibility and alerting.
- Development & Automation: Python & Jenkins programming skills and experience with CI/CD pipelines for automated deployment and testing.
- Architecture & Design: Understanding of data lake and lakehouse architectures, modular and configuration-driven development, and scalable ingestion frameworks.
- Cloud certifications.
- Good exposure to Agile software development and DevOps practices such as Infrastructure as Code (IaC), Continuous Integration and automated deployment.
- Strong practical application development experience on Linux and Windows-based systems.
Collaboration & Communication
- Proven ability to work independently and collaboratively across cross-functional teams, with excellent verbal and written communication skills.
- Agile Methodologies: Familiarity with Agile development practices and tools such as Rally or similar project tracking systems.
- Experience working directly with customers, partners and third-party developers.
Benefits
This position comes with competitive compensation and benefits package:
- Competitive salary and performance-based bonuses
- Comprehensive benefits package
- Career development and training opportunities
- Flexible work arrangements (remote and/or office-based)
- Dynamic and inclusive work culture within a globally renowned group
- Private Health Insurance
- Pension Plan
- Paid Time Off
- Training & Development
About Capgemini
Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 340,000 team members in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group €22.5 billion in revenues in 2023.
Top Skills
What We Do
Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of 270,000 team members in nearly 50 countries. With its strong 50 year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group reported in 2020 global revenues of €16 billion.
.png)
