The Role
Design, build and maintain scalable, observable end-to-end data pipelines on AWS. Ingest data from REST APIs, transform and load into data lakes/warehouses, implement orchestration and monitoring, and explain technical solutions to stakeholders.
Summary Generated by Built In
We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.
With over 8,000 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.
This position requires a hybrid work model (3x/week) at our office in Campinas, SP, Brazil.
Responsibilities:
- Build and maintain end-to-end data pipelines in AWS, often ingesting data from multiple REST APIs.
- Design reliable, observable, and scalable pipelines, with a strong focus on data quality and monitoring.
Explain and discuss the logic of your solutions with stakeholders, not just the tools used.
- Advanced English, comfortable explaining technical solutions in conversation.
- Proven experience as a Data Engineer
- Strong hands-on experience in Python (data processing, API integration, automation) and advanced SQL (CTEs, window functions, optimization).
- Solid experience designing, building, and maintaining data pipelines on AWS, including:
- Ingestion from REST APIs (authentication, pagination, rate limiting, error handling).
- Transformation and loading into data lakes / data warehouses.
- Orchestration (e.g. Step Functions, Glue Workflows, or similar).
- Strong hands-on experience with AWS Serverless and data ecosystem:
- Lambda, Glue (Glue Jobs / Glue Studio), DynamoDB, ECS/Fargate (if applicable).
- S3, IAM, CloudWatch (logs, metrics, alarms), Step Functions.
- Experience with PySpark or similar distributed processing frameworks (e.g. Spark on EMR/Glue).
- Experience in marketing data use cases (campaigns, events, customer 360, CDP).
- Experience with Adobe Experience Platform (AEP), especially CDP.
- Experience with event-based architectures (e.g. tracking events, customer journeys).
- Good understanding of Data Engineering fundamentals:
- Data modeling (dimensional and relational), data structures.
- ETL vs ELT, batch vs streaming workflows.
- Data quality, data governance, and data observability practices (monitoring, alerting, lineage).
- Familiarity with Git/GitHub and CI/CD workflows for data pipelines.
- Strong problem-solving mindset: Ability to clearly explain the logic behind the solution, trade-offs and troubleshooting steps.
- Strong communication skills and ability to collaborate with cross-functional teams.
#LI-AG4
#mid-senior
Our benefits:
-Health and dental insurance
-Meal and food allowance
-Childcare assistance
-Extended paternity leave
-Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;
-Profit Sharing and Results Participation (PLR);
-Life insurance
-Continuous learning platform (CI&T University);
-Discount club
-Free online platform dedicated to physical, mental, and overall well-being
-Pregnancy and responsible parenting course
-Partnerships with online learning platforms
-Language learning platform
And many more!
More details about our benefits here: https://ciandt.com/br/pt-br/carreiras
At CI&T, inclusion starts at the first contact. If you are a person with a disability, it is important to present your assessment during the selection process. See which data needs to be included in the report by clicking here.This way, we can ensure the support and accommodations that you deserve. If you do not yet have the assessment, don't worry: we can support you in obtaining it.
We have a dedicated Health and Well-being team, inclusion specialists, and affinity groups who will be with you at every stage. Count on us to make this journey side by side.
Skills Required
- Advanced English, comfortable explaining technical solutions in conversation
- Proven experience as a Data Engineer
- Hands-on experience with Python for data processing, API integration, and automation
- Advanced SQL skills (CTEs, window functions, query optimization)
- Designing, building, and maintaining data pipelines on AWS
- Experience ingesting data from REST APIs (auth, pagination, rate limiting, error handling)
- Orchestration experience (Step Functions, Glue Workflows, or similar)
- Hands-on experience with AWS serverless and data ecosystem: Lambda, Glue (Jobs/Studio), DynamoDB, ECS/Fargate, S3, IAM, CloudWatch, Step Functions
- Experience with PySpark or similar distributed processing frameworks (Spark on EMR/Glue)
- Experience with data modeling, ETL/ELT patterns, data quality, governance, and observability (nice to have)
- Experience with marketing data use cases (campaigns, customer 360) (nice to have)
- Experience with Adobe Experience Platform (AEP) / CDP (nice to have)
- Familiarity with event-based architectures and tracking events (nice to have)
- Familiarity with Git/GitHub and CI/CD workflows for data pipelines (nice to have)
- Strong problem-solving mindset and ability to explain trade-offs and troubleshooting steps (nice to have)
- Strong communication skills and ability to collaborate with cross-functional teams (nice to have)
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
CI&T is your end-to-end digital transformation partner. As a digital native, we bring a 27-year track record of accelerating business impact through complete and scalable digital solutions. With a global presence of 6,000+ professionals in strategy, research, data science, design and engineering, we unlock top-line growth, improve customer experience and drive operational efficiency.
