The Role
Design, develop, and optimize AWS data pipelines, ETL workflows, database architectures, and complex SQL processes. Build Python-based automation, integrate batch and real-time AWS services, and improve data warehouse performance. Monitor and troubleshoot cloud data workflows, resolve Hypercare support tickets, perform root cause analysis, and collaborate with application support teams. Preferred experience includes Athena, EMR, OpenSearch, CloudFormation, messaging services, Macie, Spark, DynamoDB, and Kinesis.
Summary Generated by Built In
Senior Data Engineer
Primary Skills
- Athena, SNS, SQS, CloudWatch, Macie, Spark - Scala, Kinesis, CloudFormation, EMR, Open Search, DynamoDB, Amazon API Gateway, SCT, Redshift, DMS, Oozie
Specialization
- AWS Data EngineerIng Advanced: Data Engineer
Job requirements
- Experience Range: With at least 2 to 4 years of hands-on AWS data engineering experience, including cloud-based data pipeline development. Key Responsibilities: 1. Design, develop, and optimize scalable data pipelines and ETL workflows using AWS services such as Glue, Lambda, Step Functions, and Redshift to support business analytics. 2. Implement and maintain robust database architectures, ensuring effective data modeling, normalization, and query optimization for high-volume analytics platforms. 3. Write, review, and optimize complex SQL queries for efficient data extraction, transformation, and loading across multiple AWS data stores. 4. Develop automation scripts and data engineering solutions using Python to streamline data ingestion, transformation, and cloud-native application processes. 5. Monitor, troubleshoot, and resolve technical issues in cloud-based data workflows, ensuring high availability and reliability of data services. 6. Collaborate with application support teams to resolve Hypercare tickets, providing technical guidance and root cause analysis for data-related issues. 7. Integrate AWS services such as S3, EventBridge, and Aurora to support real-time and batch data processing requirements. 8. Enhance data processing performance by implementing best practices in data warehousing and contributing to system performance tuning initiatives. Required Skills: 1. AWS Glue 2. AWS Lambda 3. AWS Step Functions 4. Amazon EventBridge 5. Amazon S3 6. Amazon Redshift 7. Amazon Aurora 8. Database design and data modeling 9. Complex SQL query development 10. Python programming for data engineering and ETL automation 11. AWS CloudWatch for monitoring and alerting 12. Data warehousing concepts and performance tuning Preferred Skills: 1. AWS Athena 2. AWS EMR 3. AWS OpenSearch 4. Infrastructure-as-code tools such as CloudFormation 5. Amazon SNS and SQS for messaging and event-driven architectures 6. AWS Macie for data security 7. Spark (Scala) and big data processing frameworks 8. Amazon DynamoDB and Amazon Kinesis for data streaming and storage Desired Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline 2. AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect – Associate certification 3. Certification in Python programming or data engineering such as Python Institute PCAP or equivalent Additional Information: Application support, management, and development responsibilities; strong technical knowledge required. Resolve Hypercare tickets as part of ongoing support.
Skills Required
- 2 to 4 years of hands-on AWS data engineering experience, including cloud-based data pipeline development
- Experience developing scalable data pipelines and ETL workflows using AWS Glue, Lambda, Step Functions, and Redshift
- Experience with database design, data modeling, normalization, and query optimization
- Complex SQL query development for data extraction, transformation, and loading
- Python programming for data engineering and ETL automation
- Experience with AWS CloudWatch monitoring and alerting
- Knowledge of data warehousing concepts and performance tuning
- Experience integrating Amazon S3, EventBridge, and Aurora for batch and real-time processing
- Ability to monitor, troubleshoot, and resolve cloud-based data workflow issues
- Ability to collaborate with application support teams and resolve Hypercare tickets
- AWS Athena experience
- AWS EMR experience
- AWS OpenSearch experience
- Infrastructure-as-code experience with CloudFormation
- Experience with SNS, SQS, Macie, Spark with Scala, DynamoDB, or Kinesis
- Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or a related discipline
- AWS Certified Data Analytics Specialty or AWS Certified Solutions Architect Associate certification
- Python programming or data engineering certification, such as PCAP or equivalent
Brillio Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Brillio and has not been reviewed or approved by Brillio.
-
Healthcare Strength — Healthcare is considered comprehensive, including medical coverage for employees and dependents alongside life, disability, and accidental death protections. Feedback suggests these protections are a core strength of the package.
-
Leave & Time Off Breadth — Time-off options include paid leave and parental leave, with flexible or ‘flexible PTO’ approaches cited in some contexts. Feedback suggests this breadth helps support work-life balance when team norms permit usage.
-
Wellbeing & Lifestyle Benefits — Wellbeing offerings span counseling, financial-management sessions, fitness programs, and travel insurance, plus region-specific extras like discounted IT hardware and work-from-home essentials. Feedback suggests these add-ons enhance perceived value beyond core insurance.
Brillio Insights
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Brillio is the leader in global digital business transformation, applying technology with a human touch. We help businesses define internal and external transformation objectives, and translate those objectives into actionable market strategies using proprietary technologies. With 2600+ experts and 13 offices worldwide, Brillio is the ideal partner for enterprises that want to quickly increase their core business productivity, and achieve a competitive edge, with the latest digital solutions.
.jpeg)
