Principal Data Engineer-R01570250

Posted 7 Days Ago
Be an Early Applicant
Ap Transco, Kalyan Nagar, Hyderabad, Telangana, IND
Hybrid
Expert/Leader
Information Technology
The Role
Designs and leads scalable AWS data platforms, ETL pipelines, real-time streaming, data migrations, and analytics infrastructure. The role uses services including EMR, Redshift, Athena, Kinesis, DMS, CloudFormation, and CloudWatch, while integrating Stibo Master Data Management solutions. Responsibilities include optimizing distributed data systems, ensuring security and data quality, mentoring engineers, leading technical reviews, and collaborating with enterprise application and analytics teams.
Summary Generated by Built In
Senior Tech Specialist, Applications & Platforms

Job requirements

    Experience Range: 7 to 10 years of experience in advanced AWS data engineering, including significant expertise in Master Data Management (MDM) with Stibo and designing large-scale data solutions Key Responsibilities:
  • Design and architect scalable data pipelines and solutions using AWS native services to support complex business requirements
  • Develop, implement, and optimize ETL processes leveraging AWS technologies such as EMR, Redshift, Athena, and DMS
  • Configure and manage real-time data streaming and ingestion frameworks utilizing Kinesis and Amazon API Gateway
  • Monitor, troubleshoot, and enhance data infrastructure performance using CloudWatch and Open Search
  • Automate deployment and infrastructure provisioning with CloudFormation and manage schema migrations using SCT
  • Lead the implementation and integration of Master Data Management (MDM) solutions using Stibo within enterprise data platforms
  • Collaborate with cross-functional teams to integrate data solutions with enterprise applications and analytics platforms
  • Ensure data security, quality, and compliance by implementing best practices and leveraging AWS security features
  • Lead technical reviews, mentor junior engineers, and drive adoption of emerging data technologies within the organization
  • Required Skills:
  • Advanced proficiency in AWS services including SNS, SQS, Amazon API Gateway, Athena, CloudFormation, CloudWatch, DMS, DynamoDB, EMR, Kinesis, Open Search, Redshift, SCT
  • Expertise in designing and managing data pipelines and ETL workflows on AWS
  • Strong experience with Spark using Scala for large-scale data processing
  • Hands-on experience with Oozie workflow scheduling and orchestration
  • Deep knowledge of real-time data streaming with AWS Kinesis
  • Proven ability to configure and optimize Amazon Redshift for analytics workloads
  • Experience with DynamoDB for NoSQL database solutions
  • Ability to automate infrastructure and deployments using AWS CloudFormation
  • Proficient in monitoring and logging with AWS CloudWatch
  • Skill in managing data migration and schema transformation using AWS SCT and DMS
  • Demonstrated expertise in implementing and integrating MDM solutions using Stibo
  • Preferred Skills:
  • Experience integrating AWS data solutions with third-party analytics and visualization tools
  • Proficiency in optimizing performance for large-scale distributed data systems
  • Knowledge of emerging AWS data services and staying current with industry best practices
  • Experience with Open Search for search and analytics use cases
  • Background in mentoring and leading engineering teams in cloud data projects
  • Familiarity with advanced data governance and data quality frameworks in MDM environments
  • Desired Qualifications:
  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline
  • AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect – Professional
  • Certification in Apache Spark or relevant big data technologies (preferred)

Skills Required

  • 7 to 10 years of experience in advanced AWS data engineering and large-scale data solutions
  • Significant expertise implementing and integrating Master Data Management solutions using Stibo
  • Advanced proficiency with AWS services including SNS, SQS, API Gateway, Athena, CloudFormation, CloudWatch, DMS, DynamoDB, EMR, Kinesis, OpenSearch, Redshift, and SCT
  • Experience designing and managing AWS data pipelines and ETL workflows
  • Strong experience with Apache Spark using Scala for large-scale data processing
  • Hands-on experience with Apache Oozie workflow scheduling and orchestration
  • Deep knowledge of real-time data streaming with AWS Kinesis
  • Experience configuring and optimizing Amazon Redshift for analytics workloads
  • Experience using DynamoDB for NoSQL database solutions
  • Ability to automate infrastructure and deployments using AWS CloudFormation
  • Proficiency in monitoring and logging with AWS CloudWatch
  • Skill managing data migration and schema transformation using AWS SCT and DMS
  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related discipline
  • Experience integrating AWS data solutions with third-party analytics and visualization tools
  • Proficiency optimizing large-scale distributed data systems
  • Knowledge of emerging AWS data services and industry best practices
  • Experience with OpenSearch for search and analytics use cases
  • Background mentoring and leading engineering teams in cloud data projects
  • Familiarity with advanced data governance and data quality frameworks in MDM environments
  • AWS Certified Data Analytics Specialty or AWS Certified Solutions Architect Professional
  • Certification in Apache Spark or relevant big data technologies

Brillio Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Brillio and has not been reviewed or approved by Brillio.

  • Healthcare Strength Healthcare is considered comprehensive, including medical coverage for employees and dependents alongside life, disability, and accidental death protections. Feedback suggests these protections are a core strength of the package.
  • Leave & Time Off Breadth Time-off options include paid leave and parental leave, with flexible or ‘flexible PTO’ approaches cited in some contexts. Feedback suggests this breadth helps support work-life balance when team norms permit usage.
  • Wellbeing & Lifestyle Benefits Wellbeing offerings span counseling, financial-management sessions, fitness programs, and travel insurance, plus region-specific extras like discounted IT hardware and work-from-home essentials. Feedback suggests these add-ons enhance perceived value beyond core insurance.

Brillio Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
2,676 Employees
Year Founded: 2014

What We Do

Brillio is the leader in global digital business transformation, applying technology with a human touch. We help businesses define internal and external transformation objectives, and translate those objectives into actionable market strategies using proprietary technologies. With 2600+ experts and 13 offices worldwide, Brillio is the ideal partner for enterprises that want to quickly increase their core business productivity, and achieve a competitive edge, with the latest digital solutions.

Similar Jobs

JPMorganChase Logo JPMorganChase

Client Data

Financial Services
Hybrid
Hyderabad, Telangana, IND
289097 Employees
Hybrid
Hyderabad, Telangana, IND
289097 Employees
Hybrid
2 Locations
289097 Employees
Hybrid
Hyderabad, Telangana, IND
289097 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account