AWS Data Engineer

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Job Profile - Senior Engineer AWS cloud

Exp - 6-10 years

Job Location – Bangalore

Responsibilities:
As a Data Engineer, you will be responsible implementing complex data pipelines and analytics
solutions to support key decision-making business processes in our client’s domain. You will
gain exposure to a project that is leveraging cutting edge AWS technology that applies Big Data
and Machine Learning to solve new and emerging problems for our clients. You will gain a
added advantage of working very closely with AWS Professional Services teams directly
executing within AWS Services and Technologies to solve complex and challenging business
problems for Enterprises.
 

Key responsibilities include:
- Work closely with Product Owners and AWS Professional Service Architects to understand
requirements, formulate solutions, and implement them.
- Implement scalable data transformation pipelines as per design
- Implement Data model and Data Architecture as per laid out design.
- Evaluate new capabilities of AWS analytics services, develop prototypes, and assist in drawing
POVs , participate in design discussions
Requirements
• Minimum 3 years’ experience implementing transformation and loading of data from a
wide variety of traditional and non-traditional sources such as structured, unstructured,
and semi structured using SQL, NoSQL and data pipelines for real-time, streaming,
batch and on-demand workloads
• At least 2 years implementing solutions using AWS services such as Lambda, AWS
Athena and Glue AWS S3, Redshift, Kinesis, Lambda, Apache Spark,
• Experience working with data warehousing data lakes or Lakehouse concepts on AWS
• Experience implementing batch processing using AWS Glue/Lake formation, & Data
Pipeline
• Experience in EMR/MSK
• Experience or Exposure to AWS Dynamo DB will be a plus
• Develop object-oriented code using Python, besides PySpark, SQL and one other
languages (Java or Scala would be preferred)
• Experience on Streaming technologies both OnPrem/Cloud such as consuming and
producing from Kafka, Kinesis
• Experience building pipelines and orchestration of workflows in an enterprise
environment using Apache Airflow/Control M
• Experience implementing Redshift on AWS or any one of Databricks on AWS, or Snowflake on AWS
• Good understanding of Dimensional Data Modelling will be a plus.
• Ability to multi-task and prioritize deadlines as needed to deliver results
• Ability to work independently or as part of a team
• Excellent verbal and written communication skills with great attention to detail and accuracy
• Experience working in an Agile/Scrum environment

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!