The Role
As a Data Engineer, you will be part of a talented team of engineers responsible for the deployment and configuration of cloud resources to meet individual client business needs in AWS. Client engagements cover a wide variety of business requirements and require our engineers to adapt quickly and stay on top of recent cloud technology trends. Candidates should be able to identify and remediate issues within cloud-based systems, based on their knowledge of industry standards and best practices.
Responsibilities
Responsibilities
- Work with the team to evaluate business needs and priorities, liaise with key business partners and address team needs related to data systems and management
- Translate business requirements into technical specifications; establish and define details, definitions, and requirements of applications, components and enhancements
- Participate in project planning; identifying milestones, deliverables and resource requirements; tracks activities and task execution
- Generate design, development, test plans, detailed functional specifications documents, user interface design, and process flow charts for execution of programming
- Develop data pipelines / APIs using a variety of tools, including but not limited to Python, SQL, Spark and various AWS services
- Use an analytical, data-driven approach to drive a deep understanding of fast changing business
- Build large-scale batch and real-time data pipelines with data processing frameworks in AWS
- Moving data from on-prem to cloud and cloud data conversions
- Experience in data engineering with an emphasis on data pipelines, analytics and reporting
- Exposure to the AWS Cloud Platform
- Experience in SQL, data transformations, and troubleshooting across at least one database Platform (Redshift, Amazon RDS, Cassandra, Snowflake, PostgreSQL, Databricks, etc.)
- Experience in the design and build of data extraction, transformation, and loading processes by writing custom data pipelines
- Experience in a scripting languages such as Python
- Experience designing and building solutions utilizing various Cloud services such as EC2, S3, EMR, Kinesis, RDS, Redshift/Spectrum, Lambda, Glue, Athena, API gateway, etc.
- AWS Certification - Solutions Architect Pro or Data Specialty
- Machine Learning experience
- Advanced GenAI experience
Similar Jobs
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
We’re Protagona – an AWS Advanced Tier partner that helps industry leaders propel innovation with cutting-edge data solutions.
Exclusively focused on AWS, our expertise and bias for action equates to faster delivery, scalable systems, and cost-efficient outcomes for our customers. The cornerstone of our humanized delivery approach is co-innovation, ensuring your team receives as much attention as your technology.
We work with organizations of all sizes, ranging from startups to midsize organizations and Fortune 500 corporations. While our core focus is data, our expertise spans cloud acceleration, application modernization, data engineering, and DevOps & SRE