About Metal Toad
Metal Toad is an Advanced AWS Consulting Partner that empowers organizations to innovate through artificial intelligence, cloud migration, cost optimization, and application modernization. We help our customers with their cloud adoption by providing architecture, migration, optimization, machine learning, and even 24/7 support. We are a professional services firm providing services in software engineering and the cloud. We do Technical consulting, Programming & Quality Assurance, DevOps, Applications, UX, Product management, and Project management.
To apply for this position, please submit your resume in English as a PDF.
Job Description
We are looking for a highly technical, hands-on Data Infrastructure Engineer to join our team. This is not a standard Data Engineering role; instead, you will focus on building robust, scalable Data Infrastructure platforms using Open Source software. Your primary mission is to deploy and manage high-performance data technologies—such as Apache Pinot, Apache Druid, and Trino—within a well-architected Amazon EKS environment.
You will work on pioneering, high-risk technical solutions, navigating complex customer environments to deliver cutting-edge infrastructure that pushes the boundaries of standard implementations.
Responsibilities
Key Responsibilities
- Infrastructure Implementation: Architect and deploy Open Source Data OSS (Trino, Spark, Pinot, Druid) on Amazon EKS.
- Hands-on Development: Maintain a 100% hands-on approach, utilizing IDEs, Git, and strict coding best practices to manage infrastructure as code.
- Problem Solving: Navigate complex customer hierarchies and technical landscapes to identify, propose, and implement bespoke solutions.
- Pioneering Work: Design and implement novel, high-risk solutions that have not been previously established.
- Collaboration: Act as a subject-matter expert in Open Source technologies, ensuring all builds are well-architected and production-ready.
QUALIFICATIONS REQUIRED
- Agree with our
Corporate Values Statement. - Believes in the company's mission: to help people.
- Believes in the principles of open source.
- Advanced to fluent English communication skills are essential for this role.
- Kubernetes/EKS: Deep expertise in Kubernetes and Amazon EKS is a must-have.
- Core Infrastructure Tooling: Proficiency in Terraform, Helm, Docker, and Karpenter.
- Data OSS Expertise: Minimum rating of 3 (on a 5-point scale) in deploying and managing Data OSS software, including Trino, Spark, or Pinot.
- Data Foundations: Strong familiarity with Data Lakes, Spark, and Hive architectures.
- Versatility: A demonstrated willingness to work with non-AWS and broad Open Source ecosystems.
- Soft Skills: High comfort level engaging with complex customer environments and an aptitude for high-stakes technical troubleshooting.
NICE TO HAVE
- Prior hands-on experience working with Fruitstand.
- Demonstrated history of contributing to or managing complex open-source projects in production environments.
Skills Required
- Submit resume in English as a PDF
- Agree with the Corporate Values Statement
- Belief in company mission (to help people) and open source principles
- Advanced to fluent English communication skills
- Deep expertise in Kubernetes and Amazon EKS
- Proficiency with Terraform, Helm, Docker, and Karpenter
- Experience deploying and managing Data OSS (Trino, Spark, Pinot, Druid) (minimum rating 3/5)
- Familiarity with Data Lakes and Hive architectures
- Willingness to work with non-AWS and broad open-source ecosystems
- Strong customer-facing troubleshooting and high-stakes technical problem-solving skills
- Prior hands-on experience with Fruitstand
- History of contributing to or managing complex open-source projects in production
What We Do
Metal Toad is a Cloud Partner who delivers AWS Machine Learning & Media Solutions. Not just an AWS managed services provider with a machine learning specialty, Metal Toad provides high quality consulting, development, application support, and managed services at an affordable rate via their hybrid onshore + nearshore North American & Brazilian team. We have helped develop award-winning consumer-facing applications for industry leaders like Sony, Daimler, Intel, the Golden Globes, Siemens Wind Power, ABC, NBC, DC Comics, Warner Brothers, & the Linux Foundation.
