Responsibilities:
- Design, implement, and maintain robust data infrastructure, including databases, data warehouses, and data lakes, to support our rapidly expanding data landscape. You will engage and lead initiatives that enhance our data capabilities and drive innovation.
- Develop, deploy, and test ETL pipelines for extracting, transforming, and loading data from various sources. You will ensure data quality and integrity, playing a key role in the accuracy of our analytical insights.
- Collaborate with data scientists and data engineers to integrate and test machine learning models within our data systems, ensuring smooth functionality and high performance. This aspect of the role provides an exciting opportunity to work at the intersection of data engineering and machine learning.
- Implement cutting-edge automation and orchestration tools to streamline data operations, minimize manual processes, and boost efficiency. Your contributions will significantly enhance our operational capabilities.
- Continuously assess and optimize data pipelines and infrastructure for performance, scalability, and cost-effectiveness. You will identify and resolve bottlenecks, ensuring that our systems can handle growing demands.
- Establish proactive monitoring and alerting mechanisms to detect and address potential issues in real time. Your vigilance will help maintain high availability and reliability of our data systems.
- Work closely with cross-functional teams—including data scientists, analysts, and software engineers—to understand evolving data requirements. You will be instrumental in delivering tailored solutions that align with business objectives.
- Create comprehensive documentation of data infrastructure, pipelines, and processes. Help us promote a culture of continuous improvement by sharing knowledge and best practices within the team.
Requirements:
- Top Secret with capability to obtain a CI Poly
- Security+ certification (or willingness to get certified within the first month)
- Associates degree or higher in engineering, computer science, or related field and 5+ years of experience as a DevOps/Cloud/Software engineer -OR- 8+ years of experience as a DevOps/Cloud/Software engineer
- Proficiency in programming languages such as Python, Java, or Scala.
- Strong experience with relational databases (e.g., PostgreSQL, MySQL) and big data technologies (e.g., Hadoop, Spark).
- Experienced with Elasticsearch and Cloud Search.
- Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Experience with data pipeline orchestration tools (e.g., Airflow, Luigi) and workflow automation tools (e.g., Jenkins, GitLab CI/CD).
- Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes) is a plus.
- Data pipeline management
- Proven experience maintaining production systems for external customers
- Experience working with Open Source Technologies such as Red Hat (OpenShift) and Linux/Unix
- Engaging with Data engineers in troubleshooting issues
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
Similar Jobs
What We Do
Get behind the scenes insights from startup tech teams: https://www.myhatchpad.com/newsletter/
hatch I.T. is a specialized technology consulting firm connecting software, product, and data engineers with tech startups in emerging tech markets. We offer customized models that transform the way early-stage and high-growth startups scale. Our flagship programs include:
- Scale – technical consulting and recruiting services for high-growth startups
- Stride – technical strategy and consulting for early-stage startups
- hatchpad – an online community platform connecting startup technologists to network, learn, and advance in their careers
In true startup fashion, our roots can be traced to a garage in Leesburg, VA in 2013. While working with local startups, our Founder & CEO, Tim Winkler, realized that traditional staffing models didn’t align with the growth needs of startups. Working with those firms felt transactional and the costs were way outside a startup's budget. There was a need for a solution that was relational, community driven, and flexibly priced. With this in mind, hatch I.T. was formed, along with customized models that transform the way early-stage and high-growth startups scale.
Fast forward 8 years and 15 employees later, hatch has developed a platform that provides a roadmap to guide startups from MVP through all stages of growth. After proving this model with dozens of startups across DC, Maryland, & Virginia, we realized it was needed in all emerging startup markets.
If you’re a startup looking to grow your startup team, or an engineer looking for a career at an innovative tech company, connect with hatch I.T. today.
