Responsibilities:
- Collaborate with Artificial Intelligence and Machine Learning team members to operationalize data pipelines and ML tasks.
- Provide day-to-day support for deploying Python-native ML pipelines.
- Implement efficient data ingestion strategies and change data capture mechanisms, leveraging Databricks and AWS services, to ensure real-time and accurate data updates for analytics and decision-making processes.
- Utilize Databricks to design, develop, and maintain scalable data pipelines, enabling efficient extraction, transformation, and loading (ETL) processes.
- Leverage Python programming expertise to enhance data processing scripts, ensuring robustness, efficiency, and maintainability in AWS Lambda environments.
- Execute data engineering tasks to facilitate AI/ML capabilities.
- Communicate results effectively to diverse audiences through presentations.
- Assist in architectural leadership, technical support, and advisement services to ensure integration of identity management system technologies meets security requirements.
- Provide support to leadership engaging with senior-level executives at a public facing Federal agency, offering subject matter expertise in security architecture and other key domains.
- Identify and address problems and inefficiencies, implementing solutions.
- Identify and optimize data bottlenecks, leveraging automation where applicable.
- Establish and manage data lifecycle policies, including retention backups/restores
Requirements:
- US Citizenship with the ability to receive a Public Trust clearance or higher
- Must be eligible to obtain a Public Trust Clearance.
- Minimum 7 years of experience in Software Development focused on data proficiency in designing and maintaining data architectures to meet business needs.
- Experience in acquiring, processing, and optimizing datasets.
- Ability to support AI/ML teams by enhancing feature engineering code.
- Strong familiarity with Spark, including regular updates.
- Skilled in creating, managing, and optimizing Spark Structured Streaming jobs, leveraging technologies like Delta Live Tables and/or DBT.
- Competence in developing and managing ksqlDB and Kafka Streams queries/code.
- Experience maintaining and updating Python-based data processing scripts executed on AWS Lambdas.
- Commitment to conducting unit tests for all Spark, Python data processing, and Lambda code.
- Bachelor’s degree in computer science or a related field.
- Strongly preferred: candidates who live in an SBA HUBZone
Top Skills
What We Do
Get behind the scenes insights from startup tech teams: https://www.myhatchpad.com/newsletter/
hatch I.T. is a specialized technology consulting firm connecting software, product, and data engineers with tech startups in emerging tech markets. We offer customized models that transform the way early-stage and high-growth startups scale. Our flagship programs include:
- Scale – technical consulting and recruiting services for high-growth startups
- Stride – technical strategy and consulting for early-stage startups
- hatchpad – an online community platform connecting startup technologists to network, learn, and advance in their careers
In true startup fashion, our roots can be traced to a garage in Leesburg, VA in 2013. While working with local startups, our Founder & CEO, Tim Winkler, realized that traditional staffing models didn’t align with the growth needs of startups. Working with those firms felt transactional and the costs were way outside a startup's budget. There was a need for a solution that was relational, community driven, and flexibly priced. With this in mind, hatch I.T. was formed, along with customized models that transform the way early-stage and high-growth startups scale.
Fast forward 8 years and 15 employees later, hatch has developed a platform that provides a roadmap to guide startups from MVP through all stages of growth. After proving this model with dozens of startups across DC, Maryland, & Virginia, we realized it was needed in all emerging startup markets.
If you’re a startup looking to grow your startup team, or an engineer looking for a career at an innovative tech company, connect with hatch I.T. today.
.png)
