Data Engineering Lead

 
Analytica is seeking a remote  to lead cloud data engineering implementations that support business intelligence, machine learning, data science and/or graph analytics on federal client projects.

The ideal candidate will be comfortable working hands-on with technical implementations as well as working directly with clients in both a consulting and delivery capacity. You must be able to tackle complex, enterprise cloud or on-premises software and technology projects.

Analytica has been recognized by Inc. Magazine as one of the fastest-growing 250 businesses in the US for 3 years. We work with U.S. government clients in health, civilian, and national security missions to build better technology products that impact our day-to-day lives. The company offers competitive compensation with opportunities for bonuses, employer-paid health care, training and development funds, and 401k match.

• Build and scale advanced cloud data pipelines that support effective data management, governance and sharing
• Build out data pipelines in AWS for data lakes and data warehouses.
• Implementing data pipelines, via a variety of tools including Amazon S3, AWS Glue, Amazon Textract, Amazon Comprehend, AWS Lambda, SQL and/or Python scripts, in the cloud to an existing data lake and data warehouse.
• Implement data pipelines, for batch and streaming data sources, from external feeds into a cloud-based data lake and eventually into data warehouses;
• Use AWS serverless components in the data pipeline architecture;

• US Citizen with the ability to secure US Federal Security Clearance

• Bachelor’s degree in Computer Science, Software Engineering or other technical field. Masters Degree a plus 

• Certifications in Databricks (Machine Learning, etc) strongly preferred 

• 8+ years of experience in designing and developing ETL processes and managing data pipelines

• 4+ years of experience with Databricks, including building and optimizing data pipelines using Databricks notebooks and clusters

• Experience using various AWS services, including AWS Glue, Amazon S3, and Amazon Redshift

• Experience designing, developing, and maintaining ETL pipelines, including data extraction, transformation, and loading processes

• Experience with AWS Glue Data Catalog for managing metadata, schema definitions, and data lineage

• Experience monitoring ETL job runs, identifying bottlenecks, and troubleshooting issues, including use of AWS CloudWatch

• Knowledge of performance optimization techniques for ETL jobs, such as partitioning, bucketing, and caching

• Ability to write Python code for ETL scripts and custom transformations

• Experience with Tableau, PowerBI, and/or SAS Viya business intelligence tools.

• Ability to effectively communicate in writing and orally with a wide range of audiences and maintain interpersonal relationships.

• Ability to work within time constraints and manage multiple tasks against critical deadlines. 

About ANALYTICA: Analytica is a leading consulting and information technology solutions provider to public sector organizations supporting health, civilian, and national security missions. The company is an award winning SBA 8(a) small business that has been recognized by Inc. Magazine each of the past three years as one of the 250 fastest-growing companies in the U.S. Analytica specializes in providing software and systems engineering, information management, analytics & visualization, agile project management, and management consulting services. The company is appraised by the Software Engineering Institute (SEI) at CMMI® Maturity Level 3 and is an ISO 9001:2008 certified provider.