Analytica is seeking a Data Engineer to support one or more dynamic, long-term federal government enterprise data programs. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale AWS and/or Databricks based data environments. You will support designing, maintaining, automating and optimizing ETL operations ensuring data quality and efficient data management.
Responsibilities include (but not limited to):
- Design, build, and optimize scalable data solutions using a Medallion Architecture.
- Manage ingestion routines for processing multi-terabyte datasets efficiently for multiple projects simultaneously, where each project may have multiple workspaces.
- Integrate data from various structured and unstructured sources to enable high-quality business insights. Proficiency in data analysis techniques for deriving insights from large datasets.
- Implement effective data management strategies to ensure data integrity, availability, and accessibility. Identify opportunities for cost optimization in data storage, processing, and analytics operations.
- Montor and support user requests, addressing platform or performance issues, cluster stability, Spark optimization, and configuration management.
- Collaborate with the team to enable advanced AI-driven analytics and data science workflows.
Basic Qualifications:
- 5+ years of hands-on Data Integration experience creating and maintaining efficient scripts/data pipelines to clean, transform and ingest data from a variety of formats into database tables, data warehouses or data lake repositories.
- 3+ years of experience using SQL and Python to manipulate, profile and build data products
- Strong Experience building data pipelines using Databricks and/or AWS serverless components; using AWS Glue to build, maintain and monitor ETL jobs; using Python to implement ETL scripts and AWS Secrets Manager to manage credentials.
- Databricks and/or AWS Data Engineer Certification is strongly preferred.
- Proficient written, verbal, and client communication and presentation skills
- Must be US Citizen and be able to obtain and maintain a Public Trust security clearance
About ANALYTICA: Analytica is a leading consulting and information technology solutions provider to public sector organizations supporting health, civilian, and national security missions. The company is an award winning SBA 8(a) small business that has been recognized by Inc. Magazine each of the past three years as one of the 250 fastest-growing companies in the U.S. Analytica specializes in providing software and systems engineering, information management, analytics & visualization, agile project management, and management consulting services. The company is appraised by the Software Engineering Institute (SEI) at CMMI® Maturity Level 3 and is an ISO 9001:2008 certified provider.
Top Skills
What We Do
Analytica is an award-winning consulting and technology services provider that supports public-sector health, civilian, and national security. We specialize in data-driven solutions, which have been recognized by organizations such as NYU’s Governance Lab for driving public sector modernization and innovation. Analytica is an SBA Certified 8(a), HUBZone that has been honored as one of the 250 fastest-growing businesses in the U.S. for three consecutive years by Inc.
For information on the company visit: www.analytica.net
For exciting career opportunities visit: careers.analytica.net