Senior Developer (Azure, Databricks)

Posted 21 Days Ago
Be an Early Applicant
Hiring Remotely in United States of America
Remote
101K-183K Annually
Senior level
Information Technology • Software
The Role
The Senior Developer will lead a team in the full data management cycle, focusing on data ingestion, transformation, and visualization using Microsoft Azure tools. Responsibilities include advising teams, implementing data security, optimizing data performance, mentoring, and ensuring best practices in data governance and architecture.
Summary Generated by Built In

The Health Mission Solutions is seeking a Senior Developer, contingent upon contract award.

The Senior Developer will lead a small team of developers and work closely with the Program Manager, Data Architect, Cloud Operations Lead, data engineers, and data analysts to support multiple public health project teams in their full data management cycle including data ingestion, data cleansing, data transformation, data security, data exploration, and data visualization using Microsoft Azure tools and technologies. They include Databricks, SPARK Streaming, Azure SQL, Delta Lake, Azure Data Factory, HD Insights, and Notebook. This position requires hands on data centric development experience in an Azure cloud environment.

Specific roles & responsibilities for the Data Architect position include:

  • Advise, support, and coach project teams in ingesting data, creating data pipelines, selecting the appropriate Azure services, optimizing data storage, cataloguing data, enforcing technical & architectural standards, and troubleshooting development & production issues.
  • Design and implement data security measures to ensure PII/PHI data is protected from unauthorized access.
  • Create real time Dashboard in rapid development
  • Incorporate data governance into the solution design, which includes policies, procedures, and standards for managing and using data
  • Continuously optimize the performance of data pipelines in Databricks and Azure Data Factory (ADF).
  • Investigate and recommend new technologies to modernize the data pipeline process. Stay current on the latest advancements in data technologies.
  • Collaborate with customer SMEs on data projects to develop data pipeline architectures and strategies.
  • Mentor project teams and data engineers on best practices and new technologies.
  • Collaborate with data engineers, business analysts, and testers to drive agile development team to implement data architecture.
  • Actively lead/participate in the discovery/validation/verification process throughout the development life cycle.
  • Guide and lead other developers and actively engage in process improvement initiatives.
  • Identify, evaluate, and demonstrate solutions to complex system problems.
  • Design and develop documentation including procedures, process flow diagrams, work instructions, and protocols for processes.

Required Skills and experience

  • Bachelor degree from an accredited college in a related discipline, or equivalent experience/combined education, with 10+ years or more of professional experience; or 8+ years of professional experience with a related Master degree.
  • Proven software development experience on a large scale Azure Data Lake platform
  • Experience onboarding and managing multiple data pipelines of high complexity and processing millions of records per day
  • Experience working simultaneously with multiple data sources, entities submitting data daily to the datalake and deliver Technical Assistance to ensure successful operations.
  • Experience building Azure cloud-based ETL processes and data pipelines to automate data workflows in a rapid timeframe for emergency response
  • Experience implementing automated processes to QC data products and pipelines before data release, including de-duplication of data.
  • Experience in implementing Databricks unity catalog for the Lakehouse projects
  • Experience in handling and delivering big data analytics for daily users.
  • Strong prior experience with and expert knowledge of Databricks, Delta Lake, SPARK Streaming, Azure Synapse, Jupyter Notebooks, Microservices, Azure Function, Event Hubs, Logic Apps, Azure Kubernetes, Confluent Kalka, HD Insights, and Azure Data Factory
  • Prior experience integrating applications with AI/ML technologies including chatbots.
  • Ability to collaborate with and influence customer leadership and external teams on data initiative strategies.
  • Develop enterprise standards for Reference & Master Data Management, Data Quality, Data Integration and Data security.
  • Ability to present complex ideas and subject matter to stakeholders and customer leadership.
  • Proven experience working in a development environment following agile practices and processes.
  • Experience developing documentation including specifications, procedures, process flow diagrams, work instructions, and protocols for processes.
  • Proven experience with supporting highly critical customer missions.
  • Prior proven leadership experience.
  • Excellent verbal and written communication skills, including experience working directly with customers to discuss their requirements and objectives.
  • Proven experience in multi-tasking and managing efforts to the schedule.
  • Ability to learn and support new systems and applications.

Desired skills and experience

  • Working experience at CDC or other federal agencies
  • Experience with Azure DevOps and CI/CD pipelines.
  • Azure Data Engineer certification, Databricks Certified Data Engineer Associate certification, or similar certifications
  • Experience onboarding and managing 100+ data pipelines of high complexity and processing volumes of greater than 5M records per day.
  • Experience performing data linkage of terabytes of data using Privacy Preserving Record Linkage (PPRL)
  • Experience implementing and operationalize real time dashboards (DevOps, Program analytics) using enterprise BI tools including PowerBI, Tableau, RShiny.
  • Experience working with SAS Viya, Palantir Foundry, R, and/or python.
  • Experience with Transition-In to take over a large scale Azure based data lake platform
  • Experience with agile development process

Original Posting Date:2024-10-31

While subject to change based on business needs, Leidos reasonably anticipates that this job requisition will remain open for at least 3 days with an anticipated close date of no earlier than 3 days after the original posting date as listed above.

Pay Range:Pay Range $101,400.00 - $183,300.00

The Leidos pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.

Top Skills

Azure
Databricks
Spark
The Company
Alexandria, VA
27,104 Employees
On-site Workplace

What We Do

We Are Leidos

For 50 years we have been tackling some of the biggest problems that face our nation and our world.

OUR MISSION
Through our culture of innovation and history of performance, we develop deep customer trust built on integrity and create enduring solutions that improve our world. Leidos is a science and technology solutions leader working to address some of the world’s toughest challenges in the defense, intelligence, homeland security, civil, and healthcare markets. The company’s 43,000 employees support vital missions for government and commercial customers. Headquartered in Reston, Va., Leidos reported annual revenues of approximately $11.09 billion for the fiscal year ended January 3, 2020.

Leidos was cited for the meaningful work employees perform that is challenging, impactful, and aligned with our customers’ missions as reasons professionals want to work and stay at our company. Leidos has also been named to lists including Forbes’ Best Employers for Diversity, Forbes’ America’s Best Employers for Women, Military Times Best for Vets Employers, and Ethisphere Institute’s World's Most Ethical Companies®.

Employees enjoy career enrichment opportunities available through mobility and development and experience rewarding relationships with supportive supervisors and talented colleagues and customers. Employees appreciate our flexible work environment, allowing for and encouraging a true work-life balance. Our professionals are also excited about our Employee Resource Groups, like the newly launched Collaborative Outreach with Remote and Embedded Employees (CORE), which strives to create an environment where every employee, regardless of location, feels fully engaged as a valued employee of Leidos.

Your most important work is ahead.

Similar Jobs

Vannevar Labs Logo Vannevar Labs

Senior DevOps Engineer

Artificial Intelligence • Machine Learning • Software • Defense
Remote
USA
130 Employees

Peloton Logo Peloton

Vice President of Quality Assurance

Fitness • Hardware • Healthtech • Retail • Software
Easy Apply
Remote
United States
2500 Employees

Peloton Logo Peloton

Senior Hardware Test Engineer

Fitness • Hardware • Healthtech • Retail • Software
Easy Apply
Remote
United States
2500 Employees
103K-134K Annually

Crunchyroll Logo Crunchyroll

Staff Site Reliability Engineer - Data Engineering, Platform

Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
Remote
San Francisco, CA, USA
1200 Employees
191K-239K Annually

Similar Companies Hiring

bet365 Thumbnail
Software • Gaming • eSports • Digital Media • Automation
Denver, Colorado
6100 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account