Overview

Digital Products and Services team members are responsible for securely managing information systems throughout their lifecycle, including knowing what information systems are within their scope of responsibility, understanding what sensitive data is stored, transmitted, or processed on those information systems, enforcing the security principles of least privilege and least functionality, knowing what events may constitute a cybersecurity incident, and understanding their role in security incident response activities.

The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. Come join a remarkable team where quality care meets quality service, in every dimension, every time.

#JoinTeamAubergine #NovantHealth Let Novant Health be the destination for your professional growth.

At Novant Health, one of our core values is diversity and inclusion. By engaging the strengths and talents of each team member, we ensure a strong organization capable of providing remarkable healthcare to our patients, families and communities. Therefore, we invite applicants from all group dynamics to apply to our exciting career opportunities.

Qualifications

• Education: 2 Year / Associate Degree, required. Computer Science or related field. 4 Year / Bachelors Degree, preferred. Computer Science or related field.
• Experience: 5 years of experience in Information Technology, preferred. 2 years of experience with at least one contemporary data transformation tool, required.
• Licensure/Certification: Microsoft, Databricks, AWS or GCP Certified Data Engineer Associate, preferred.
• Additional Skills (required):
  • Capable of building and optimizing highly scalable data sets, 'big data' pipelines and architectures to support structured and semi-structured data processing.
  • Capable of performing root cause analysis on processes and data to identify opportunities for improvement
  • Capable of building processes supporting data transformations, data structures, metadata, dependency, and workload management.
  • Capable of writing scalable automated unit test and data validation frameworks.
  • Capable of working with business partners to design and implement automated data validations to maintain data quality
  • Capable with data warehousing concepts and design.
  • Capable of writing and optimizing SQL
  • Capable of writing code in 2 or more object function/object-oriented scripting languages including Python, Scala, C++, or Java
  • Capable of working with ADLS, Delta Lake, SQL Server, Oracle, NoSQL database.
  • Capable of implementing lambda data-processing architecture (batch and streaming) such as Azure Event Hubs, Apache Spark (incl. structured streaming), Apache Kafka
  • Capable of working independently or within a team and take ownership of tasks.
  • Capable of explaining and mentoring junior team members in the above concepts and techniques.
  • Capable of building big data management processes to manage archival, retention, dataset time-travel at scale.
  • Capable of working in a fast-paced environment and able to handle multiple tasks with minimal supervision.
  • Capable of DataOps or DevOps and agile methodologies
• Additional Skills (preferred):
  • Understanding of Healthcare data is desired.
  • Knowledge or experience with HL7 or FHIR
  • Experience with leveraging microservices and API-based solutions such as Azure Functions
  • Capable of working with message queuing and stream processing.
  • Experience with Trino or other data virtualization tools
  • Experience with Informatica Powercenter.
  • Capable of orchestration of complex data pipelines to process batch and streaming data using Airflow, Azure Event Grid.
  • Capable of building capabilities to implement row level filtering and column data masking.

Responsibilities

It is the responsibility of every Novant Health team member to deliver the most remarkable patient experience in every dimension, every time.

• Our team members are part of an environment that fosters team work, team member engagement and community involvement.
• The successful team member has a commitment to leveraging diversity and inclusion in support of quality care.
• All Novant Health team members are responsible for fostering a safe patient environment driven by the principles of "First Do No Harm".