Data Engineer

Palmer College of Chiropractic is looking for a Data Engineer!

The Data Engineer designs, develops, implements, administers, and maintains data integration solutions, ETL/ELT pipelines, cloud infrastructure, data warehouse objects, and supporting applications across Palmer College of Chiropractic. This role moves, transforms, validates, and delivers data between institutional systems, cloud platforms, databases, APIs, and external services to support operational processes, institutional reporting, analytics, system implementations, and data governance initiatives. The Data Engineer collaborates with stakeholders across the College to translate business and technical requirements into scalable, maintainable, and accurate data solutions.

ORGANIZATIONAL RELATIONSHIPS

Responsible to the Director of Applications and has a support responsibility to all other departments and College personnel as necessary.

SPECIFIC DUTIES AND RESPONSIBILITIES

• Build and support reliable ETL/ELT pipelines and integrations that move data among Palmer’s enterprise applications, databases, cloud platforms, APIs, and external partners.

• Administer and enhance Snowflake data structures, security, transformations, and automated processing to support operational and analytical needs.

• Prepare governed data for reporting, analysis, and institutional decision-making.

• Support data migrations and system implementations through mapping, transformation, testing, reconciliation, and production deployment.

• Monitor and troubleshoot data processes, strengthen data quality and security controls, maintain technical documentation, and collaborate with College stakeholders and vendors.

REQUIRED TECHNICAL SKILLS AND COMPETENCIES

• Data Engineering: ETL/ELT development, orchestration, data integration, transformation, staging, file processing, migration, and reconciliation.

• Programming and Query Languages: Advanced SQL and Python scripting for data processing, automation, validation, testing, and integration.

• Cloud and Orchestration: Azure Data Factory, Azure Blob Storage, Azure Batch, Azure DevOps, and related Azure identity, monitoring, networking, and security services.

• Data Warehousing: Snowflake administration and development, dimensional and relational design, schemas, tables, views, stages, ingestion, transformations, workload management, and query optimization.

• Data Exchange: REST APIs, CSV, XML, JSON, SFTP, structured records, authentication methods, and automated file transfers.

• Data Governance: Metadata management, cataloging, lineage, data products, business glossaries, stewardship, and technical documentation.

• Operational Support: Pipeline monitoring, logging, alerting, incident diagnosis, data reconciliation, root-cause analysis, and data quality controls.

• Documentation and Collaboration: Technical writing, source-to-target mapping, stakeholder communication, requirements analysis, estimation, and cross-functional problem-solving.

• Security and Privacy: Role-based access control, secrets management, secure data transfer, least privilege, and responsible handling of regulated and sensitive data.

ADDITIONAL SKILLS AND QUALIFICATIONS

Skills

• A strong interest in institutional data and in developing practical solutions for complex data challenges.

• Ability to translate business requirements into supportable technical designs and clearly explain technical concepts to nontechnical stakeholders.

• Strong analytical, troubleshooting, organizational, time-management, documentation, and communication skills.

• Ability to work independently, manage competing priorities, and collaborate effectively in a service-oriented, team-based environment.

• Commitment to accuracy, security, maintainability, continuous improvement, and customer service.

Ability to

• Quickly learn the College’s goals, business processes, data domains, systems, and operating constraints.

• Design, build, test, deploy, monitor, and maintain data pipelines, platforms, applications, and warehouse objects that meet institutional standards.

• Manage data storage and access, optimize schemas and queries, and protect data quality and integrity.

• Prioritize and complete work in an environment with production deadlines, frequent interruptions, and multiple concurrent responsibilities.

• Participate in scheduled maintenance, production support, and after-hours incident response when required.

Minimum Qualifications

• Bachelor’s degree or equivalent combination of relevant education and professional experience.

• Three years of professional experience in data engineering, data warehousing, data integration, database development, or a closely related field.

• Demonstrated experience developing production SQL and Python solutions and supporting ETL/ELT pipelines in a cloud or enterprise environment.

• Experience working with relational databases, APIs, structured data files, source control, testing, troubleshooting, and technical documentation.

• Excellent customer service and communication skills with the ability to work effectively with individuals at all levels, including external vendors and support partners.

• Demonstrated organization, accuracy, thoroughness, accountability, and commitment to work quality.

• Regular and reliable attendance. Availability to perform scheduled evening or weekend work and respond to critical production issues as required.

Desired Qualifications

• Hands-on experience with Azure Data Factory, Azure Blob Storage, Azure Batch, Azure DevOps, and Azure monitoring or security services.

• Hands-on Snowflake administration and development experience, including role-based access, stages, tasks, stored procedures, query optimization, and warehouse cost management.

• Experience supporting enterprise data migrations, system implementations, data reconciliation, and production cutovers.

• Knowledge of higher-education data domains and privacy or security requirements, including FERPA, HIPAA, and PCI DSS.

PHYSICAL REQUIREMENTS AND WORK ENVIRONMENT

• Perform sedentary to light work in a ventilated, lighted, and temperature-controlled office setting.

• Frequent need to stand, stoop, walk, sit, lift light objects up to 10 pounds, and perform similar actions during the workday.

• Frequent use of a computer, keyboard, telephone, and other standard office equipment, with extended periods of focused screen work.

OTHER DUTIES

Performs additional duties as assigned in support of institutional data management, system integration, reporting, operational efficiency, and technology initiatives. Performs all responsibilities in a manner consistent with Palmer College of Chiropractic policies, including Equal Employment Opportunity and Affirmative Action requirements.