Data Engineer (Databricks + Informatica + Azure)

Posted Yesterday
Hiring Remotely in Dallas, TX, USA
In-Office or Remote
Mid level
Design
The Role
Design, build, and optimize scalable data pipelines and ETL/ELT processes on cloud-native platforms (Databricks, Informatica). Implement Data Lakehouse models, ensure data quality, support CI/CD deployments, monitor production workflows, and enforce governance, security, and compliance for healthcare data alongside architects and stakeholders.
Summary Generated by Built In
Allata is a global consulting and technology services firm with offices in the US, India, and Argentina. We help organizations accelerate growth, drive innovation, and solve complex challenges by combining strategy, design, and advanced technology. Our expertise covers defining business vision, optimizing processes, and creating engaging digital experiences. We architect and modernize secure, scalable solutions using cloud platforms and top engineering practices.

Allata also empowers clients to unlock data value through analytics and visualization and leverages artificial intelligence to automate processes and enhance decision-making. Our agile, cross-functional teams work closely with clients, either integrating with their teams or providing independent guidance—to deliver measurable results and build lasting partnerships.

We are seeking a skilled Data Engineer to join our consulting team on a strategic project with one of our key clients in the healthcare industry. You will be responsible for designing, building, and optimizing scalable data solutions that support analytics, reporting, and advanced data use cases in regulated environments.

In this role, you will work alongside data architects, analysts, and business stakeholders, translating healthcare data requirements into robust technical solutions. You will operate within high-performing teams in an environment where technical excellence, autonomy, and data-driven decision-making are valued.

 

Role & Responsibilities:

  • Design, develop, and maintain scalable data pipelines using modern distributed data processing platforms and cloud environments.
  • Build and optimize ETL/ELT processes following industry best practices and cloud-native architectures.
  • Implement data models aligned with modern Data Lakehouse principles and data architecture frameworks.
  • Ensure data quality, consistency, and performance across ingestion, staging, and curated data layers.
  • Collaborate with data architects, analysts, and business stakeholders to understand complex healthcare data requirements.
  • Develop reusable data transformation logic and modular processing components for efficient, maintainable systems. 
  • Support deployment processes following CI/CD and DevOps best practices.
  • Monitor and optimize data workflows for performance, scalability, and reliability in production environments.
  • Contribute to data governance, security, and compliance practices relevant to regulated healthcare environments. 

Hard Skills - Must have:

  • Proven hands-on experience with Informatica as a data integration and ETL platform.
  • Strong experience with Databricks or similar distributed data processing platforms.
  • Core expertise in data architecture, data integrations, data warehousing, and ETL/ELT process design.
  • Applied experience developing and deploying custom scripts and modules for distributed computing environments (custom code execution across parallel executors and worker nodes).
  • Strong proficiency in SQL, Python, and PySpark (or equivalent distributed processing languages) for data transformation and processing.
  • Solid knowledge of cloud and hybrid relational database systems such as MS SQL Server, PostgreSQL, Oracle, Azure SQL, AWS RDS, or comparable engines.
  • Hands-on experience with batch and streaming data processing techniques and data compaction strategies. 

Soft Skills / Business Specific Skills:

  • Strong analytical and problem-solving skills.
  • Ability to work effectively in cross-functional and distributed teams.
  • Clear communication skills, with the ability to explain technical concepts to non-technical stakeholders.
  • Proactive mindset with a strong sense of ownership.
  • Commitment to delivering high-quality, reliable data solutions.

At Allata, we value differences.

Allata is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Allata makes employment decisions without regard to race, color, creed, religion, age, ancestry, national origin, veteran status, sex, sexual orientation, gender, gender identity, gender expression, marital status, disability or any other legally protected category.

This policy applies to all terms and conditions of employment, including but not limited to, recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.

Skills Required

  • Hands-on experience with Informatica as a data integration and ETL platform.
  • Strong experience with Databricks or similar distributed data processing platforms.
  • Core expertise in data architecture, data integrations, data warehousing, and ETL/ELT process design.
  • Experience developing and deploying custom scripts/modules for distributed computing across executors and worker nodes.
  • Strong proficiency in SQL for data transformation and processing.
  • Strong proficiency in Python for data transformation and processing.
  • Strong proficiency in PySpark (or equivalent distributed processing languages).
  • Knowledge of cloud and hybrid relational database systems (MS SQL Server, PostgreSQL, Oracle, Azure SQL, AWS RDS).
  • Hands-on experience with batch and streaming data processing techniques and data compaction strategies.
  • Experience supporting deployment processes following CI/CD and DevOps best practices.
  • Experience with data governance, security, and compliance in regulated healthcare environments.
  • Strong analytical and problem-solving skills (soft skill).
  • Ability to work effectively in cross-functional and distributed teams (soft skill).
  • Clear communication skills, including explaining technical concepts to non-technical stakeholders (soft skill).
  • Proactive mindset with strong sense of ownership and commitment to quality (soft skill).
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dallas, Texas
233 Employees

What We Do

Allata (pronounced a-ley-ta) is a strategy, architecture and enterprise-level application development company focused on helping clients enhance or scale business opportunities, create efficiencies and automate processes through custom technologies. We are building a different kind of firm – focused on doing exciting, transformational work for great clients and bringing caring and dedicated people to make our clients goals a reality. Our vision is to build an energized group of talented professionals that can stand strong on their own but work better as a networked team. We enable business agility at the intersection of people, process, and technology. We provide solutions and expert services to assist businesses to become more nimble, transformative, and disruptive in their respective industries. We define vision, strategy, and value creation models for shaping strategic product designs, managing, and transforming enterprise delivery. Just as strongly as we care about our clients, we feel that it is important to give back to the community and non-profits that we are passionate about. Every month, Allata donates 2% of our net income to a charitable cause our team believes in. We live by our mantra: Family comes first, clients are king, we take great care of our people.

Similar Jobs

Atlassian Logo Atlassian

Team Lead

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
Austin, TX, USA
11000 Employees
113K-176K Annually
Easy Apply
Remote or Hybrid
2 Locations
180 Employees
110K-160K Annually

Eve Logo Eve

Software Engineer

Legal Tech • Software • Generative AI
Easy Apply
Remote or Hybrid
United States
180 Employees
250K-300K Annually

Coinbase Logo Coinbase

Senior Machine Learning Engineer

Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Easy Apply
Remote
USA
4700 Employees
180K-212K Annually

Similar Companies Hiring

Million Dollar Baby Co. Thumbnail
eCommerce • Kids + Family • Retail • Sales • Design • Manufacturing
Pico Rivera, CA
200 Employees
Tapestry - Coach and Kate Spade Thumbnail
eCommerce • Fashion • Retail • Sales • Wearables • Design
New York, NY
16000 Employees
Munchkin, Inc. Thumbnail
Consumer Web • eCommerce • Food • Kids + Family • Design • Manufacturing
Milton, Ontario
325 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account