Data Engineer

Posted Yesterday
Hiring Remotely in US
Remote
95K-140K Annually
Mid level
Software • Financial Services
The Role
Design, build, and maintain scalable batch and near-real-time data pipelines and data products using Databricks and Spark. Integrate internal/external sources, implement data models, ensure data quality, support BI (Sisense), CI/CD, and collaborate with analysts, scientists, and stakeholders to enable analytics and decision-making.
Summary Generated by Built In

We are seeking an accomplished Data Engineer to join our rapidly growing team. This role is

responsible for designing, building, and evolving scalable data pipeline architecture to

ensure reliable, high-quality data delivery across the organization.

The ideal candidate is a hands-on engineer with strong experience building and

maintaining data pipelines, and a passion for delivering robust data solutions that enable

analytics and business decision-making.

The Data Engineer will partner with data architects, data analysts, data scientists, and

cross-functional stakeholders to deliver trusted data assets supporting a wide range of

business initiatives. They will ensure efficient and reliable data delivery across multiple

teams, systems, and products in a dynamic environment.

This role offers the opportunity to evolve and enhance a modern data platform by improving

existing pipelines or redesigning them for greater scalability, performance, and

maintainability. The successful candidate will apply modern software engineering

practices, including AI-assisted development tools, to improve productivity, code quality,

and delivery speed while maintaining strong engineering standards.

RESPONSIBILITIES

• Design, develop, and maintain scalable data pipelines and data products for

internal and external consumers.

• Build and optimize batch and near real-time data ingestion, transformation, and

delivery processes.

• Integrate data from internal and external sources to support business, reporting,

and analytics requirements.

• Collaborate with data architects, analysts, data scientists, and business

stakeholders to deliver scalable data solutions and support Sisense dashboards

and analytics assets.

• Design and implement data models that support reporting, analytics, and

operational use cases.

• Ensure data quality, reliability, and performance through monitoring, validation,

automated testing, and troubleshooting.

• Write maintainable, well-documented, and testable code; participate in code

reviews; and leverage AI-assisted development tools to improve quality and

efficiency.

• Support CI/CD, infrastructure automation, technical documentation, and

continuous improvements to data architecture, tooling, and engineering practices

QUALIFICATIONS

• 2–4 years of professional experience in Data Engineering, Data Warehousing, or

related roles.

• Strong hands-on experience with Python and SQL for building scalable data

pipelines and transformation logic.

• Experience with Apache Spark, Parquet, and Azure Databricks, including

Databricks workflows, Delta Lake, Delta Sharing, and Unity Catalog.

• Strong SQL expertise including performance tuning, indexing, partitioning, query

optimization, and stored procedure development.

• Solid understanding of ETL/ELT methodologies, data warehousing principles,

and modern data engineering best practices.

• Experience designing and implementing data models to support analytics,

reporting, and operational use cases.

• Experience supporting or working with BI tools such as Sisense (or similar

platforms).

• Experience with CI/CD pipelines and version control practices (e.g., GitLab,

Jenkins, or equivalent).

• Experience working in fast-paced product environments with an emphasis on

delivery, maintainability, and minimizing technical debt.

• Strong communication skills with the ability to collaborate across technical and

non-technical stakeholders

BONUS QUALIFICATIONS

• Experience building lightweight data applications or internal tools using any of

the following frameworks such as Streamlit, Dash, Flask, Gradio, Shiny, or

Node.js.

• Ability to navigate ambiguity, prioritize effectively, and adapt to changing

business needs.

• Prior experience in financial services or regulated environments is a plus

Skills Required

  • 2-4 years of professional experience in Data Engineering, Data Warehousing, or related roles.
  • Strong hands-on experience with Python for building scalable data pipelines.
  • Strong hands-on experience with SQL for building scalable data pipelines and transformation logic.
  • Experience with Apache Spark.
  • Experience with Parquet.
  • Experience with Azure Databricks, including Databricks workflows.
  • Experience with Delta Lake.
  • Experience with Delta Sharing.
  • Experience with Unity Catalog.
  • Strong SQL expertise including performance tuning, indexing, partitioning, query optimization, and stored procedure development.
  • Solid understanding of ETL/ELT methodologies and data warehousing principles.
  • Experience designing and implementing data models to support analytics, reporting, and operational use cases.
  • Experience supporting or working with BI tools such as Sisense (or similar platforms).
  • Experience with CI/CD pipelines and version control practices (e.g., GitLab, Jenkins, or equivalent).
  • Experience working in fast-paced product environments with emphasis on delivery, maintainability, and minimizing technical debt.
  • Strong communication skills and ability to collaborate across technical and non-technical stakeholders.
  • Ability to ensure data quality, reliability, and performance through monitoring, validation, automated testing, and troubleshooting.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Costa Mesa, CA
522 Employees
Year Founded: 1998

What We Do

Pioneering Technologies for Your Financial Institution Since 1998, we have been creating innovative technologies that transform the way financial institutions operate by solving complex problems with streamlined, user-friendly solutions. Our robust and secure technologies empower lenders and consumers to get reliable, accurate information every time, at any time. As well-established industry leaders, we continue to set the industry standard for web-based credit reporting and lending for financial institutions of every size.

Similar Jobs

Upside Logo Upside

Data Engineer

Artificial Intelligence • Fintech • Machine Learning • Mobile • Payments • Retail • Software
Remote or Hybrid
4 Locations
275 Employees
215K-250K Annually

PwC Logo PwC

Data Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
40 Locations
370000 Employees
63K-140K Annually

PwC Logo PwC

Data Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
42 Locations
370000 Employees
77K-202K Annually

GC AI Logo GC AI

Data Engineer

Artificial Intelligence • Legal Tech
In-Office or Remote
San Mateo, CA, USA
100 Employees
165K-350K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account