Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Hiring Remotely in Egypt
Remote
Mid level
Artificial Intelligence • Cloud • Analytics • Automation
The Role
Design, build, and maintain ETL pipelines and transformations using Microsoft Fabric or equivalent tools. Ensure data quality, implement incremental loads, develop dimensional models, troubleshoot pipelines, document lineage, and support UAT and semantic model development for analytics and reporting across the Mortgage Cadence Platform.
Summary Generated by Built In

The Data Engineer operates within the framework established by the Lead — designing, building, and maintaining robust data pipelines and transformation logic that power analytics, compliance, and operational reporting across the Mortgage Cadence Platform.

The role is execution-focused with increasing ownership of end-to-end data workflows as familiarity with the platform grows. Strong SQL, ETL, and data quality skills are required; the ability to build reports and leverage semantic models is secondary to data engineering excellence.

Job Responsibilities

  • Design and build extraction, transformation, and loading (ETL) pipelines using Microsoft Fabric (Dataflow Gen2, Notebooks, or equivalent tools)
  • Write optimized SQL queries and transformations for data ingestion from designated source systems
  • Apply data quality rules and validation logic at each pipeline stage
  • Implement incremental loads and manage refresh schedules for performance
  • Escalate to Lead for architectural decisions or complex transformation patterns
  • Define and implement data quality checks at ingestion, transformation, and output stages
  • Perform ongoing data validation to ensure pipeline outputs align with business logic and source system expectations
  • Identify, document, and escalate data quality issues with root cause analysis
  • Maintain data quality dashboards and SLA monitoring
  • Support UAT for new data sources or transformation logic
  • Build and maintain data transformations using Power Query, SQL, or Python as appropriate
  • Develop dimensional models and define aggregation logic aligned with analytics requirements
  • Optimize data structures for performance and maintainability
  • Document transformation logic, lineage, and assumptions per team standards
  • Troubleshoot pipeline failures and performance issues; coordinate resolution with IT/Engineering
  • Respond to data discrepancy reports from business users and analysts
  • Maintain documentation of data sources, data dictionaries, and transformation specifications
  • Support capacity planning and optimization of Fabric environments and pipelines
  • Collaborate with Lead to define semantic models and calculated metrics

Requirements
  • Advanced SQL query optimization, window functions, performance tuning, debugging complex transformations.
  • Proficient with Microsoft Fabric — (Dataflow Gen2, Notebooks, Lakehouse) OR equivalent ETL tools (Python, dbt, Talend, Informatica)
  • Strong understanding of relational database design and dimensional modeling
  • Power Query / M — complex data shaping, merging, error handling, and transformation logic
  • Python or similar scripting language — data manipulation, pipeline automation
  • Git/version control basics — able to collaborate on code and track changes
  • Data quality and testing frameworks — unit tests, assertions, validation rules
  • Ability to interpret business requirements and design efficient data solutions
  • Data governance mindset — understands data lineage, documentation, and quality standards
  • Proactive about identifying edge cases and potential data issues
  • Mortgage/lending domain familiarity preferred; willingness to learn domain required
  • Works effectively within defined standards and escalates architectural questions to Lead
  • Able to balance speed with quality; advocates for technical excellence

Skills Required

  • Advanced SQL (query optimization, window functions, performance tuning)
  • Proficient with Microsoft Fabric (Dataflow Gen2, Notebooks, Lakehouse) or equivalent ETL tools (Python, dbt, Talend, Informatica)
  • Strong understanding of relational database design and dimensional modeling
  • Power Query / M for complex data shaping and transformation
  • Python or similar scripting language for data manipulation and automation
  • Git / version control basics
  • Experience with data quality and testing frameworks (unit tests, assertions, validation rules)
  • Ability to interpret business requirements and design efficient data solutions
  • Data governance mindset including lineage and documentation
  • Mortgage/lending domain familiarity
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Montreal, Quebec
62 Employees

What We Do

PartnerOne is an enterprise software company that manages the world’s largest data environments through virtualized cloud storage, hyper-automation, artificial intelligence, and metadata analytics. Contrary to other software companies, we play a mission-critical role in not just one, but many aspects of the enterprise Big Data cycle. Over 1250 of the world’s largest data environments rely on our software for their most critical needs and to safeguard their most valuable data.

Similar Jobs

Autochek Africa Logo Autochek Africa

Data Engineer

Automotive • eCommerce • Fintech • Transportation
In-Office or Remote
28 Locations

Nawy Logo Nawy

Data Engineer

Information Technology • Machine Learning • Real Estate
Remote
Ma‘adi, Cairo, EGY
1392 Employees
1-1 Annually
Remote or Hybrid
Cairo, EGY
Remote
Cairo, EGY
96 Employees

Similar Companies Hiring

Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account