The Role
Designs, builds, and maintains scalable data platforms and resilient pipelines using Medallion architecture, Databricks, Apache Spark, Parquet, Iceberg, and Delta Lake. The role includes database optimization for PostgreSQL and SQLite, data quality and performance monitoring, ETL/ELT development, troubleshooting, documentation, and collaboration with analytics stakeholders.
Summary Generated by Built In
This is a remote position.
We are seeking a Data Engineer with approximately 5 years of experience to design, build, and maintain scalable data platforms and pipelines. The ideal candidate will have strong expertise in modern data engineering practices, distributed data processing technologies, and open data lake architectures. This role involves working closely with cross-functional teams to ensure reliable, efficient, and high-quality data solutions that support analytics and business needs.
The Key Responsibilities are:
- Build resilient data pipelines using Medallion architecture principles.
- Manage and optimize open storage formats including Parquet, Iceberg, and Delta Lake.
- Design, develop, and maintain distributed data processing workloads using Databricks and Apache Spark.
- Perform database operations, optimization, and maintenance for PostgreSQL and SQLite environments.
- Ensure data quality, reliability, scalability, and performance across data platforms.
- Collaborate with data consumers and stakeholders to support reporting, analytics, and operational data requirements.
- Monitor, troubleshoot, and improve data infrastructure and pipeline performance.
- Follow data engineering best practices, coding standards, and documentation processes.
Requirements
Requirements
- Bachelor’s degree in Computer Science, Software Engineering, or a related field.
- Approximately 5 years of experience in Data Engineering or a related role.
- Advanced SQL skills with strong expertise in PostgreSQL.
- Strong proficiency in Python and DuckDB.
- Experience with data lakes and open-source query and storage layers.
- Hands-on experience working with Parquet, Iceberg, and Delta Lake.
- Experience with distributed computing frameworks, specifically Databricks and Apache Spark.
- Strong understanding of data modeling, ETL/ELT processes, and data pipeline development.
- Knowledge of database administration, performance tuning, and optimization techniques.
- Excellent problem-solving and analytical skills.
- Ability to work effectively both independently and within a collaborative team environment.
- Excellent English communication skills.
This opportunity is remote for Egyptian applicants and Hybrid for Lebanese applicants.
Skills Required
- Bachelor's degree in Computer Science, Software Engineering, or a related field
- Approximately 5 years of experience in Data Engineering or a related role
- Advanced SQL skills with strong expertise in PostgreSQL
- Strong proficiency in Python and DuckDB
- Experience with data lakes and open-source query and storage layers
- Hands-on experience with Parquet, Iceberg, and Delta Lake
- Experience with Databricks and Apache Spark
- Strong understanding of data modeling, ETL/ELT processes, and data pipeline development
- Knowledge of database administration, performance tuning, and optimization techniques
- Excellent problem-solving and analytical skills
- Ability to work independently and collaboratively
- Excellent English communication skills
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
CME is a multinational technology firm that specializes in turning modernization and AI into outcomes, helping enterprises transition from strategy to live systems. With over 650 engineers across eight locations, the company creates enterprise systems and scales AI to enable lasting transformation, having successfully delivered more than 350 large-scale projects.
