The Role
Design, develop, maintain, test, and optimize ETL processes for batch and real-time data integration. Translate requirements into technical specifications, document data mappings, monitor production pipelines, troubleshoot issues, and support data modeling, architecture, governance, and quality initiatives. The role also includes user training and project status reporting.
Summary Generated by Built In
Objective:
- Responsible for designing, developing, and maintaining ETL processes to support our data integration and analysis efforts that enable the efficient and accurate processing of data for analysis and reporting.
Responsibilities:
- Designing, developing, and maintaining ETL processes to support our data integration and analysis efforts.
- Understanding data requirements and translating them into ETL specifications.
- Developing and maintaining ETL documentation, including design documents, technical specifications, and data mappings.
- Conduct unit testing and integration testing of ETL processes to ensure the accuracy and completeness of data.
- Troubleshooting and resolving ETL-related issues, including performance tuning and optimization.
- Monitoring production ETL processes and proactively identifying and resolving issues to ensure data accuracy and availability.
- Participating in the design and development of data models, data architecture, and other data-related initiatives.
- Conducting training sessions for end-users.
- Periodically report project status to Tech lead/ principal.
Requirements
- Bachelor's degree in computer science, information technology, engineering, or related field.
- 5–7 years of hands-on experience in data engineering, ETL/ELT development, and data integration.
- Knowledge of ETL tools and technologies such as DataStage or Informatica.
- Strong experience with Apache Spark (Java Spark) and Spark Structured Streaming for large-scale batch and real-time data processing.
- Strong programming skills in Java and Python, with experience building scalable data processing applications.
- Solid experience with Apache Hadoop (HDFS) and distributed data processing concepts.
- Experience with Apache Kafka and Kafka Connect data pipelines.
- Hands-on experience implementing Change Data Capture (CDC) solutions using technologies such as Debezium, Oracle Log Miner, and SQL Server CDC.
- Strong understanding of data warehousing concepts, including dimensional modeling, star and snowflake schemas, fact and dimension tables, and slowly changing dimensions.
- Strong SQL skills and experience working with relational databases such as Oracle, SQL Server, PostgreSQL, or MySQL.
- Knowledge of data modeling, data quality, metadata management, and data governance best practices.
- Familiarity with Docker, containerization, and Linux environments is a plus.
- Ability to leverage AI-powered tools and Large Language Models (LLMs).
- Experience working in Agile/Scrum development environments.
Benefits
- USD Salaries: Earn a competitive salary in USD, with growth tied directly to your performance and impact.
- Comprehensive Benefits: Enjoy full social insurance and healthcare coverage to support your well-being.
- Continuous Growth: Stay ahead in a rapidly evolving world with access to ongoing learning and development opportunities.
- Autonomy & Impact: Define success on your terms. We provide the freedom, tools, and support you need to thrive and make a meaningful difference.
- Inclusive Culture: Be your authentic self. Join a team that values every voice, celebrates diversity, and fosters innovation through inclusion.
Skills Required
- Bachelor's degree in computer science, information technology, engineering, or a related field
- 5-7 years of hands-on experience in data engineering, ETL/ELT development, and data integration
- Knowledge of ETL tools such as DataStage or Informatica
- Strong experience with Apache Spark and Spark Structured Streaming
- Strong programming skills in Java and Python
- Experience building scalable data processing applications
- Solid experience with Apache Hadoop, HDFS, and distributed data processing concepts
- Experience with Apache Kafka and Kafka Connect data pipelines
- Hands-on experience implementing Change Data Capture using Debezium, Oracle LogMiner, or SQL Server CDC
- Strong understanding of data warehousing, dimensional modeling, star and snowflake schemas, fact and dimension tables, and slowly changing dimensions
- Strong SQL skills and experience with relational databases such as Oracle, SQL Server, PostgreSQL, or MySQL
- Knowledge of data modeling, data quality, metadata management, and data governance best practices
- Familiarity with Docker, containerization, and Linux environments
- Ability to leverage AI-powered tools and Large Language Models
- Experience working in Agile/Scrum development environments
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
KnowledgeNet appears to be a technology and professional-services company operating across software development, data, project management, content, and IT support. Its advertised roles include a Development Head, Senior Software Project Manager, Senior Data Developer, Senior Content Writer, Scrum Master, and IT Help Desk specialist, with openings in Cairo and Riyadh. The company presents itself as a family-oriented workplace focused on meaningful and rewarding careers.









