The Role
Design, develop, test, and maintain ETL/ELT pipelines and data integrations for batch and real-time processing. Troubleshoot and tune ETL jobs, monitor production pipelines, contribute to data modeling and architecture, document designs, deliver end-user training, and report status to technical leadership.
Summary Generated by Built In
Objective:
- Responsible for designing, developing, and maintaining ETL processes to support our data integration and analysis efforts that enable the efficient and accurate processing of data for analysis and reporting.
Responsibilities:
- Designing, developing, and maintaining ETL processes to support our data integration and analysis efforts.
- Understanding data requirements and translating them into ETL specifications.
- Developing and maintaining ETL documentation, including design documents, technical specifications, and data mappings.
- Conduct unit testing and integration testing of ETL processes to ensure the accuracy and completeness of data.
- Troubleshooting and resolving ETL-related issues, including performance tuning and optimization.
- Monitoring production ETL processes and proactively identifying and resolving issues to ensure data accuracy and availability.
- Participating in the design and development of data models, data architecture, and other data-related initiatives.
- Conducting training sessions for end-users.
- Periodically report project status to Tech lead/ principal.
Requirements
- Bachelor's degree in computer science, information technology, engineering, or related field.
- 5–7 years of hands-on experience in data engineering, ETL/ELT development, and data integration.
- Knowledge of ETL tools and technologies such as DataStage or Informatica.
- Strong experience with Apache Spark (Java Spark) and Spark Structured Streaming for large-scale batch and real-time data processing.
- Strong programming skills in Java and Python, with experience building scalable data processing applications.
- Solid experience with Apache Hadoop (HDFS) and distributed data processing concepts.
- Experience with Apache Kafka and Kafka Connect data pipelines.
- Hands-on experience implementing Change Data Capture (CDC) solutions using technologies such as Debezium, Oracle Log Miner, and SQL Server CDC.
- Strong understanding of data warehousing concepts, including dimensional modeling, star and snowflake schemas, fact and dimension tables, and slowly changing dimensions.
- Strong SQL skills and experience working with relational databases such as Oracle, SQL Server, PostgreSQL, or MySQL.
- Knowledge of data modeling, data quality, metadata management, and data governance best practices.
- Familiarity with Docker, containerization, and Linux environments is a plus.
- Ability to leverage AI-powered tools and Large Language Models (LLMs).
- Experience working in Agile/Scrum development environments.
Benefits
- USD Salaries: Earn a competitive salary in USD, with growth tied directly to your performance and impact.
- Comprehensive Benefits: Enjoy full social insurance and healthcare coverage to support your well-being.
- Continuous Growth: Stay ahead in a rapidly evolving world with access to ongoing learning and development opportunities.
- Autonomy & Impact: Define success on your terms. We provide the freedom, tools, and support you need to thrive and make a meaningful difference.
- Inclusive Culture: Be your authentic self. Join a team that values every voice, celebrates diversity, and fosters innovation through inclusion.
Skills Required
- Bachelor's degree in computer science, information technology, engineering, or related field
- 5-7 years hands-on experience in data engineering, ETL/ELT development, and data integration
- Experience with ETL tools such as DataStage or Informatica
- Strong experience with Apache Spark (Java Spark) and Spark Structured Streaming
- Strong programming skills in Java
- Strong programming skills in Python
- Solid experience with Apache Hadoop (HDFS) and distributed data processing concepts
- Experience with Apache Kafka and Kafka Connect
- Hands-on experience implementing Change Data Capture (Debezium, Oracle Log Miner, SQL Server CDC)
- Strong understanding of data warehousing concepts (dimensional modeling, star/snowflake schemas, SCDs)
- Strong SQL skills and experience with relational databases (Oracle, SQL Server, PostgreSQL, MySQL)
- Knowledge of data modeling, data quality, metadata management, and data governance best practices
- Familiarity with Docker, containerization, and Linux environments
- Ability to leverage AI-powered tools and Large Language Models (LLMs)
- Experience working in Agile/Scrum development environments
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
KnowledgeNet appears to be a technology and professional-services company operating across software development, data, project management, content, and IT support. Its advertised roles include a Development Head, Senior Software Project Manager, Senior Data Developer, Senior Content Writer, Scrum Master, and IT Help Desk specialist, with openings in Cairo and Riyadh. The company presents itself as a family-oriented workplace focused on meaningful and rewarding careers.
