As a Data Engineer He/She will be responsible for designing, building, and maintaining the data architecture and infrastructure required for our organization's data needs. will also be responsible for developing, testing, and deploying data solutions, ensuring that they meet our organization's needs.
Requirements
- 5+ years of experience in Data Engineering
- Strong expertise in Python, Pandas, and PySpark for large-scale data processing
- Advanced hands-on experience with Databricks and Azure Synapse Spark
- Strong experience with Azure Data Factory and end-to-end data pipeline development
- Expertise in SQL query tuning and performance optimization
- Experience in SQL Server migration projects
- Experience designing scalable big data and cloud-based data solutions
- Ability to independently develop, optimize, and deploy enterprise data workflows
- Knowledge aligned with Databricks Certified Data Engineering Professional
- Nice to have: Terraform for Azure and infrastructure automation
- L2 knowledge assessed in the Databricks certification: Databricks Certified Data Engineering Professional
Similar Jobs
What We Do
DeepSource stands as a trusted partner for businesses seeking cutting-edge AI services in computer vision, natural language processing, and predictive analytics. With a particular focus on Arabic NLP and ChatGPT bot development, DeepSource is dedicated to empowering companies with groundbreaking solutions that streamline operations, optimize workflows, and enhance user experiences. Our commitment to excellence is evident in our approach to addressing a wide range of AI needs, from hiring top talent and managing end-to-end AI projects to providing tailored consulting and comprehensive training programs. DeepSource's team of experts is equipped with extensive knowledge and experience in various AI technologies, which enables them to develop and deploy advanced solutions across multiple industries. Our adaptive strategies and innovative methodologies allow businesses to stay competitive in today's rapidly evolving digital landscape
