What you’ll do:
• Design, build and maintain data processing ETL pipelines & data products in a multi-cloud, multi-region, distributed processing context choosing the right technologies.
• Drive data investigations to deliver a resolution of technical, procedural, and operational issues.
• Solve complex business problems by utilizing disciplined development methodology, producing scalable, flexible, efficient and supportable solutions using appropriate technologies.
Skills:
Data engineering patterns: Sound knowledge of the different data engineering patterns to determine what to use and when
Data architecture: Understanding of data architecture and frameworks like Data mesh, data fabric etc.
Big Data Technologies: Proficiency in big data technologies such as data lake, EMR, Glue for analysing large datasets.
Programming Languages: Proficiency in programming languages commonly used in data engineering, such as Python, Java, or Scala. with OOP expertise
Data Warehousing: Strong knowledge of data warehousing solutions preferably Amazon Snowflake.
ETL/ELT Tools: Familiarity with orchestration tools
Database Systems: Expertise in both relational and NoSQL databases.
Data Modelling: Skill in designing efficient data models, both for OLAP and OLTP systems.
Streaming Data: Knowledge of streaming data technologies.
Version Control: Experience with version control systems : Git.
Containerization and Orchestration: Understanding of containerization technologies (Docker) and container orchestration platforms (Kubernetes).
Data Security: Knowledge of data encryption, access control, and compliance with data privacy regulations.
Monitoring and Logging: Proficiency in setting up monitoring and logging solutions for data pipelines using different tools
Skills Required
- Proficiency in ETL and data engineering patterns
- Understanding of data architecture and frameworks
- Expertise in big data technologies like data lake, EMR, Glue
- Proficiency in Python, Java, or Scala with OOP expertise
- Strong knowledge of data warehousing solutions, preferably Amazon Snowflake
- Familiarity with orchestration tools
- Expertise in relational and NoSQL databases
- Skill in designing efficient data models for OLAP and OLTP systems
- Knowledge of streaming data technologies
- Experience with version control systems like Git
- Understanding of Docker and Kubernetes
- Knowledge of data security, encryption, and privacy regulations
- Proficiency in monitoring and logging solutions for data pipelines
What We Do
IBS Software is a leading SaaS solutions provider to the travel industry globally, managing mission-critical operations for customers in the aviation, tour & cruise, hospitality and energy resources industries. IBS Software's solutions for the aviation industry cover fleet and crew operations, aircraft maintenance, passenger services, loyalty programs, staff travel & air-cargo management. IBS Software also runs a real-time B2B and B2C distribution platform providing hotel room inventory, rates, and availability to a global network of hospitality companies and channels. For the tour and cruise industry, IBS provides a comprehensive customer-centric, digital platform that covers onshore, online and on-board solutions. The Consulting and Digital Transformation (CDx) business focuses on driving digital transformation initiatives of its customers, leveraging its domain knowledge, digital technologies and engineering excellence. IBS Software operates from 16 offices across the world.
