Data Engineer (RTS)

We are looking for an experienced Data Engineer with strong expertise in building and maintaining robust data pipelines, optimizing data workflows, and ensuring the availability of high-quality data for business insights and real-time systems (RTS). The ideal candidate will have hands-on experience with modern data engineering tools, cloud platforms, and big data ecosystems.

• Design, build, and maintain scalable data pipelines and ETL/ELT processes.
• Work with structured and unstructured datasets to ensure data quality, accuracy, and availability.
• Collaborate with data scientists, analysts, and business stakeholders to deliver reliable datasets for analytics and reporting.
• Optimize query performance and ensure real-time/near-real-time data processing for RTS.
• Implement data security, governance, and compliance standards.
• Troubleshoot data-related issues and ensure system reliability and scalability.
• Stay updated with emerging tools and best practices in big data and cloud-based data engineering.

• 5–8 years of proven experience as a Data Engineer or in a similar role.
• Strong proficiency in SQL, Python, or Scala.
• Hands-on experience with big data technologies (Hadoop, Spark, Kafka, Hive, etc.).
• Experience with cloud platforms (AWS, Azure, or GCP) and their data services (e.g., Redshift, Snowflake, BigQuery, Data Lake).
• Strong understanding of ETL/ELT frameworks, data warehousing, and data modeling.
• Experience with real-time data streaming and processing frameworks.
• Good knowledge of CI/CD, version control (Git), and DevOps practices.
• Excellent problem-solving and communication skills.

• Experience in containerization and orchestration (Docker, Kubernetes, Airflow, etc.).
• Knowledge of data governance and security best practices.
• Familiarity with machine learning pipelines.

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.