Octopus Digital is leading the charge in Industry 4.0 across Pakistan and the Middle East, revolutionizing industries with smart factory solutions, AI, big data, and IoT. Our cloud-native, AI-powered platforms deliver actionable insights, making complex data accessible for all professionals. We help businesses digitize manufacturing, supply chain, and financial processes, offering 24/7 support and business intelligence through flexible subscription services. With a global presence and a focus on continuous innovation, we empower companies to thrive in the digital age and stay ahead of the competition. Let us help you unlock the future of your business.
Job Overview:We are looking for a Data Engineer to join our team and design, build, and maintain robust and scalable data pipelines. The ideal candidate will play a critical role in developing systems that process and analyze data efficiently, enabling data-driven decision-making across the organization.
Key Responsibilities:- Design, develop, and maintain ETL pipelines to ingest, transform, and load large volumes of data from various sources into data lakes and data warehouses.
- Collaborate with Data Scientists, Analysts, and Software Engineers to ensure clean and reliable data for analytical solutions and models.
- Build and optimize data storage and retrieval systems using Microsoft Azure Coud Platform
- Develop and maintain data models, databases, and schemas to support business intelligence, reporting, and analytics.
- Implement data governance principles, including quality, integrity, and security protocols.
- Monitor, troubleshoot, and improve data pipelines, ensuring systems are reliable and scalable.
- Automate data workflows and optimize performance using modern tools like Apache Spark, Airflow, or similar orchestration frameworks.
- Perform root-cause analysis on complex data issues and implement solutions.
- Keep up-to-date with emerging technologies in data engineering, proposing innovative solutions to improve data infrastructure.
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, IT, or related field.
- 3-5+ years of experience in a Data Engineering role or similar capacity.
- Proficiency with SQL and programming languages such as Python or Java.
- Experience with Azure Data Platform (Data Factory, Synapse Analytics, Databricks, AppLogic)
- Hands-on experience with ETL/ELT tools (e.g., SQL SSIS , Apache Airflow, Talend, Matillion, Informatica).
- Familiarity with big data technologies like Apache Spark, Kafka, or Hadoop.
- Knowledge of data warehousing concepts and experience with platforms like SQL Server, Azure Synapse Analytics (formerly Azure SQL Data Warehouse), Snowflake, Redshift, or BigQuery.
- Strong problem-solving skills and an ability to analyze complex data architectures.
- Familiarity with CI/CD pipelines, version control (e.g., Git), and data automation.
- Experience working in an Agile environment.
- Experience with streaming data frameworks (Kafka, Flink, Kinesis).
- Knowledge of data governance and security practices (GDPR, HIPAA compliance).
- Understanding of Machine Learning Operations (MLOps) or DataOps.
- Certifications in relevant technologies like Azure Data Engineer, or Google Professional Data Engineer.
- Opportunity to work with a talented team on impactful data-driven projects.
- Access to cutting-edge tools and technologies.
- Competitive salary, benefits, and a dynamic work environment.
- Travel for easy commute.
Similar Jobs
What We Do
Avanceon is the leading provider of automation, control systems integration, proprietary energy management solutions and support services. It has a strong market footprint through its offices in Dubai - UAE (covering Middle East), Lahore - Pakistan (covering South Asia) and Exton, Pennsylvania - United States of America (covering North America). Avanceon is also among the select group of ‘certified members’ of Control System Integrators Association (‘CSIA’) and is also listed on the Control Engineering Magazine’s System Integrator Hall of Fame.Avanceon has been in the automation business for the last 24 years and has transformed into a 360 degree solution provider for automation, energy management, service and maintenance. Servicing clients over a span of two decades, Avanceon has completed several projects for major blue chip companies enabling it to earn strong credentials, move up the learning curve and develop a diverse client base. Going forward, it intends to capitalize on its core strengths to expand its footprint in the Middle East by setting up offices in Qatar, Kingdom of Saudi Arabia (KSA) and Oman.
