Sr. Data Engineer - Azure(Fabric)

Posted 2 Days Ago
Be an Early Applicant
Ahmedabad, Gujarat, IND
In-Office
Senior level
Information Technology
The Role
Design, build, and maintain end-to-end data pipelines on Microsoft Fabric and related cloud platforms. Implement high-scale ETL/ELT ingestion, transformation, and modeling using Spark, Kafka, Airflow, and Databricks. Optimize databases and SQL performance, ensure data quality, governance, and security, and collaborate with cross-functional teams and stakeholders to deliver production data solutions.
Summary Generated by Built In

Job Title: Senior Data Engineer (Azure)

Location: Ahmedabad, Gujarat

Experience: 4+ years

Job Type: Full Time

Department: Data Engineering

About Simform:

Simform is a premier digital engineering company specializing in Cloud, Data, AI/ML, and Experience Engineering to create seamless digital experiences and scalable products. Simform is a strong partner for Microsoft, Google Cloud, and Databricks. With a presence in 5+ countries, Simform primarily serves North America, the UK, and the Northern European market. Simform takes pride in being one of the most reputed employers in the region, having created a thriving work culture with a high work-life balance that gives a sense of freedom and opportunity to grow.  


Role Overview:

We are looking for a Senior Data Engineer (Azure) who is passionate about managing large-scale data, eager to take on challenges, and committed to delivering exceptional results. This role requires expertise in Azure data services, ETL pipelines, and database management. If you are a proactive problem solver with a strong technical background and a team player with a positive attitude, we want to hear from you.


Key Responsibilities

  • Design, develop, monitor, and maintain end-to-end data pipelines on Microsoft Fabric.

  • Work with Microsoft Fabric services such as

    • Fabric Pipelines (ETL/ELT)

    • Fabric Dataflows Gen2

    • Fabric Lakehouse (Bronze/Silver/Gold architecture)

    • Fabric Warehouse (SQL analytics engine)

    • OneLake (unified storage)

    • Fabric Notebooks (PySpark / Spark SQL)

    • Direct Lake mode for Power BI

    • Fabric KQL Database / Eventstream / Real-Time Hub

    • Fabric Shortcuts (cross‑workspace & multi-cloud virtualization)

    • Semantic Models

    • Data Activator (alerting / action triggers) For ingestion, transformation, modeling, analytics, and real-time processing.

  • Develop and optimize data ingestion, transformation, and analytical workflows for structured and unstructured data.

  • Design efficient data models to ensure optimal performance in data processing and storage.

  • Implement large-scale data ingestion pipelines capable of handling TBs of data.

  • Build distributed batch or real-time data solutions using Apache Kafka, Apache Airflow, Databricks, or Fabric Real-Time Hub components.

  • Build and maintain ETL/ELT pipelines for data integration and migration.

  • Work extensively with relational databases (PostgreSQL, MySQL, SQL Server) and NoSQL databases (MongoDB, CosmosDB, Cassandra, GraphDB).

  • Optimize SQL queries, performance tuning, indexing, partitioning, and denormalization strategies.

  • Collaborate with cross-functional teams, including data scientists and software engineers, to integrate data solutions into production environments.

  • Ensure data quality, integrity, governance, lineage, and compliance with security best practices.

  • Participate in client interactions and stakeholder meetings to gather requirements and provide technical insights.

Required Skills & Qualifications

  • Bachelor’s/Master’s degree in Computer Science, Data Engineering, or a related field.

  • 4+ years of hands-on experience in data engineering, ETL development, and data pipeline implementation.

  • Proficiency in Python and SQL for data processing and analysis.

  • Strong expertise in Microsoft Fabric (Pipelines, Dataflows Gen2, Lakehouse, Warehouse, OneLake, Notebooks, Direct Lake, KQL Database, Real-Time Hub, Eventstream, Shortcuts, Semantic Models).

  • Experience with big data frameworks like Spark, Kafka, and Airflow.

  • Working knowledge of cloud data warehouse solutions such as Synapse, Snowflake, Redshift, or BigQuery.

  • Experience with NoSQL databases (MongoDB, CosmosDB, Cassandra, GraphDB) and relational databases.

  • Strong analytical and problem-solving skills.

  • Ability to work independently, mentor peers, and meet tight deadlines.

  • Excellent interpersonal and communication skills.

  • Experience with cloud-based data architecture and security best practices.

  • Fabric certifications are a plus (DP‑600, DP‑700, Fabric Analytics/Data Engineer Associate).

Preferred Qualifications (Nice to Have)

  • Experience with data lake architectures.

  • Knowledge of machine learning model deployment and data processing for AI applications.

  • Prior experience in automated data pipeline deployment using CI/CD workflows.

Why Join Us:

  • Young Team, Thriving Culture

  • Flat-hierarchical, friendly, engineering-oriented, and growth-focused culture.

  • Well-balanced learning and growth opportunities

  • Free health insurance.

  • Office facilities with a game zone, an in-office kitchen with affordable lunch service, and free snacks.

  • Sponsorship for certifications/events and library service.

  • Flexible work timing, leaves for life events, WFH, and hybrid options.

Skills Required

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
  • 4+ years of hands-on experience in data engineering, ETL development, and data pipeline implementation.
  • Proficiency in Python for data processing and analysis.
  • Proficiency in SQL and experience optimizing SQL queries and performance tuning.
  • Strong expertise in Microsoft Fabric (Pipelines, Dataflows Gen2, Lakehouse, Warehouse, OneLake, Notebooks, Direct Lake, KQL Database, Real-Time Hub, Eventstream, Shortcuts, Semantic Models).
  • Experience with big data frameworks like Spark, Kafka, and Airflow.
  • Experience with Databricks.
  • Working knowledge of cloud data warehouse solutions (Synapse, Snowflake, Redshift, BigQuery).
  • Experience with NoSQL databases (MongoDB, CosmosDB, Cassandra, GraphDB) and relational databases (PostgreSQL, MySQL, SQL Server).
  • Experience building ETL/ELT pipelines for large-scale (TBs) data ingestion and transformation.
  • Experience with cloud-based data architecture and security best practices.
  • Strong analytical, problem-solving, communication skills, and ability to mentor peers.
  • Fabric certifications (DP-600, DP-700, Fabric Analytics/Data Engineer Associate).
  • Experience with data lake architectures.
  • Knowledge of machine learning model deployment and data processing for AI applications.
  • Experience with automated data pipeline deployment using CI/CD workflows.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Ahmedabad, Gujarat
845 Employees
Year Founded: 2010

What We Do

Simform is a tech company with a mission to help successful companies extend their tech capacity. Founded in October 2010, we have helped organizations ranging from Startups that went public, to Fortune 500 companies, and WHO backed NGOs. Simform helps companies become innovation leaders by delivering software teams on demand. We help you - choose the right technologies to invest in, decide on the best architecture and processes to follow, and oversee the successful delivery of their software projects.

Similar Jobs

Mondelēz International Logo Mondelēz International

Organization Capability Specialist

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
India
90000 Employees

CSC Logo CSC

Team Leader of Fund Accounting

Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Remote or Hybrid
5 Locations
8500 Employees
Remote or Hybrid
3 Locations
289097 Employees

Capco Logo Capco

Business Analyst

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

Similar Companies Hiring

Scrunch  Thumbnail
Artificial Intelligence • Information Technology • Marketing Tech • Software • SEO
Salt Lake City, Utah
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account