Data Engineer

Posted 13 Days Ago
Be an Early Applicant
Vadodara, Gujarat, IND
In-Office
Mid level
Software
The Role
Designs, builds, optimizes, and supports scalable Microsoft Fabric data engineering solutions. Responsibilities include developing ingestion pipelines, Lakehouse and Warehouse architectures, ETL/ELT processes, dimensional models, data quality controls, monitoring, troubleshooting, security, governance, CI/CD, and production support. Collaborates with analysts, Power BI developers, application teams, data scientists, and business stakeholders to deliver reliable, analytics-ready data in an Agile environment.
Summary Generated by Built In

We are looking for a Data Engineer with strong hands-on experience in Microsoft Fabric to design, build, optimize, and support scalable data engineering solutions. The role focuses on data ingestion and transformation, Lakehouse and Warehouse development, data pipelines, and reliable delivery of curated, analytics-ready data. The successful candidate will work closely with data analysts, Power BI developers , application teams, and business stakeholders to translate business needs into secure, maintainable, high-performing data solutions.



RequirementsKey Responsibilities
Microsoft Fabric & Data Platform Development

·       Design, develop, and maintain end-to-end data engineering solutions using Microsoft Fabric.

·       Build and manage Fabric Data Factory pipelines for batch, scheduled, and incremental data ingestion.

·       Develop and maintain Fabric Lakehouse and Warehouse solutions, using OneLake for centralized data storage and management.

·       Use Fabric notebooks, Spark, SQL analytics, and Dataflows Gen2 to process and transform data.

·       Apply Medallion Architecture (Bronze, Silver, and Gold) where appropriate for data organization, quality, and reuse.

Data Ingestion, Transformation & Modeling

·       Develop robust ETL/ELT processes to ingest data from databases, REST APIs, files, and cloud/SaaS applications.

·       Implement incremental loads, change data capture (CDC), slowly changing dimensions (SCD), partitioning, and other suitable processing strategies.

·       Develop and optimize analytical data models, including dimensional models and star/snowflake schemas.

·       Use SQL, Python, PySpark, and Spark SQL to transform, validate, and prepare data for reporting and analytics.

·       Implement data quality checks, validation, reconciliation, error handling, and appropriate recovery mechanisms.

Performance, Reliability & Operations

·       Monitor pipeline execution and data processing; troubleshoot failures and perform root-cause analysis.

·       Optimize Spark jobs, SQL queries, pipeline design, and storage usage for performance, scalability, and cost efficiency.

·       Implement logging, monitoring, alerting, and production-support practices to improve platform reliability.

·       Support issue resolution and continuous improvement across data pipelines and platform workloads.

Security, Governance & Deployment

·       Apply appropriate security controls, workspace access, identity and access management, and data access practices with platform and security teams.

·       Follow data governance, documentation, and engineering standards; support data lineage and governance requirements where applicable.

·       Use Git-based source control and support CI/CD and deployment processes for Fabric solutions through Azure DevOps or GitHub.

·       Document data architecture, pipelines, data models, dependencies, operational procedures, and technical decisions.

Collaboration & Business Alignment

·       Work with Power BI teams to provide curated, trusted, analytics-ready datasets and support semantic-model requirements.

·       Collaborate with analysts, data scientists, application teams, and business stakeholders to understand requirements and deliver practical solutions.

·       Contribute to design reviews, estimation, sprint planning, testing, release activities, and continuous improvement in an Agile delivery environment.

Required Qualifications
Experience & Education

·       3+ years of experience in data engineering, with mandatory hands-on experience developing solutions in Microsoft Fabric.

·       Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, Data Science, or a related field; equivalent professional experience may be considered.

·       Experience building end-to-end data pipelines and supporting data solutions through development, deployment, and production.

Microsoft Fabric Skills

·       Hands-on experience with Fabric Data Factory / Data Pipelines, Lakehouse, Warehouse, OneLake, notebooks, Spark, SQL analytics, and Dataflows Gen2.

·       Understanding of Microsoft Fabric architecture, workspaces, and end-to-end data processing patterns.

·       Ability to develop, troubleshoot, and optimize production-ready data pipelines in Microsoft Fabric.

·       Familiarity with Fabric data agents and their potential use in data discovery or conversational access to data.

Core Data Engineering Skills

·       Strong SQL skills, including complex queries, joins, CTEs, window functions, and query optimization.

·       Strong programming knowledge in Python and/or PySpark, with practical experience in data transformation and processing.

·       Solid understanding of ETL/ELT concepts, batch and incremental processing, data warehousing, and dimensional modeling.

·       Experience with data quality, validation, reconciliation, error handling, and reliable pipeline design.

·       Working understanding of cloud security, identity, access management, and secure handling of enterprise data.

DevOps & Engineering Practices

·       Experience with Git and source control, and familiarity with Azure DevOps or GitHub.

·       Understanding of CI/CD pipelines, automated deployment, environment management, and release practices.

·       Experience with monitoring, logging, troubleshooting, and production support.

Preferred Qualifications

·       Microsoft Certified: Fabric Data Engineer Associate (DP-700) is preferred; Microsoft Certified: Fabric Analytics Engineer Associate (DP-600) is also relevant.

·       Experience migrating data solutions from Azure Synapse Analytics, Azure Data Factory, Databricks, or traditional data warehouses to Microsoft Fabric.

·       Experience with Power BI semantic models and DAX.

·       Knowledge of Microsoft Purview, data governance, data lineage, and compliance practices.

·       Exposure to real-time analytics, Eventstream, or Real-Time Intelligence in Microsoft Fabric.

·       Experience integrating REST APIs and SaaS data sources.

·       Familiarity with Microsoft Azure AI Foundry / Microsoft Foundry and its data or AI-related capabilities.

·       Experience working in Agile/Scrum teams.

Preferred Candidate Profile

·       Strong analytical thinking, problem-solving, and attention to data quality.

·       Able to work independently while collaborating effectively with cross-functional teams.

·       Clear communication and technical documentation skills.

·       Able to translate business requirements into scalable and maintainable data solutions.

·       Takes ownership of data engineering solutions from design and development through deployment and production support.

·       Shows initiative in learning and applying evolving Microsoft Fabric and modern data engineering capabilities.

Key Success Measures

·       Reliable, maintainable, and well-documented Fabric pipelines delivered to agreed timelines.

·       Improved data quality, reconciliation, and availability of trusted analytics-ready datasets.

·       Effective pipeline and query performance, with appropriate cost and resource optimization.

·       Timely resolution of pipeline issues and adherence to security and engineering standards.

·       Effective collaboration with reporting, analytics, application, and business teams.​



Skills Required

  • 3+ years of experience in data engineering
  • Hands-on experience developing solutions in Microsoft Fabric
  • Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field; equivalent professional experience may be considered
  • Experience building end-to-end data pipelines and supporting data solutions through development, deployment, and production
  • Experience with Fabric Data Factory or Data Pipelines, Lakehouse, Warehouse, OneLake, notebooks, Spark, SQL analytics, and Dataflows Gen2
  • Strong SQL skills, including complex queries, joins, CTEs, window functions, and query optimization
  • Strong programming knowledge in Python and/or PySpark
  • Understanding of ETL/ELT, batch and incremental processing, data warehousing, and dimensional modeling
  • Experience with data quality, validation, reconciliation, error handling, and reliable pipeline design
  • Working understanding of cloud security, identity, access management, and secure enterprise data handling
  • Experience with Git and source control, with familiarity with Azure DevOps or GitHub
  • Understanding of CI/CD pipelines, automated deployment, environment management, and release practices
  • Experience with monitoring, logging, troubleshooting, and production support
  • Microsoft Certified: Fabric Data Engineer Associate (DP-700)
  • Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
  • Experience migrating solutions from Azure Synapse Analytics, Azure Data Factory, Databricks, or traditional data warehouses to Microsoft Fabric
  • Experience with Power BI semantic models and DAX
  • Knowledge of Microsoft Purview, data governance, data lineage, and compliance practices
  • Exposure to real-time analytics, Eventstream, or Real-Time Intelligence in Microsoft Fabric
  • Experience integrating REST APIs and SaaS data sources
  • Familiarity with Microsoft Azure AI Foundry or Microsoft Foundry
  • Experience working in Agile or Scrum teams
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Crystal River, FL
194 Employees

What We Do

NetWeb provides innovative products and reliable professional services to business enterprises around the globe since 1998. The company has built up a core competence in creating and deploying cost-effective capability using an offshore-centric business model. The company’s offices are based in Florida, USA and , Vadodara, India. We have professional associates in both USA and UK to perform sales, marketing and customer management functions. Our competitive advantages include a pool of highly competent professionals, a strong management team, strategic offshore location, extreme cost-effectiveness, an ISO-9001:2008 certified Quality Management System and over 26 Years of successful performance. Our Quality Management System has been certified by ISO-9001:2008 to cover the entire spectrum of our services including the design, development and support of software solutions. The Quality Management System has been built upon well defined and proven standard operating procedures to ensure consistent and high quality standards. NetWeb is committed to long-term customer relationships. We function as a seamless extension of our client’s organization and share a common perspective and understanding of their business imperatives. Our business model requires all engagements to be long-term relationships that include a potential to develop a partnership between the two companies. We create and support intellectual assets for our clients with complete trust and confidence

Similar Jobs

Zensar Technologies Logo Zensar Technologies

Data Engineer

Information Technology
In-Office or Remote
2 Locations
10000 Employees

Zensar Technologies Logo Zensar Technologies

Data Engineer

Information Technology
In-Office or Remote
2 Locations
10000 Employees

Simform Logo Simform

Data Engineer

Information Technology
In-Office or Remote
Ahmedabad, Gujarat, IND
845 Employees

Zensar Technologies Logo Zensar Technologies

Data Engineer

Information Technology
In-Office or Remote
2 Locations
10000 Employees

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account