Big Data Engineer (Azure Databricks)

Posted 7 Hours Ago
Hiring Remotely in USA
Remote
Mid level
Artificial Intelligence • Information Technology • Machine Learning • Software • Virtual Reality • Analytics
The Role
The Big Data Engineer will lead data migration projects and develop scalable data pipelines to ensure efficient data movement using Azure Databricks and other Azure components. Responsibilities include ensuring data quality, providing technical support, and staying updated on cloud and data technologies.
Summary Generated by Built In

Company Description

👋🏼 We're Nagarro.

We are a digital product engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18,500+ experts across 36 countries, to be exact). Our work culture is dynamic and non-hierarchical. We're looking for great new colleagues. That's where you come in!

By this point in your career, it is not just about the tech you know or how well you can code. It is about what more you want to do with that knowledge. Can you help your teammates proceed in the right direction? Can you tackle the challenges our clients face while always looking to take our solutions one step further to succeed at an even higher level? Yes? You may be ready to join us.

Job Description

In this role, you will work with our Business Analytics & Insights (BAI) team, collaborating with cross-functional teams to deliver high-quality data solutions in areas such as Supply Chain, Finance, Operations, Customer Experience, HR, Risk Management, and Global IT.

Responsibilities:

  • Lead the technical planning for data migration, including data ingestion, transformation, storage, and access control within Azure Data Factory and Azure Data Lake.
  • Design and implement scalable, efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks.
  •  Develop reusable frameworks for the ingestion of large datasets.
  •  Ensure data quality and integrity by implementing robust validation and cleansing mechanisms throughout the data pipeline.
  •  Work with event-based/streaming technologies to ingest and process data in real-time.
  •  Provide technical support to the team, resolving challenges during the migration and post-migration phases.
  •  Stay current with the latest advancements in cloud computing, data engineering, and analytics technologies; recommend best practices and industry standards for data lake solutions.

Qualifications

  • 3+ years of IT experience.
  •  Minimum of 4 years working with Azure Databricks.
  •  Proficiency in Data Modeling and Source System Analysis.
  •  Strong knowledge of PySpark and SQL.
  •  Experience with Azure components: Data Factory, Data Lake, SQL Data Warehouse (DW), and Azure SQL.
  •  Experience with Python for data engineering purposes.
  •  Ability to conduct data profiling, cataloging, and mapping for technical design and construction of data flows.
  • Familiarity with data visualization/exploration tools.

Additional Information

  • Strong problem-solving capabilities, able to translate business requirements into data science solutions.
  • Excellent communication skills, with the ability to explain complex concepts to both technical and non-technical stakeholders.
  • Strong team player with excellent interpersonal and collaboration skills.
  • Ability to deliver high-quality results within specified timelines.

Top Skills

Python
SQL
The Company
19,994 Employees
Remote Workplace
Year Founded: 1996

What We Do

Nagarro helps future-proof your business through a forward-thinking, fluidic, and CARING mindset. We excel at digital engineering and help our clients become human-centric, digital-first organizations, augmenting their ability to be responsive, efficient, intimate, creative, and sustainable. Today, we are 19,000 experts across 36 countries, forming a Nation of Nagarrians, ready to help our customers succeed.

Similar Jobs

Nagarro Logo Nagarro

Big Data Engineer - Azure Databricks

Artificial Intelligence • Information Technology • Machine Learning • Software • Virtual Reality • Analytics
Remote
USA
19994 Employees

Nagarro Logo Nagarro

Big Data Engineer - Azure Databricks

Artificial Intelligence • Information Technology • Machine Learning • Software • Virtual Reality • Analytics
Remote
USA
19994 Employees

CrowdStrike Logo CrowdStrike

Sr. Analyst, Falcon Complete (Remote, 3rd Shift)

Cloud • Information Technology • Sales • Security • Cybersecurity
Remote
United States
10000 Employees
115K-185K Annually

CrowdStrike Logo CrowdStrike

Threat Analyst, Machine Learning - SkillBridge (Remote)

Cloud • Information Technology • Sales • Security • Cybersecurity
Remote
United States
10000 Employees

Similar Companies Hiring

Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees
RunPod Thumbnail
Software
Philadelphia, PA
51 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account