Senior Data Engineer (Databricks)

Posted 9 Days Ago
Be an Early Applicant
Coimbatore, Tamil Nadu, IND
In-Office
Senior level
Artificial Intelligence • Cloud • Information Technology • Machine Learning • Natural Language Processing • Consulting
Cutting-edge AI, Machine Learning and Cloud Transformation company at the forefront of technological innovation
The Role
Build, optimize, and scale end-to-end data pipelines using Databricks, SQL, Python, and Spark. Improve ETL/ELT performance, reliability, and cost efficiency; implement data quality, governance, and security practices; troubleshoot distributed data workflows; collaborate with engineers, analysts, and stakeholders; and support cloud data platform migration and modernization initiatives.
Summary Generated by Built In

Unlock Your Future with Nexaminds!

At Nexaminds, we're on a mission to redefine industries with AI. We're passionate about the limitless potential of artificial intelligence to transform businesses, streamline processes, and drive growth.

Join us on our visionary journey. We're leading the way in AI solutions, and we're committed to innovation, collaboration, and ethical practices. Become a part of our team and shape the future powered by intelligent machines. If you're driven by ambition, success, fun, and learning, Nexaminds is where you belong.

Nexaminds is looking for a Senior Databricks Engineer to lead the development, optimization, and scaling of our data solutions. The ideal candidate has hands-on expertise building end-to-end pipelines on Databricks and enjoys working in a fast-paced, highly collaborative environment.

Location: India

General Duties & Responsibilities

(May include but are not limited to the following)

  • Solution Design & Delivery: Translate business requirements into technical specifications to implement robust data ingestion processes. Understand data solution requirements, manage development, and lead end-to-end project delivery.
  • Data Pipeline Engineering: Develop and implement data pipelines to support organizational initiatives. Build and maintain complex ETL (Extract, Transform, Load) or ELT (Extract, Load, Transform) pipelines to efficiently move data from various sources into a usable, structured format.
  • System Optimization: Ensure data systems are highly efficient, scalable, and performant to meet the rigorous demands of data-intensive applications.
  • Cross-Functional Collaboration: Work closely with data scientists, analysts, and other key stakeholders to understand their data needs and provide them with the necessary data infrastructure and specialized tools.
  • Quality & Governance: Implement processes and tools to ensure optimal data accuracy, consistency, and strict compliance with relevant internal policies and industry regulations.
  • Technical Documentation: Create functional and technical design documents, ensuring comprehensive and up-to-date documentation is maintained for all newly created or modified data processes.
Minimum Requirements

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.

Minimum Experience & Technical Skills
  • Data Engineering: 5+ years of proven experience building data ingestion processes and data infrastructure tools.
  • Azure & Big Data Stack: 5+ years of hands-on experience utilizing DataBricks, Scala, Azure Data Factory (ADF), and SQL Server.
  • Database Management: 5+ years of advanced database development and management experience with MS SQL Server.
Preferred Qualifications & Industry Experience
  • Healthcare Domain: Experience in the healthcare industry is strongly preferred, including a proven understanding of healthcare data terminology.
  • Regulatory Compliance: Clear understanding and working knowledge of HIPAA protocols and data privacy standards.
  • Business Intelligence: Experience working with Microsoft’s Power BI, SSRS, SSAS, Azure Data Factory, and other cloud-based BI or reporting services is a distinct advantage.
  • Certifications: An active Microsoft Azure Certification is considered a strong plus.

What you can expect from us

Here at Nexaminds, we're not your typical workplace. We're all about creating a friendly and trusting environment where you can thrive. Why does this matter? Well, trust and openness lead to better quality, innovation, commitment to getting the job done, efficiency, and cost-effectiveness.

  • Stock options 📈
  • Remote work options 🏠
  • Flexible working hours 🕜
  • Benefits above the law
  • But it's not just about the work; it's about the people too. You'll be collaborating with some seriously awesome IT pros.
  • You'll have access to mentorship and tons of opportunities to learn and level up.

Ready to embark on this journey with us? 🚀🎉 If you're feeling the excitement, go ahead and apply!

Skills Required

  • 5+ years of experience in data engineering or similar roles
  • Strong expertise with Databricks, including Spark, Delta Lake, Workflows, and SQL
  • Proficiency in Python and SQL
  • Understanding of Azure or AWS cloud platforms
  • Experience with data modeling, data warehousing, and distributed computing
  • Shell scripting experience
  • Experience with GitHub and JFrog Artifactory
  • Excellent communication and collaboration skills
  • Strong written and verbal English proficiency
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Washington, DC
80 Employees
Year Founded: 2023

What We Do

Nexaminds is a cutting-edge AI and Cloud Transformation company at the forefront of technological innovation. We specialize in developing advanced artificial intelligence solutions that empower businesses to unlock their full potential. With a team of skilled AI and Cloud experts and a passion for revolutionizing industries, we are dedicated to delivering intelligent, scalable, and customized solutions tailored to meet our clients' specific needs. We strive to create innovative AI-driven solutions that enhance efficiency, productivity, and decision-making processes across industries. By leveraging state-of-the-art technology and fostering a culture of creativity, we aim to be the trusted partner that enables organizations to embrace the future with confidence.

Similar Jobs

ShyftLabs Logo ShyftLabs

Senior Data Engineer

Blockchain • Database • Analytics
Hybrid
Coimbatore, Tamil Nadu, IND
110 Employees

Pfizer Logo Pfizer

Senior Associate, Senior Data Manager, Clinical Data Sciences

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Hybrid
Chennai, Tamil Nadu, IND
121990 Employees

Pfizer Logo Pfizer

Marketing Associate

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
8 Locations
121990 Employees
69K-114K Annually

Optum Logo Optum

Senior Manager Software Engineering

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Chennai, Tamil Nadu, IND
160000 Employees

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account