Databricks Engineer/ Architect- EST Timezone

Posted 2 Days Ago
Be an Early Applicant
Hiring Remotely in India
Remote
Senior level
Information Technology • Software
ISHIR is an award-winning and SEI CMMi Level 3 certified custom software development company.
The Role
Design, build, stabilize, and optimize Databricks-based end-to-end data pipelines. Harden production workflows, resolve performance bottlenecks, implement best practices for scalability and cost, and support reporting/BI solutions while collaborating across teams to improve platform reliability and business value.
Summary Generated by Built In
About the Role:

We are looking for experienced Databricks Engineers / Architects to join a fast-moving data transformation initiative. The client is already live on Databricks with production pipelines and reporting in place, but the platform requires stabilization, optimization, and scaling.

This is an opportunity to work in a high-impact environment, helping transform an evolving data platform into a reliable, production-grade system delivering consistent business value.

Key Responsibilities:
  • Design, build, and stabilize Databricks-based data pipelines
  • Perform pipeline optimization and production hardening
  • Develop and support reporting and data visualization solutions
  • Implement best practices for performance, scalability, and cost optimization
  • Work on end-to-end data workflows (ingestion → transformation → reporting)
  • Identify and resolve performance bottlenecks and system inefficiencies
  • Bring structure and consistency to an evolving Databricks environment
  • Collaborate with cross-functional teams to improve platform reliability and ROI
Required Skills & Experience:
  • Strong hands-on experience with Databricks (must-have)
  • Experience in data pipeline development (ETL/ELT)
  • Solid understanding of data engineering and data architecture principles
  • Experience working with large-scale data processing systems
  • Exposure to reporting/BI tools (Power BI, Tableau, or similar)
  • Ability to work in fast-paced, evolving environments with minimal handholding
Preferred / Good-to-Have Skills:
  • Familiarity with Apache Spark (PySpark / Scala)
  • Experience with cloud platforms (AWS / Azure / GCP)
  • Knowledge of performance tuning and cost optimization in Databricks
  • Exposure to data governance, security, and best practices
  • Prior experience in stabilizing or scaling data platforms
Ideal Candidate Profile:
  • Can quickly ramp up and contribute from day one
  • Strong problem-solver with experience handling unstable or partially built systems
  • Comfortable working in a “build while running” environment
  • Balances technical expertise with delivery focus
What Success Looks Like:
  • Stabilized and optimized Databricks pipelines
  • Improved platform reliability and performance
  • Scalable and production-ready data workflows
  • Consistent and measurable business value delivery

Skills Required

  • Strong hands-on experience with Databricks
  • Experience in data pipeline development (ETL/ELT)
  • Solid understanding of data engineering and data architecture principles
  • Experience working with large-scale data processing systems
  • Exposure to reporting/BI tools (Power BI, Tableau, or similar)
  • Ability to work in fast-paced, evolving environments with minimal handholding
  • Familiarity with Apache Spark (PySpark / Scala)
  • Experience with cloud platforms (AWS / Azure / GCP)
  • Knowledge of performance tuning and cost optimization in Databricks
  • Exposure to data governance, security, and best practices
  • Prior experience in stabilizing or scaling data platforms
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dallas, TX
200 Employees
Year Founded: 1999

What We Do

ISHIR partners with BOLD businesses to navigate their shift to an AI native world. We help AI-first leaders bring clarity to complex decisions and turn AI into real business advantage. Our work combines strategic thinking, product development, and AI engineering expertise. We focus on reinvention through people, processes, products, and platforms so organizations do not just adopt AI, but operate differently because of it. We help businesses move faster with confidence and WIN in a post AI era. Headquartered in Dallas Fort-Worth (regional presence across Texas), we are a Digital Product Innovation Studio + AI-Native System Integrator with a 26+ year (established 1999) legacy of helping organizations transform ideas into measurable business impact. We deliver a complete portfolio of digital services including AI-powered custom software development, AI-accelerated product innovation, data + AI strategy, data engineering, AI Agent automation, and global AI-first talent solutions. Our Focus We partner with AI-curious and forward-thinking companies to design and build competitive advantage through AI-native digital products and solutions that drive growth and redefine industries. By combining digital product innovation, data + AI transformation, and AI-First engineering teams, we help businesses: Reducing time-to-value through clarity, lean experimentation, and continuous AI-powered delivery Leverage customer insights to accelerate product-market fit (PMF) with rapid validation and prototyping Strengthen competitive advantage through Innovation, Data + AI and Talent Accelerators Providing global AI-First engineering talent, global capability centers (GCC) and agile AI engineering pods for ongoing innovation Integrating automation and AI agents to enhance human performance Our CTOs & CAIOs help businesses move faster, reduce risk, and align technology with business priorities. Our Difference We call it Impact Engineering — the ability to merge digital strategy, AI technology, and execution to deliver meaningful outcomes. ISHIR’s cross-functional teams bring clarity, speed, and precision to every engagement. Our global delivery model ensures the right expertise at the right time, wherever you are in your innovation journey. Let’s build what’s next — together. ISHIR serves clients in Texas (Dallas Fort Worth, Austin, San Antonio, and Houston), LATAM (Argentina, Brazil, Costa Rica, Colombia), India (New Delhi/Noida), UAE (Dubai, Abu Dhabi)

Why Work With Us

Flexible, Honest Inspiring

Gallery

Gallery

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account