The Role
Lead professional services engagements delivering production-grade Big Data and AI solutions on Databricks. Responsibilities include designing cloud-native architectures, coding in Python or Scala, optimizing Apache Spark workloads, implementing CI/CD and MLOps, resolving complex technical issues, advising strategic customers, and influencing product roadmaps. The role combines hands-on engineering, solution architecture, technical consulting, and executive-level stakeholder communication.
Summary Generated by Built In
We are looking for a high-caliber Senior Solution Architect to join our Professional Services team. This is a high-impact, technical role designed for a seasoned expert who can balance deep hands-on coding with strategic consulting. As an Sr Solutions Architect, you will be embedded with our most strategic customers, acting as a “Trusted Advisor” to design, build, and deploy production-grade Big Data and AI solutions on the Databricks platform.
Key Responsibilities
- Technical Delivery: Lead short-to-mid-term professional services projects, focusing on data engineering, data science, and cloud-native architecture.
- Hands-on Engineering: Write production-quality code (Python, Scala), optimize distributed compute (Apache Spark) workloads, and integrate solutions across cloud ecosystems.
- Architecture & Design: Design reference architecture and assist customers with production-level deployments, CI/CD pipelines, and MLOps.
- Strategic Advisory: Guide customers through “Build vs. Buy” decisions, highlighting the value of scalability and maintainability over technical debt.
- Problem Solving: Resolve high-level technical escalations and unblock customers by debugging complex performance issues or building bridge solutions for feature gaps.
- Collaboration: Work closely with Product Engineering to provide real-world feedback and influence the future roadmap of the Databricks platform.
Required Skills & Experience
- Experience: 8+ years in Data Engineering, Analytics, or Platform roles, with at least 10+ years in technical consulting.
- Technical Mastery: Deep expertise in Apache Spark internals and distributed processing.
- Coding: Advanced proficiency in Python or Scala.
- Cloud Expertise: Deep experience in at least one major cloud provider (AWS, Azure, or GCP) and working knowledge of a second.
- Project History: Proven track record of delivering at least 6-8+ end-to-end Databricks projects.
- DevOps/MLOps: Strong familiarity with production deployment practices, including CI/CD and data governance frameworks (Unity Catalog).
- Certifications: Databricks Certified Data Engineering Professional (or equivalent).
Soft Skills & Professional Qualities
- Consulting Mindset: Ability to earn trust early, empathize with customer pain points, and manage stakeholder expectations effectively.
- Communication: Skilled at simplifying complex technical concepts for executive-level stakeholders.
- Adaptability: Comfortable working across various industries and diverse cloud environments.
- Strategic Thinking: Focuses on long-term value, identifying “quick wins” while mitigating long-term architectural risks.
What to Expect
- This is a billable professional services role. You will be an embedded engineer delivering real implementations, not just strategy.
- You will tackle some of the most challenging data problems in the industry, requiring you to be both a visionary architect and a diligent debugger.
- You will play a critical role in helping customers adopt a “Data + AI” mindset, transforming how they operate their business.
- You will become more of a Sr Forward Deployed Engineer
Skills Required
- 8+ years of experience in data engineering, analytics, or platform roles
- 10+ years of experience in technical consulting
- Deep expertise in Apache Spark internals and distributed processing
- Advanced proficiency in Python or Scala
- Deep experience with at least one major cloud provider: AWS, Azure, or GCP
- Working knowledge of a second major cloud provider
- Track record of delivering at least 6–8 end-to-end Databricks projects
- Familiarity with production deployment practices, CI/CD, MLOps, and data governance frameworks including Unity Catalog
- Databricks Certified Data Engineering Professional certification or equivalent
- Ability to build customer trust, understand pain points, and manage stakeholder expectations
- Ability to explain complex technical concepts to executive-level stakeholders
- Ability to work across industries and diverse cloud environments
- Strategic approach to balancing quick wins with long-term architectural risks
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Koantek is a Databricks-exclusive system integrator focused on enterprise-scale data and AI transformation, helping clients modernize, migrate, and scale AI solutions.








