The Role
Design and present scalable Databricks Lakehouse architectures, lead data engineering and ML projects, build reference architectures and demos, validate cloud integrations, and support sales through technical account planning and customer engagement.
Summary Generated by Built In
About Koantek:
Koantek is a Databricks-exclusive system integrator trusted by enterprises to move from platform adoption to real AI impact. A seven-time Databricks Partner of the Year, we’re recognized with Brickbuilder Specializations across AI, Security & Governance, Migrations, Lakeflow, and multiple industries.
We combine deep technical expertise with proven delivery to help customers operationalize data and AI at scale — securely, efficiently, and with measurable business outcomes.
Our teams combine deep Databricks engineering expertise with a product-driven delivery mindset. From enterprise-grade Agent-to-Agent (A2A) and Multi-Context Processing (MCP) architectures to AI-powered governance and computer vision, we help organizations move beyond pilots and deploy AI confidently at scale.
Senior Databricks Solution Architect
Overview:
We are seeking an experienced and dedicated Senior Solutions Architect to lead technical engagements and provide strategic guidance for our strategic client accounts. This high-impact role requires deep expertise in the Databricks Platform, acting as the client's primary technical advisor for complex data, analytics, and AI initiatives. You will bridge business objectives with technical execution, designing and delivering scalable Lakehouse architectures while mentoring client teams and driving adoption of advanced Databricks capabilities.
Key Responsibilities:
• Platform Architecture & Design: Lead the design and implementation of enterprise-scale, secure, and high-performance data architectures on the
Databricks Lakehouse Platform, leveraging Delta Lake, Unity Catalog, serverless compute, and advanced features like Photon engine.
• Hands-On Implementation & Leadership: Provide expert hands-on guidance and lead development of complex data engineering pipelines using Apache Spark, PySpark, SQL, and Scala, with a focus on code quality, optimization, and best practices.
• Performance Tuning & Optimization: Identify, diagnose, and resolve complex performance issues in large-scale data processing, query optimization, and cluster configurations.
• Client Advisory & Strategy: Serve as the trusted senior technical advisor to client leadership, engineering, and data science teams, delivering best practices in data governance, security, MLOps, and operational excellence.
• Knowledge Transfer & Team Enablement: Design and deliver advanced workshops, training sessions, and ongoing mentorship to accelerate client team proficiency and self-sufficiency.
• Feature Adoption & Innovation: Champion the adoption of new Databricks features and tools (e.g., Photon, AI/BI, Mosaic AI) and integrate them effectively into client environments.
• Cloud Integration: Ensure seamless, optimized, and secure integration with major cloud platforms (AWS, Azure, GCP) including storage, networking, IAM, and security services.
Required Qualifications and Skills
Technical Expertise:
Technical Expertise:
• 8+ years of experience in data engineering, big data architecture, or software engineering with a focus on data platforms.
• 5+ years of deep, hands-on experience designing, implementing, and optimizing solutions on the Databricks platform.
• Expert-level proficiency in Apache Spark ecosystem (PySpark, Spark SQL, Scala) and large-scale data processing.
• Strong experience with cloud infrastructure (AWS, Azure, GCP), including storage solutions (S3, ADLS), networking, and security models.
• Deep expertise in Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and best practices for ETL/ELT, data governance, and reliability.
• Proficiency in Python, Scala, advanced SQL, and modern DevOps practices including Docker, Kubernetes, and CI/CD.
Professional & Communication Skills:
• Exceptional client-facing and presentation skills, able to communicate complex concepts to both technical and C-level audiences.
• Proven leadership in client engagements, ability to drive consensus and influence decision-making across stakeholder groups.
• Strong problem-solving, analytical skills, and a proactive, consultative mindset.
Preferred Qualifications:
• Databricks Certified Professional or higher certifications.
• Relevant cloud certifications (e.g., AWS Certified Big Data, Azure Data Engineer, Google Professional Data Engineer).
• Experience with MLOps, generative AI, and advanced analytics on Databricks.
• Prior experience in senior consulting, solution architecture, or resident roles.
"Koantek is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status."
Skills Required
- Translate customer business needs into technology solutions and establish stakeholder buy-in
- Design, architect, and present data systems and manage delivery of production data solutions
- Hands-on development experience on Databricks
- Expert-level knowledge of Apache Spark, MLflow, and Delta Lake
- Expert-level hands-on coding experience in Spark/Scala, Python or PySpark
- In-depth understanding of Spark architecture (Spark Core, Spark SQL, DataFrames, Streaming, RDD caching, MLlib)
- Deep experience with distributed computing and Spark runtime
- Experience with private and public cloud architectures and migration considerations
- Extensive hands-on experience implementing data migration and processing using AWS/Azure/GCP services
- Familiarity with CI/CD for production deployments
- Familiarity with performance and scalability optimization
- Completed data engineering professional certification and required classes
- SQL proficiency and fluency in database technologies
- Degree in a quantitative discipline (Computer Science, Applied Mathematics, Operations Research)
- Relevant certifications (Databricks, AWS/Azure/GCP AI/ML) are a plus
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Koantek is a Databricks-exclusive system integrator focused on enterprise-scale data and AI transformation, helping clients modernize, migrate, and scale AI solutions.
