SunnyData is a leading Databricks technology partner, helping customers build scalable architectures, robust data engineering pipelines, and advanced ML and AI applications. As a Principal Solutions Architect, you'll drive customer success on two fronts: hands on technical execution and presales support, splitting your time evenly between the two.
The Impact You Will Have
Customer Engagement: Serve as a trusted advisor to customers, guiding their data engineering and architecture strategy with a focus on Databricks solutions.
Technical Delivery: Design, build, and deploy comprehensive data solutions that capture, transform, and leverage data for AI, ML, and business intelligence initiatives, while driving innovation through thought leadership on data trends.
Presales Support: Partner with sales teams to present technical solutions to prospective clients, demonstrating the value of SunnyData's offerings.
Project Oversight: Manage multiple customer accounts, ensuring timely delivery and clear reporting on progress and outcomes.
Solution Design: Architect data solutions that incorporate best practices in governance, security, and data quality.
Data Analysis: Evaluate data sources for their value and recommend inclusion strategies that strengthen analytics.
Cross Functional Collaboration & Mentorship: Guide internal teams, provide direction and mentorship to project teams, and educate end users on data products and analytic environments.
Problem Resolution: Perform system analysis, diagnose data and system defects, and apply the right fix.
Quality Assurance: Test data movement, transformation code, and data components for accuracy and reliability.
Required Experience
Experience: 10+ years as a hands on Solutions Architect and/or Senior Data Engineer, with recent experience implementing data solutions on Databricks.
Technical Proficiency: Expertise in data engineering technologies (Spark, Hadoop, Kafka), the Databricks platform, and data science/ML tooling (pandas, scikitlearn).
Architecture & Solution Design: Deep understanding of the end to end data analytics workflow (data modeling, ETL, data integration) using modern engineering techniques. Able to run complex architecture discovery, solution design sessions, and build implementation blueprints that engineering and analytics teams can execute.
Programming Skills: Proficiency in Java, Python, and/or Scala.
Cloud Platforms: AWS, Azure, and/or GCP.
SQL Expertise: Able to write, debug, and optimize SQL queries.
Client Facing Skills: Strong written and verbal communication, with experience in client facing roles.
Presentation Skills: Able to build and deliver detailed presentations to clients and stakeholders.
Documentation: Experience producing detailed solution documentation, including POCs, roadmaps, sequence diagrams, class hierarchies, and logical system views.
End to End Solutions: Able to take technical solutions into production, ensuring performance, security, scalability, and robust data integration.
Team Leadership: Experience managing, mentoring, and growing a team of engineers.
Preferred Experience
Distributed Storage: Familiarity with cloud and distributed data storage systems such as S3, ADLS, HDFS, GCS, Kudu, ElasticSearch/Solr, Cassandra, or other NoSQL storage systems.
Data Integration: Experience with data integration technologies like Spark, Kafka, StreamSets, Matillion, Fivetran, NiFi, AWS Data Migration Services, Azure Data Factory, and Informatica Intelligent Cloud Services (IICS).
Software Development Lifecycle: Comprehensive experience with the complete SDLC, including design, documentation, implementation, testing, and deployment.
Automated Pipelines: Expertise in automated data transformation and curation using tools like dbt, Spark, Spark Streaming, and automated pipelines.
Workflow Management: Experience with workflow management and orchestration tools like Airflow, AWS Managed Airflow, Luigi, and NiFi.
Domain Knowledge: Background working in the Financial Services industry, preferably in a banking environment.
Regulatory Compliance: Understanding of industry compliance requirements and standards, specifically in banking IT landscapes.
Certifications (at least 2 of the following): Associate Developer for Apache Spark, Data Engineer Associate, Professional Data Engineer, Machine Learning Associate, Professional ML Engineer.
Location: residing in Pacific Time or on the West Coast are strongly preferred.
Education:
Degree: 4-year Bachelor's degree in Computer Science or a related field.
Benefits
Health Insurance : Employees and their eligible family members including spouses, domestic partners, and children are eligible for coverage from the first day of employment.
Paid Time Off : Start your career at SunnyData with a minimum of 20 days Paid Time Off annually, plus nine paid company Holidays.
An opportunity to grow your technical and people skills, lead teams on complex customer projects that are highly innovative and cutting edge. Great opportunity to grow in your career with the right level of focus, innovation and customer centricity with a high growth consulting company dedicated to Databricks.
Compensation Overview
The annual base salary range provided for this position is a nationwide market range and represents a broad range of salaries for this role across the country. The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. As part of our comprehensive compensation and benefits program, employees are also eligible for performance-based cash incentive awards.
Our Commitment to Diversity and Inclusion:
SunnyData is dedicated to building a workforce that reflects the world around us. We are an equal opportunity employer committed to unbiased hiring practices. All qualified applicants will receive consideration for employment without regard to race, religion, gender identity, disability, veteran status, or any other protected characteristic.
Why Join SunnyData?
Innovative Environment: Work with cutting-edge technologies and industry leaders in data engineering and AI.
Customer Impact: Make a real difference in how businesses leverage data for strategic decision-making.
Career Growth: Opportunities for professional development and career advancement.
Collaborative Culture: Join a supportive team that values collaboration and knowledge sharing.
If you are passionate about data engineering and enjoy engaging with clients to solve their most challenging problems, we would love to hear from you. Apply today and become a key player in SunnyData's success story.
Skills Required
- 10+ years of hands-on experience as a Solutions Architect and/or Senior Data Engineer
- Recent experience implementing data solutions on Databricks
- Expertise with data engineering technologies including Spark, Hadoop, and Kafka
- Expertise with the Databricks platform
- Experience with data science and machine learning tooling such as pandas and scikit-learn
- Deep understanding of data modeling, ETL, data integration, and end-to-end data analytics workflows
- Ability to conduct architecture discovery and solution design sessions and create implementation blueprints
- Proficiency in Java, Python, and/or Scala
- Experience with AWS, Azure, and/or GCP
- Ability to write, debug, and optimize SQL queries
- Strong written and verbal communication skills with client-facing experience
- Ability to create and deliver detailed presentations to clients and stakeholders
- Experience producing solution documentation including POCs, roadmaps, sequence diagrams, class hierarchies, and logical system views
- Experience taking technical solutions into production with performance, security, scalability, and data integration considerations
- Experience managing, mentoring, and growing engineering teams
- Four-year bachelor's degree in Computer Science or a related field
- Familiarity with cloud and distributed storage systems such as S3, ADLS, HDFS, GCS, Kudu, Elasticsearch/Solr, Cassandra, or other NoSQL systems
- Experience with data integration technologies such as StreamSets, Matillion, Fivetran, NiFi, AWS Data Migration Service, Azure Data Factory, or IICS
- Comprehensive SDLC experience across design, documentation, implementation, testing, and deployment
- Experience with automated data transformation and curation using dbt, Spark, Spark Streaming, and automated pipelines
- Experience with workflow management and orchestration tools such as Airflow, AWS Managed Airflow, Luigi, or NiFi
- Financial services or banking industry experience
- Understanding of banking IT compliance requirements and standards
- At least two listed certifications, including Apache Spark Associate Developer, Databricks Data Engineer Associate, Google Professional Data Engineer, Databricks Machine Learning Associate, or Google Professional ML Engineer
- Residence in Pacific Time or on the West Coast
SunnyData Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about SunnyData and has not been reviewed or approved by SunnyData.
-
Healthcare Strength — Health insurance is considered to start on day one for employees and eligible family members, which is positioned as a meaningful advantage. Feedback suggests coverage timing and inclusivity are clear for U.S. roles.
-
Leave & Time Off Breadth — Paid time off is described as at least 15 days annually plus 9 company holidays for U.S. roles. This indicates a solid baseline that aligns with standard professional services expectations.
-
Flexible Benefits — Remote-first work with no relocation required is highlighted, offering location flexibility across multiple countries. This flexibility is presented as a notable non-cash perk.
SunnyData Insights
What We Do
SunnyData is a Databricks-centered partner with deep Data Engineering roots, exclusively focused on migrating, modernizing and scaling data solutions on the Databricks platform. We bridge the gap between concept and real-world impact, recognizing that a solid Data Engineering foundation is essential for successful AI, ML, Data Science, and Analytics projects. Our expertise ensures that advanced technologies are implemented effectively, turning lab-driven innovation into tangible business outcomes and measurable ROI. Founded by data architects and engineers with a proven track record, our leadership team includes early adopters of Spark and leaders in Apache big data projects. With over 20 years of experience across Cloudera, Informatica, and phData, our team features a Databricks MVP, enabling us to solve the most complex data challenges. What We Specialize In: + Data Engineering + Data Migrations to Databricks + GenAI & Data Science + Data & AI Governance with Unity Catalog * Our deep industry expertise in Financial Services, Healthcare & Life Sciences, and Retail enables us to deliver highly contextualized solutions for regulated and data-driven sectors. We operate and deliver from both the USA and Uruguay. We chose Uruguay for its strategic location (within 3 hours of all U.S. timezones), top-tier data talent (#1 exporter in LATAM), and innovative culture, providing the fastest internet in LATAM and offering universal and free quality education.
