Senior Software Engineer (Spark) - Cloud Data Platform

Posted 8 Hours Ago
Be an Early Applicant
San Mateo, CA
Hybrid
125K-180K Annually
Senior level
Cloud • Information Technology • Insurance • Software • Analytics
Guidewire is the platform P&C insurers trust to engage, innovate, and grow efficiently.
The Role
The Senior Software Engineer will lead the design and implementation of a cloud-native data platform and analytics SaaS services, focusing on high-performance Spark applications, large-scale distributed systems, and mentoring junior developers. Responsibilities include hands-on coding, architecture leadership, optimizing applications, and ensuring scalability and security.
Summary Generated by Built In

Guidewire Software is an insure-tech software company with more than 3,200 people in 40+ countries worldwide. We are an internet-scale, cloud-native, real-time data platform built for the property and casualty insurance industry worldwide.


Are you passionate about building internet-scale multi-tenant cloud-native data platforms?


Do you have prior experience in building data platforms/data lake and analytics SaaS services in the public cloud with expertise in modern Big Data stack (Apache Spark, Hadoop, Kafka, Flink, Hive etc.)


If so then come join our Cloud Data Platform team! This team owns, builds, and operates Guidewire’s cloud-native data platform and analytics SaaS offerings. The Guidewire Data Platform is an enterprise-grade, internet-scale, and cloud-native Big Data platform targeted to be best-in-class in enabling our customers with mission-critical insights and decision-making capabilities.

 

The platform is designed to support all our analytics, data science, and data applications. Guidewire’s data platform already processes Billions of real-time data to provide a rich set of AI/ML SaaS solutions! You will work in a highly collaborative environment building next-generation platforms and services using the latest and greatest cutting-edge & bleeding-edge technologies. You will have fun building cloud-native, enterprise-grade, and internet-scale platforms and SaaS applications.


Required Skills:

  • 8+ years' experience working in a similar Senior Software Engineer role within a data platform/data engineering team
  • Extensive experience with Big Data and distributed systems.
  • Experience with stream processing using Spark.
  • Ability to design large-scale distributed systems.
  • Prior experience in building data platforms using Big Data stack (Kafka, Hadoop, Spark, Flink, Hive ..) on the public cloud.
  • Excellent programming skills in Java.
  • Understanding of distributed systems concepts and principles (consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms).
  • Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques.
  • Eager to learn new things and passionate about technology!.
  • Comfortable working with Kubernetes, AWS, Docker, and Terraform.

What you would do:

  • Hands-on coding and implementation of high-performance Spark applications, leveraging your deep understanding of distributed computing and data processing.
  • Designing and optimizing Spark applications.
  • Design cloud-native data platform and analytics SaaS services
  • Own architecture and provide technical leadership to multiple teams
  • Hands-on coding>60% of the time
  • Design and build large-scale real-time stream processing systems
  • Design and develop micro-services and analytics SaaS solutions
  • Own scalability, availability, and data security
  • Own, tackle & resolve code defects
  • Mentor junior developers in standards and best practices!

What you would need to succeed:

  • Extensive experience working on a public cloud-like AWS
  • Prior experience and passion for building a large-scale multi-tenant cloud-native data platform
  • Emphasize team wins over individual success
  • Strong technical interpersonal skills
  • Excellent software development skills in one or more of the following languages: Java/Scala
  • Extensive experience with Big Data and distributed systems.
  • Expertise in Spark or Flink, Kafka, and Hadoop ecosystem
  • Ability to design large-scale distributed systems
  • Have developed in more than one language and ready to pivot to any language/framework
  • Understand microservices architecture patterns pattern like Service Discovery/API Gateway/Domain Driven Design etc
  • Experience with containers technology
  • Ability to work in an agile fast-paced environment
  • BS or MS degree (Computer Science or Math)

  • Bonus

  • AWS (EMR, S3, Glue, Kinesis)
  • Debezium
  • ELK
  • Experience in building SaaS/PaaS on AWS/GCP/Azure.
  • AI/ML

Be Yourself & Stay Clever

At Guidewire, we value autonomy, empowerment, and inclusivity, which is why we want each of our employees to be heard and celebrated. We’re in the business of uplifting people, so they can fulfill their goals and ambitions. So, there’s plenty of time and space for you to broaden your skills and experience.


If we've got you excited and you’re ready for a career upgrade, then we're eager to hear from you! Get in touch to learn more about the Guidewire team you’ll work with.


Our employee culture

https://careers.guidewire.com/culture


Who We Are

https://careers.guidewire.com/about


#LI-HR1

#insurtech

#guidewire

#python

#javaprogramming

#featured


About Guidewire


Guidewire is the platform P&C insurers trust to engage, innovate, and grow efficiently. We combine digital, core, analytics, and AI to deliver our platform as a cloud service. More than 540+ insurers in 40 countries, from new ventures to the largest and most complex in the world, run on Guidewire.


As a partner to our customers, we continually evolve to enable their success. We are proud of our unparalleled implementation track record with 1600+ successful projects, supported by the largest R&D team and partner ecosystem in the industry. Our Marketplace provides hundreds of applications that accelerate integration, localization, and innovation.


For more information, please visit www.guidewire.com and follow us on Twitter: @Guidewire_PandC.


Guidewire Software, Inc. is proud to be an equal opportunity and affirmative action employer. We are committed to an inclusive workplace, and believe that a diversity of perspectives, abilities, and cultures is a key to our success. Qualified applicants will receive consideration without regard to race, color, ancestry, religion, sex, national origin, citizenship, marital status, age, sexual orientation, gender identity, gender expression, veteran status, or disability. All offers are contingent upon passing a criminal history and other background checks where it's applicable to the position.


Disability Accommodations and Guidewire’s Appeals Process. Guidewire provides accommodations to the hiring process to create a fair opportunity for candidates with disabilities to contend for open positions. Accommodation requests should be directed to [email protected]. If things do not go as hoped, we invite you to use our appeals process. Guidewire promises to independently review any denied accommodation and any decision not to offer you the position. The appeals process is the same in either case. Within five business days of receiving a notice of denial of an accommodation, or receiving a notice of your non-selection for a vacancy, e-mail [email protected] to make an appeal. Guidewire will assign a new decision-maker to review the request and/or hiring decision, who will then notify you in writing of a decision within 10 business days.

Top Skills

Java
The Company
HQ: San Mateo, CA
3,400 Employees
Hybrid Workplace
Year Founded: 2001

What We Do

Guidewire is the platform P&C insurers trust to engage, innovate, and grow efficiently. ​We combine digital, core, analytics, and AI to deliver our platform as a cloud service. More than 540 insurers, from new ventures to the largest and most complex in the world, run on Guidewire.

As a partner to our customers, we continually evolve to enable their success. We are proud of our unparalleled implementation track record, with 1,000+ successful projects, supported by the largest R&D team and partner ecosystem in the industry. Our marketplace provides hundreds of applications that accelerate integration, localization, and innovation.

Why Work With Us

We're focused on each and every employees' personal and professional development, and offer internal career mobility programs and growth opportunities that make Guidewire unique. Other perks like generous PTO, flexible working, our Guidewire Gives Back charitabeland our "Work From Almost Anywhere" program support our employees' work-life balance

Gallery

Gallery

Similar Jobs

Arch Systems Inc. Logo Arch Systems Inc.

Data Engineer

Artificial Intelligence • Internet of Things • Machine Learning • Software • Analytics • Industrial • Manufacturing
Remote
Palo Alto, CA, USA
80 Employees
200K-250K Annually

Check Logo Check

Staff Software Engineer

Fintech • HR Tech • Payments • Infrastructure as a Service (IaaS) • Data Privacy
Remote
San Francisco, CA, USA
100 Employees

Snap Inc. Logo Snap Inc.

Staff Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
5 Locations
5000 Employees
189K-333K Annually

Snap Inc. Logo Snap Inc.

Manager, Machine Learning Engineering, Embedding Platform

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
5 Locations
5000 Employees
189K-333K Annually

Similar Companies Hiring

MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana
Silverfort Thumbnail
Security • Sales • Information Technology • Cybersecurity • Automation
SG
357 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account