Software Engineer III (Spark) - Cloud Data Platform

Guidewire Software is an insure-tech software company building internet-scale, cloud-native, real-time data platforms for the property and casualty insurance industry worldwide.
San Mateo, CA, USA
$108,000 - $155,000
Data
Senior Software Engineer
Hybrid
1,000 - 5,000 Employees
5+ years of experience
AI · Finance · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Data Engineer II

Senior Data Engineer position at Microsoft focusing on cloud data infrastructure, requiring 8+ years of experience in data engineering and big data technologies.

Analytics Engineer (L5) - Content and Studio

Senior Analytics Engineer role at Netflix focusing on content and studio analytics, requiring 4+ years of experience in data analysis and engineering.

Senior Data Engineer - Data Science

Senior Data Engineer position at LinkedIn focusing on building and managing data systems for the Data Science team, offering competitive pay and hybrid work environment.

Senior Data Engineer

Senior Data Engineer position at Airbnb, building and maintaining data pipelines for marketing technology platform, offering remote work and competitive compensation.

Senior Data Engineer

Senior Data Engineer position at Simply Business, working on data platforms and ML systems with modern tech stack in a hybrid work environment in London.

Description For Software Engineer III (Spark) - Cloud Data Platform

Guidewire Software is seeking a Software Engineer III (Spark) for their Cloud Data Platform team. This role involves building and operating Guidewire's cloud-native data platform and analytics SaaS offerings. The ideal candidate will have 5+ years of experience in data platform/data engineering, with expertise in Big Data technologies like Apache Spark, Hadoop, and Kafka.

Key responsibilities include:

  • Hands-on coding and implementation of high-performance Spark applications
  • Designing and optimizing Spark applications
  • Building cloud-native data platforms and analytics SaaS services
  • Providing technical leadership to multiple teams
  • Designing and developing large-scale real-time stream processing systems

Required skills:

  • Extensive experience with Big Data and distributed systems
  • Strong programming skills in Java
  • Experience with stream processing using Spark
  • Familiarity with AWS, Kubernetes, Docker, and Terraform
  • Deep understanding of algorithms, data structures, and performance optimization

The role offers the opportunity to work on an enterprise-grade, internet-scale platform that processes billions of real-time data points to provide AI/ML SaaS solutions. The successful candidate will work in a collaborative environment using cutting-edge technologies to build next-generation platforms and services.

Guidewire values autonomy, empowerment, and inclusivity, offering opportunities for skill development and career growth. The company serves over 540+ insurers in 40 countries and is committed to fostering a diverse and inclusive workplace.

This is a hybrid position based in San Mateo, CA, with a salary range of $108,000 - $155,000 per year, plus additional benefits not included in this base salary.

Last updated 2 months ago

Responsibilities For Software Engineer III (Spark) - Cloud Data Platform

  • Hands-on coding and implementation of high-performance Spark applications
  • Designing and optimizing Spark applications
  • Design cloud-native data platform and analytics SaaS services
  • Own architecture and provide technical leadership to multiple teams
  • Hands-on coding >60% of the time
  • Design and build large-scale real-time stream processing systems
  • Design and develop micro-services and analytics SaaS solutions
  • Own scalability, availability, and data security
  • Own, tackle & resolve code defects
  • Mentor junior developers in standards and best practices

Requirements For Software Engineer III (Spark) - Cloud Data Platform

Java
Kafka
Kubernetes
  • 5+ years' experience in a Senior Software Engineer role within a data platform/data engineering team
  • Extensive experience with Big Data and distributed systems
  • Experience with stream processing using Spark
  • Ability to design large-scale distributed systems
  • Excellent programming skills in Java
  • Understanding of distributed systems concepts and principles
  • Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques
  • Comfortable working with Kubernetes, AWS, Docker, and Terraform
  • BS or MS degree (Computer Science or Math)

Interested in this job?