Software Development Engineer, Open Data Analytics Engines - Spark

World's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$129,300 - $223,600
Data
Senior Software Engineer
In-Person
5,000+ Employees
3+ years of experience
Enterprise SaaS · Cloud

Description For Software Development Engineer, Open Data Analytics Engines - Spark

Amazon Web Services (AWS) is seeking a Senior Software Engineer to join their analytics team, specifically working on core engines for Athena and EMR services. This role is part of a strategic initiative to enhance AWS's data analytics capabilities, focusing on improving open-source engines like Trino and Spark for serverless environments.

The position offers an exciting opportunity to work on large-scale analytics systems that have already achieved 5x performance improvements through optimizations in query runtime, storage connectors, and compiler modifications. As part of the engines team, you'll be responsible for making deeper changes to the query engine codebase and implementing key features for performance optimization.

AWS, as the world's leading cloud platform, provides an environment where innovation is constant and impact is significant. The role sits within the Utility Computing (UC) organization, which is responsible for foundational services like S3 and EC2, along with continuous product innovations that maintain AWS's industry leadership.

The ideal candidate will bring 3+ years of software development experience and a strong background in system design and architecture. You'll be working with a diverse team that values work-life harmony and promotes an inclusive culture through various employee-led initiatives and learning opportunities.

This position offers competitive compensation ranging from $129,300 to $223,600 based on location and experience, plus additional benefits including equity, sign-on payments, and comprehensive medical coverage. You'll be part of a team that values diverse experiences and perspectives, with strong support for career growth through mentorship and knowledge-sharing opportunities.

The role combines technical depth with strategic importance, offering the chance to influence the future of cloud-based analytics while working with cutting-edge technology and contributing to the open-source community. If you're passionate about large-scale distributed systems and want to make an impact on AWS's analytics capabilities, this role presents an excellent opportunity for career growth and technical challenge.

Last updated an hour ago

Responsibilities For Software Development Engineer, Open Data Analytics Engines - Spark

  • Hands-on development for core components of the query engine
  • Design and develop solutions and algorithms to improve the performance of Spark
  • Design and develop improvements to the AWS Runtime for Spark's integration with other AWS services
  • Manage complex deliverables project and research projects with deadlines
  • Ensure data consistency and durability with breakthrough performance and scalability
  • Interact and partner with the open source community

Requirements For Software Development Engineer, Open Data Analytics Engines - Spark

Java
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture experience
  • Experience programming with at least one software programming language
  • Experience with coding standards, code reviews, source control management
  • Experience with build processes, testing, and operations

Benefits For Software Development Engineer, Open Data Analytics Engines - Spark

Medical Insurance
Dental Insurance
Vision Insurance
401k
Equity
  • Medical benefits
  • Financial benefits
  • Work-life harmony
  • Mentorship and career growth opportunities
  • Inclusive team culture
  • Employee-led affinity groups
  • Equity compensation
  • Sign-on payments

Interested in this job?

Jobs Related To Amazon Software Development Engineer, Open Data Analytics Engines - Spark

Sr Software Development Engineer, AWS Open Data Analytics Engines

Senior SDE role at AWS working on data analytics engines, improving performance and scalability of Athena and EMR services, requiring 5+ years of experience.

IT APP Dev Engineer, Financial Planning

Senior IT Application Development Engineer role at Amazon's FP&A team, focusing on Cognos development and financial planning solutions with 10+ years of experience required.

Sr. Business Intelligence Engineer

Senior Business Intelligence Engineer role at Amazon Search, focusing on reinforcement learning systems and data analysis to optimize shopping experiences for millions of customers.

Sr. Business Intelligence Engineer, Long Term Planning

Senior Business Intelligence Engineer role at Amazon focusing on supply chain optimization and transportation planning across Europe, based in Luxembourg.

Business Intelligence Engineer (L5), Amazon

Senior Business Intelligence Engineer role at Amazon Payment team, focusing on data analytics and insights for Japan Payment Products.