Query Engine Architect - Accelerated Apache Spark

NVIDIA is the world leader in accelerated computing, pioneering solutions for AI and digital twins.
$272,000 - $425,500
Distributed Systems
Principal Software Engineer
Hybrid
15+ years of experience
AI · Enterprise SaaS

Description For Query Engine Architect - Accelerated Apache Spark

NVIDIA is seeking an experienced Query Engine Architect to lead the acceleration of Apache Spark and related frameworks on GPUs. This role is at the forefront of building the next generation data processing ecosystem, focusing on optimizing the world's most popular distributed data processing engine. The position offers an opportunity to work with cutting-edge technology at the intersection of big data and GPU acceleration.

The role involves leading query optimization efforts on the RAPIDS Spark team, working closely with open source communities, and developing solutions that can significantly improve data processing performance using GPU acceleration. You'll be responsible for reviewing and optimizing query processing plans, implementing adaptive execution strategies, and identifying opportunities for performance improvements through operator fusion.

As a Principal Engineer at NVIDIA, you'll collaborate with strategic partners to deploy accelerated data processing solutions in both cloud and on-premise environments. The position requires deep expertise in database query engines, distributed systems, and extensive experience with open source big-data projects. You'll be working with a team of forward-thinking professionals in an environment that values innovation and technical excellence.

The role offers a competitive compensation package including a base salary range of $272,000 - $425,500, equity, and comprehensive benefits. This is an excellent opportunity for someone passionate about distributed systems, query optimization, and GPU acceleration to make a significant impact on the future of data processing technology. The position combines technical leadership, open source community engagement, and the chance to work with cutting-edge technology at a company that's leading the world in accelerated computing.

Last updated 2 days ago

Responsibilities For Query Engine Architect - Accelerated Apache Spark

  • Lead query optimization effort on the RAPIDS Spark team
  • Review and optimize logical and physical query processing plans
  • Implement adaptive query execution based on CPU/GPU resources
  • Identify operator fusion opportunities for performance improvement
  • Engage with open source communities including Apache Spark and RAPIDS
  • Work with strategic partners on deploying accelerated data processing solutions
  • Present technical solutions at industry conferences and meetups

Requirements For Query Engine Architect - Accelerated Apache Spark

Java
Scala
Kubernetes
  • BS, MS, or PhD in Computer Science, Computer Engineering, or equivalent experience
  • 15+ years of work or research experience in software development
  • 5+ years working with key open source big-data projects
  • Deep expertise in database query engines and query optimization
  • Excellent programming skills in C++, Java, and/or Scala
  • Knowledge of distributed system schedulers
  • Strong interpersonal skills
  • Experience with Apache Spark, Hadoop, Hive, Flink, Impala, Drill, Calcite, and Substrait

Benefits For Query Engine Architect - Accelerated Apache Spark

Equity
  • Competitive base salary
  • Equity
  • Comprehensive benefits package

Interested in this job?

Jobs Related To NVIDIA Query Engine Architect - Accelerated Apache Spark

Senior Networking Architect

Senior Networking Architect position at NVIDIA focusing on developing next-generation network solutions for AI and accelerated computing.

Senior Software Architect - Data Center Systems

Senior Software Architect role at NVIDIA focusing on Data Center Systems and deep learning server platforms, offering competitive compensation and opportunity to work on cutting-edge technology.

Senior Software Architect, Advanced Development

Senior Software Architect role at NVIDIA focusing on advanced development in network programmability, distributed systems, and data center technologies.

Distinguished Engineer – Data Center System Software Architect

Lead system software architecture for NVIDIA's data center systems, driving innovation in GPU-powered enterprise and cloud computing platforms.

Principal Engineer, Agentic System Architecture

Lead architect position for agentic systems and LLM integration at NVIDIA, requiring 15+ years of experience in distributed systems and AI frameworks.