Senior Big Data Hadoop ML Engineer (GCP)

Rackspace Technology is a multicloud solutions expert, combining expertise with world's leading technologies across applications, data, and security to deliver end-to-end solutions.
$116,100 - $198,440
Data
Senior Software Engineer
Remote
5,000+ Employees
10+ years of experience

Description For Senior Big Data Hadoop ML Engineer (GCP)

We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team at Rackspace Technology. The ideal candidate will have a strong background in developing batch processing systems, with extensive experience in the Apache Hadoop ecosystem (Map Reduce, Oozie, Hive, Pig, HBase, Storm). This role involves working in Java and on Machine Learning pipelines for data collection or batch inference.

As a Senior Big Data Hadoop ML Engineer (GCP), you will:

  • Develop scalable and robust code for large scale batch processing systems using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, and HBase
  • Develop, manage, and maintain batch pipelines supporting Machine Learning workloads
  • Leverage GCP for scalable big data processing and storage solutions
  • Implement automation/DevOps best practices for CI/CD, IaC, etc.

Key requirements include:

  • Proficiency in the Hadoop ecosystem with Map Reduce, Oozie, Hive, Pig, HBase, Storm
  • Strong programming skills with Java, Python, and Spark
  • Knowledge of public cloud services, particularly in GCP
  • Experience in Infrastructure and Applied DevOps principles
  • Ability to tackle complex challenges and devise effective solutions
  • Strong written and verbal communication skills for effective remote collaboration
  • 10+ years of experience in customer-facing software/technology or consulting
  • 5+ years of experience with "on-premises to cloud" migrations or IT transformations
  • Technical degree in Computer Science, Software Engineering, or related field

This is a remote position, offering the flexibility to work from anywhere in the United States. Rackspace Technology is known for being a great place to work, consistently recognized by Fortune, Forbes, and Glassdoor. They offer a collaborative environment where you can bring your whole self to work and be part of a winning team on an inspiring mission.

Join Rackspace Technology to embrace technology, empower customers, and deliver the future of cloud solutions!

Last updated 7 months ago

Responsibilities For Senior Big Data Hadoop ML Engineer (GCP)

  • Develop scalable code for large scale batch processing systems
  • Develop, manage, and maintain batch pipelines for ML workloads
  • Leverage GCP for big data processing and storage solutions
  • Implement automation/DevOps best practices for CI/CD, IaC

Requirements For Senior Big Data Hadoop ML Engineer (GCP)

Java
Python
  • Proficiency in Hadoop ecosystem (Map Reduce, Oozie, Hive, Pig, HBase, Storm)
  • Strong programming skills with Java, Python, and Spark
  • Knowledge in public cloud services, particularly GCP
  • Experience in Infrastructure and Applied DevOps principles
  • 10+ years of experience in customer-facing software/technology or consulting
  • 5+ years of experience with 'on-premises to cloud' migrations
  • Technical degree in Computer Science, Software Engineering or related
  • Experience with batch pipelines supporting Machine Learning workloads

Interested in this job?

Jobs Related To Rackspace Senior Big Data Hadoop ML Engineer (GCP)

Lead Specialist Solution Engineer, Data Cloud

Lead Solution Engineer role at Salesforce focusing on Data Cloud implementation, requiring expertise in data architecture, AI/ML, and executive-level engagement.

Data Compression Research Engineer, Sr.

Senior Data Compression Research Engineer role at Qualcomm focusing on developing innovative compression algorithms for neural network and multimedia systems.

Senior Software Engineer- Tableau Engineer

Senior Tableau Engineer role at Convera focusing on server administration, dashboard optimization, and data management for the world's largest non-bank B2B payments company.

Senior Software Engineer- Snowflake Administrator

Senior Software Engineer position at Convera focusing on Snowflake administration, data engineering, and enterprise-scale database management for B2B payments infrastructure.