Senior Big Data Hadoop ML Engineer (GCP)

Rackspace Technology is a multicloud solutions expert, combining expertise with world's leading technologies across applications, data, and security to deliver end-to-end solutions.
$116,100 - $198,440
Data
Senior Software Engineer
Remote
5,000+ Employees
10+ years of experience

Description For Senior Big Data Hadoop ML Engineer (GCP)

We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team at Rackspace Technology. The ideal candidate will have a strong background in developing batch processing systems, with extensive experience in the Apache Hadoop ecosystem (Map Reduce, Oozie, Hive, Pig, HBase, Storm). This role involves working in Java and on Machine Learning pipelines for data collection or batch inference.

As a Senior Big Data Hadoop ML Engineer (GCP), you will:

  • Develop scalable and robust code for large scale batch processing systems using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, and HBase
  • Develop, manage, and maintain batch pipelines supporting Machine Learning workloads
  • Leverage GCP for scalable big data processing and storage solutions
  • Implement automation/DevOps best practices for CI/CD, IaC, etc.

Key requirements include:

  • Proficiency in the Hadoop ecosystem with Map Reduce, Oozie, Hive, Pig, HBase, Storm
  • Strong programming skills with Java, Python, and Spark
  • Knowledge of public cloud services, particularly in GCP
  • Experience in Infrastructure and Applied DevOps principles
  • Ability to tackle complex challenges and devise effective solutions
  • Strong written and verbal communication skills for effective remote collaboration
  • 10+ years of experience in customer-facing software/technology or consulting
  • 5+ years of experience with "on-premises to cloud" migrations or IT transformations
  • Technical degree in Computer Science, Software Engineering, or related field

This is a remote position, offering the flexibility to work from anywhere in the United States. Rackspace Technology is known for being a great place to work, consistently recognized by Fortune, Forbes, and Glassdoor. They offer a collaborative environment where you can bring your whole self to work and be part of a winning team on an inspiring mission.

Join Rackspace Technology to embrace technology, empower customers, and deliver the future of cloud solutions!

Last updated 4 months ago

Responsibilities For Senior Big Data Hadoop ML Engineer (GCP)

  • Develop scalable code for large scale batch processing systems
  • Develop, manage, and maintain batch pipelines for ML workloads
  • Leverage GCP for big data processing and storage solutions
  • Implement automation/DevOps best practices for CI/CD, IaC

Requirements For Senior Big Data Hadoop ML Engineer (GCP)

Java
Python
  • Proficiency in Hadoop ecosystem (Map Reduce, Oozie, Hive, Pig, HBase, Storm)
  • Strong programming skills with Java, Python, and Spark
  • Knowledge in public cloud services, particularly GCP
  • Experience in Infrastructure and Applied DevOps principles
  • 10+ years of experience in customer-facing software/technology or consulting
  • 5+ years of experience with 'on-premises to cloud' migrations
  • Technical degree in Computer Science, Software Engineering or related
  • Experience with batch pipelines supporting Machine Learning workloads

Interested in this job?

Jobs Related To Rackspace Senior Big Data Hadoop ML Engineer (GCP)

Sr Big Data Engineer (GCP)- Airflow and Oozie

Senior Big Data Engineer role at Rackspace, focusing on GCP, Airflow, and Oozie for scalable batch processing systems.

Senior Big Data Hadoop ML Engineer (GCP) - Canada

Senior Big Data Hadoop ML Engineer (GCP) position at Rackspace, working remotely in Canada on large-scale batch processing and ML pipelines using GCP.

Sr. Business Intelligence Engineer, NCRC, NCRC Science and Analytics

Senior Business Intelligence Engineer role at Amazon's NCRC team, focusing on data solutions for returns and re-commerce operations.

Sr. Business Intelligence Engineer, Amazon DSP

Senior Business Intelligence Engineer role at Amazon DSP, focusing on data analytics and BI solutions for programmatic advertising platforms.