Senior Big Data Hadoop ML Engineer (GCP) - Canada

Rackspace Technology is a multicloud solutions expert, combining expertise with world's leading technologies across applications, data, and security to deliver end-to-end solutions.
Data
Senior Software Engineer
Remote
5,000+ Employees
10+ years of experience

Description For Senior Big Data Hadoop ML Engineer (GCP) - Canada

Rackspace Technology is seeking a highly skilled Senior Big Data Hadoop ML Engineer (GCP) for a remote position in Canada. The ideal candidate will have extensive experience in the Apache Hadoop ecosystem and developing batch processing systems.

Key responsibilities include:

  • Developing scalable code for large-scale batch processing using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, and HBase
  • Managing and maintaining batch pipelines supporting Machine Learning workloads
  • Leveraging GCP for big data processing and storage solutions
  • Implementing DevOps best practices for CI/CD and Infrastructure as Code

Requirements:

  • Proficiency in Hadoop ecosystem (Map Reduce, Oozie, Hive, Pig, HBase, Storm)
  • Strong programming skills in Java, Python, and Spark
  • Experience with GCP and other cloud services
  • 10+ years of experience in customer-facing software/technology or consulting
  • 5+ years of experience with "on-premises to cloud" migrations
  • Technical degree in Computer Science, Software Engineering, or related field

This role offers the opportunity to work on cutting-edge big data and machine learning projects while collaborating with a dynamic team in a remote setting. Join Rackspace Technology, consistently recognized as a best place to work, and be part of a mission to embrace technology, empower customers, and deliver the future.

Last updated 4 months ago

Responsibilities For Senior Big Data Hadoop ML Engineer (GCP) - Canada

  • Develop scalable and robust code for large scale batch processing systems using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, Hbase
  • Develop, manage, and maintain batch pipelines supporting Machine Learning workloads
  • Leverage GCP for scalable big data processing and storage solutions
  • Implementing automation/DevOps best practices for CI/CD, IaC, etc.

Requirements For Senior Big Data Hadoop ML Engineer (GCP) - Canada

Java
Python
  • Proficiency in Hadoop ecosystem (Map Reduce, Oozie, Hive, Pig, HBase, Storm)
  • Strong programming skills with Java, Python, and Spark
  • Knowledge in public cloud services, particularly in GCP
  • Experience in Infrastructure and Applied DevOps principles
  • Ability to tackle complex challenges and devise effective solutions
  • Strong written and verbal communication skills
  • Proven experience in engineering batch processing systems at scale
  • 10+ years of experience in customer-facing software/technology or consulting
  • 5+ years of experience with 'on-premises to cloud' migrations or IT transformations
  • Technical degree: Computer Science, Software Engineering or related

Interested in this job?

Jobs Related To Rackspace Senior Big Data Hadoop ML Engineer (GCP) - Canada

Sr Big Data Engineer (GCP)- Airflow and Oozie

Senior Big Data Engineer role at Rackspace, focusing on GCP, Airflow, and Oozie for scalable batch processing systems.

Senior Big Data Hadoop ML Engineer (GCP)

Senior Big Data Hadoop ML Engineer (GCP) at Rackspace Technology - Remote opportunity to develop scalable batch processing systems and ML pipelines using Hadoop ecosystem and GCP.

Sr. Business Intelligence Engineer, NCRC, NCRC Science and Analytics

Senior Business Intelligence Engineer role at Amazon's NCRC team, focusing on data solutions for returns and re-commerce operations.

Sr. Business Intelligence Engineer, Amazon DSP

Senior Business Intelligence Engineer role at Amazon DSP, focusing on data analytics and BI solutions for programmatic advertising platforms.