Taro Logo

Senior Big Data Hadoop ML Engineer (GCP) - Canada

Rackspace Technology is a multicloud solutions expert, combining expertise with world's leading technologies across applications, data, and security to deliver end-to-end solutions.
Data
Senior Software Engineer
Remote
5,000+ Employees
10+ years of experience
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Senior Big Data Hadoop ML Engineer (GCP) - Canada

Rackspace Technology is seeking a highly skilled Senior Big Data Hadoop ML Engineer (GCP) for a remote position in Canada. The ideal candidate will have extensive experience in the Apache Hadoop ecosystem and developing batch processing systems.

Key responsibilities include:

  • Developing scalable code for large-scale batch processing using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, and HBase
  • Managing and maintaining batch pipelines supporting Machine Learning workloads
  • Leveraging GCP for big data processing and storage solutions
  • Implementing DevOps best practices for CI/CD and Infrastructure as Code

Requirements:

  • Proficiency in Hadoop ecosystem (Map Reduce, Oozie, Hive, Pig, HBase, Storm)
  • Strong programming skills in Java, Python, and Spark
  • Experience with GCP and other cloud services
  • 10+ years of experience in customer-facing software/technology or consulting
  • 5+ years of experience with "on-premises to cloud" migrations
  • Technical degree in Computer Science, Software Engineering, or related field

This role offers the opportunity to work on cutting-edge big data and machine learning projects while collaborating with a dynamic team in a remote setting. Join Rackspace Technology, consistently recognized as a best place to work, and be part of a mission to embrace technology, empower customers, and deliver the future.

Last updated a year ago

Responsibilities For Senior Big Data Hadoop ML Engineer (GCP) - Canada

  • Develop scalable and robust code for large scale batch processing systems using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, Hbase
  • Develop, manage, and maintain batch pipelines supporting Machine Learning workloads
  • Leverage GCP for scalable big data processing and storage solutions
  • Implementing automation/DevOps best practices for CI/CD, IaC, etc.

Requirements For Senior Big Data Hadoop ML Engineer (GCP) - Canada

Java
Python
  • Proficiency in Hadoop ecosystem (Map Reduce, Oozie, Hive, Pig, HBase, Storm)
  • Strong programming skills with Java, Python, and Spark
  • Knowledge in public cloud services, particularly in GCP
  • Experience in Infrastructure and Applied DevOps principles
  • Ability to tackle complex challenges and devise effective solutions
  • Strong written and verbal communication skills
  • Proven experience in engineering batch processing systems at scale
  • 10+ years of experience in customer-facing software/technology or consulting
  • 5+ years of experience with 'on-premises to cloud' migrations or IT transformations
  • Technical degree: Computer Science, Software Engineering or related

Interested in this job?