We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team at Rackspace Technology. The ideal candidate will have a strong background in developing batch processing systems, with extensive experience in the Apache Hadoop ecosystem (Map Reduce, Oozie, Hive, Pig, HBase, Storm). This role involves working in Java and on Machine Learning pipelines for data collection or batch inference.
As a Senior Big Data Hadoop ML Engineer (GCP), you will:
- Develop scalable and robust code for large scale batch processing systems using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, and HBase
- Develop, manage, and maintain batch pipelines supporting Machine Learning workloads
- Leverage GCP for scalable big data processing and storage solutions
- Implement automation/DevOps best practices for CI/CD, IaC, etc.
Key requirements include:
- Proficiency in the Hadoop ecosystem with Map Reduce, Oozie, Hive, Pig, HBase, Storm
- Strong programming skills with Java, Python, and Spark
- Knowledge of public cloud services, particularly in GCP
- Experience in Infrastructure and Applied DevOps principles
- Ability to tackle complex challenges and devise effective solutions
- Strong written and verbal communication skills for effective remote collaboration
- 10+ years of experience in customer-facing software/technology or consulting
- 5+ years of experience with "on-premises to cloud" migrations or IT transformations
- Technical degree in Computer Science, Software Engineering, or related field
This is a remote position, offering the flexibility to work from anywhere in the United States. Rackspace Technology is known for being a great place to work, consistently recognized by Fortune, Forbes, and Glassdoor. They offer a collaborative environment where you can bring your whole self to work and be part of a winning team on an inspiring mission.
Join Rackspace Technology to embrace technology, empower customers, and deliver the future of cloud solutions!