Data Pipelines Engineering Lead
Description For Data Pipelines Engineering Lead
Qualcomm India Private Limited is seeking an experienced Data Pipelines Engineering Lead to join their innovative team. This role presents an exciting opportunity to lead the definition, design, and deployment of big data pipeline systems for autonomous driving applications.
As the Data Pipelines Engineering Lead, you'll be responsible for architecting and maintaining critical data infrastructure both on-premises and in the AWS Cloud. You'll work with cutting-edge technologies including Kubernetes, Argo Workflows, and modern observability tools while leading a distributed team across multiple global locations including India, Sweden, Romania, Germany, and the US.
The ideal candidate will bring 10+ years of experience in data engineering, with deep expertise in cloud technologies and distributed systems. You'll be instrumental in advancing software quality standards and maintaining long-term productivity through sophisticated architecture design and implementation. Your technical expertise in AWS Cloud, Kubernetes, Python, and modern C++ will be essential for success in this role.
Key responsibilities include optimizing platform performance and scalability, implementing robust CI/CD pipelines, and providing technical leadership to team members. You'll collaborate closely with data scientists and software engineers to ensure seamless integration of data workflows while maintaining high standards of system reliability and efficiency.
Qualcomm offers an exceptional benefits package including comprehensive health coverage, financial planning support, and continuous learning opportunities. You'll be part of a global team working on cutting-edge autonomous driving technology, with the chance to make significant impacts on next-generation automotive systems.
This role offers an excellent opportunity for a seasoned data engineering leader to shape the future of autonomous driving technology while working with a diverse, global team at one of the world's leading technology companies. Join us in pushing the boundaries of what's possible in automotive data systems and help drive innovation in this rapidly evolving field.
Responsibilities For Data Pipelines Engineering Lead
- Architect, develop, and maintain the Autonomous Driving Data platform, both on-premises and AWS Cloud
- Lead a Distributed Data Systems team while remaining hands-on
- Translate Product Management and Department requirements into work packages
- Collaborate with data scientists and software engineers to define requirements
- Optimize the platform's performance, scalability and costs
- Monitor and troubleshoot system performance
- Implement and maintain CI pipelines for application containers
- Provide technical guidance and mentorship to junior team members
Requirements For Data Pipelines Engineering Lead
- Bachelor's degree in Engineering, Computer Science, or related field with 4+ years experience
- Strong expertise in configuring and optimizing Kubernetes clusters for data workloads
- Experience with ELK stack, particularly ElasticSearch and Kibana
- Proficient in Python, C++ and Bazel build systems
- Experience with AWS services such as EKS, EC2, VPC, IAM, S3
- Strong problem-solving skills and ability to troubleshoot complex technical issues
- Experience with CI/CD pipelines and automation tools
- In-depth understanding of distributed computing and parallel computing
Benefits For Data Pipelines Engineering Lead
- World-class health coverage for employees and dependents
- Financial planning and future security programs
- Emotional and mental wellbeing support
- Continuous learning and development programs
- Tuition reimbursement
- Mentorship opportunities
Jobs Related To Qualcomm Data Pipelines Engineering Lead
