Senior Data Platform Engineer
Description For Senior Data Platform Engineer
BigID, an innovative tech startup specializing in data security, compliance, privacy, and AI data management, is seeking a Senior Data Platform Engineer to join their Data Platform team. This role offers an exciting opportunity to work with cutting-edge big data technologies in a fast-paced, rewarding environment.
As a Senior Data Platform Engineer, you'll be responsible for designing, developing, and maintaining BigID's big data architecture. Your expertise in Elastic, Kafka, and Java will be crucial in ensuring the scalability and performance of their data systems. You'll implement real-time data streaming pipelines, optimize search capabilities, and collaborate with cross-functional teams to translate requirements into technical specifications.
The ideal candidate should have 8+ years of software engineering experience, with at least 5 years focused on big data technologies, particularly Elastic and Kafka. Proficiency in Java programming and a strong understanding of data modeling, ETL processes, and data warehousing are essential. You'll also need excellent problem-solving abilities and a solid grasp of CI/CD principles.
BigID offers a competitive benefits package, including equity participation, flexible work arrangements, and various office perks. The company has been recognized with numerous awards, including being named a Hot Company in AI and Machine Learning at the 2024 Global InfoSec Awards and appearing on the Inc. 5000 list for the 4th consecutive year.
Join BigID's people-centric culture that values innovation, diversity, integrity, and collaboration. You'll have the opportunity to work with some of the most talented people in the industry and make a significant impact in the field of data management and security.
Responsibilities For Senior Data Platform Engineer
- Implement data processing pipelines using Kafka for real-time data streaming
- Optimize and manage search capabilities using Elastic technologies
- Collaborate with product managers, data analysts, and other stakeholders to gather requirements and translate them into technical specifications
- Oversee code reviews, ensure best practices in coding and data handling, and maintain high-quality standards in software development
- Stay up-to-date with emerging trends and technologies in big data and recommend improvements to our architecture and processes
- Troubleshoot and resolve issues in a timely manner to minimize downtime and ensure system reliability
Requirements For Senior Data Platform Engineer
- Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred
- 8+ years of experience in the software engineering field
- 5+ years of experience in big data technologies, with a focus on Elastic and Kafka
- Proficiency in Java programming and experience with related frameworks
- Strong understanding of data modeling, ETL processes, and data warehousing
- Excellent problem-solving abilities and strong analytical skills
- A solid understanding of CI/CD principles
- Experience working with both external and in-house APIs and SDKs
Benefits For Senior Data Platform Engineer
- Equity participation - everyone shares in our success
- Flexible work arrangements - for parents, for remote workdays, etc.
- Office perks: dog-friendly environment, fully stocked fridge, gym, and exercise classes, weekly Happy Hours, free parking, evening meals
- Knowledge training & Career development tracks
Jobs Related To BigID Senior Data Platform Engineer
