Senior Data Platform Engineer
Description For Senior Data Platform Engineer
BigID is a leading tech startup in data security, compliance, privacy, and AI data management. We help customers reduce risk, drive innovation, achieve compliance, build trust, and maximize data value. As a Senior Data Platform Engineer, you'll design, develop, and maintain our big data architecture, focusing on Kafka and Elasticsearch. You'll implement data processing pipelines, optimize search capabilities, and collaborate with cross-functional teams. Key responsibilities include overseeing code reviews, troubleshooting issues, and staying current with big data trends. The ideal candidate has 8+ years in software engineering, 5+ years in big data (Elastic and Kafka), proficiency in Java, and strong problem-solving skills. We offer equity participation, flexible work arrangements, office perks, and career development opportunities. Our culture values Care, Do, Try & Shine, emphasizing customer focus, positive impact, perseverance, and standing out. Join our diverse, inclusive team and contribute to innovative solutions in data management.
Responsibilities For Senior Data Platform Engineer
- Implement data processing pipelines using Kafka for real-time data streaming
- Optimize and manage search capabilities using Elastic technologies
- Collaborate with product managers, data analysts, and other stakeholders
- Oversee code reviews and ensure best practices in coding and data handling
- Stay up-to-date with emerging trends and technologies in big data
- Troubleshoot and resolve issues to minimize downtime and ensure system reliability
Requirements For Senior Data Platform Engineer
- Bachelor's degree in Computer Science, Engineering, or related field; Master's degree preferred
- 8+ years of experience in the software engineering field
- 5+ years of experience in big data technologies, with a focus on Elastic and Kafka
- Proficiency in Java programming and experience with related frameworks
- Strong understanding of data modeling, ETL processes, and data warehousing
- Excellent problem-solving abilities and strong analytical skills
- Solid understanding of CI/CD principles
- Experience working with both external and in-house APIs and SDKs
Benefits For Senior Data Platform Engineer
- Equity participation
- Flexible work arrangements
- Office perks: dog-friendly environment, fully stocked fridge, gym, exercise classes, weekly Happy Hours, free parking, evening meals
- Knowledge training & Career development tracks
Jobs Related To BigID Senior Data Platform Engineer
