Senior Data Platform Engineer

BigID is an innovative tech startup focusing on data security, compliance, privacy, and AI data management solutions. We're leading the market in all things data, helping customers reduce risk, drive innovation, achieve compliance, build trust, and extract more value from their data.

As a Senior Data Platform Engineer, you'll be responsible for designing, developing, maintaining, and implementing our big data architecture. Your expertise in Elastic, Kafka, and Java will be crucial for ensuring the scalability and performance of our data systems.

Key responsibilities include:

• Implementing data processing pipelines using Kafka for real-time streaming
• Optimizing and managing search capabilities with Elastic technologies
• Collaborating with cross-functional teams to gather requirements
• Overseeing code reviews and maintaining high-quality standards
• Staying current with emerging trends in big data
• Troubleshooting and resolving issues to ensure system reliability

Requirements:

• Bachelor's degree in Computer Science or related field (Master's preferred)
• 8+ years of software engineering experience
• 5+ years of experience with big data technologies, focusing on Elastic and Kafka
• Proficiency in Java programming
• Strong understanding of data modeling, ETL processes, and data warehousing
• Excellent problem-solving and analytical skills
• Understanding of CI/CD principles
• Experience with APIs and SDKs

Advantages:

• Experience with Docker, Kubernetes
• Experience with cloud platforms (AWS or Azure)

BigID offers a range of benefits, including equity participation, flexible work arrangements, office perks, and career development opportunities. We value diversity and inclusion, creating a culture where every voice is heard and everybody belongs.

Join our fast-paced, rewarding environment and work with some of the most talented people in the industry who value innovation, diversity, integrity, and collaboration.