Senior Data Engineer

BigID is an innovative tech startup focusing on data security, compliance, privacy, and AI data management solutions.
Data
Senior Software Engineer
Hybrid
8+ years of experience
AI · Cybersecurity · Enterprise SaaS

Description For Senior Data Engineer

BigID is a leading tech startup in data security, compliance, privacy, and AI data management. We're building a global team passionate about innovation and next-gen technology. As a Senior Data Engineer on our Data Platform team, you'll design and maintain our data platforms, focusing on Kafka and Elasticsearch. You'll implement data processing pipelines, optimize search capabilities, and collaborate with cross-functional teams to ensure scalability and reliability of our data solutions.

Key responsibilities include:

  • Implementing real-time data streaming with Kafka
  • Managing and optimizing Elastic technologies
  • Collaborating with stakeholders to translate requirements into technical specifications
  • Overseeing code reviews and maintaining high-quality standards
  • Staying updated on big data trends and recommending improvements
  • Troubleshooting and resolving issues to ensure system reliability

We're looking for candidates with:

  • Bachelor's degree in Computer Science or related field (Master's preferred)
  • 8+ years in software engineering, 5+ years in big data technologies (Elastic and Kafka)
  • Proficiency in Java programming
  • Strong understanding of data modeling, ETL processes, and data warehousing
  • Excellent problem-solving and analytical skills

We offer a people-centric culture with opportunities for growth, equity participation, flexible work arrangements, and various office perks. Our values - Care, Do, Try & Shine - guide our work and culture. Join us in making a positive impact in the world of data management and security!

Last updated 4 months ago

Responsibilities For Senior Data Engineer

  • Implement data processing pipelines using Kafka for real-time data streaming
  • Optimize and manage search capabilities using Elastic technologies
  • Collaborate with stakeholders to translate requirements into technical specifications
  • Oversee code reviews and maintain high-quality standards
  • Stay up-to-date with big data trends and recommend improvements
  • Troubleshoot and resolve issues to ensure system reliability

Requirements For Senior Data Engineer

Java
Kafka
  • Bachelor's degree in Computer Science, Engineering, or related field (Master's preferred)
  • 8+ years of experience in software engineering
  • 5+ years of experience in big data technologies (Elastic and Kafka)
  • Proficiency in Java programming
  • Strong understanding of data modeling, ETL processes, and data warehousing
  • Excellent problem-solving abilities and strong analytical skills
  • Solid understanding of CI/CD principles
  • Experience with external and in-house APIs and SDKs

Benefits For Senior Data Engineer

Equity
  • Equity participation
  • Flexible work arrangements
  • Office perks: dog-friendly environment, fully stocked fridge, gym, exercise classes, weekly Happy Hours, free parking, evening meals
  • Knowledge training & Career development tracks

Interested in this job?

Jobs Related To BigID Senior Data Engineer

Senior Data Platform Engineer

Senior Data Platform Engineer role at BigID, focusing on big data technologies like Kafka and Elasticsearch, requiring 8+ years of experience in software engineering.

Senior Data Platform Engineer

Senior Data Platform Engineer at BigID: Design and maintain big data architecture with focus on Kafka and Elasticsearch.

Senior Data Platform Engineer

Senior Data Platform Engineer role at BigID, focusing on big data technologies like Kafka and Elasticsearch. 8+ years experience required.

Senior Data Platform Engineer

Senior Data Platform Engineer at BigID: Design and maintain scalable data platforms using Kafka and Elasticsearch.

Senior Data Scientist

Senior Data Scientist role at Intuit focusing on Identity Data Science Team, developing advanced data-driven solutions and next-generation capabilities.