Senior Data Engineer

BigID is an innovative tech startup focusing on data security, compliance, privacy, and AI data management solutions.
Data
Senior Software Engineer
Hybrid
8+ years of experience
AI · Cybersecurity · Enterprise SaaS

Description For Senior Data Engineer

BigID is a leading tech startup in data security, compliance, privacy, and AI data management. We're building a global team passionate about innovation and next-gen technology. As a Senior Data Engineer on our Data Platform team, you'll design and maintain our data platforms, focusing on Kafka and Elasticsearch. You'll implement data processing pipelines, optimize search capabilities, and collaborate with cross-functional teams to ensure scalability and reliability of our data solutions.

Key responsibilities include:

  • Implementing real-time data streaming with Kafka
  • Managing and optimizing Elastic technologies
  • Collaborating with stakeholders to translate requirements into technical specifications
  • Overseeing code reviews and maintaining high-quality standards
  • Staying updated on big data trends and recommending improvements
  • Troubleshooting and resolving issues to ensure system reliability

We're looking for candidates with:

  • Bachelor's degree in Computer Science or related field (Master's preferred)
  • 8+ years in software engineering, 5+ years in big data technologies (Elastic and Kafka)
  • Proficiency in Java programming
  • Strong understanding of data modeling, ETL processes, and data warehousing
  • Excellent problem-solving and analytical skills

We offer a people-centric culture with opportunities for growth, equity participation, flexible work arrangements, and various office perks. Our values - Care, Do, Try & Shine - guide our work and culture. Join us in making a positive impact in the world of data management and security!

Last updated 8 days ago

Responsibilities For Senior Data Engineer

  • Implement data processing pipelines using Kafka for real-time data streaming
  • Optimize and manage search capabilities using Elastic technologies
  • Collaborate with stakeholders to translate requirements into technical specifications
  • Oversee code reviews and maintain high-quality standards
  • Stay up-to-date with big data trends and recommend improvements
  • Troubleshoot and resolve issues to ensure system reliability

Requirements For Senior Data Engineer

Java
Kafka
  • Bachelor's degree in Computer Science, Engineering, or related field (Master's preferred)
  • 8+ years of experience in software engineering
  • 5+ years of experience in big data technologies (Elastic and Kafka)
  • Proficiency in Java programming
  • Strong understanding of data modeling, ETL processes, and data warehousing
  • Excellent problem-solving abilities and strong analytical skills
  • Solid understanding of CI/CD principles
  • Experience with external and in-house APIs and SDKs

Benefits For Senior Data Engineer

Equity
  • Equity participation
  • Flexible work arrangements
  • Office perks: dog-friendly environment, fully stocked fridge, gym, exercise classes, weekly Happy Hours, free parking, evening meals
  • Knowledge training & Career development tracks

Interested in this job?

Jobs Related To BigID Senior Data Engineer

Sr. Business Intelligence Engineer, Kuiper Marketing

Senior Business Intelligence Engineer role at Amazon's Project Kuiper, focusing on marketing analytics and data-driven decision making for satellite broadband initiative.

Senior Software Engineer

Senior Software Engineer role at Microsoft working on Azure Data engineering team, focusing on big data analytics and data platform development.

Analytics Engineer (L5) - Content & Studio

Senior Analytics Engineer role at Netflix, focusing on data-driven decision-making for content presentation and creative production, offering competitive compensation and comprehensive benefits.

Senior/Lead Solution Engineer - Tableau

Senior Solution Engineer position at Salesforce's Tableau team, focusing on data analytics, BI solutions, and customer success with 6-10 years of experience required.

Senior Customer Data Platform Product Engineer

Senior Customer Data Platform Product Engineer role at The Pokémon Company International, focusing on CDP initiatives, data strategy, and customer data optimization.