Kafka Engineer

Master-Works is a company focused on innovative data solutions and real-time data processing infrastructure.
Backend
Mid-Level Software Engineer
In-Person
3+ years of experience
Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Full Stack Developer/ Full Stack Engineer

Full Stack Developer position at Master-Works requiring 3+ years of experience in React.js, Node.js, and various databases, based in Hyderabad, India.

P360 Developer

P360 Developer position at Master-Works in Riyadh, focusing on Informatica P360 implementation, data management, and system integration.

WebMethods Developer

WebMethods Developer position at Master-Works, focusing on integration solutions development using WebMethods suite, requiring 3+ years of experience.

System Integration Engineer

System Integration Engineer position at Master-Works, focusing on designing and implementing integration solutions, requiring 3+ years of experience and expertise in APIs, cloud platforms, and data integration.

Test and Quality Assurance Engineer

Join Master-Works as a Test and Quality Assurance Engineer to develop and execute comprehensive testing strategies for software applications in Riyadh.

Description For Kafka Engineer

Master-Works is seeking a talented Kafka Engineer to join their innovative team. This role focuses on designing and implementing robust data streaming solutions using Apache Kafka. The position involves working with cross-functional teams to ensure efficient, reliable, and scalable data pipelines that enable real-time data processing and analytics.

The ideal candidate will have strong experience in Kafka administration and development, with expertise in configuring and managing Kafka clusters. They should be proficient in programming languages like Java, Scala, or Python, and have a solid understanding of distributed systems and microservices architecture.

Key responsibilities include designing and maintaining Kafka-based data pipelines, implementing monitoring best practices, collaborating with various teams, troubleshooting issues, ensuring data security, and creating comprehensive documentation. Experience with cloud platforms like AWS, Azure, or GCP is valued.

Master-Works values innovation and teamwork, offering an opportunity to make a significant impact in the field of data engineering. The role is based in Riyadh, Saudi Arabia, requiring on-site presence. This position is perfect for someone passionate about real-time data solutions and eager to contribute to building robust data streaming infrastructure.

Last updated 4 months ago

Responsibilities For Kafka Engineer

  • Design, develop, and maintain scalable Kafka-based data pipelines
  • Implement best practices for monitoring and maintaining Kafka clusters
  • Collaborate with data architects, data scientists, and application developers to integrate Kafka with various data sources and targets
  • Troubleshoot and resolve issues in data streaming and Kafka configurations
  • Ensure data security and compliance within the Kafka ecosystem
  • Create documentation for Kafka configurations, data models, and workflows
  • Stay current with Kafka-related technologies and advocate for improvements

Requirements For Kafka Engineer

Kafka
Java
Python
Scala
  • 3+ years of experience in Kafka administration and development
  • Strong proficiency in configuring, managing, and optimizing Apache Kafka
  • Experience with Kafka Streams, Kafka Connect, and related tools
  • Solid understanding of distributed systems and microservices architecture
  • Familiarity with programming languages such as Java, Scala, or Python
  • Experience with cloud-based environments (AWS, Azure, GCP) is a plus
  • Excellent problem-solving and analytical skills
  • Strong communication and collaboration abilities

Interested in this job?