Kafka Engineer
Description For Kafka Engineer
Master-Works is seeking a talented Kafka Engineer to join their innovative team. This role focuses on designing and implementing robust data streaming solutions using Apache Kafka. The position involves working with cross-functional teams to ensure efficient, reliable, and scalable data pipelines that enable real-time data processing and analytics.
The ideal candidate will have strong experience in Kafka administration and development, with expertise in configuring and managing Kafka clusters. They should be proficient in programming languages like Java, Scala, or Python, and have a solid understanding of distributed systems and microservices architecture.
Key responsibilities include designing and maintaining Kafka-based data pipelines, implementing monitoring best practices, collaborating with various teams, troubleshooting issues, ensuring data security, and creating comprehensive documentation. Experience with cloud platforms like AWS, Azure, or GCP is valued.
Master-Works values innovation and teamwork, offering an opportunity to make a significant impact in the field of data engineering. The role is based in Riyadh, Saudi Arabia, requiring on-site presence. This position is perfect for someone passionate about real-time data solutions and eager to contribute to building robust data streaming infrastructure.
Responsibilities For Kafka Engineer
- Design, develop, and maintain scalable Kafka-based data pipelines
- Implement best practices for monitoring and maintaining Kafka clusters
- Collaborate with data architects, data scientists, and application developers to integrate Kafka with various data sources and targets
- Troubleshoot and resolve issues in data streaming and Kafka configurations
- Ensure data security and compliance within the Kafka ecosystem
- Create documentation for Kafka configurations, data models, and workflows
- Stay current with Kafka-related technologies and advocate for improvements
Requirements For Kafka Engineer
- 3+ years of experience in Kafka administration and development
- Strong proficiency in configuring, managing, and optimizing Apache Kafka
- Experience with Kafka Streams, Kafka Connect, and related tools
- Solid understanding of distributed systems and microservices architecture
- Familiarity with programming languages such as Java, Scala, or Python
- Experience with cloud-based environments (AWS, Azure, GCP) is a plus
- Excellent problem-solving and analytical skills
- Strong communication and collaboration abilities
Jobs Related To Master-Works Kafka Engineer
