Staff Engineer (Market Data)

At Kpler, we are dedicated to helping our clients navigate complex markets with ease. By simplifying global trade information and providing valuable insights, we empower organisations to make informed decisions in commodities, energy, and maritime sectors.

Since our founding in 2014, we have focused on delivering top-tier intelligence through user-friendly platforms. Our team of over 500 experts from 35+ countries works tirelessly to transform intricate data into actionable strategies, ensuring our clients stay ahead in a dynamic market landscape.

As a Staff Engineer (Market Data) at Kpler, you will:

• Contribute to the roadmap to upgrade data pipelines for quality and reliability
• Design and implement APIs, pipelines, and read models to publish datasets
• Maintain and optimise datasets and their schemas
• Guarantee data integrity and availability to consumers
• Provide state-of-the-art environments and tools for the development team
• Share expertise and guidance with team members

Requirements:

• At least 8 years of experience as a Software Engineer / Data Engineer
• Hands-on experience with Kafka and Scala in production, especially with Cats or Spark
• Ability to design and implement RESTful APIs
• Experience with DevOps and Infrastructure as Code practices, especially on AWS
• Experience with Data Processing Orchestration (Airflow)
• Fluency in English and experience working in an international environment

Preferred skills:

• Functional Programming frameworks (e.g., fs2)
• Big Data Management (DeltaLake, Medallion, Lineage)
• Terraform, gitops, Kubernetes
• Machine learning, OCR, NLP
• ElasticSearch, GraphQL
• Python
• SQL schema and PostgreSQL optimisations
• AWS WAF principles

Join Kpler to leverage cutting-edge innovation for impactful results and experience unparalleled support on your journey to success. We are committed to providing a fair, inclusive, and diverse work environment, welcoming people of different backgrounds, experiences, abilities, and perspectives.