Data Engineer

A technology business using satellite data and AI to provide real-time insights on global seaborne energy flows.
Data
Mid-Level Software Engineer
Hybrid
3+ years of experience
AI · Enterprise SaaS

Description For Data Engineer

Vortexa is revolutionizing the energy industry through advanced technology and AI. As a Data Engineer, you'll join a dynamic team responsible for processing vast amounts of data from satellite sources and various external inputs. The role involves handling terabytes of data in real-time, implementing complex prediction models, and maintaining high-performance data pipelines.

The Data Production Team manages all of Vortexa's data operations, from processing raw satellite data from 600,000 vessels to generating valuable forecasts for vessel destinations, cargo tracking, and market predictions. You'll work with cutting-edge technology while ensuring robust, maintainable solutions that meet industry standards.

The position offers an opportunity to work with top minds in the industry, in an environment that encourages intellectual engagement and constructive debate. You'll be instrumental in bridging the gap between scientific experiments and commercial products, ensuring the highest standards of data processing and analysis.

Working at Vortexa means joining a fast-growing international technology business that values innovation, collaboration, and personal growth. The company offers a flexible working environment, comprehensive benefits, and the chance to make a significant impact in the energy sector through technology.

The ideal candidate will combine strong technical skills in data engineering with a passion for solving complex problems. You'll need expertise in distributed systems, proficiency in multiple programming languages, and the ability to work effectively in a fast-paced startup environment. This role offers the perfect blend of technical challenge and business impact, making it an exciting opportunity for ambitious data engineers.

Last updated a month ago

Responsibilities For Data Engineer

  • Design and build infrastructure for pipeline and ML model deployment
  • Ensure 100% uptime and fault-tolerance of data pipelines
  • Work with software engineers, data scientists, and market analysts
  • Process and manage terabytes of data daily using AWS, K8s, and Airflow

Requirements For Data Engineer

Java
Python
Kafka
Kubernetes
  • Experience in building and deploying distributed scalable backend data processing pipelines
  • Fluency in both Java and Python (Rust is a plus)
  • Knowledge of data lake systems like Athena and big data storage formats
  • Experience with full software development life cycle
  • Coaching experience for developers
  • Experience with Apache Kafka and streaming frameworks (preferred)
  • Familiarity with observability principles (preferred)
  • Experience with web scraping technologies (preferred)

Benefits For Data Engineer

Equity
Medical Insurance
  • Equity options for all staff
  • Flexible working policy with remote & home working options
  • Private Health Insurance via Vitality
  • Global Volunteering Policy
  • Regular staff events

Interested in this job?

Jobs Related To Vortexa Data Engineer

Data Engineer

Data Engineer position at Vortexa working with data streams in a hybrid work environment in London

Data Engineer, Modeling and Optimization

Data Engineer position at Amazon's Modeling and Optimization team, building large-scale data infrastructure for logistics systems with competitive compensation.

Business Intelligence Engineer II, Application Security, Stores Security

Business Intelligence Engineer role at Amazon focusing on application security data analysis and reporting, offering competitive salary and comprehensive benefits in New York City.

Business Intelligence Engineer, Data Center Engineering

Business Intelligence Engineer role at AWS, focusing on data analysis and insights for global data center operations, requiring 3+ years experience in data analysis and visualization.

Business Intelligence Engineer, Trustworthy Shopping Experience

Business Intelligence Engineer role at Amazon focusing on customer protection through data analysis and insights generation.