Data Engineer
Description For Data Engineer
Near Space Labs is revolutionizing earth imaging through their innovative fleet of stratospheric robots. Operating at altitudes between 40,000 and 60,000 feet, their proprietary balloon-based imaging systems capture petabytes of valuable imagery data. They're seeking a Senior Data Engineer to spearhead the evolution of their petabyte-scale geospatial imagery pipeline.
The role demands a seasoned professional with 5+ years of Python expertise and deep knowledge of distributed systems. You'll be responsible for building and maintaining data pipelines, implementing cloud storage solutions, and ensuring optimal performance of data processing systems. The position offers a unique opportunity to work with cutting-edge technology in space imaging and geospatial data processing.
Working from Barcelona, you'll join an international team in a flexible hybrid environment. The tech stack includes Python, TypeScript, Kubernetes, and various cloud technologies. This role is perfect for someone who thrives in a startup environment, enjoys solving complex technical challenges, and wants to contribute to groundbreaking earth observation technology.
The company offers a diverse and inclusive workplace, emphasizing innovation and professional growth. You'll be part of a team committed to building unique technologies and finding novel solutions to interesting problems. This is an excellent opportunity for a data engineer who wants to make a significant impact in space technology while working with petabyte-scale data systems.
Responsibilities For Data Engineer
- Build and maintain proprietary data pipeline for batch geospatial data processing
- Monitor and support data pipeline performance and reliability
- Develop new data processing tasks to support evolving data requirements
- Design and implement data storage solutions using cloud-based storage services
- Develop and optimize data workflows using distributed systems
- Rapid generation of functional prototypes
Requirements For Data Engineer
- 5+ years of experience developing robust data pipelines and applications in Python
- Strong understanding of data structures, algorithms and geospatial data
- Experience with distributed processing frameworks (Airflow, Spark)
- Ability to interact and manage containerized data applications using Docker and Kubernetes
- Experience with cloud-based storage solutions and data warehousing technologies
- Knowledge of distributed systems
- Strong problem-solving and troubleshooting abilities
- Self-starter with ability to work independently and collaboratively
Benefits For Data Engineer
- Diverse and inclusive workplace
- International team environment
- Startup culture with critical role opportunities
- Novel and interesting technical challenges
Jobs Related To Near Space Labs Data Engineer
