Senior Software Engineer, Data Ingestion

Industry-leading data orchestration and observability platform provider, powered by Airflow, helping data teams build reliable data products.
$180,000 - $210,000
Data
Senior Software Engineer
Remote
5+ years of experience
Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Senior Delivery Consultant – Data Engineer, AWS Professional Services Israel

Senior Data Engineering role at AWS Professional Services, focusing on designing and implementing cloud solutions while providing technical guidance to customers.

Senior Business Intelligence Engineer, NACP Analytics

Senior Business Intelligence Engineer position at Amazon, leading analytics and automation for capacity planning, requiring 10+ years experience and strong technical skills.

Sr Data Engineer

Senior Data Engineer position at Disney Entertainment building and maintaining Identity and Device Data products with focus on scalable data processing pipelines.

Sr. Data Engineer, Amazon Devices-Demand Planning

Senior Data Engineer position at Amazon Devices-Demand Planning team, leading data architecture solutions and ETL implementations using AWS technologies, offering competitive compensation and benefits.

Senior Analytics Developer

Senior Analytics Developer role at SOCi, leading data pipeline development and analytics solutions with competitive compensation and hybrid work model in Vancouver.

Description For Senior Software Engineer, Data Ingestion

Astronomer, the creator of Astro, is seeking a Senior Software Engineer to join their R&D team focusing on data ingestion. This role is crucial for their data observability product, Astro Observe, which is built on OpenLineage events. As a globally-distributed, venture-backed team, Astronomer is at the forefront of data orchestration and observability.

The position offers an opportunity to work on mission-critical analytics and AI solutions, contributing to both proprietary and open-source projects. You'll be instrumental in designing and implementing OpenLineage data collection and ingestion efforts, directly impacting the platform's scalability and customer value delivery.

The ideal candidate brings strong Python expertise and extensive engineering experience, but Astronomer values diverse backgrounds and unconventional career paths. You'll work in a remote-first environment, collaborating with cross-functional teams to enhance the platform's observability and governance features.

This role offers competitive compensation ($180,000-$210,000) plus equity, and the chance to work with cutting-edge technologies like Apache Airflow and OpenLineage. The position combines technical depth with customer impact, making it perfect for engineers passionate about data systems and observability who want to shape the future of data orchestration.

Last updated 5 months ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events
  • Contribute to design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to implement observability and governance features
  • Contribute to platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
Go
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices including code reviews, testing, CI/CD

Interested in this job?