Senior Software Engineer, Data Ingestion

Industry-leading DataOps platform provider building Astro, powered by Airflow, to accelerate reliable data products for insights and AI.
$180,000 - $210,000
Data
Senior Software Engineer
Remote
5+ years of experience
AI · Enterprise SaaS

Description For Senior Software Engineer, Data Ingestion

Astronomer is seeking a Senior Software Engineer to join their R&D team, focusing on their data observability product - Astro Observe. As an industry leader in Apache Airflow management, Astronomer has designed Astro, a cutting-edge DataOps platform powered by Airflow that helps data teams build reliable data products for analytics, AI, and data-driven applications.

The role centers on leading the design and implementation of OpenLineage data collection and ingestion efforts, which are crucial to the company's expansion strategy. You'll be working with a globally-distributed, venture-backed team of innovators and collaborators, contributing directly to the platform's success and customer value delivery.

Key responsibilities include contributing to the OpenLineage and Airflow Open Source community, developing Astro Observe's ingestion pipelines, and collaborating with cross-functional teams to implement observability features. The ideal candidate brings 5+ years of engineering experience, strong Python skills, and excellent communication abilities.

The position offers competitive compensation ranging from $180,000 to $210,000, plus equity, and embraces remote work culture. Astronomer values diverse experiences and backgrounds, welcoming candidates with unconventional career paths who meet the essential qualifications. The company is committed to equal opportunity employment and maintains a remote-first work environment.

This role presents an exciting opportunity to be at the forefront of data orchestration and observability, working with cutting-edge technologies while contributing to both proprietary and open-source projects. You'll be part of a team dedicated to empowering data teams worldwide and driving innovation in the data infrastructure space.

Last updated 9 days ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events
  • Contribute to design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to implement observability and governance features
  • Contribute to platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
Go
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices including code reviews, testing, CI/CD

Interested in this job?

Jobs Related To Astronomer Senior Software Engineer, Data Ingestion

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with OpenLineage and Airflow in a remote environment.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with Python and OpenLineage to enhance data pipeline visibility.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with OpenLineage and Apache Airflow in a remote environment.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with Python and OpenLineage in a remote environment.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with OpenLineage and Apache Airflow in a remote environment.