Senior Software Engineer, Data Ingestion

Industry-leading DataOps platform provider building Astro, powered by Airflow, to accelerate building reliable data products.
$180,000 - $210,000
Data
Senior Software Engineer
Remote
5+ years of experience
Enterprise SaaS · AI

Description For Senior Software Engineer, Data Ingestion

Astronomer, the company behind Astro - an industry-leading DataOps platform powered by Airflow, is seeking a Senior Software Engineer for their data ingestion team. This role focuses on their data observability product, Astro Observe, a critical component built on OpenLineage events. The position offers an opportunity to work with cutting-edge technology in data orchestration and observability.

The ideal candidate will be instrumental in designing and implementing OpenLineage data collection and ingestion systems, directly impacting the company's ability to scale and deliver value to customers. The role involves significant contribution to open-source communities, particularly OpenLineage and Airflow, while working on enterprise-grade observability solutions.

This is a remote position with a competitive salary range of $180,000 - $210,000, plus equity and comprehensive benefits. The role requires 5+ years of engineering experience, with strong Python skills and software development best practices. Experience with OpenLineage, Apache Airflow, data observability products, Golang, SQL, and distributed systems would be advantageous.

Astronomer offers a unique opportunity to join a globally-distributed, venture-backed team focused on empowering data teams to build mission-critical analytics, AI, and software solutions. The company values diverse experiences and backgrounds, making it an ideal place for professionals with unconventional career paths. As part of the R&D team, you'll be at the forefront of managing Apache Airflow at scale while contributing to the broader data engineering community.

Last updated 9 minutes ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events
  • Contribute to the design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to implement observability and governance features
  • Contribute to platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
Go
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices including code reviews, testing, CI/CD

Benefits For Senior Software Engineer, Data Ingestion

Equity
  • Equity

Interested in this job?

Jobs Related To Astronomer Senior Software Engineer, Data Ingestion

Field Engineer, SWAT

Senior Field Engineer position at Astronomer focusing on Apache Airflow implementation and customer technical solutions, offering competitive salary and remote work.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with Python and OpenLineage in a remote environment.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with OpenLineage and Apache Airflow in a remote environment.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with OpenLineage and Airflow in a remote environment.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with OpenLineage and Apache Airflow in a remote environment.