Senior Software Engineer, Data Ingestion

Industry-leading DataOps platform provider building Astro, powered by Airflow, to accelerate building reliable data products.
$180,000 - $210,000
Data
Senior Software Engineer
Remote
5+ years of experience
Enterprise SaaS · AI

Description For Senior Software Engineer, Data Ingestion

Astronomer, the company behind Astro - an industry-leading DataOps platform powered by Airflow, is seeking a Senior Software Engineer for their data ingestion team. This role focuses on their data observability product, Astro Observe, built on OpenLineage events. The position offers an opportunity to work with cutting-edge data technologies while contributing to open-source communities.

The ideal candidate will lead design and implementation of OpenLineage data collection and ingestion efforts, directly impacting the company's ability to scale and deliver value to customers. This role combines technical expertise in Python and data systems with collaborative skills to work across teams.

The position offers competitive compensation ranging from $180,000 to $210,000, plus equity and comprehensive benefits. As a remote-first company, Astronomer values diversity and maintains an inclusive work environment. They welcome candidates with unconventional backgrounds who meet the essential qualifications.

Key responsibilities include enhancing OpenLineage events extraction from Airflow, developing ingestion pipelines, and implementing observability features. The role requires strong Python skills, 5+ years of engineering experience, and expertise in software development best practices. Experience with OpenLineage, Apache Airflow, and data observability products is advantageous.

Join a globally-distributed, venture-backed team focused on empowering data teams to build mission-critical analytics, AI, and software solutions. This role offers the chance to be at the forefront of the industry while contributing to the future of data orchestration and observability.

Last updated 9 days ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events
  • Contribute to design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to implement observability and governance features
  • Contribute to platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
Go
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices including code reviews, testing, CI/CD, version control

Interested in this job?

Jobs Related To Astronomer Senior Software Engineer, Data Ingestion

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with OpenLineage and Airflow in a remote environment.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with Python and OpenLineage to enhance data pipeline visibility.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability features for the Astro platform.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with Python and OpenLineage in a remote environment.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with OpenLineage and Apache Airflow in a remote environment.