Senior Software Engineer, Data Ingestion

Industry-leading data orchestration and observability platform powered by Airflow, accelerating building reliable data products.
$190,000 - $220,000
Data
Senior Software Engineer
Remote
5+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Customer Engineer III, Data Management, Google Cloud

Senior Customer Engineer role at Google Cloud focusing on data management, offering $147K-$218K salary plus benefits, requiring 10 years of cloud architecture experience.

Customer Engineer, Business Intelligence, Looker (Korean or Mandarin)

Senior Customer Engineer position at Google Cloud, focusing on Business Intelligence with Looker, requiring Korean or Mandarin fluency and 10 years of data analysis experience.

Customer Engineer, Data Management Specialist, Google Cloud (Arabic)

Senior Customer Engineer position at Google Cloud focusing on data management and solutions architecture, requiring Arabic fluency and extensive cloud experience.

Senior Software Engineer, Data Governance AI Agent

Senior Software Engineer position at Google focusing on developing AI agents for data governance, requiring expertise in Large Language Models and complex system design.

Senior Data Engineer, Fleet Decision Intelligence, Google Cloud

Senior Data Engineer position at Google Cloud, leading data pipeline development and governance initiatives while mentoring junior engineers.

Description For Senior Software Engineer, Data Ingestion

Astronomer, the company behind Astro - an industry-leading data orchestration and observability platform, is seeking a Senior Software Engineer for their data ingestion team. This role focuses on their data observability product, Astro Observe, built on OpenLineage events. The position offers an opportunity to work with cutting-edge technology in data orchestration and Apache Airflow.

The ideal candidate will lead design and implementation of OpenLineage data collection and ingestion efforts, contributing directly to the product's scalability and customer value. This role combines technical expertise in Python and data systems with collaborative teamwork to enhance platform capabilities.

Working in a remote-first, globally-distributed environment, you'll be part of a venture-backed team dedicated to empowering data teams. The role offers competitive compensation (CA$190,000 - CA$220,000) plus equity, and welcomes candidates with unconventional backgrounds who meet the core qualifications.

Key technical areas include Python, OpenLineage, Apache Airflow, and data observability systems. The position involves both hands-on development and strategic input on product direction, making it ideal for engineers passionate about data systems and open-source contributions.

Astronomer values diversity and maintains an inclusive work environment, making it an excellent opportunity for those looking to make an impact in the data orchestration space while working with a forward-thinking team.

Last updated 2 months ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to the OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events from Airflow
  • Contribute to the design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to understand user requirements
  • Implement and iterate on the observability and governance features
  • Contribute to the overall platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
Go
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices including code reviews, testing, CI/CD, version control, automation and debugging

Benefits For Senior Software Engineer, Data Ingestion

Equity
  • Equity
  • Comprehensive benefits package

Interested in this job?