Senior Software Engineer, Data Ingestion

Industry-leading data orchestration and observability platform provider, powered by Airflow, helping data teams build reliable data products.
$180,000 - $210,000
Data
Senior Software Engineer
Remote
5+ years of experience
Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Senior Data Scientist, Research, Ads Metrics

Senior Data Scientist position at Google focusing on ads metrics research, offering competitive compensation and the opportunity to shape advertising products.

Senior Data Scientist, Research, Workspace

Senior Data Scientist position at Google focusing on Workspace products, requiring 5+ years of analytics experience and expertise in Python, R, and SQL.

Senior Data Scientist, Product, Google Store

Senior Data Scientist position at Google Store focusing on product analytics, requiring 5+ years of experience in data analysis, statistics, and programming.

Senior Data Scientist, Google Play

Senior Data Scientist position at Google Play focusing on analytics, product decisions, and strategic insights using Python, R, and SQL.

Customer Engineer III, Data Management, Google Cloud

Senior Customer Engineer role at Google Cloud focusing on data management, offering $147K-$218K salary plus benefits, requiring 10 years of cloud architecture experience.

Description For Senior Software Engineer, Data Ingestion

Astronomer, the creator of Astro, is seeking a Senior Software Engineer to join their R&D team focusing on data ingestion. This role is crucial for their data observability product, Astro Observe, which is built on OpenLineage events. As a globally-distributed, venture-backed team, Astronomer is at the forefront of data orchestration and observability.

The position offers an opportunity to work on mission-critical analytics and AI solutions, contributing to both proprietary and open-source projects. You'll be instrumental in designing and implementing OpenLineage data collection and ingestion efforts, directly impacting the platform's scalability and customer value delivery.

The ideal candidate brings strong Python expertise and extensive engineering experience, but Astronomer values diverse backgrounds and unconventional career paths. You'll work in a remote-first environment, collaborating with cross-functional teams to enhance the platform's observability and governance features.

This role offers competitive compensation ($180,000-$210,000) plus equity, and the chance to work with cutting-edge technologies like Apache Airflow and OpenLineage. The position combines technical depth with customer impact, making it perfect for engineers passionate about data systems and observability who want to shape the future of data orchestration.

Last updated 4 months ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events
  • Contribute to design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to implement observability and governance features
  • Contribute to platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
Go
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices including code reviews, testing, CI/CD

Interested in this job?