Senior Software Engineer, Data Ingestion

Industry-leading data orchestration and observability platform powered by Airflow, accelerating building reliable data products.
$190,000 - $220,000
Data
Senior Software Engineer
Remote
5+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Senior, Data Scientist

Senior Data Scientist position at Sam's Club focusing on merchandising financial planning, offering $90k-$180k salary with comprehensive benefits in Bentonville, AR.

Senior, Data Scientist

Senior Data Scientist position at Walmart focusing on security compliance and analytics, offering competitive salary and comprehensive benefits in Bentonville, AR.

Data Scientist III

Senior Data Scientist role at Sam's Club AI Labs focusing on machine learning, big data analytics, and AI implementation across retail operations.

Sr. Business Intelligence Engineer, Amazon Search

Senior BI Engineer role at Amazon Search, developing reinforcement learning systems for shopping experience optimization, offering competitive salary and benefits.

Sr. Business Intelligence Engineer, Search Experience Science, Search Assistance

Senior Business Intelligence Engineer role at Amazon Search, focusing on data analytics and insights for Search Assistance features serving millions of customers.

Description For Senior Software Engineer, Data Ingestion

Astronomer, the company behind Astro - an industry-leading data orchestration and observability platform, is seeking a Senior Software Engineer for their data ingestion team. This role focuses on their data observability product, Astro Observe, built on OpenLineage events. The position offers an opportunity to work with cutting-edge technology in data orchestration and Apache Airflow.

The ideal candidate will lead design and implementation of OpenLineage data collection and ingestion efforts, contributing directly to the product's scalability and customer value. This role combines technical expertise in Python and data systems with collaborative teamwork to enhance platform capabilities.

Working in a remote-first, globally-distributed environment, you'll be part of a venture-backed team dedicated to empowering data teams. The role offers competitive compensation (CA$190,000 - CA$220,000) plus equity, and welcomes candidates with unconventional backgrounds who meet the core qualifications.

Key technical areas include Python, OpenLineage, Apache Airflow, and data observability systems. The position involves both hands-on development and strategic input on product direction, making it ideal for engineers passionate about data systems and open-source contributions.

Astronomer values diversity and maintains an inclusive work environment, making it an excellent opportunity for those looking to make an impact in the data orchestration space while working with a forward-thinking team.

Last updated 3 months ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to the OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events from Airflow
  • Contribute to the design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to understand user requirements
  • Implement and iterate on the observability and governance features
  • Contribute to the overall platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
Go
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices including code reviews, testing, CI/CD, version control, automation and debugging

Benefits For Senior Software Engineer, Data Ingestion

Equity
  • Equity
  • Comprehensive benefits package

Interested in this job?