Senior Software Engineer, Data Ingestion

Industry-leading data orchestration and observability platform provider, powered by Airflow, helping data teams build reliable data products.
$190,000 - $220,000
Data
Senior Software Engineer
Remote
5+ years of experience
Enterprise SaaS · AI
This job posting may no longer be active. You may be interested in these related jobs instead:
Lead Data Engineer (Data Consumption, Access and SD) - Chase UK

Lead Data Engineer position at Chase UK focusing on data platform development, cloud infrastructure, and pipeline optimization.

Sr Lead Software Engineer- Oracle, SQL, Data Modeling

Senior Lead Software Engineer role at JPMorgan Chase focusing on Oracle, SQL, and Data Modeling, requiring 5+ years of experience in database design and optimization.

Sr. Business Intelligence Engineer

Senior Business Intelligence Engineer role at Amazon Search, focusing on reinforcement learning systems and data analysis to optimize shopping experiences for millions of customers.

Sr. Business Intelligence Engineer, Long Term Planning

Senior Business Intelligence Engineer role at Amazon focusing on supply chain optimization and transportation planning across Europe, based in Luxembourg.

Business Intelligence Engineer (L5), Amazon

Senior Business Intelligence Engineer role at Amazon Payment team, focusing on data analytics and insights for Japan Payment Products.

Description For Senior Software Engineer, Data Ingestion

Astronomer is seeking a Senior Software Engineer to work on their data observability product - Astro Observe, a critical component built on top of OpenLineage events. This role offers an opportunity to work with a globally-distributed, venture-backed team focused on delivering industry-leading data orchestration solutions. The position involves leading the design and implementation of OpenLineage data collection and ingestion efforts, contributing to open-source communities, and developing scalable solutions. The ideal candidate will have strong Python skills, 5+ years of engineering experience, and a passion for data observability. The role offers competitive compensation ranging from CA$190,000 - CA$220,000, plus equity, and embraces remote work culture. Astronomer values diverse experiences and backgrounds, making it an ideal place for those with unconventional career paths. The company's mission is to empower data teams to bring mission-critical analytics, AI, and software to life, placing you at the forefront of the industry's evolution. Working at Astronomer means joining a team of learners, innovators, and collaborators dedicated to transforming how organizations handle data orchestration and observability.

Last updated 3 months ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to the OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events from Airflow
  • Contribute to the design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to understand user requirements
  • Implement and iterate on the observability and governance features
  • Contribute to the overall platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
Go
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices including code reviews, testing, CI/CD, version control, automation and debugging

Benefits For Senior Software Engineer, Data Ingestion

Equity
  • Equity
  • Comprehensive benefits package

Interested in this job?