Senior Software Engineer, Data Ingestion

Industry-leading data orchestration and observability platform provider, powering Astro for data teams using Airflow.
$180,000 - $210,000
Data
Senior Software Engineer
Remote
5+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Lead Data Engineer (Data Consumption, Access and SD) - Chase UK

Lead Data Engineer position at Chase UK focusing on data platform development, cloud infrastructure, and pipeline optimization.

Sr Lead Software Engineer- Oracle, SQL, Data Modeling

Senior Lead Software Engineer role at JPMorgan Chase focusing on Oracle, SQL, and Data Modeling, requiring 5+ years of experience in database design and optimization.

Sr. Business Intelligence Engineer

Senior Business Intelligence Engineer role at Amazon Search, focusing on reinforcement learning systems and data analysis to optimize shopping experiences for millions of customers.

Sr. Business Intelligence Engineer, Long Term Planning

Senior Business Intelligence Engineer role at Amazon focusing on supply chain optimization and transportation planning across Europe, based in Luxembourg.

Business Intelligence Engineer (L5), Amazon

Senior Business Intelligence Engineer role at Amazon Payment team, focusing on data analytics and insights for Japan Payment Products.

Description For Senior Software Engineer, Data Ingestion

Astronomer, the company behind Astro - an industry-leading data orchestration and observability platform, is seeking a Senior Software Engineer for their data ingestion team. This role focuses on their data observability product, Astro Observe, built on OpenLineage events. The position offers an opportunity to work with cutting-edge technology in data orchestration and Apache Airflow.

The ideal candidate will lead design and implementation of OpenLineage data collection and ingestion efforts, contributing directly to both open-source communities and product development. This role requires strong Python skills, experience with software development best practices, and 5+ years of engineering experience.

Working in a remote-first, globally-distributed environment, you'll collaborate with cross-functional teams to enhance platform capabilities and improve customer experience. The company values diverse experiences and unconventional career paths, fostering an inclusive culture focused on learning and innovation.

The role offers competitive compensation ($180,000-$210,000) plus equity, making it an attractive opportunity for experienced engineers passionate about data systems and open-source technologies. As part of Astronomer's expansion strategy, you'll have a direct impact on helping customers gain better visibility into their data pipelines and products.

Last updated 3 months ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events
  • Contribute to design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to implement observability and governance features
  • Contribute to platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices

Benefits For Senior Software Engineer, Data Ingestion

Equity
  • Equity
  • Comprehensive benefits package

Interested in this job?