Senior Software Engineer, Data Ingestion

Industry-leading data orchestration and observability platform provider, powering Astro for data teams using Airflow.
$180,000 - $210,000
Data
Senior Software Engineer
Remote
5+ years of experience
Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Senior Data Engineer

Senior Data Engineer role at Oblivious focusing on building secure data integrations and frameworks using Python, combining AI capabilities with privacy protection.

Senior Data Scientist, Research, Ads Metrics

Senior Data Scientist position at Google focusing on ads metrics research, offering competitive compensation and the opportunity to shape advertising products.

Senior Data Scientist, Research, Workspace

Senior Data Scientist position at Google focusing on Workspace products, requiring 5+ years of analytics experience and expertise in Python, R, and SQL.

Senior Data Scientist, Product, Google Store

Senior Data Scientist position at Google Store focusing on product analytics, requiring 5+ years of experience in data analysis, statistics, and programming.

Senior Data Scientist, Google Play

Senior Data Scientist position at Google Play focusing on analytics, product decisions, and strategic insights using Python, R, and SQL.

Description For Senior Software Engineer, Data Ingestion

Astronomer, the company behind Astro, is seeking a Senior Software Engineer to work on their data observability product - Astro Observe. This role focuses on leading the design and implementation of OpenLineage data collection and ingestion efforts. The position is remote-based and offers competitive compensation ranging from $180,000 to $210,000 plus equity.

The ideal candidate will be instrumental in enhancing the OpenLineage and Airflow Open Source community, contributing to Astro Observe's ingestion pipelines, and collaborating with cross-functional teams to implement observability features. With 5+ years of engineering experience required, the role demands strong Python skills and expertise in software development best practices.

Astronomer is a globally-distributed, venture-backed team focused on empowering data teams to bring mission-critical analytics, AI, and software to life. The company values diverse experiences and backgrounds, welcoming candidates with unconventional career paths. The role offers an opportunity to work at the forefront of data orchestration and observability, directly impacting the company's ability to scale and deliver value to customers.

Working in a remote-first environment, you'll be part of a team dedicated to providing exceptional experiences in managing Apache Airflow at scale. The position includes work on critical components of the company's expansion strategy, built on top of OpenLineage events. This is an excellent opportunity for someone passionate about data systems, open source contributions, and creating impactful solutions for data teams worldwide.

Last updated 2 months ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events
  • Contribute to design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to implement observability and governance features
  • Contribute to platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
Go
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices including code reviews, testing, CI/CD

Interested in this job?