Senior Software Engineer, Data Ingestion

Industry-leading data orchestration and observability platform provider, powering Astro for data teams using Airflow.
$180,000 - $210,000
Data
Senior Software Engineer
Remote
5+ years of experience
Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Sr. Business Intelligence Engineer, Amazon Search

Senior BI Engineer role at Amazon Search, developing reinforcement learning systems for e-commerce optimization with competitive compensation and benefits.

Business Intelligence Engineer, Amazon Flex

Senior Business Intelligence Engineer position at Amazon Flex, focusing on building end-to-end business intelligence solutions and working with big data sets.

Sr. Business Intelligence Engineer, Selling Partner Promotions

Senior Business Intelligence Engineer role at Amazon focusing on promotional analytics and data-driven insights to enhance seller and customer experience.

Sr. Business Intelligence Engineer, Search Experience Science, Search Assistance

Senior Business Intelligence Engineer role at Amazon Search, focusing on data analytics for Search Assistance features, requiring 10+ years experience and strong SQL/Python skills.

Sr. Simulation Engineer- Material Flow Design, Innovation, Engineering & Sustainability

Senior Simulation Engineer role at Amazon focusing on logistics optimization, material flow design, and sustainable infrastructure development across European operations.

Description For Senior Software Engineer, Data Ingestion

Astronomer, the company behind Astro - an industry-leading data orchestration and observability platform, is seeking a Senior Software Engineer for their data ingestion team. This role focuses on their data observability product, Astro Observe, built on OpenLineage events. The position offers an opportunity to work with cutting-edge technology in data orchestration and Apache Airflow.

The ideal candidate will be instrumental in designing and implementing OpenLineage data collection and ingestion efforts. This role combines technical expertise in Python and data systems with the opportunity to contribute to open-source communities. The position requires 5+ years of engineering experience and offers competitive compensation between $180,000-$210,000 plus equity.

As a globally-distributed, venture-backed team, Astronomer values diverse experiences and unconventional career paths. The company maintains a remote-first culture and emphasizes learning, innovation, and collaboration. This role provides an excellent opportunity for engineers passionate about data systems and observability to make a significant impact in a rapidly growing field.

The position involves working with cross-functional teams, contributing to open-source projects, and building scalable solutions for data pipeline visibility. Additional valuable skills include experience with Golang, SQL, OLAP databases, and distributed systems. Astronomer offers a comprehensive benefits package and promotes an inclusive work environment, making it an attractive opportunity for senior engineers looking to work on challenging problems in the data orchestration space.

Last updated 4 months ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events
  • Contribute to design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to implement observability and governance features
  • Contribute to platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
Go
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices (code reviews, testing, CI/CD, version control)

Benefits For Senior Software Engineer, Data Ingestion

Equity
  • Equity
  • Comprehensive benefits package

Interested in this job?