Senior Software Engineer, Data Ingestion

Industry-leading data orchestration and observability platform provider, powering Astro for data teams using Airflow.
$180,000 - $210,000
Data
Senior Software Engineer
Remote
5+ years of experience
Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Senior, Data Scientist

Senior Data Scientist position at Sam's Club focusing on merchandising financial planning, offering $90k-$180k salary with comprehensive benefits in Bentonville, AR.

Senior, Data Scientist

Senior Data Scientist position at Walmart focusing on security compliance and analytics, offering competitive salary and comprehensive benefits in Bentonville, AR.

Data Scientist III

Senior Data Scientist role at Sam's Club AI Labs focusing on machine learning, big data analytics, and AI implementation across retail operations.

Sr. Business Intelligence Engineer, Amazon Search

Senior BI Engineer role at Amazon Search, developing reinforcement learning systems for shopping experience optimization, offering competitive salary and benefits.

Sr. Business Intelligence Engineer, Search Experience Science, Search Assistance

Senior Business Intelligence Engineer role at Amazon Search, focusing on data analytics and insights for Search Assistance features serving millions of customers.

Description For Senior Software Engineer, Data Ingestion

Astronomer, the company behind Astro, is seeking a Senior Software Engineer to work on their data observability product - Astro Observe. This role focuses on leading the design and implementation of OpenLineage data collection and ingestion efforts. The position is remote-based and offers competitive compensation ranging from $180,000 to $210,000 plus equity.

The ideal candidate will be instrumental in enhancing the OpenLineage and Airflow Open Source community, contributing to Astro Observe's ingestion pipelines, and collaborating with cross-functional teams to implement observability features. With 5+ years of engineering experience required, the role demands strong Python skills and expertise in software development best practices.

Astronomer is a globally-distributed, venture-backed team focused on empowering data teams to bring mission-critical analytics, AI, and software to life. The company values diverse experiences and backgrounds, welcoming candidates with unconventional career paths. The role offers an opportunity to work at the forefront of data orchestration and observability, directly impacting the company's ability to scale and deliver value to customers.

Working in a remote-first environment, you'll be part of a team dedicated to providing exceptional experiences in managing Apache Airflow at scale. The position includes work on critical components of the company's expansion strategy, built on top of OpenLineage events. This is an excellent opportunity for someone passionate about data systems, open source contributions, and creating impactful solutions for data teams worldwide.

Last updated 3 months ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events
  • Contribute to design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to implement observability and governance features
  • Contribute to platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
Go
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices including code reviews, testing, CI/CD

Interested in this job?