Senior Software Engineer, Data Ingestion

Industry-leading data orchestration and observability platform provider, powering Astro for data teams using Airflow.
$180,000 - $210,000
Data
Senior Software Engineer
Remote
5+ years of experience
Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Senior Software Engineer - Trading Data Fabric

Senior Software Engineer position at Belvedere Trading, focusing on building and managing data and research platforms for high-volume trading operations using cloud technologies.

LLM Engineer (Data Platform)

Senior LLM Engineer position at 42dot focusing on petabyte-scale data platform development for AI model training, requiring expertise in distributed systems and data engineering.

Senior Data Engineer

Senior Data Engineer position at Titan Wealth's Cape Town Tech Hub, focusing on Azure data solutions with hybrid work options and comprehensive benefits.

Senior Data Engineer - Integrations Services

Senior Data Engineer position at StackAdapt, building scalable data pipelines and integrations for a leading programmatic advertising platform.

Senior Python Data Engineer (Finance Technology)

Senior Python Data Engineer position at Crypto.com, focusing on building financial data pipelines and transformation systems using Python, Airflow, and SQL.

Description For Senior Software Engineer, Data Ingestion

Astronomer, the company behind Astro, is seeking a Senior Software Engineer to work on their data observability product - Astro Observe. This role focuses on leading the design and implementation of OpenLineage data collection and ingestion efforts. The position is remote-based and offers competitive compensation ranging from $180,000 to $210,000 plus equity.

The ideal candidate will be instrumental in enhancing the OpenLineage and Airflow Open Source community, contributing to Astro Observe's ingestion pipelines, and collaborating with cross-functional teams to implement observability features. With 5+ years of engineering experience required, the role demands strong Python skills and expertise in software development best practices.

Astronomer is a globally-distributed, venture-backed team focused on empowering data teams to bring mission-critical analytics, AI, and software to life. The company values diverse experiences and backgrounds, welcoming candidates with unconventional career paths. The role offers an opportunity to work at the forefront of data orchestration and observability, directly impacting the company's ability to scale and deliver value to customers.

Working in a remote-first environment, you'll be part of a team dedicated to providing exceptional experiences in managing Apache Airflow at scale. The position includes work on critical components of the company's expansion strategy, built on top of OpenLineage events. This is an excellent opportunity for someone passionate about data systems, open source contributions, and creating impactful solutions for data teams worldwide.

Last updated 2 months ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events
  • Contribute to design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to implement observability and governance features
  • Contribute to platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
Go
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices including code reviews, testing, CI/CD

Interested in this job?