Senior Software Engineer, Data Ingestion

Industry-leading data orchestration and observability platform provider, powered by Airflow, helping data teams build reliable data products.
$190,000 - $220,000
Data
Senior Software Engineer
Remote
5+ years of experience
Enterprise SaaS

Description For Senior Software Engineer, Data Ingestion

Astronomer is seeking a Senior Software Engineer to join their R&D team, focusing on their data observability product - Astro Observe. This role is crucial for the company's expansion strategy, working with OpenLineage events and leading data collection and ingestion efforts.

As a Senior Software Engineer at Astronomer, you'll be at the forefront of managing Apache Airflow at scale. The position offers an opportunity to work on Astro Observe, a critical component built on OpenLineage events. Your work will directly impact the platform's ability to scale and deliver value to customers.

The ideal candidate brings 5+ years of engineering experience, with strong Python skills and expertise in software development best practices. You'll contribute to the OpenLineage and Airflow Open Source community, design and develop ingestion pipelines, and collaborate with cross-functional teams to enhance observability features.

Astronomer offers a competitive compensation package ranging from CA$190,000 - CA$220,000, plus equity and comprehensive benefits. The company values diversity and maintains a remote-first culture, welcoming candidates with unconventional backgrounds.

This role is perfect for engineers passionate about data observability, with bonus points for experience in OpenLineage, Apache Airflow, Golang, SQL, OLAP databases, and distributed systems. You'll join a globally-distributed, venture-backed team of innovators working to empower data teams and deliver mission-critical analytics, AI, and software solutions.

Working at Astronomer means being part of a company that's revolutionizing data orchestration and observability. You'll have the opportunity to shape the future of data management while working with cutting-edge technologies and contributing to open-source communities. The company's commitment to diversity, learning, and collaboration makes it an ideal environment for professional growth and impact.

Last updated a month ago

Responsibilities For Senior Software Engineer, Data Ingestion

  • Contribute to the OpenLineage and Airflow Open Source community to enhance data collection and extraction of OpenLineage events
  • Contribute to the design, development and vision of Astro Observe's ingestion pipelines
  • Collaborate with cross-functional teams to understand user requirements
  • Implement and iterate on observability and governance features
  • Contribute to the overall platform usability, reliability, and scalability

Requirements For Senior Software Engineer, Data Ingestion

Python
  • Strong focus on helping customers gain visibility and actionable insights
  • Proven experience with Python
  • Strong written and verbal communication skills
  • 5+ years of engineering experience
  • Experience with fast-paced startup environments
  • Experience with software development best practices including code reviews, testing, CI/CD, version control, automation and debugging

Interested in this job?

Jobs Related To Astronomer Senior Software Engineer, Data Ingestion

Senior Software Engineer, Data Ingestion

Senior Software Engineer role at Astronomer focusing on data ingestion and observability platform development using Python and OpenLineage.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, offering remote work and competitive compensation.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with OpenLineage and Apache Airflow in a remote environment.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with Python and OpenLineage in a remote environment.

Senior Software Engineer, Data Ingestion

Senior Software Engineer position at Astronomer focusing on data ingestion and observability, working with OpenLineage and Apache Airflow in a remote environment.