Senior Software Engineer - Backend (Data Lineage)
Description For Senior Software Engineer - Backend (Data Lineage)
Atlan is seeking a highly skilled Senior Software Engineer to join their Backend team, focusing on Data Lineage. The ideal candidate will have 6+ years of experience in backend development and expertise in building systems for efficient data relationship generation and orchestration packages.
Key responsibilities include developing source-specific packages for metadata management, collaborating with field teams to support customers and partners, owning multiple package lifecycles, mentoring junior engineers, and driving innovation for Atlan users.
The role requires proficiency in Python, data orchestration, ETL processes, and cloud platforms. Experience with tools like DBT, Fivetran, Airflow, and Kafka is highly valued. The position offers the opportunity to work on cutting-edge data management solutions and contribute to open-source projects.
Atlan values a strong engineering culture, emphasizing knowledge sharing and personal growth. They offer a remote work environment and are committed to helping their team members achieve their best work and reach their "Ikigai". Join Atlan to be part of a mission to help data teams worldwide excel in their work while developing your own skills and career in a supportive, innovative environment.
Responsibilities For Senior Software Engineer - Backend (Data Lineage)
- Understand and build source-specific packages focused on crawling, mining, and migrating metadata from multiple data sources
- Work closely with our field teams to unblock customers and partners during onboarding as a technical subject matter expert
- Take full ownership of the lifecycle for multiple packages, acting as the technical owner
- Mentor and groom junior engineers working on these packages
- Deploy and Maintain the packages on the Atlan Metadata Marketplace
- Drive innovation and enhance developer productivity for users of Atlan
Requirements For Senior Software Engineer - Backend (Data Lineage)
- 6+ years of backend development experience as an individual contributor
- Hands-on experience with Python
- Proven experience in data orchestration including but not limited to building and deploying data pipelines
- Hands-on experience with ETL processes and orchestration/data transformation tools (eg - DBT, Fivetran, Airflow, Kafka, Dagster, etc)
- Experience leading customer and partner calls as a technical SME, with the ability to provide support for the packages you own
- Proficiency with Kubernetes and cloud platforms (AWS, Azure, or GCP)
