Lead Data Engineer
Description For Lead Data Engineer
Tide, a leading business financial platform, is seeking a Lead Data Engineer to join their team in Hyderabad, India. With over 575,000 SME members in the UK and 250,000 in India, Tide is rapidly expanding its finance & admin platform designed to save small businesses time and money.
As a Lead Data Engineer, you'll be responsible for building and running data pipelines and services to support business functions, reports, and dashboards. You'll work with technologies like BigQuery/Snowflake, Airflow, Stitch/Fivetran, dbt, Tableau/Looker, and AWS/GCP.
Key responsibilities include developing ETL/ELT pipelines, designing scalable processes in a Data Mesh architecture, mentoring junior engineers, and being a go-to expert for data technologies. You'll translate business requirements into technical solutions, own the delivery of data models and reports, and champion data warehouse governance.
The ideal candidate has 7+ years of experience with data warehouse technology, proficiency in SQL and data modeling, and familiarity with modern data stack tools. You should have experience in agile processes, data ingestion techniques, and working in cross-functional teams. Strong technical documentation skills and business-level English are essential.
Tide offers a competitive salary, comprehensive benefits including health insurance and stock options, and a flexible work environment. Join a diverse, inclusive team of over 1,800 Tideans across multiple countries and be part of a mission to empower small businesses worldwide.
Responsibilities For Lead Data Engineer
- Developing end to end ETL/ELT Pipeline working with Data Analysts of business Function
- Designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture
- Mentoring other Junior Engineers in the Team
- Be a 'go-to' expert for data technologies and solutions
- Troubleshooting and resolving technical issues as they arise
- Translating business requirements into technical requirements
- Owning the delivery of data models and reports end to end
- Perform exploratory data analysis to identify data quality issues
- Working with Data Analysts to ensure that all data feeds are optimised and available at the required times
- Discovering, transforming, testing, deploying and documenting data sources
- Applying, help defining, and championing data warehouse governance
- Building Looker Dashboard for use cases if required
Requirements For Lead Data Engineer
- 7+ years of extensive development experience using snowflake or similar data warehouse technology
- Working experience with dbt and other technologies of the modern data stack, such as Snowflake, Apache Airflow, Fivetran, AWS, git, Looker
- Experience in agile processes, such as SCRUM
- Extensive experience in writing advanced SQL statements and performance tuning them
- Experience in Data Ingestion techniques using custom or SAAS tool like fivetran
- Experience in data modelling and can optimise existing/new data models
- Experience in data mining, data warehouse solutions, and ETL
- Experience working in agile cross-functional delivery team
- High development standards, especially for code quality, code reviews, unit testing, continuous integration and deployment
- Strong technical documentation skills
- Business-level English and good communication skills
- Basic understanding of various systems across the AWS platform (Good to have)
- Experience with python, governance tool or data quality tool will be added advantage
Benefits For Lead Data Engineer
- Competitive salary
- Self & Family Health Insurance
- Term & Life Insurance
- OPD Benefits
- Mental wellbeing through Plumm
- Learning & Development Budget
- WFH Setup allowance
- 15 days of Privilege leaves
- 12 days of Casual leaves
- 12 days of Sick leaves
- 3 paid days off for volunteering or L&D activities
- Stock Options
- Flexible working arrangements
- Work from a different country or Indian state for 90 days of the year
Jobs Related To Tide Lead Data Engineer
