Data Engineer
Description For Data Engineer
Citylitics is seeking a skilled and enthusiastic Data Engineer to join their growing team. The role requires solid experience with Apache Airflow and Google Cloud Platform (GCP) services like Dataflow, BigQuery, and Vertex AI. The ideal candidate will have 2+ years of experience building and maintaining complex data pipelines in a production environment.
Key responsibilities include:
- Designing, building, and maintaining scalable data pipelines using Apache Airflow, Dataflow, and other GCP services
- Collaborating on data modeling and optimization within BigQuery
- Implementing monitoring and troubleshooting for data pipelines
- Working closely with other teams to translate business requirements into technical solutions
- Contributing to the ongoing improvement of data infrastructure and processes
The company offers a unique opportunity to work on impactful projects in the infrastructure sector, using cutting-edge technologies and AI tools. Citylitics provides a dynamic work environment with opportunities for growth, mentorship, and internal promotions.
Technologies used include Python, Django, Cloud SQL, Airflow/Cloud Composer, Google Cloud Platform, Dash & Plotly.
Citylitics is committed to diversity, inclusivity, and providing equal opportunities for all employees.
Responsibilities For Data Engineer
- Design, build, and maintain highly scalable and reliable data pipelines using Apache Airflow, Dataflow, and other GCP services
- Collaborate on data modeling & optimization within BigQuery
- Implement monitoring & troubleshooting for data pipelines
- Work closely with other teams to translate business requirements into technical solutions
- Contribute to the ongoing improvement of data infrastructure and processes
Requirements For Data Engineer
- Proven experience (2+ years) building and maintaining data pipelines using Apache Airflow
- Strong understanding of data warehousing principles and experience working with BigQuery
- Experience with cloud-based data processing frameworks like Apache Beam (ideally with Google Cloud Dataflow)
- Familiarity with Google Cloud Platform (GCP) services, specifically BigQuery, Dataflow, and Vertex AI
- Proficiency in at least one scripting language (Python preferred)
- Experience with version control systems (Git)
- Excellent problem-solving skills and a proactive approach to identifying and resolving issues
- Good communication and collaboration skills
- Understanding of data modeling concepts and best practices
- Experience with CI/CD pipelines is a plus
Benefits For Data Engineer
- Opportunity to work for one of the top 15 innovative analytics startups in Canada
- Influence positive change in sustainable public infrastructure
- Work on a disruptive solution in a market with no direct competition
- Fast-paced environment with less bureaucracy than large tech companies
- Access to Generative AI tools and full Data Universe
- Internal mentorship program
- Professional growth and skill-based development
- Internal promotion opportunities
Jobs Related To Citylitics Data Engineer
