Data Engineer

BJSS is seeking a Data Engineer to join their team. As a BJSS data engineer, you'll help clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps culture. You'll work in a fast-moving, agile environment, within multi-disciplinary teams of highly skilled consultants, delivering modern data platforms into large organisations.

Key responsibilities and requirements:

• Build, optimize, and maintain data applications, systems, and services
• Combine software engineering discipline with knowledge and experience in building data solutions
• Work with cloud technologies (AWS, Azure, GCP) and data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion, etc.
• Apply coding best practices and design patterns
• Experience with code and data versioning, dependency management, code quality and optimization, error handling, logging, monitoring, validation, and alerting
• Proficiency in writing well-tested object-oriented Python
• Experience with CI/CD tooling for code analysis, building, testing, and deployment
• Understanding of design choices for data storage and data processing, focusing on cloud data services
• Experience in using parallel computing to process large datasets and optimize computationally intensive tasks
• Ability to programmatically deploy, schedule, and monitor components in a workflow
• Skill in writing complex queries against relational and non-relational data stores

BJSS offers a collaborative and open culture, with opportunities to work on challenging projects for leading organizations. They provide various perks, including flexible benefits, health and wellbeing support, professional development opportunities, and a hybrid working model.

Join BJSS to be part of an innovative team solving complex technology problems and delivering impactful solutions used by millions daily.