Senior Data Engineer

Capco is a global technology and business consultancy, focused on the financial services sector.
Data
Senior Software Engineer
Contact Company
Finance

Description For Senior Data Engineer

Capco is a global technology and business consultancy, focused on the financial services sector. We are passionate about helping our clients succeed in an ever-changing industry.

As a Senior Data Engineer at Capco, you will work on engaging projects with some of the largest banks in the world, on projects that will transform the financial services industry. You'll be part of a digital engineering team that develops new and enhances existing financial and data solutions, having the opportunity to work on exciting greenfield projects as well as on established Tier1 bank applications adopted by millions of users.

Your responsibilities will include:

  • Working alongside clients to interpret requirements and define industry-leading solutions
  • Designing and developing robust, well-tested data pipelines
  • Demonstrating and helping clients adhere to best practices in engineering and SDLC
  • Developing both on-premise and cloud-based solutions
  • Supporting internal Capco capabilities by sharing insight, experience, and credentials

You'll be involved in digital and data transformation processes through a continuous delivery model. You will work on automating and optimizing data engineering processes, develop robust and fault-tolerant data solutions both on cloud and on-premise deployments. You'll have the opportunity to work across different data, cloud, and messaging technology stacks, and learn specialized data and cloud technologies to widen your skill set.

Capco is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. We're happy to cater to any reasonable adjustments you may require to ensure you have the best possible platform to succeed.

Join Capco and be part of transforming the financial services industry while growing your career in data engineering.

Last updated 11 hours ago

Responsibilities For Senior Data Engineer

  • Work alongside clients to interpret requirements and define industry-leading solutions
  • Design and develop robust, well-tested data pipelines
  • Demonstrate and help clients adhere to best practices in engineering and SDLC
  • Develop both on-premise and cloud-based solutions
  • Support internal Capco capabilities by sharing insight, experience, and credentials
  • Work on automating and optimizing data engineering processes
  • Develop robust and fault-tolerant data solutions both on cloud and on-premise deployments
  • Work across different data, cloud, and messaging technology stacks

Requirements For Senior Data Engineer

Java
Python
  • Strong cloud provider's experience on at least one of AWS, Azure or GCP
  • Hands-on experience using Scala/Python/Java
  • Experience in data and cloud technologies such as Hadoop, HIVE, Spark, Pig, SQOOP, Flume, PySpark, Databricks, Cloudera, Airflow, Oozie, S3, Glue, Athena, Terraform etc.
  • Experience with schema design using semi-structured and structured data structures
  • Experience on messaging technologies – Kafka, Spark Streaming, Amazon Kinesis
  • Strong experience in SQL
  • Good understanding of the differences and tradeoff between SQL and NoSQL, ETL and ELT
  • Understanding of containerisation, Graph Databases and ML Algorithms
  • Experience with data lake formation and data warehousing principles and technologies – BigQuery, Redshift, Snowflake
  • Experience using version control tool such as Git
  • Experience building CI/CD Pipelines on Jenkins, CircleCI
  • Enthusiasm and ability to pick up new technologies as needed

Interested in this job?

Jobs Related To Capco Senior Data Engineer

Business Intelligence Engineer, Last Mile Analytics

Lead Amazon's last mile quality team as a Business Intelligence Engineer, shaping strategy for customer-facing products and driving continuous improvement.

Sr. Data Scientist, Apple Services Engineering

Senior Data Scientist role at Apple Services Engineering, focusing on experimentation, metrics design, and data-driven decision making.

Worldwide Logistics Operations- Industrial Engineer DC Operations

Senior Industrial Engineer role at Apple, optimizing DC operations and driving innovation in supply chain logistics.

Data Engineer (L5) - Content Machine Learning

Senior Data Engineer role at Netflix, focusing on Content Machine Learning and Knowledge Graph development.

Senior Data Engineer

Senior Data Engineer role at Microsoft in Hyderabad, India, focusing on advanced data engineering and analytics for Windows products.