Data Architect (Databricks)

Capco Poland is a global technology and management consultancy specializing in driving digital transformation across the financial services industry.
Data
Remote
Finance

Description For Data Architect (Databricks)

Capco Poland, a global technology and management consultancy, is seeking a Data Architect specializing in Databricks to join their team. This remote position offers an exciting opportunity to drive digital transformation in the financial services industry.

As a Data Architect, you'll be responsible for designing, developing, and implementing robust data architecture solutions using modern platforms like Databricks. Your role will involve leading data migrations, architecting scalable data pipelines, and optimizing ETL workflows. You'll collaborate with cross-functional teams to deliver solutions that meet business requirements and support advanced analytics.

Key responsibilities include:

  • Designing and implementing scalable, reliable, and secure data environments
  • Leading migrations from traditional RDBMS to Databricks environments
  • Developing and managing ETL processes using Databricks
  • Optimizing performance of data systems
  • Collaborating with data engineers, scientists, analysts, and product managers
  • Defining best practices and standards for data engineering processes
  • Evaluating and implementing new technologies to improve efficiency
  • Providing technical leadership and mentorship to junior team members
  • Ensuring compliance with organizational policies and industry standards

The ideal candidate will have extensive experience with Databricks, cloud platforms (AWS, Azure, or GCP), and big data technologies. Strong knowledge of data warehousing, SQL, and programming languages like Python is essential. Familiarity with containerization technologies and excellent problem-solving skills are also required.

Capco offers a inclusive work environment that celebrates individuality and diversity. They provide numerous benefits, including flexible contract options, remote work possibilities, access to learning platforms, and various employee perks. Join Capco to be part of a dynamic team driving innovation in the financial services sector.

Last updated 10 days ago

Responsibilities For Data Architect (Databricks)

  • Design, develop, and implement robust data architecture solutions utilizing modern day data platforms like Databricks
  • Ensure scalable, reliable, and secure data environments that meet business requirements and support advanced analytics
  • Lead the migration of data from traditional RDBMS systems to Databricks environments
  • Architect and design scalable data pipelines and infrastructure to support the organization's data needs
  • Develop and manage ETL processes using Databricks to ensure efficient data extraction, transformation, and loading
  • Optimize ETL workflows to enhance performance and maintain data integrity
  • Ensure seamless data transition with minimal disruption to ongoing operations
  • Monitor and optimize performance of data systems to ensure reliability, scalability, and cost-effectiveness within Databricks environments
  • Collaborate with cross-functional teams, including data engineers, data scientists, analysts, and product managers, to understand data requirements and deliver solutions
  • Define best practices and standards for data engineering/data warehouse processes and ensure adherence to them
  • Evaluate and implement new technologies and tools to improve the efficiency and effectiveness of data pipelines
  • Provide technical leadership and mentorship to junior members of the data engineering team
  • Work closely with DevOps and infrastructure teams to deploy and manage data systems in production environments
  • Ensure that all data solutions comply with organizational policies, industry standards, and regulatory requirements
  • Collaborate with enterprise architects and IT leadership to ensure alignment of data architecture with overall IT architecture and strategies

Requirements For Data Architect (Databricks)

Python
Kubernetes
  • Extensive experience with Databricks, including ETL processes and data migration
  • Experience with additional cloud platforms like AWS, Azure, or GCP
  • Knowledge of big data technologies and frameworks
  • Strong knowledge of data warehousing concepts, data modeling, and SQL
  • Experience with RDBMS systems and transitioning data to modern cloud platforms
  • Proficiency in programming languages such as Python, SQL, and scripting languages
  • Knowledge of data governance frameworks, data quality management practices, and data security principles
  • Proficiency in database technologies, including relational databases e.g., SQL Server
  • In-depth knowledge of data modeling, database design
  • Familiarity with containerization technologies such as Docker and orchestration tools like Kubernetes
  • Excellent problem-solving and analytical skills
  • Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams
  • Bachelor or Master Degree in Computer Science or related field

Benefits For Data Architect (Databricks)

Medical Insurance
Vision Insurance
Dental Insurance
Education Budget
  • Employment contract and/or Business to Business - whichever you prefer
  • Possibility to work remotely
  • Speaking English on daily basis, mainly in contact with foreign stakeholders and peers
  • Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance)
  • Access to 3.000+ Business Courses Platform (Udemy)
  • Access to required IT equipment
  • Paid Referral Program
  • Participation in charity events e.g. Szlachetna Paczka
  • Ongoing learning opportunities to help you acquire new skills or deepen existing expertise
  • Being part of the core squad focused on the growth of the Polish business unit
  • A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients
  • A work culture focused on innovation and creating lasting value for our clients and employees

Interested in this job?