Senior Data Engineer

Global Atlantic Financial Group is a leading insurance company meeting the retirement and life insurance needs of individuals and institutions. It is a wholly-owned subsidiary of KKR, a leading global investment firm.
$102,000 - $194,500
Data
Senior Software Engineer
Hybrid
1,000 - 5,000 Employees
8+ years of experience
AI · Finance
This job posting may no longer be active. You may be interested in these related jobs instead:
Data Engineer, Healthcare

Remote Data Engineer position at Cascala Health, building healthcare data pipelines and infrastructure with $140-160K salary range, requiring 4+ years experience.

Sr. Software Engineer, Big Data

Senior Software Engineer position at Pinterest focusing on Big Data infrastructure, data warehousing, and analytics systems at petabyte scale.

Lead Apache Hadoop Engineer

Lead Apache Hadoop Engineer position at Deutsche Bank, focusing on big data infrastructure and Hadoop ecosystem development.

Epic BI Developer Sr- Cogito, Caboodle, Clarity

Senior Epic BI Developer position focusing on Cogito, Caboodle, and Clarity systems at Advocate Aurora Health.

Senior Power BI/Data Visualization Developer

Senior Power BI/Data Visualization Developer position at Hillenbrand, focusing on creating and maintaining data visualizations and business intelligence solutions.

Description For Senior Data Engineer

The Senior Data Engineer will expand and optimize the data and data pipeline architecture, as well as optimize data flow and collection for cross functional teams. The role involves performing data architecture analysis, design, development, and testing to deliver data applications, services, interfaces, ETL processes, reporting, and other workflow and management initiatives.

Key responsibilities include:

  • Designing and developing enterprise data architecture solutions using AWS Glue, Lambda, and other data technologies like Spark, Scala, Java, Python, SQL, etc.
  • Designing and developing machine learning algorithms and AI models for business requirements
  • Creating and maintaining optimal data pipeline architecture
  • Partnering with business leaders to determine and prioritize delivery initiatives
  • Ensuring appropriate change management and technology methodologies are carried out consistently

The ideal candidate should have:

  • 8 to 10 years of overall IT experience with 3 years of relevant experience in designing and developing end-to-end enterprise-wide big data solutions and Machine Learning Algorithms
  • Strong analytical and leadership skills
  • Experience with AWS Glue, Lambda, Spark, Scala, and strong SQL skills (preferably Redshift)
  • Master's in data science preferred, bachelor's degree in computer science or related field required

This role offers a competitive salary range of $102,000 - $194,500 USD, along with comprehensive benefits including health insurance, 401(k) with immediate vesting on employee contributions, and potential for annual cash bonuses and long-term incentives.

Global Atlantic is committed to creating an inclusive environment and values diversity in its workforce. The company offers a hybrid work model with 3-4 days per week in the office for most locations.

Last updated 7 months ago

Responsibilities For Senior Data Engineer

  • Design and develop enterprise data / data architecture solutions using AWS Glue, Lambda and other data technologies like Spark, Scala, Java, Python, SQL etc.
  • Design and develop machine learning algorithms and AI models for business requirements
  • Study and transform data science prototypes and apply appropriate machine learning algorithms and tools
  • Run machine learning tests and experiments, and document findings and results
  • Train, retrain, and monitor machine learning systems and models as needed
  • Assemble large, complex data sets that meet functional / non-functional business requirements
  • Create and maintain optimal data pipeline architecture
  • Devise and execute continual improvement initiatives in all Data Management Service delivery and technology
  • Partner with business leaders to determine and prioritize delivery initiatives
  • Define or influence system, technical and application architectures for major areas of development
  • Devise and execute in software development life cycle including requirements gathering, development, testing, release management, and maintenance
  • Engage with business partners to report on technology strengths, weaknesses, successes, and challenges
  • Ensure appropriate change management and other technology methodologies are carried out consistently

Requirements For Senior Data Engineer

Java
Python
Scala
  • At least 8 to 10 years of overall IT experience and 3 years' relevant experience in design and development of enterprise-wide big data solutions and Machine Learning Algorithms
  • Master's in data science preferred, bachelor's degree in computer science or related field required
  • Experience in designing and developing big data solutions using Spark, Scala, AWS Glue etc.
  • Strong Analytical and Leadership skills
  • Strong ML experience
  • AWS Glue and Lambda experience is must
  • Application development experience in Scala/Python
  • Strong Database SQL experience preferably Redshift
  • Highly organized and analytic, capable of solving business problems using technology

Benefits For Senior Data Engineer

401k
Medical Insurance
Dental Insurance
Vision Insurance
Education Budget
  • Comprehensive health, retirement, life and disability plans
  • 401(k) with immediate vesting on employee contributions
  • Company match on 401(k) contributions
  • Annual cash bonuses
  • Long-term incentives (equity)
  • Education budget
  • Flexible work arrangements

Interested in this job?