Sr. Data Engineer

Abacus Insights is a mission-driven, growth-stage technology company focused on transforming the healthcare industry. Founded in 2017, we've built a highly successful SaaS business, raising over $81 Million from leading VC firms. Our innovative data integration and management platform allows healthcare payers to access historically siloed data, supporting their analytical, operational, and financial needs.

We're seeking a Sr. Data Engineer to join our Tech Ops division. In this role, you'll work with customers, data vendors, and internal teams to integrate data into our state-of-the-art platform built on scalable cloud architectures. You'll develop data pipelines, lead architecture implementation, collaborate with cross-functional teams, and ensure data security and compliance with healthcare regulations.

Key responsibilities include:

• Developing data pipelines with Databricks and Snowflake
• Leading architecture and implementation of solutions for health plan clients
• Collaborating with teams to translate requirements into technical solutions
• Implementing data security measures and ensuring HIPAA compliance
• Providing technical leadership and mentoring junior engineers
• Optimizing data processes and creating detailed documentation
• Conducting training for team members and clients

We're looking for candidates with:

• Bachelor's Degree in computer science or related field
• Strong communication skills with technical and non-technical stakeholders
• Proficiency in Python and SQL
• Experience with ETL pipelines using Databricks or similar frameworks
• Familiarity with structured and semi-structured data processing using PySpark
• Knowledge of AWS services (S3, SQS) or similar cloud services
• Experience with Terraform and GitLab CICD
• Query tuning and performance optimization skills
• Familiarity with data warehousing (Snowflake or similar)

Bonus points for healthcare industry experience, US Healthcare knowledge, and experience with DBT and Kafka.

Join our diverse team and contribute to driving better healthcare outcomes through innovative data solutions!