Senior Data Engineer

Quorum develops Generative AI technology for government affairs data analysis, helping professionals navigate political data and policy advocacy.
Data
Senior Software Engineer
Remote
101 - 500 Employees
5+ years of experience
AI · Enterprise SaaS

Description For Senior Data Engineer

Quorum is at the forefront of revolutionizing government affairs through its innovative Generative AI technology. As a Senior Data Engineer on the Quorum Copilot project, you'll be instrumental in building and scaling the data infrastructure that powers our AI analysis tool. The role involves working with vast datasets including 120,000 bills from state legislatures, 100,000+ social media posts, and extensive Capitol Hill testimony.

The position offers a unique opportunity to work with cutting-edge technologies in a remote-first environment, focusing on advanced Retrieval-Augmented Generation (RAG) systems and large-scale data processing. You'll be part of a 100+ member team that values quality, security, and collaborative development.

The ideal candidate brings strong technical expertise in data engineering, cloud services, and machine learning technologies, with at least 5 years of experience. You'll need proficiency in Python, SQL, and big data tools, along with a deep understanding of AWS services.

What makes this role exceptional is the chance to directly impact public affairs and policy advocacy through technology. You'll be working on solutions that help professionals navigate complex political landscapes more effectively. The company offers comprehensive benefits including healthcare, professional development opportunities, and flexible work arrangements.

Quorum stands out for its commitment to pay equity, implementing a "No Negotiation" policy for base salaries. The company culture emphasizes continuous learning, team collaboration, and work-life balance, making it an ideal environment for professionals who want to make a meaningful impact while growing their careers.

Last updated 15 minutes ago

Responsibilities For Senior Data Engineer

  • Architect and implement highly scalable RAG data pipelines for legislative bills, social media posts, and content analysis
  • Design real-time processing pipelines for vast datasets
  • Design and implement data cleansing and transformation pipelines
  • Lead cloud-based AWS deployments
  • Innovate on data architecture to support Quorum Copilot
  • Drive build vs buy decisions and solution trade-off analysis

Requirements For Senior Data Engineer

Python
Kafka
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field
  • 5+ years in data engineering
  • Expertise in AWS cloud services (EC2, EMR, RDS, Redshift)
  • Proficient in big data tools (Hadoop, Spark, Kafka) and ML frameworks
  • 3+ years experience with Python
  • Deep knowledge of SQL and NoSQL databases
  • Experience with vector databases and RAG systems preferred
  • Strong problem-solving skills and willingness to learn

Benefits For Senior Data Engineer

Dental Insurance
Medical Insurance
Mental Health Assistance
Parental Leave
Education Budget
  • Standard Brazil Holidays
  • Monthly Work from Home Stipend
  • Mental and Dental Care by SulAmérica
  • Monthly Professional Development/Mental Health stipend
  • Alelo Food Voucher
  • Incompany English classes
  • Free Subscription to the Calm app
  • Flexible Paid Time Off
  • Inclusion & Diversity Affinity Groups
  • 12 weeks of paid parental leave

Interested in this job?

Jobs Related To Quorum Senior Data Engineer

Senior Data Engineer

Senior Data Engineer position at Airbnb, building and maintaining data pipelines for marketing technology platform, offering remote work and competitive compensation.

AWS Data Engineer - Fully Remote - US Only

Senior AWS Data Engineer position at Scalepex, building scalable data solutions for utility systems using AWS services, requiring 5+ years of experience.

Data Engineer II

Senior Data Engineer position at Microsoft focusing on cloud data infrastructure, requiring 8+ years of experience in data engineering and big data technologies.

Analytics Engineer (L5) - Content and Studio

Senior Analytics Engineer role at Netflix focusing on content and studio analytics, requiring 4+ years of experience in data analysis and engineering.

Senior Data Engineer - Data Science

Senior Data Engineer position at LinkedIn focusing on building and managing data systems for the Data Science team, offering competitive pay and hybrid work environment.