Senior Data Engineer

Quorum develops Generative AI technology for government affairs data analysis, helping professionals navigate political data and policy advocacy.
Data
Senior Software Engineer
Remote
101 - 500 Employees
5+ years of experience
AI · Enterprise SaaS

Description For Senior Data Engineer

Quorum is at the forefront of revolutionizing government affairs through its innovative Generative AI technology. As a Senior Data Engineer on the Quorum Copilot project, you'll be instrumental in building and scaling the data infrastructure that powers our AI analysis tool. The role involves working with vast datasets including 120,000 bills from state legislatures, 100,000+ social media posts, and extensive Capitol Hill testimony.

The position offers a unique opportunity to work with cutting-edge technologies in a remote-first environment, focusing on advanced Retrieval-Augmented Generation (RAG) systems and large-scale data processing. You'll be part of a 100+ member team that values quality, security, and collaborative development.

The ideal candidate brings strong technical expertise in data engineering, cloud services, and machine learning technologies, with at least 5 years of experience. You'll need proficiency in Python, SQL, and big data tools, along with a deep understanding of AWS services.

What makes this role exceptional is the chance to directly impact public affairs and policy advocacy through technology. You'll be working on solutions that help professionals navigate complex political landscapes more effectively. The company offers comprehensive benefits including healthcare, professional development opportunities, and flexible work arrangements.

Quorum stands out for its commitment to pay equity, implementing a "No Negotiation" policy for base salaries. The company culture emphasizes continuous learning, team collaboration, and work-life balance, making it an ideal environment for professionals who want to make a meaningful impact while growing their careers.

Last updated a month ago

Responsibilities For Senior Data Engineer

  • Architect and implement highly scalable RAG data pipelines for legislative bills, social media posts, and content analysis
  • Design real-time processing pipelines for vast datasets
  • Design and implement data cleansing and transformation pipelines
  • Lead cloud-based AWS deployments
  • Innovate on data architecture to support Quorum Copilot
  • Drive build vs buy decisions and solution trade-off analysis

Requirements For Senior Data Engineer

Python
Kafka
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field
  • 5+ years in data engineering
  • Expertise in AWS cloud services (EC2, EMR, RDS, Redshift)
  • Proficient in big data tools (Hadoop, Spark, Kafka) and ML frameworks
  • 3+ years experience with Python
  • Deep knowledge of SQL and NoSQL databases
  • Experience with vector databases and RAG systems preferred
  • Strong problem-solving skills and willingness to learn

Benefits For Senior Data Engineer

Dental Insurance
Medical Insurance
Mental Health Assistance
Parental Leave
Education Budget
  • Standard Brazil Holidays
  • Monthly Work from Home Stipend
  • Mental and Dental Care by SulAmérica
  • Monthly Professional Development/Mental Health stipend
  • Alelo Food Voucher
  • Incompany English classes
  • Free Subscription to the Calm app
  • Flexible Paid Time Off
  • Inclusion & Diversity Affinity Groups
  • 12 weeks of paid parental leave

Interested in this job?

Jobs Related To Quorum Senior Data Engineer

Senior Data Scientist, YouTube Premium

Senior Data Scientist position at YouTube Premium focusing on analytics, modeling, and data-driven product strategy, offering competitive compensation and benefits.

Senior Data Scientist, Research, Ads Metrics

Senior Data Scientist position at Google focusing on ads metrics research, offering competitive salary and opportunity to shape advertising products through data-driven decisions.

Senior Data Scientist, Research

Senior Data Scientist position at Google, working on product analytics and development using Python and SQL, with 5+ years of experience required.

Senior Data Scientist, Search (Real World Journeys)

Senior Data Scientist position at Google, focusing on Search analytics and Real World Journeys, requiring expertise in data analysis, programming, and fluency in English and Portuguese.

Customer Engineer, Data Analytics, Google Cloud

Senior Data Engineer role at Google Cloud focusing on data analytics and customer engineering, offering competitive compensation and benefits.