AI Engineer - Scraping

Quorum is shaping the future of AI-Powered public affairs. As we expand our efforts to harness AI in scraping, parsing, and structuring legislative, regulatory, and government data across federal, all 50 states, and local levels, we’re seeking an AI Engineer with a builder’s mindset and a drive to make an impact. In this role, you’ll help design and scale a cutting-edge pipeline that uses large language models (LLMs) to transform complex, unstructured government data into clean, actionable insights.

As an AI Engineer, you’ll play a pivotal role in architecting and scaling GenAI systems that drive our AI-powered scraping infrastructure and its surrounding ecosystem. You will lead the design and implementation of a comprehensive data ingestion pipeline that spans federal, state, and local levels—leveraging LLMs (e.g., GPT-4) to extract structured information from legislative bills, regulatory documents, and procedural histories across diverse government websites.

This is a hands-on engineering role where you will own the end-to-end AI workflow— from web scraping and data preprocessing to prompt engineering, evaluation, and QA integration. Success in this role requires deep experience with AI-first development practices, LLM APIs, and the practical challenges of ensuring high-quality structured data at scale.

What You’ll Do

• Design, implement, and maintain a distributed scraping framework to ingest legislation and regulatory data across  federal, all states, and local levels.
• Build and optimize LLM-powered pipelines to extract structured data (titles, sponsors, dates, history, status, etc.) from raw legislative content.
• Develop robust prompt engineering patterns and schema-driven output formats to achieve 95%+ accuracy.
• Build and maintain a schema drift monitoring framework, including weekly sampling and validation of outputs.
• Set up automatic validation, confidence scoring (e.g., via Confident.ai), and routing of low-confidence records to manual review pipelines.
• Make high-impact architectural decisions that balance performance, cost, scalability, and maintainability.
• Stay current with emerging frameworks and tools, and champion pragmatic adoption where appropriate.
• Influence best practices around AI-first development and clean service-oriented architecture.
• Debug and optimize AI-powered features to improve accuracy, latency, and user experience.

You Should Have

• 5+ years of engineering experience, including at least 1+ years shipping AI/LLM-based products in production.
• Strong experience with Python (3.7+) and data validation libraries (Pydantic, jsonschema).
• Proven ability to develop scalable ETL pipelines and web scrapers (Scrapy, Playwright, Selenium).
• Proven ability to lead complex technical initiatives and influence product direction.
• Experience with vector databases and semantic search systems (OpenSearch, Qdrant, etc).
• Strong understanding of embedding models, LLM-based systems, and RAG architectures.
• Familiarity with tools like LangChain, LlamaIndex, or Bedrock.
• Experience defining and iterating on LLM evaluation metrics, evaluation sets, production feedback loops, optimizing for precision, recall, and real-world accuracy.
• Excellent collaboration skills—you can work closely with product managers, UX designers, and cross-functional engineers.
• Strong written and verbal communication; able to influence through documentation and discussion.
• Experience in an AI-First engineering environment with tools like Github Copilot, Augment, or Cursor.

Nice to Have

• Experience with Django or similar Python web frameworks.
• Frontend experience (TypeScript/React) with AI-first interfaces.
• Domain familiarity in civic tech, legal tech, or policy-driven environments.

Why You’ll Love Working at Quorum

• Work on one of the most ambitious and impactful GenAI initiatives in civic tech.
• Lead the charge on greenfield systems and technical innovation—not just maintenance.
• Join a tight-knit, fast-moving, mission-driven engineering team.
• Generous benefits, flexible time off, and a deep culture of learning, collaboration, and support.

Our Work Environment

We are a remote-first team with flexible work options: work remotely, or you may choose to come into our office in Belo Horizonte.

Do you want to learn what it's like to have a real impact at a fast-growing company that is changing the way the advocacy process works? If so, drop us a line. We'd love to talk to you!

Benefits

• Flexible Paid Time Off
• Standard Brazil holidays plus additional company-wide days off for team members to rest and recharge
• Free Subscription to the Calm App
• Free Subscription to LinkedIn Learning to support professional development
• Invest in Yourself Days - one designated day per quarter is dedicated to your professional development!
• Monthly Work from Home Stipend
• Mental and Dental Care by SulAmérica
• Virtual and in-person team events
• Mental Health stipend
• Alelo Food Voucher
• In company English classes 
• Inclusion & Diversity Affinity Groups to support belonging
• 12 weeks of paid parental leave

This is a CLT opportunity

Quorum Is Working to Advance Pay Equity: What Does That Mean For You?

In an effort to continue to build a diverse and inclusive work environment that advances pay equity, Quorum has implemented a “No Negotiation” policy for base salary for new hires for roles that are currently staffed by three or more team members. This means that candidates for the Fullstack Software Engineer II role cannot negotiate Quorum’s base salary offer.

Here’s our promise to you:

• We will not ask you what you are currently earning.
• We will consider years of relevant experience, relevant professional certifications/education, and performance expectations in setting what we believe is a competitive, fair base salary offer.
• We will be transparent about our compensation structure (see above) so that all candidates have equal access to compensation information and can make an informed decision about whether or not Quorum is the right workplace for them.

If you are interested in learning more about how negotiation impacts pay equity and/or why other start-ups have decided to implement a “No Negotiation” policy of some type, here are a few resources: Project Include, AAUW, Ministry for Women, Magoosh.

Note: Quorum does not endorse or verify any of the information provided in the resources on the impact of negotiation on pay equity. We provide these resources simply to increase awareness of a topic we believe is important for both employers and candidates to consider.  

We comply with all requirements for US government federal contractors issued by the OFCCP, IFR, and the terms of our government contracts.

EEO/AA/F/M/Vet/Disabled

Vaga Inclusiva para PCD.
Você é uma pessoa que busca uma empresa inclusiva e comprometida com a diversidade? Então essa oportunidade pode ser para você!
Se candidate anexando o seu currículo e laudo médico, se possível.

Inclusive Opportunity for PWD.
Are you a person looking for an inclusive company committed to diversity? Then this opportunity could be for you!
Apply by attaching your CV.