Software Developer (Content Integration & Data Pipelines)

Posted 3 Days Ago
Be an Early Applicant
Ottawa, ON, CAN
In-Office
75K-110K Annually
Mid level
Software • Database
The Role
Build and scale production-grade web scraping, content integration, and data pipelines using TypeScript, Java, Kafka, and Solr. Develop event-driven services, REST APIs, parsing and normalization logic, and integrations with content providers and external feeds. Improve pipeline reliability, observability, performance, and data quality while contributing to architecture and technical direction. The role also includes mentoring junior developers and supporting high-volume media content processing.
Summary Generated by Built In

Company Overview

Agility PR Solutions provides today’s communicators with powerful and intuitive AI powered media outreach, monitoring, and measurement solutions. For almost twenty years, Agility has helped clients from across industries and continents discover relevant journalists and influencers, make meaningful connections with the media, amplify their stories, monitor media coverage and social conversations, and report on the impact of their public relations activities. Agility is one of the fastest growing companies in the PR tech space and it’s recognized by users on G2 for ease of use, quick implementation, and outstanding customer service.  

We are a remote-first company, with colleagues based across vibrant cities in Canada, US, the UK, Philippines and India. We are intentional in helping our teams realize their full potential, and continue to invest in their learning and development, career progression, offering competitive pay and benefits, enabling leadership and work environment. 

About the Role

As a Software Developer (Content Integration & Data Pipelines), you will design, build, and scale the production-grade pipelines that collect, process, and deliver online news and web content across our platform. You will play a key role in shaping how content flows from thousands of sources into our search and analytics systems — powering the monitoring, insights, and AI-driven features PR professionals rely on every day. 

This role goes beyond implementation. You will contribute to system design, architecture decisions, and data strategy, helping define how content is acquired, normalized, enriched, and indexed at scale using event-driven design.


You’ll work across both:

  • Content acquisition and integration (TypeScript, web scraping and crawling, source integrations)  
  • Backend and pipeline systems (Java, event-driven architecture with Kafka, search indexing with Solr) 


Agility PR Solutions is building next-generation media intelligence capabilities powered by AI. Your work will directly influence how customers extract insights, automate workflows, and make decisions from large-scale media data

What you’ll do

  • Build and maintain scalable web scrapers and crawlers that follow web scraping standards and best practices (robots.txt, rate limiting, polite crawling)  
  • Develop content integration and parsing logic using TypeScript  
  • Design and build event-driven services using Kafka to process, enrich, and route content in near real time  
  • Integrate with third-party content providers, feeds (RSS/Atom), and external APIs  
  • Design and implement RESTful services (Java) to support content processing and delivery  
  • Define and enforce best practices for: 
    • Scraping compliance and source management  
    • Pipeline reliability, error handling, and data quality  
    • Observability and monitoring of content pipelines  
  • Optimize performance, cost, and reliability of pipeline workloads
  • Contribute to architectural decisions and technical direction 
  • Mentor junior developers and contribute to team knowledge sharing

What You'll Bring

  • Degree in Computer Science or related field (or equivalent experience) 
  • 3+ years of software development experience 
  • Proficiency in TypeScript / JavaScript 
  • Solid experience building backend services (Java or similar) 
  • Hands-on experience with web scraping and crawling in production environments, including adherence to web scraping standards (robots.txt, rate limiting, terms of use)  

You should have practical experience with:

  • Event-driven architecture and message streaming (e.g., Kafka)  
  • HTML parsing, content extraction, and normalization techniques  
  • Designing high-volume, fault-tolerant data pipelines

Experience with:

  • SQL and data modeling 
  • Linux environments 
  • Git, and modern development workflows 
  • Kafka
  • Maven
  • Knowledge of Solr (indexing, schema design, query tuning) is an asset

Strongly preferred:

  • Experience building content ingestion pipelines for news or media data  
  • Understanding of system design and scalability tradeoffs 
  • Ability to work independently and take ownership of projects  
  • Strong problem-solving and system design thinking  
  • Effective communication across technical and non-technical stakeholders  
  • Passion for data, automation, and emerging technologies, including AI

Why You'll Love It Here

  • Fully remote work environment  
  • Collaborative culture – and key tools enabling it  
  • Competitive compensation package  
  • Health, Dental & Vision benefits  
  • RRSP matching  
  • Life Insurance
  • Employee Assistance Program (EAP)  
  • Career Development & Progression opportunities   
  • Paid Vacation, Personal Days and Sick days  
  • Week off between Christmas and New Years'  
  • No Internal Meetings Fridays  


Compensation for this role is expected to fall within the range of $75,000 - 110,000 annually. The final offer will reflect each candidate’s experience, skills, and internal equity.
This is for a vacant position.


AI Usage

We use technology to make hiring smarter, faster, and more personal, never less human. Artificial intelligence (AI) tools help us manage applications efficiently and highlight qualifications that align with each role, allowing our recruiters to focus more on meaningful conversations with candidates. AI does not make hiring decisions at Agility. Every decision is made by people, our hiring managers and recruitment professionals, who are trained to apply sound judgment and equitable practices at every stage. We believe technology exists to amplify human insight, not replace it. That belief shapes how we build relationships, tell stories, and grow our teams.

At Agility, we strive every day to build a more inclusive work environment and introduce tools that enable it. We strongly encourage applications from all people regardless of race, religion, gender, age, disability status or sexual orientation.

Even if you find yourself not checking all the boxes of our listed requirements but you are excited about this opportunity, we'd love to hear from you anyway. Our Talent Acquisition team will review your application for this role, and other potential role matches open now or in the future.

If, at any stage of the application process, you require accommodation owing to disability or a medical need, please let us know at [email protected] for us to make appropriate arrangements.



At Agility, we strive every day to build a more inclusive work environment and introduce tools that enable it. We strongly encourage applications from all people regardless of race, religion, gender, age, disability status or sexual orientation.

Even if you find yourself not checking all the boxes of our listed requirements but you are excited about this opportunity, we'd love to hear from you anyway. Our Talent Acquisition team will review your application for this role, and other potential role matches open now or in the future.

If, at any stage of the application process, you require accommodation owing to disability or a medical need, please let us know at [email protected] for us to make appropriate arrangements.

Thank you for your time in reviewing this opportunity, and we hope to hear from you should you find this the right fit!


Skills Required

  • Degree in Computer Science or a related field, or equivalent experience
  • 3+ years of software development experience
  • Proficiency in TypeScript and JavaScript
  • Experience building backend services using Java or a similar language
  • Production experience with web scraping and crawling
  • Knowledge of web scraping standards, including robots.txt, rate limiting, and terms of use
  • Experience with event-driven architecture and message streaming, such as Kafka
  • Experience with HTML parsing, content extraction, and normalization
  • Experience designing high-volume, fault-tolerant data pipelines
  • Experience with SQL and data modeling
  • Experience working in Linux environments
  • Experience with Git and modern development workflows
  • Experience with Kafka
  • Experience with Maven
  • Knowledge of Solr, including indexing, schema design, and query tuning
  • Experience building content ingestion pipelines for news or media data
  • Understanding of system design and scalability tradeoffs
  • Ability to work independently and take ownership of projects
  • Strong problem-solving and system design skills
  • Effective communication with technical and non-technical stakeholders
  • Interest in data, automation, emerging technologies, and AI
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Ottawa, ON
207 Employees
Year Founded: 2003

What We Do

Agility PR Solutions provides powerful, yet easy to use media database, monitoring, and analytics solutions for tomorrow’s communicators. Since 2003, clients have trusted our tools and services to help them identify and connect with influencers, capture coverage, and measure impact of everything they do. Whether we do it for you or help you do it yourself, our team of media experts make it easy to monitor and measure traditional, broadcast, social and online coverage.

Similar Jobs

In-Office
Ottawa, ON, CAN
207 Employees
65K-75K Annually

Samsara Logo Samsara

Customer Success Manager

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
Canada
4000 Employees
110K-142K Annually

Ericsson Logo Ericsson

SW Developer

Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
In-Office
Ottawa, ON, CAN
88000 Employees
85K-111K Annually

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Temporary Sales Associate

eCommerce • Fashion • Retail • Sales • Wearables • Design
Hybrid
Mississauga, ON, CAN
16000 Employees
18-22 Hourly

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account