Senior Data Engineer

Posted 4 Days Ago
Easy Apply
Be an Early Applicant
Belfast, County Antrim, Northern Ireland, GBR
In-Office
Senior level
On-Demand • Security • Software
The Role
Design and build data pipelines, implement data ingestion patterns, optimize pipeline performance, support ML use cases, and collaborate on data solutions.
Summary Generated by Built In

Black Duck Software, Inc. helps organizations build secure, high-quality software, minimizing risks while maximizing speed and productivity. Black Duck, a recognized pioneer in application security, provides SAST, SCA, and DAST solutions that enable teams to quickly find and fix vulnerabilities and defects in proprietary code, open source components, and application behavior. With a combination of industry-leading tools, services, and expertise, only Black Duck helps organizations maximize security and quality in DevSecOps and throughout the software development life cycle.

What you’ll do 

  • Design and build data pipelines and datasets supporting one or more product areas within an established, governed data platform.
  • Implement ingestion patterns for batch, streaming, and event data, onboarding new data sources using existing frameworks and standards.
  • Build and maintain reliable data pipelines with appropriate data quality checks, basic lineage, monitoring, and alerting.
  • Develop curated datasets and views that are secure, discoverable, and ready for analytics, reporting, and downstream consumption.
  • Contribute to customerfacing data products such as datasets, metrics, exports, or feeds, ensuring accuracy and clear documentation.
  • Implement data models for both operational databases and analytics stores, following agreed modelling conventions and best practices.
  • Support ML and analytics use cases by producing trusted training datasets and featureready outputs with consistent definitions.
  • Optimize pipeline performance, cost, and reliability within defined architectural patterns.
  • Collaborate with product managers, engineers, analysts, and security partners to deliver data solutions aligned to roadmap needs.
  • Participate in oncall rotations and operational support for data services owned by the team.
  • Contribute to technical discussions, code reviews, and continuous improvement of data engineering practices. 

Required 

  • Solid experience building and operating production data pipelines and datasets in a cloud environment.
  • Strong SQL skills and working Python experience for building data pipelines, transformations, and automation.
  • Handson experience with cloud platforms (AWS or Google Cloud), including core services such as compute, storage, IAM, and networking.
  • Experience working with both operational databases (e.g., RDSstyle systems) and analytics or columnar data stores. 

Black Duck considers all applicants for employment without regard to race, color, religion, sex, gender preference, national origin, age, disability, or status as a Covered Veteran in accordance with federal law. In addition, Black Duck complies with applicable state and local laws prohibiting discrimination in employment in every jurisdiction in which it maintains facilities. Black Duck also provides reasonable accommodation to individuals with a disability in accordance with applicable laws.

Top Skills

AWS
GCP
Python
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Burlington, MA
275 Employees
Year Founded: 2002

What We Do

Organizations worldwide use Black Duck Software’s industry-leading products to secure and manage open source software, eliminating the pain related to security vulnerabilities, compliance and operational risk. Black Duck is headquartered in Burlington, MA, and has offices in San Jose, London, Frankfurt, Hong Kong, Tokyo, Vancouver, Seoul & Beijing

Why Work With Us

We pride ourselves on cultivating an environment of collaboration, creativity, and fun! We know where you work can influence how you work, which is why our collaborative office space focuses on community and continuous learning. Our work-hard, play-hard attitude even got us named a Top Place to Work in Massachusetts by The Boston Globe!

Gallery

Gallery

Similar Jobs

In-Office or Remote
2 Locations
21 Employees

MoonPay Logo MoonPay

Platform Engineer

Blockchain • Fintech • Payments • Cryptocurrency • Web3
Remote or Hybrid
2 Locations
244 Employees
200K-250K Annually

Nebius Logo Nebius

Senior Software Engineer

Artificial Intelligence • Information Technology • Consulting
In-Office or Remote
5 Locations
473 Employees

ConsenSys Logo ConsenSys

Senior Data Engineer

Blockchain • Software • Web3
In-Office or Remote
39 Locations
900 Employees
156K-187K Annually

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Hardware • Other • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account