Senior Engineer - Data Ingestion

Posted 8 Days Ago
Be an Early Applicant
Chicago, IL, USA
In-Office
200K-250K Annually
Senior level
Financial Services
The Role
Build and operate large-scale data ingestion pipelines powering research and trading platforms. Own pipeline quality, reliability, performance, and data health; collaborate with traders, quantitative researchers, and data owners; optimize compute, storage, and SLAs; migrate pipelines to modern platforms; and implement tools to detect and resolve source-data quality issues.
Summary Generated by Built In

Chicago Trading Company (CTC) is a premier proprietary trading firm specializing in options market making.  Our collaborative culture fuels innovation in quantitative research, systematic trading strategies, and cutting-edge trading technology.  For over three decades CTC has provided critical liquidity across derivatives exchanges worldwide - making them fairer, more transparent, and more efficient.

We strive to be the most innovative firm in the industry today, tomorrow, and long into the future while upholding ethical excellence. We believe that CTC makes a positive impact on the markets, the lives of our employees, and all the communities to which we belong. Started in 1995 by a team of forward-thinking Traders, we are proud to call ourselves an industry leader that keeps making markets and each other better.

As an engineer for the Data Ingest team, you will build and maintain the core, top-level data assets that power our research platforms. These are used by every desk at CTC, from junior traders to executives. Because of this broad user base, the product’s surface area is extensive. By ensuring high quality data in a timely fashion, you help support data-driven decision-making on daily basis.

WHAT YOU'LL DO

  • Own the quality, reliability, and overall health of our source data pipelines.
  • Work closely with Traders and Quantitative Researchers to understand their needs, and how they use our final data products.
  • Act as the data-delivery expert for your stakeholders, and design the most reliable and efficient way to source the data they need.
  • Optimize existing pipelines to improve SLA for users and lower the compute and storage footprint across the firm.
  • Migrate existing pipelines onto modern data platforms and hardware, and improve the process for future migrations.
  • Collaborate with the broader data organization to improve our overall platform offering and functionality.
  • Detect source data quality issues that lead to incorrect downstream metrics, and partner with data owners to build tools that surface and resolve these issues before users see them.

WHAT WE'RE LOOKING FOR

  • Hands-on experience building and operating large-scale data pipelines, ideally in the hundreds of terabytes to petabytes range.
  • Strong software architecture and large-scale system design skills.
  • Strong proficiency in SQL and in object-oriented languages such as Python.
  • Hands-on experience with at least one major cloud provider (AWS, Azure, GCP) and/or HPC workloads.
  • Strong interpersonal skills and the ability to work in a team environment.

NICE TO HAVE

  • Experience with tick capture, market data, or trading industry data (options, equities, futures).
  • C++.
  • Experience with data observability and data quality tooling, including diagnosing source data problems.
  • Experience with open table formats such as Iceberg or Delta, and with query engines such as Trino, Spark, or DuckDB.

Compensation

The salary range for this role is listed below. This role is also eligible for an annual discretionary bonus. The discretionary bonus will be dependent upon the individual’s skills, experience, qualifications, and firm performance. 

Salary Range
$200,000$250,000 USD

Most teams at CTC, with the exception of Trading, follow a hybrid workplace model, subject to change based on business need.

Our Benefits 

We strongly believe in the well-being of our employees and their families so we offer outstanding benefits to support you both professionally and personally. These benefits include generous time off, insurance coverage, paid parental leave, free breakfast and lunch (plus healthy snacks, of course), wellness reimbursement, and a variety of other benefits focused on providing the best employee experience. 

(Disclaimer: interns and contractors are not eligible for benefits at CTC) 

Our Commitment to Diversity, Equity and Inclusion

At CTC, we aim to cultivate a workplace that celebrates diversity and each person feels included, engaged and empowered. Where each of us feels we belong. We are committed to having a diverse workforce and are proud to be an equal opportunity employer. CTC does not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment. 

If you have a disability and believe you need a reasonable accommodation in order to search for a job opening or to apply for a position, please contact us at [email protected]. Note that emails sent to this email account for non-disability related issues, such as following up on an application, will not receive a response.

Use of Artificial Intelligence (AI)

Information submitted by job applicants may be subject to review and analysis by automated systems, including Artificial Intelligence (AI), as part of the recruitment process. Such systems are utilized to enhance the efficiency and effectiveness of our hiring procedures. Applicants are advised that any information provided may be evaluated by AI tools to ensure an equitable and thorough assessment.

Skills Required

  • Hands-on experience building and operating large-scale data pipelines, ideally at hundreds of terabytes to petabytes scale
  • Strong software architecture and large-scale system design skills
  • Strong proficiency in SQL
  • Strong proficiency in object-oriented languages such as Python
  • Hands-on experience with at least one major cloud provider such as AWS, Azure, or GCP, and/or HPC workloads
  • Strong interpersonal skills and ability to work in a team environment
  • Experience with tick capture, market data, or trading industry data
  • C++ experience
  • Experience with data observability and data quality tooling, including diagnosing source data problems
  • Experience with open table formats such as Iceberg or Delta
  • Experience with query engines such as Trino, Spark, or DuckDB
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Chicago, IL
783 Employees
Year Founded: 1995

What We Do

Chicago Trading Company (CTC) is a highly analytical, team oriented derivatives trading firm that employs a dynamic, disciplined approach to trading across a variety of products and strategies. We take decisive action to position ourselves at the forefront of the financial markets. We actively trade in a broad spectrum of asset classes that include Equities, Interest Rates, and Commodities. We have grown dramatically since our inception in 1995. Recognized as a leading provider of liquidity and pricing on numerous derivatives exchanges globally, we trade more than 20 hours a day, six days a week. With offices in Chicago and London, our success and rapid growth are due to our market experience, state of the art technology, risk management capabilities, and financial engineering expertise.

Similar Jobs

Coupa Logo Coupa

Director, FP&A - 11697

Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
In-Office or Remote
Chicago, IL, USA
3000 Employees
152K-213K Annually

PwC Logo PwC

Artificial Intelligence Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
8 Locations
370000 Employees
99K-232K Annually

PwC Logo PwC

Bank Platform Transformation - Core Banking Modernization - Sr Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
11 Locations
370000 Employees
124K-280K Annually

PwC Logo PwC

Tax - Japanese Business Network - Associate - Summer/Fall 2027

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
4 Locations
370000 Employees
54K-142K Annually

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account