Web Scraping Data Engineer

Posted 5 Days Ago
New York, NY
In-Office
125K-200K Annually
Mid level
Fintech • Payments • Financial Services
The Role
Seeking a Data Engineer to develop web scraping capabilities for a hedge fund. Responsibilities include request management, data pipeline creation, monitoring, and quality checks, along with collaboration with various internal teams.
Summary Generated by Built In

Verition Fund Management LLC (“Verition”) is a multi-strategy, multi-manager hedge fund founded in 2008.  Verition focuses on global investment strategies including Global Credit, Global Convertible, Volatility & Capital Structure Arbitrage, Event-Driven Investing, Equity Long/Short & Capital Markets Trading, and Global Quantitative Trading.

We are seeking a Data Engineer with experience utilizing Web Scraping technologies, frameworks and libraries in addition to traditional data engineering practices. This role is new to the team, and we need an engineer who has experience building scrapes and interacting with Portfolio Managers on the buy side to augment our data team. Our Data team operates a cloud platform for structured data, market data, security master, streaming data, alternative data that may be acquired from APIs, files, websites, internal databases etc. We want to enable a new service, Web Scraping, for our internal clients. Experience and knowledge of modern techniques for scraping, supporting large data sets, historical data, data monitoring, data validation, support, operations, request management, interaction with clients such as Technology, Operations and Portfolio managers will be required. This role will be an opportunity for an aspiring data engineer to help establish a new process, learn and grow into a more senior data engineering role as the person shows a positive track record with our new scraping capability.

Responsibilities:

  • Utilize AI Models, Code, Libraries or applications to enable a scalable Web Scraping capability
  • Web Scraping Request Management including intake, assessment, accessing sites to scrape, utilizing tools to scrape, storage of scrape, validation and entitlement to users
  • Fielding Questions from users about the scrapes and websites
  • Coordinating with Compliance on approvals and TOU reviews
  • Some Experience building Data pipelines in AWS platform utilizing existing tools like Cron, Glue, Eventbridge, Python based ETL, AWS Redshift
  • Normalizing/standardizing vendor data, firm data for firm consumption
  • Implement data quality checks to ensure reliability and accuracy of scraped data
  • Coordinate with Internal teams on delivery, access, requests, support
  • Promote Data Engineering best practices

 

Required Skills and Qualifications:

  • Bachelor’s degree in computer science, Engineering, Mathematics or related field
  • 2-5 experience in a similar role
  • Prior buy side experience is strongly preferred (Multi-Strat/Hedge Funds)
  • Capital markets experience is necessary with good working knowledge of reference data across asset classes and experience with trading systems
  • AWS cloud experience with commons services (S3, lambda, cron, Event Bridge etc.)
  • Experience with web-scraping frameworks (Scrapy, BeautifulSoup, Selenium, Playwright etc.)
  • Strong hands-on skills with NoSQL and SQL databases, programming in Python, data pipeline orchestration tools and analytics tools
  • Familiarity with time series data and common market data sources (Bloomberg, Refinitiv etc.) is a plus
  • Familiarity with modern Dev Ops practices and infrastructure-as-code tools (e.g. Terraform, CloudFormation)
  • Strong communication skills to work with stakeholders across technology, investment, and operations teams.
  • Ability to work independently or as a part of a team in a fast-paced environment with tight deadlines.
Salary Range
$125,000$200,000 USD

Top Skills

AWS
Beautifulsoup
CloudFormation
NoSQL
Playwright
Python
Scrapy
Selenium
SQL
Terraform
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
638 Employees
Year Founded: 2008

What We Do

Verition Fund Management LLC (“Verition”) is a multi-strategy, multi-manager hedge fund founded in 2008. Verition focuses on global investment strategies including Credit, Fixed Income & Macro, Convertible & Volatility Arbitrage, Event-Driven, Equity Long/Short & Capital Markets, and Quantitative Strategies.

Talent is the lifeline of Verition's success. Our culture encourages individuals to communicate openly across all strategies and businesses, and we believe there is alpha in integration. We strive to empower our Investment Professionals to act like business owners by making decisions based on a combination of rigorous analysis and an open, creative mindset. We have locations in Greenwich, CT, Norwalk, CT, New York, NY, London, UK, Singapore, Republic of Singapore, DIFC, Dubai (United Arab Emirates) and an affiliate office in Hong Kong (SAR), China. Verition has an institutional quality infrastructure with a team of over 500 investment/risk and non-investment professionals.

Verition is always seeking ambitious and entrepreneurial individuals that can be impactful and help to drive differentiated returns.

To learn more, please contact us for information at: [email protected]

Similar Jobs

BAE Systems, Inc. Logo BAE Systems, Inc.

Design Engineer

Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Hybrid
Endicott, NY, USA
40000 Employees
119K-201K Annually

BAE Systems, Inc. Logo BAE Systems, Inc.

Technical Support

Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Hybrid
Buffalo, NY, USA
40000 Employees
95K-162K Annually

Schrödinger, Inc. Logo Schrödinger, Inc.

Vice President, Strategic Finance and FP&A

Artificial Intelligence • Big Data • Healthtech • Machine Learning • Software • Biotech • Pharmaceutical
Hybrid
New York, NY, USA
937 Employees
250K-365K Annually

EliseAI Logo EliseAI

Marketing Manager

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Real Estate
In-Office
New York City, NY, USA
320 Employees
150K-190K Annually

Similar Companies Hiring

Camber Thumbnail
Social Impact • Healthtech • Fintech
New York, NY
53 Employees
Rain Thumbnail
Web3 • Payments • Infrastructure as a Service (IaaS) • Fintech • Financial Services • Cryptocurrency • Blockchain
New York, NY
40 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account