Web Scraping Data Engineer

Verition Fund Management LLC (“Verition”) is a multi-strategy, multi-manager hedge fund founded in 2008.  Verition focuses on global investment strategies including Global Credit, Global Convertible, Volatility & Capital Structure Arbitrage, Event-Driven Investing, Equity Long/Short & Capital Markets Trading, and Global Quantitative Trading.

We are seeking a Data Engineer with experience utilizing Web Scraping technologies, frameworks and libraries in addition to traditional data engineering practices. This role is new to the team, and we need an engineer who has experience building scrapes and interacting with Portfolio Managers on the buy side to augment our data team. Our Data team operates a cloud platform for structured data, market data, security master, streaming data, alternative data that may be acquired from APIs, files, websites, internal databases etc. We want to enable a new service, Web Scraping, for our internal clients. Experience and knowledge of modern techniques for scraping, supporting large data sets, historical data, data monitoring, data validation, support, operations, request management, interaction with clients such as Technology, Operations and Portfolio managers will be required. This role will be an opportunity for an aspiring data engineer to help establish a new process, learn and grow into a more senior data engineering role as the person shows a positive track record with our new scraping capability.

Responsibilities:

• Utilize AI Models, Code, Libraries or applications to enable a scalable Web Scraping capability
• Web Scraping Request Management including intake, assessment, accessing sites to scrape, utilizing tools to scrape, storage of scrape, validation and entitlement to users
• Fielding Questions from users about the scrapes and websites
• Coordinating with Compliance on approvals and TOU reviews
• Some Experience building Data pipelines in AWS platform utilizing existing tools like Cron, Glue, Eventbridge, Python based ETL, AWS Redshift
• Normalizing/standardizing vendor data, firm data for firm consumption
• Implement data quality checks to ensure reliability and accuracy of scraped data
• Coordinate with Internal teams on delivery, access, requests, support
• Promote Data Engineering best practices

Required Skills and Qualifications:

• Bachelor’s degree in computer science, Engineering, Mathematics or related field
• 2-5 experience in a similar role
• Prior buy side experience is strongly preferred (Multi-Strat/Hedge Funds)
• Capital markets experience is necessary with good working knowledge of reference data across asset classes and experience with trading systems
• AWS cloud experience with commons services (S3, lambda, cron, Event Bridge etc.)
• Experience with web-scraping frameworks (Scrapy, BeautifulSoup, Selenium, Playwright etc.)
• Strong hands-on skills with NoSQL and SQL databases, programming in Python, data pipeline orchestration tools and analytics tools
• Familiarity with time series data and common market data sources (Bloomberg, Refinitiv etc.) is a plus
• Familiarity with modern Dev Ops practices and infrastructure-as-code tools (e.g. Terraform, CloudFormation)

• Strong communication skills to work with stakeholders across technology, investment, and operations teams.
• Ability to work independently or as a part of a team in a fast-paced environment with tight deadlines.