Senior Engineering Manager, AI

Posted Yesterday
Be an Early Applicant
Hiring Remotely in New York, NY, USA
Remote or Hybrid
361K-497K Annually
Senior level
Artificial Intelligence • Fintech • Machine Learning • Natural Language Processing • Business Intelligence
AlphaSense empower professionals to make smarter business decisions with confidence and speed.
The Role
Lead and grow an AI Platform engineering team (up to 10 senior/staff engineers) to design, operate, and scale a high-throughput enterprise AI Gateway. Own architecture, low-latency routing, caching, queueing, vendor orchestration across 6+ LLM providers and 50+ models, ensure availability and cost telemetry, and align roadmap with product, research, and executive stakeholders.
Summary Generated by Built In
About AlphaSense: 

The world’s most sophisticated companies rely on AlphaSense to remove uncertainty from decision-making. With market intelligence and search built on proven AI, AlphaSense delivers insights that matter from content you can trust. Our universe of public and private content includes equity research, company filings, event transcripts, expert calls, news, trade journals, and clients’ own research content.

The acquisition of Tegus by AlphaSense in 2024 advances our shared mission to empower professionals to make smarter decisions through AI-driven market intelligence. Together, AlphaSense and Tegus will accelerate growth, innovation, and content expansion, with complementary product and content capabilities that enable users to unearth even more comprehensive insights from thousands of content sets. Our platform is trusted by over 6,000 enterprise customers, including a majority of the S&P 500. Founded in 2011, AlphaSense is headquartered in New York City with more than 2,000 employees across the globe and offices in the U.S., U.K., Finland, India, Singapore, Canada, and Ireland. Come join us!

About the Role: 

To support our growth, we are searching for a Senior Engineering Manager to lead the AI Platform team. This group builds and operates our core AI Gateway, serving as the critical high-throughput highway for all Large Language Model (LLM) traffic across the entire AlphaSense ecosystem. The right leader will bring deep experience running high-performance teams, a strong background in distributed system architecture, and hands-on familiarity with multi-vendor integrations. Superior communication and strategic collaboration skills are critical for managing expectations and aligning stakeholders across the entire R&D organization.

Who You Are:
  • Proven Engineering Leadership: Strong track record of managing and growing high-performing teams of senior and staff engineers, with a passion for developing technical leaders and aligning engineering objectives with business strategy.
  • Enterprise Scale Experience: Seasoned background in designing, building, and operating high-throughput, low-latency distributed systems (specifically handling complex routing, caching, queueing, or rate limiting).
  • Technical Thought Leadership: Ability to deeply engage in high-level architectural discussions, provide constructive technical direction, and deliver high-impact feedback during architectural reviews.
  • Strategic Communication: Exceptional communication and partnership skills to align diverse engineering, product, and executive partners across the R&D organization.
  • Modern Tooling & AI-First Mindset: Active embrace of AI tools in developer workflows, with an expectation for the team to leverage AI in their toolchains to maximize engineering velocity.
  • Relevant Tech Stack Experience (Nice to Have): Experience in the applied AI space or working with frameworks and tools such as LangChain, LangGraph, LiteLLM, or OpenRouter.
  • Experience with orchestrators and proxies like Temporal, Envoy, or similar enterprise-grade gateway technologies.
  • Experience with Python, Java, and highly distributed caching/queueing systems.

What You’ll Do: 

  • Strategic Team Leadership: Manage, mentor, and grow a highly talented team of up to 10 senior and staff software engineers (mostly distributed across North America).
  • Foster a high-performance culture of technical excellence, predictable delivery, and career growth.
  • High-Scale Operations & Scaling: Own the strategy and architecture of our enterprise AI Gateway - currently processing up to 1 Trillion LLM tokens per week with a projected 10x growth surge driven by agentic workflows (such as SuperAnalyst) - while ensuring high availability, sub-millisecond routing, caching, queueing, and robust fallback mechanisms.
  • Multi-Vendor Orchestration: Strategically guide the integration, evaluation, and management of 6+ major LLM vendors and 50+ distinct models, optimizing for latency, cost, and reliability across different providers.
  • Cross-Functional Alignment: Partner closely with product management, AI research teams, and executive engineering leads to align the gateway's roadmap with core product features and organizational goals.
  • Technical Governance: Define and champion software engineering best practices, architectural standards, and token-based cost-tracking telemetry across the AI Platform organization.

For base compensation, we set standard ranges for all roles based on function and level benchmarked against similar stage growth companies and internal comparables. In order to be compliant with local legislation, as well as to provide greater transparency to candidates, we share salary ranges on all job postings regardless of desired hiring location. Final offer amounts are determined by multiple factors including candidate experience/expertise and may vary from the amounts listed below. 

You may also be offered equity, and a generous benefits program.

Compensation Range
$361,200$496,800 USD

AlphaSense is an equal-opportunity employer. We are committed to a work environment that supports, inspires, and respects all individuals. All employees share in the responsibility for fulfilling AlphaSense’s commitment to equal employment opportunity. AlphaSense does not discriminate against any employee or applicant on the basis of race, color, sex (including pregnancy), national origin, age, religion, marital status, sexual orientation, gender identity, gender expression, military or veteran status, disability, or any other non-merit factor. This policy applies to every aspect of employment at AlphaSense, including recruitment, hiring, training, advancement, and termination.

In addition, it is the policy of AlphaSense to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations, and ordinances where a particular employee works.

Recruiting Scams and Fraud

We at AlphaSense have been made aware of fraudulent job postings and individuals impersonating AlphaSense recruiters. These scams may involve fake job offers, requests for sensitive personal information, or demands for payment. Please note:

  • AlphaSense never asks candidates to pay for job applications, equipment, or training.
  • All official communications will come from an @alpha-sense.com email address.
  • If you’re unsure about a job posting or recruiter, verify it on our Careers page.

If you believe you’ve been targeted by a scam or have any doubts regarding the authenticity of any job listing purportedly from or on behalf of AlphaSense please contact us. Your security and trust matter to us.

Skills Required

  • Proven engineering leadership managing and growing senior and staff engineers
  • Experience designing, building, and operating high-throughput, low-latency distributed systems (routing, caching, queueing, rate limiting)
  • Hands-on familiarity with multi-vendor LLM integrations and orchestration across model providers
  • Experience with Python
  • Experience with Java
  • Experience with highly distributed caching and queueing systems
  • Strong strategic communication and cross-functional collaboration skills
  • Active embrace of AI tooling in developer workflows and AI-first mindset
  • Experience with orchestrators and proxies like Temporal or Envoy
  • Experience with applied AI frameworks and tools such as LangChain, LangGraph, LiteLLM, or OpenRouter
  • Proven ability to define engineering best practices, architectural standards, and telemetry/cost-tracking
  • Experience operating services at enterprise scale (handling extremely high token throughput)

AlphaSense Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about AlphaSense and has not been reviewed or approved by AlphaSense.

  • Inclusive Benefits Coverage Healthcare offerings include gender-affirming care and unlimited fertility coverage in addition to comprehensive medical options. Mental-health resources and an assistance program are also emphasized.
  • Leave & Time Off Breadth PTO is presented as generous or unlimited in the U.S., with volunteer days and notable parental leave for primary caregivers. These policies indicate flexible time-away support.
  • Strong & Reliable Incentives On-target earnings for several sales functions are positioned as competitive, offering meaningful upside when targets are met.

AlphaSense Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
2,000 Employees
Year Founded: 2011

What We Do

AlphaSense is the AI platform redefining market intelligence and workflow orchestration, trusted by thousands of leading organizations to drive faster, more confident decisions in business and finance. The platform combines domain specific AI with a vast content universe of over 500 million premium business documents — including equity research, earnings calls, expert interviews, filings, news, and internal proprietary content. Purpose-built for speed, accuracy, and enterprise-grade security, AlphaSense helps teams extract critical insights, uncover market-moving trends, and automate complex workflows with high quality outputs. With AI solutions like Generative Search, Generative Grid, and Deep Research, AlphaSense delivers the clarity and depth professionals need to navigate complexity and obtain accurate, real-time information quickly. Headquartered in New York City, AlphaSense employs over 2,000 people across offices in the U.S., U.K., Finland, India, Canada, and Ireland. For more information, please visit www.alpha-sense.com.

Why Work With Us

AlphaSense is shaping how companies make decisions. We're product-driven and customer obsessed in our mission to take decision makers from complexity to clarity. Our culture balances ambition with humility, autonomy with teamwork. With mentorship and real ownership, you’ll have everything you need to keep evolving, personally and professionally.

Gallery

Gallery

Similar Jobs

Deepgram Logo Deepgram

Technical Program Manager

Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Remote
USA
150 Employees
152K-190K Annually
Remote or Hybrid
USA
350 Employees
177K-226K Annually

Jerry Logo Jerry

Technical Product Manager

Artificial Intelligence • Automotive • Machine Learning • Financial Services
In-Office or Remote
10 Locations
296 Employees
160K-210K Annually

Jerry Logo Jerry

Technical Product Manager

Artificial Intelligence • Automotive • Insurance • Software
In-Office or Remote
10 Locations
371 Employees
160K-210K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account