Senior Software Engineer, AI Platform

Posted 3 Days Ago
Be an Early Applicant
Austin, TX, USA
In-Office
141K-194K Annually
Senior level
Cloud • Software
We are powering progress for our customers in the construction industry by connecting them on a global platform.
The Role
Leads infrastructure for production AI agents across GCP and AWS. Responsibilities include managing Kubernetes clusters, LLM workloads, vector databases, stateful backends, CI/CD pipelines, observability, capacity planning, automated rollbacks, and cost optimization. The role partners with application engineers, data scientists, and platform teams to deliver resilient, secure, and scalable AI infrastructure.
Summary Generated by Built In

Procore Technologies is the leading technology partner for every stage of construction. We empower construction teams to drive efficiency and mitigate risk through actionable AI & data-driven insights. For over 20 years, we have been transforming the industry with purpose-built solutions for construction professionals and we’re looking for talented people to help us build together.


We are looking for a Senior AI Infrastructure Engineer to ensure the platform infrastructure powering our AI agents remains high-performing, resilient, and cost-efficient as customer adoption scales. As the Senior AI Infrastructure Engineer on our AI Infrastructure team, you will work closely with application engineers, data scientists, and platform teams to build multi-cloud deployment pipelines, scale vector databases, and optimize our multi-provider LLM gateway. Your strengths in multi-cloud infrastructure (GCP/AWS), Kubernetes orchestration, and AI/LLM production operations will drive your success.


You will report to the VP of Engineering and will be a 2 days per week hybrid role based in our Austin, TX office.


What You’ll Do

  • Operate, scale, and maintain production workloads across Google Cloud and AWS to provide a resilient, unified multi-cloud foundation for Procore's AI agent portfolio.
  • Manage production AI model workloads across Vertex AI, Amazon Bedrock, and Anthropic, implementing explicit provider fallback, regional availability routing, and GPU-backed self-hosted model serving on Kubernetes.
  • Optimize Kubernetes (GKE and EKS) clusters through precision resource requests, limits, and dynamic autoscaling to ensure compute fleets scale efficiently with real-time customer demand.
  • Proactively plan capacity and right-size stateful backends, queues, BigQuery storage, and vector databases using empirical workload patterns and growth forecasts to keep production ahead of customer usage.
  • Lead the lifecycle management, staging rollouts, upgrades, and automated rollback strategies for production databases and search infrastructure to eliminate downtime and mitigate operational risk.
  • Establish comprehensive service-level objectives (SLOs), automated alerting, distributed agent tracing, and Datadog monitoring that reflect true user experience and eliminate operational noise.
  • Build secure, modern CI/CD pipelines, reproducible staging environments, and developer tooling to accelerate software delivery and empower application engineers building on the AI platform.

What You Bring

  • 5+ years of experience building and operating production infrastructure at scale, with deep hands-on expertise across Google Cloud (GKE, Vertex AI, IAM, VPC networking, BigQuery, Cloud Monitoring).
  • Proven AWS production experience (EKS, Lambda, IAM, RDS/Aurora, SQS/SNS) and infrastructure management using Terraform across multi-cloud environments.
  • Production Kubernetes expertise, including autoscaling, resource tuning, cluster lifecycle management, Helm, and GitOps workflows (Argo CD or equivalent).
  • Practical experience running LLMs in production via provider APIs, including quota management, load balancing, and multi-provider routing (Vertex AI, Bedrock, Anthropic).
  • Demonstrated experience deploying and operating distributed vector databases, search engines, and stateful data stores on Kubernetes.
  • Strong background in observability design, including defining meaningful alert policies, SLOs, Datadog dashboards, and incident response runbooks.
  • Track record of executing measurable performance and cost optimizations across cloud architectures, with the ability to clearly articulate engineering trade-offs.
  • Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.

Strong-fit Background Might Include

  • Senior MLOps Engineer / AI Platform Engineer
  • Senior Cloud Infrastructure Engineer (GCP / AWS)
  • Senior Site Reliability Engineer (Kubernetes & Stateful Distributed Systems)
  • Platform / Developer Experience Engineer (AI/ML Enablement)

Discover our recruiting process and interview tips from our talent acquisition team on our #LifeAtProcore blog.

Additional Information

Base Pay Range:

140,960.00 - 193,820.00 USD Annual

This role may also be eligible for Equity Compensation and/or Bonus Incentive Compensation. Procore is committed to offering competitive, fair, and commensurate compensation. Actual compensation will be based on a candidate’s job-related skills, experience, education or training, and location.

For Los Angeles County (unincorporated) Candidates:

Procore will consider for employment all qualified applicants, including those with arrest or conviction records, in accordance with the requirements of applicable federal, state, and local laws, including the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act.

A criminal history may have a direct, adverse, and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment: 1. appropriately managing, accessing, and handling confidential information including proprietary and trade secret information, as well as accessing Procore's information technology systems and platforms; 2. interacting with and occasionally having unsupervised contact with internal/external customers, stakeholders, and/or colleagues; and 3. exercising sound judgment.

Skills Required

  • 5+ years of experience building and operating production infrastructure at scale
  • Hands-on expertise with Google Cloud, including GKE, Vertex AI, IAM, VPC networking, BigQuery, and Cloud Monitoring
  • Production experience with AWS, including EKS, Lambda, IAM, RDS/Aurora, and SQS/SNS
  • Infrastructure management using Terraform across multi-cloud environments
  • Production Kubernetes expertise, including autoscaling, resource tuning, cluster lifecycle management, and Helm
  • Experience with GitOps workflows using Argo CD or an equivalent tool
  • Experience running LLMs in production through provider APIs, including quota management, load balancing, and multi-provider routing
  • Experience deploying and operating distributed vector databases, search engines, and stateful data stores on Kubernetes
  • Strong background in observability design, SLOs, alert policies, Datadog dashboards, and incident response runbooks
  • Experience delivering measurable performance and cost optimizations across cloud architectures
  • Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience

Procore Technologies Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Procore Technologies and has not been reviewed or approved by Procore Technologies.

  • Healthcare Strength — Health coverage includes an Anthem Blue Cross PPO with broad coverage and low premiums, alongside dental, vision, disability, and life insurance. Mental‑health resources and a wellbeing stipend further support overall care.
  • Leave & Time Off Breadth — A values‑driven, non‑accrual PTO approach, 12 paid holidays, and an annual company‑wide Wellness Week indicate generous time‑off options. Hybrid/remote flexibility is also highlighted in many roles and locations.
  • Parental & Family Support — Fertility benefits (e.g., via Progyny on some plans) and cash support for adoption and surrogacy are available for eligible U.S. employees. Paid parental leave and structured return‑to‑work programs are also described.

Procore Technologies Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Carpinteria, CA
4,500 Employees
Year Founded: 2002

What We Do

At Procore Technologies, we’re collectively building towards what’s next for our employees, industry, customers, and global communities. Our cloud-based construction management software streamlines the entire lifecycle of a construction project, connecting field and office teams, centralizing data to mitigate risks, providing real-time financials, and more to help clients efficiently build everything from skyscrapers to hospitals to airports. Procore was founded in 2002, and we’ve since grown into a global company of groundbreakers working throughout North America, EMEA, and APAC. Coming together from across diverse backgrounds to be our best, we embrace a culture of ownership and excellence that gives our teams the tools to grow and thrive as they shape their careers – and the Procore of tomorrow. To learn more about Procore and how you can build what comes next for your career, visit us at https://careers.procore.com/.

Why Work With Us

We make each other better at Procore. Here, your career is not pre-defined and it can take many paths. While you own your career, we provide you with the support and opportunities to help you succeed. You can help us transform an industry while you are transforming your career.

Gallery

Gallery

Similar Jobs

Arrive Logistics Logo Arrive Logistics

Senior Software Engineer

Logistics • Sales • Software • 3PL: Third Party Logistics
Hybrid
Austin, TX, USA
1700 Employees

Lansweeper Logo Lansweeper

Senior Software Engineer

Cloud • Information Technology • Software • Cybersecurity
Hybrid
Austin, TX, USA
404 Employees

Keeper Security, Inc. Logo Keeper Security, Inc.

Senior Software Engineer

Mobile • Security • Software • Cybersecurity
Remote or Hybrid
US
350 Employees

Century Interactive Company LC Logo Century Interactive Company LC

Senior Software Engineer

Artificial Intelligence • Information Technology • Marketing Tech • Professional Services
In-Office
Overland, TX, USA
96 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account