Software Architect, Platform

Reposted 21 Days Ago
Be an Early Applicant
Hiring Remotely in Austin, TX
In-Office or Remote
40K-80K
Expert/Leader
Artificial Intelligence • Cloud • Machine Learning • Software
The Role
Lead the architectural design for a distributed AI stack, focusing on performance, security, and adaptability across various layers and systems.
Summary Generated by Built In

About Us:

webAI is pioneering the future of artificial intelligence by establishing the first distributed AI infrastructure dedicated to personalized AI. We recognize the evolving demands of a data-driven society for scalability and flexibility, and we firmly believe that the future of AI lies in distributed processing at the edge, bringing computation closer to the source of data generation. Our mission is to build a future where a company's valuable data and intellectual property remain entirely private, enabling the deployment of large-scale AI models directly on standard consumer hardware without compromising the information embedded within those models. We are developing an end-to-end platform that is secure, scalable, and fully under the control of our users, empowering enterprises with AI that understands their unique business. We are a team driven by truth, ownership, tenacity, and humility, and we seek individuals who resonate with these core values and are passionate about shaping the next generation of AI.

About the Role:

We are seeking a visionary Platform Architect to lead core architectural decisions across our distributed AI stack — from runtime orchestration, through application interfaces, to mesh-aware networking. This is role lives at the intersection of systems architecture, AI infrastructure, and distributed computing. You will define, validate, and evolve the technical blueprint that powers webAI’s intelligent mesh and ensures it scales with enterprise-grade resilience, security, and performance.

Key Responsibilities:
  • End-to-End Architecture:
    Own the design and evolution of the platform architecture across the runtime, application, and mesh-network layers. Prioritize modularity, composability, and real-world deployability.

  • AI Runtime Design:
    Define and build high-performance runtimes, including task scheduling, memory management, and hardware abstraction for heterogeneous environments (CPU, GPU, NPU). Contribute to or integrate frameworks like ONNX, TensorRT, or custom inference stacks.

  • Networking Layer:
    Architect resilient peer-to-peer communication and mesh networking systems across diverse radios (Wi-Fi, Bluetooth, WebRTC, etc.), including device discovery, data synchronization, and fault tolerance.

  • Security & Observability:
    Embed zero-trust principles, encryption at rest and in transit, signed inference, and platform-level logging, monitoring, and diagnostics by design.

  • Technical Leadership:
    Serve as a technical mentor for engineering teams, validate architectural choices, conduct design reviews, and collaborate with stakeholders to ensure alignment with product vision and performance requirements.

Required Skills & Qualifications:

Experience:

  • 10+ years of relevant experience in systems architecture, distributed computing, or AI infrastructure, with a proven track record designing and scaling production-grade distributed platforms. We require depth of experience and demonstrated impact over tenure.

AI Runtime Design

  • Experience building or contributing to high-performance runtimes (ONNX, TensorRT, custom runtimes).

  • Task scheduling, memory management, hardware abstraction (CPU, GPU, NPU).

Tooling & Stack Preferences

  • Systems programming in Rust, Go, or C++ (must-have: not just Python or web dev).

  • Bonus: experience with federated learning, agent communication, MPC, or privacy-preserving computation.

  • Understanding of real-time, low-latency, and resource-constrained environments.

Networking Layer

  • Cross-radio P2P communication (Wi-Fi, Bluetooth, WebRTC, etc).

  • Device discovery, resilient mesh networking, and data synchronization.

  • Security & Observability

  • Familiarity with zero-trust models, signed inference, encryption at rest & in transit.

  • Build-in logging, monitoring, and platform-level diagnostics.

We at webAI are committed to living out the core values we have put in place as the foundation on which we operate as a team. We seek individuals who exemplify the following:

  • Truth - Emphasizing transparency and honesty in every interaction and decision.

  • Ownership - Taking full responsibility for one’s actions and decisions, demonstrating commitment to the success of our clients.

  • Tenacity - Persisting in the face of challenges and setbacks, continually striving for excellence and improvement.

  • Humility - Maintaining a respectful and learning-oriented mindset, acknowledging the strengths and contributions of others.

Benefits:

  • Competitive salary and performance-based incentives.

  • Comprehensive health, dental, and vision benefits package.

  • 401k Match

  • $200/mos Health and Wellness Stipend

  • $400/year Continuing Education Credit

  • $500/year Function Health subscription (US-based only)

  • Free parking, for in-office employees

  • Unlimited Approved PTO

  • Parental Leave for Eligible Employees

  • Supplemental Life Insurance

webAI is an Equal Opportunity Employer and does not discriminate against any employee or applicant on the basis of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We adhere to these principles in all aspects of employment, including recruitment, hiring, training, compensation, promotion, benefits, social and recreational programs, and discipline. In addition, it is the policy of webAI to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations and ordinances where a particular employee works.

Top Skills

C++
Go
Rust
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Austin, Texas
49 Employees
Year Founded: 2020

What We Do

webAI is designed to streamline the training, deployment, and execution of AI models by offering a unified execution layer for AI that seamlessly integrates cloud-based services and local devices. Our goal is to revolutionize the AI industry by laying the foundation for the development of Super Intelligence (SI).

By approaching AI execution in a heterogeneous manner, we aim to create scalable AI products that are industry leading. Our platform is dedicated to enhancing the performance and accessibility of AI technologies, making them more efficient and user-friendly for both businesses and individuals.

Similar Jobs

NVIDIA Logo NVIDIA

Software Engineer

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office or Remote
2 Locations
21960 Employees
272K-426K

Cox Enterprises Logo Cox Enterprises

Client Relationship Sr Manager

Automotive • Cloud • Greentech • Information Technology • Other • Software • Cybersecurity
Remote or Hybrid
United States
50000 Employees
109K-181K Annually

Cox Enterprises Logo Cox Enterprises

Marketing Specialist II

Automotive • Cloud • Greentech • Information Technology • Other • Software • Cybersecurity
Remote or Hybrid
TX, USA
50000 Employees
60K-89K Annually

Brilliant Earth Logo Brilliant Earth

Human Resources Business Partner

eCommerce • Fashion • Retail
Remote
United States
700 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account