HPC/AI Infrastructure Architect

Posted 2 Days Ago
Be an Early Applicant
9 Locations
In-Office
Senior level
Information Technology • Business Intelligence • Consulting
The Role
Lead the design and architecture of AI infrastructure solutions, support customer engagements, and conduct technical discussions. Develop lab infrastructure and manage proof-of-concept projects.
Summary Generated by Built In

Make an impact with NTT DATA
Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.

Your day at NTT DATA

We are seeking a highly skilled and visionary HPC/AI Infrastructure Architect – Pre-Sales Specialist to lead the technical design and architecture of large-scale AI infrastructure solutions. This role is pivotal in shaping next-generation AI Factories, supporting customer engagements, and driving technical excellence across compute, interconnect, and software stack domains. 

 

Key Responsibilities 

1. AI Factory Architecture & Design (35%) 

  • Design GPU cluster architectures tailored for AI and HPC workloads. 
  • Define node configurations for diverse workload types including dense GPU nodes, cost-optimized nodes, and high-memory CPU nodes. 
  • Specify and validate performance metrics including compute throughput, memory bandwidth, and power consumption. 
  • Architect multi-tier interconnect networks using NVLink, InfiniBand, and high-speed Ethernet. 
  • Develop topology designs and calculate bandwidth and latency targets. 
  • Model performance for customer workloads and validate against industry benchmarks. 

2. Pre-Sales Technical Leadership (30%) 

  • Lead technical discussions with customer architects and stakeholders. 
  • Conduct workload sizing and architectural presentations. 
  • Develop technical content for proposals including BoMs, compliance matrices, and scoring alignment. 
  • Analyze competitor solutions and articulate technical differentiators. 

3. Demonstrator Lab Development (20%) 

  • Design and expand lab infrastructure for AI workload testing and validation. 
  • Build reference architectures across industries such as finance, manufacturing, healthcare, and research. 
  • Support lab operations including cluster configuration, workload orchestration, and software stack maintenance. 

4. Customer Demonstrations & PoCs (10%) 

  • Deploy and showcase customer-specific AI workloads including LLM training, computer vision, and scientific simulations. 
  • Manage proof-of-concept projects, define success criteria, and present outcomes to stakeholders. 

5. Technical Expertise & Innovation (5%) 

  • Maintain relationships with key technology vendors and participate in early access programs. 
  • Evaluate emerging technologies and contribute to innovation roadmaps and adoption strategies. 

 

Required Skills & Experience 

Technical Competencies 

  • GPU Architectures: NVIDIA (H100, H200, B100, B200), AMD (MI300X), Intel (Gaudi2/3) 
  • Interconnects: InfiniBand (HDR/NDR/XDR), NVLink, RoCE, Infinity Fabric 
  • Storage Systems: Lustre, GPFS, BeeGFS, NVMe-oF, S3-compatible object storage 
  • Container Platforms: Kubernetes, Docker, Singularity/Apptainer 
  • Performance Tools: NVIDIA Nsight, ROCm, Intel VTune 

Certifications (Preferred) 

  • NVIDIA Deep Learning Institute (DLI) 
  • Red Hat Certified Specialist in OpenShift 
  • InfiniBand Certified Professional 

Experience 

  • 8+ years in HPC/AI infrastructure design 
  • 5+ years working with GPU-accelerated systems 
  • Proven experience with large-scale GPU deployments (1000+ GPUs) 
  • Successful track record in technical bid support and customer engagement 

 

What We Offer 

  • Opportunity to work on cutting-edge AI infrastructure projects 
  • Collaborative and innovative work environment 
  • Access to advanced lab infrastructure and vendor technologies 
  • Career development through technical leadership and innovation 

 

Workplace type:

Remote Working

About NTT DATA
NTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure, and connectivity. We are also one of the leading providers of digital and AI infrastructure in the world. NTT DATA is part of NTT Group and headquartered in Tokyo.

Equal Opportunity Employer
NTT DATA is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, colour, gender, sexual orientation, religion, nationality, disability, pregnancy, marital status, veteran status, or any other protected category. Join our growing global team and accelerate your career with us. Apply today.

Third parties fraudulently posing as NTT DATA recruiters 

NTT DATA recruiters will never ask job seekers or candidates for payment or banking information during the recruitment process, for any reason. Please remain vigilant of third parties who may attempt to impersonate NTT DATA recruiters—whether in writing or by phone—in order to deceptively obtain personal data or money from you. All email communications from an NTT DATA recruiter will come from an @nttdata.com email address. If you suspect any fraudulent activity, please contact us.

Top Skills

Amd
Beegfs
Docker
Gpfs
Gpu Architectures: Nvidia
Intel Vtune
Intel; Interconnects: Infiniband
Nvlink
Nvme-Of; Container Platforms: Kubernetes
Roce; Storage Systems: Lustre
Rocm
Singularity/Apptainer; Performance Tools: Nvidia Nsight
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Brisbane
55,092 Employees

What We Do

NTT DATA, Inc. is a trusted global innovator of business and technology services. We're committed to helping clients innovate, optimize and transform for long-term success. Our R&D investments help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure, and connectivity

Similar Jobs

Rapid7 Logo Rapid7

Cybersecurity Advisor II

Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Hybrid
Prague, CZE

Kraft Heinz Logo Kraft Heinz

Sales Analyst Intern

Big Data • Cloud • Food • Machine Learning • Software • Database • Analytics
Hybrid
Prague, CZE

Kraft Heinz Logo Kraft Heinz

Sales Analyst Intern

Big Data • Cloud • Food • Machine Learning • Software • Database • Analytics
Hybrid
Prague, CZE

Mondelēz International Logo Mondelēz International

Manager Data Science

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Hybrid
4 Locations

Similar Companies Hiring

Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account