Software Engineer - Backend/Distributed Systems

Reposted Yesterday
9 Locations
In-Office
Senior level
Artificial Intelligence • Software • Energy • Renewable Energy
The Role
The Software Engineer will build scalable backend services, optimize performance, and mentor peers, focusing on distributed systems development.
Summary Generated by Built In
About Emerald AI

We’re at a pivotal moment for AI and energy. Demand for compute is skyrocketing, but power constraints are becoming a critical bottleneck. Emerald AI sits at the intersection of these two worlds, enabling AI data centers to scale without overwhelming the grid.

Our Emerald Conductor software platform makes data centers flexible and responsive, allowing them to adjust power usage dynamically. This unlocks massive AI growth without major new infrastructure, while also strengthening the grid and supporting the expansion of renewable energy.

We’re a team of experts across AI, cloud, software, and energy—on a mission to scale AI sustainably. We’re backed by leading investors and partners including Radical Ventures and NVIDIA.

Learn more about our vision, team, and backers at https://www.emeraldai.co/.

About the Role

We’re hiring a Distributed Systems / Backend Engineer to serve as a key contributor on the core backend platform powering Emerald AI. This is a high-impact role: you will drive architectural decisions, introduce best practices, build foundational infrastructure, and help guide the evolution of our real-time energy intelligence engine.

You’ll work across ingestion, compute, storage, and system orchestration—designing components that must be highly reliable, resilient, and capable of operating at scale. As one of the early engineering hires, you’ll have a major influence on our stack, roadmap, and long-term technical direction.

We’re looking for talent ranging from mid-level to highly seasoned senior contributors with expertise in backend systems.

Key Responsibilities
  • Build scalable and reliable services, and APIs, used by both internal teams and enterprise customers.

  • Continuously optimize performance across GPU clusters, cloud infrastructure, and backend systems.

  • Implement observability, reliability, and security best practices

  • Proactively identify technical debt, performance bottlenecks, and strategic opportunities for architectural improvements

  • Collaborate closely with engineers, product managers, and energy domain experts to translate system constraints into scalable solutions.

  • Guide other engineers through technical design reviews, mentorship, and high-quality code standards.

Minimum requirements
  • 5+ years of software engineering experience with a focus on backend or distributed systems development.

  • Extensive experience designing, building, and maintaining microservices architectures and distributed systems at scale

  • Advanced system design capabilities with demonstrated expertise in performance optimization, horizontal scaling, and high-availability patterns

  • Solid understanding of system performance, profiling, and optimization.

  • Experience with object-oriented programming languages such as but not limited to: Python, Go, or Java

Preferred requirements
  • Experience with AI/ML frameworks or libraries (e.g., TensorFlow, PyTorch) and familiarity with MLOps tools or workflows for deploying machine learning models into production.

  • Understanding of cluster resource management and scheduling systems (e.g., experience with Slurm or similar job schedulers) and principles of efficient resource provisioning for compute-intensive workloads.

What We Offer
  • Make an impact. Solve the AI power bottleneck and shape how data centers scale sustainably.

  • Join a world-class team of AI, cloud, software, and energy experts in a collaborative, low-ego environment.

  • Build from 0→1. Influence strategy, GTM, org design, and customer/investor engagement from day one.

  • Competitive pay + equity. Stock options let you share in the value you help create.

  • Comprehensive benefits, including medical, dental, vision, and 401(k) matching.

  • Flexible location. Work from D.C., Boston, or the Bay Area, with 1 WFH day/week.
    Backed by top investors, including Radical Ventures and NVIDIA.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation.

Emerald AI strives to respect the dignity and ‎independence of people with disabilities and is committed to giving them the same ‎‎opportunity to succeed as all other employees.

Inclusiveness is core to our culture at Emerald AI, and we strive to ensure you get the most from your interview experience. Emerald AI makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.

Top Skills

Ai/Ml Frameworks
Go
Java
Python
PyTorch
TensorFlow
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
26 Employees
Year Founded: 2024

What We Do

Emerald AI transforms energy-intensive data centers into AI-powered grid allies. The Emerald AI Conductor platform enables AI data centers to flexibly adjust their power consumption from the electricity grid on demand, orchestrating the computing loads of inference, training, and fine-tuning AI models across a network of data centers to bolster the power grid’s reliability while meeting strict compute performance standards.

Flexibility could unlock up to 100 GW, or more than a decade of U.S. AI data center growth and trillions in AI investment, without enormous investments in electric grids or power plants—advancing innovation and competitiveness, ensuring power affordability for communities across the country, and bolstering the reliability of the electric power system.

Similar Jobs

McCain Foods Logo McCain Foods

Analyst, Sales Ops & Planning

Food • Retail • Agriculture • Manufacturing
In-Office
Toronto, ON, CAN
20000 Employees
59K-79K Annually

CrowdStrike Logo CrowdStrike

Software Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
ON, CAN
10000 Employees
115K-165K Annually

TransUnion Logo TransUnion

Sr. Advisor, Project Management - Portfolio Management

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Burlington, ON, CAN
13000 Employees
131K-201K Annually

TransUnion Logo TransUnion

Client Experience Specialist (13-month Maternity Leave Contract)

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Burlington, ON, CAN
13000 Employees
81K-122K Annually

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account