Sr ML Engineer - Remote

Posted Yesterday
Be an Early Applicant
Hiring Remotely in North Macedonia
Remote
Senior level
Information Technology • Professional Services • Consulting
The Role
Lead the productionization, deployment, optimization, and lifecycle management of machine learning systems. Build training and retraining pipelines, high-performance inference services, monitoring, CI/CD workflows, model versioning, and safe rollout strategies. Optimize latency, throughput, reliability, and costs using techniques such as quantization, batching, ONNX, and TensorRT. Partner with DevOps and SRE teams on observability, incident readiness, scalability, and continuous model improvement.
Summary Generated by Built In

We are looking for a senior-level AI/ML professional to lead the productionization, deployment, and continuous optimization of ML systems in mission-critical environments. This role requires strong technical leadership, deep hands-on experience shipping models to production, and the ability to drive reliability, scalability, and cost/performance trade-offs end-to-end. The ideal candidate combines strong ML depth with MLOps and production engineering excellence, and can operate autonomously while influencing architecture and best practices across teams.

Key Qualifications

● Master’s, PhD, or equivalent experience in Computer Science, Engineering, Data Science (or related), with strong foundations in mathematics, statistics, and ML.

● 6+ years (or equivalent) experience across ML engineering and MLOps /production ML, with a proven track record delivering high-impact systems in production.

● Demonstrated expertise deploying models to production: scalable serving patterns, model packaging, inference optimization, observability, and safe rollout strategies.

● Strong experience with model performance and efficiency optimization: latency/throughput tuning, batching, quantization, ONNX/TensorRT, GPU/CPU optimization, memory and cost tuning. 

● Strong proficiency in Python.

● Hands-on experience with ML frameworks such as PyTorch, scikit-learn, and optimization/runtime stacks like ONNX, TensorRT.

● Strong grasp of CI/CD for ML (e.g., GitLab CI), containerization (Docker), and reproducible workflows.

● Experience with monitoring and reliability: metrics/logging/tracing, model/data drift, alerting, SLOs, incident response practices.

● Kubernetes, AWS, FastAPI (and/or similar Python serving frameworks), SageMaker, service meshes, feature stores, model registries.

Key Responsibilities

● Handle the production lifecycle of ML systems: training, packaging, deployment, monitoring and controlled rollouts.

● Design, build, and continuously improve training and retraining pipelines (data ingestion, labeling/QA loops, feature generation, experiment tracking,

reproducibility).

● Build and improve high-performance inference services and deployment patterns.

● Drive inference optimization (ONNX/TensorRT, quantization, batching, GPU/CPU tuning) with measurable latency/cost improvements.

● Partner with DevOps/SRE to ensure operational excellence: scaling, reliability, incident readiness, observability, and alerting.

● Own model versioning, CI/CD, and release workflows ensuring reproducibility and safe delivery to production.

● Strengthen data & model monitoring (performance, drift, quality) and implement feedback loops for continuous improvement.

● Communicate results and trade-offs to stakeholders, turning technical outcomes into business value.

● Ensure model quality through rigorous evaluation and production-grade validation aligned with evolving data and business needs.

Skills Required

  • Master's, PhD, or equivalent experience in Computer Science, Engineering, Data Science, or a related field
  • Strong foundations in mathematics, statistics, and machine learning
  • 6+ years or equivalent experience in ML engineering and MLOps or production ML
  • Proven track record delivering high-impact machine learning systems in production
  • Expertise deploying models to production, including scalable serving, model packaging, inference optimization, observability, and safe rollouts
  • Experience optimizing model performance and efficiency, including latency, throughput, batching, quantization, ONNX, TensorRT, GPU/CPU, memory, and cost tuning
  • Strong proficiency in Python
  • Hands-on experience with PyTorch and scikit-learn
  • Experience with ONNX and TensorRT optimization or runtime stacks
  • Experience with ML CI/CD, including GitLab CI, containerization, and reproducible workflows
  • Experience with monitoring and reliability practices, including metrics, logging, tracing, model/data drift, alerting, SLOs, and incident response
  • Experience with Kubernetes, AWS, FastAPI or similar Python serving frameworks, SageMaker, service meshes, feature stores, and model registries
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
3 Employees
Year Founded: 2020

What We Do

ITtude is a Skopje-based recruiting and outsourcing company specializing in IT talent and HR solutions. It helps government systems, startups, and other organizations build high-performing technology teams through staff leasing, outsourcing, recruitment process outsourcing, niche hiring, and technical recruiting. The company emphasizes rapidly delivering vetted professionals, improving talent capabilities and organizational agility, and reducing recruitment overhead while supporting clients’ technology projects.

Similar Jobs

Tolt, Inc. Logo Tolt, Inc.

Full-stack Engineer

Marketing Tech • Payments • Software
Remote or Hybrid
2 Locations
4K-6K Annually

Tolt, Inc. Logo Tolt, Inc.

Full-stack Engineer

Marketing Tech • Payments • Software
Remote or Hybrid
2 Locations
48K-72K Annually
Remote
North Macedonia
81 Employees

SupportYourApp Logo SupportYourApp

Technical Support

Professional Services
In-Office or Remote
3 Locations

Similar Companies Hiring

NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Cravath, Swaine & Moore LLP Thumbnail
Legal Tech • Other • Professional Services
New York, NY
1200 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account