We seek a highly skilled and experienced Lead Machine Learning Engineer with extensive expertise in multimodal generative AI models, cross-modal architectures, and multimodal fusion techniques. The ideal candidate will not only have a strong technical background spanning text, vision, audio, and video modalities, but also the drive to mentor, educate, and advocate for the adoption of new and emerging technologies.
WHAT YOU'LL NEED
- 7+ years experience in machine learning engineering, with at least 2+ years focussed on generative AI or multimodal systems
- Proven experience developing and deploying multimodal generative AI systems with deep understanding of architectures that bridge multiple modalities (text-to-image, image-to-text, text-to-video, audio-visual models, etc.)
- Strong expertise in vision models and architectures including diffusion models, vision transformers, and multimodal embeddings
- Experience with large language models and their integration with visual and audio modalities
- Experience with multimodal retrieval systems and vector databases
- Hands-on experience with generative models across modalities including text generation, image synthesis, video generation, and audio/speech synthesis
- Demonstrated ability to lead and mentor a team of machine learning engineers and data scientists, fostering a culture of innovation and technical excellence
- Excellent communication and presentation skills, with the ability to articulate complex multimodal concepts clearly to both technical and non-technical audiences
- Professional experience developing Python libraries for machine-learning applications. Strong background in PyTorch, HuggingFace Transformers/Diffusers, and specialized libraries (e.g., Stable Diffusion, OpenAI CLIP, timm, torchaudio, torchvision)
- Strong problem-solving skills and the ability to think critically and creatively about novel multimodal applications
NICE TO HAVE
- A track record of published research in reputable journals or conferences (NeurIPS, ICML, CVPR, ICCV, etc.)
- Understanding of prompt engineering and guidance techniques for generative models
- Experience with model fine-tuning, LoRA, and efficient adaptation methods
ABOUT US
Born in 2001, Code and Theory is a digital-first creative agency that sits at the center of creativity and technology. We pride ourselves on not only solving consumer and business problems, but also helping to establish new capabilities for our clients. With a global client roster of Fortune 100s and start-ups alike, we crave the hardest problems to solve. We have teams distributed across North America, South America, Europe, and Asia. The Code and Theory global network of agencies is growing and includes Kettle, Instrument, Left Field Labs, Create Group, Mediacurrent, Rhythm, and TrueLogic.
Striving never to be pigeonholed, we work across every major category: from tech to CPG, financial services to travel & hospitality, government and education to media and publishing. We value the collaboration with our client partners, including but not limited to Adidas, Amazon, Con Edison, Diageo, EY, J.P. Morgan Chase, Lenovo, Marriott, Mars, Microsoft, Thomson Reuters, and TikTok.
The Code and Theory network is comprised of nearly 2,000 people with 50% engineers and 50% creative talent. We’re always on the lookout for smart, driven, and forward-thinking people to join our team.
Top Skills
What We Do
Code and Theory is a strategically driven, digital-first creative agency that lives at the intersection of creativity and technology. We solve consumer and business problems across the entire customer journey that flex to meet the ever-changing needs of consumer expectations. We put the user, their behaviors and needs, at the center of everything we do — from our proprietary research methodologies, to product development processes, to how we create brand, channel and messaging strategies. Our goal is simple: to solve our clients business problems.
We bring big ideas to life by looking holistically at brand ecosystems where digital plays a prominent role in driving the consumer from first-touch through to conversion to relationship deepening over time. We identify gaps in the consumer journey and opportunities in culture that require products, services or communications to fill. We work across categories, ranging as far and wide as health care (Pfizer, Sanofi, Reach MD, Bioreference Laboratories) to financial services (JP Morgan Chase, Prudential, Morgan Stanley, First Data) to cpg (Mars, Unilever, Johnson & Johnson) to technology companies (Facebook, Xerox, Samsung, Comcast) to culture brands (adidas, H&M). And because our DNA is in publishing — we’ve embedded in over 135 newsrooms in the past decade — we bring unique expertise in understanding how content is created, distributed and optimized, including our work with CNN, NBC News, NBC Sports, and Bustle Digital Group.
At Code and Theory, we strive to only be limited by our own ambition and creativity. We believe in pushing our creativity beyond the easy and obvious answers in order to deliver the solutions that are right for our clients, their businesses, and their consumers.
Gallery
