AI Product Engineer

Posted 14 Days Ago
Be an Early Applicant
Sydney, New South Wales, AUS
In-Office
Senior level
Fintech • Financial Services
The Role
Build and operate production-grade AI products, APIs, RAG solutions, and agentic workflows. Own complex AI initiatives from discovery and architecture through deployment and continuous improvement. Develop shared AI frameworks and platform capabilities, establish standards for testing, evaluation, observability, security, governance, and reliability, and improve system performance and cost. Partner with Product, Engineering, Data, and Infrastructure teams while providing technical guidance, mentoring engineers, and shaping scalable AI architecture.
Summary Generated by Built In
Who are we? 👋

CreditorWatch is entering its next chapter — and it’s an exciting one.

We’re a leading Australian data and technology company transforming how businesses manage commercial risk, make credit decisions and improve cash flow. Since 2010, we’ve built a strong position in the market, helping thousands of businesses make smarter decisions through our data, insights and technology.

Following our acquisition by global private equity firm Warburg Pincus, we have a new opportunity to build on that success and take the business to the next level. With an established platform, ambitious growth plans and plenty of opportunity ahead, we’re focused on scaling our impact and shaping what comes next.

We’re also proud to have been recognised as one of the AFR’s Top 10 Best Places to Work and certified by Great Place to Work across 2022–2025. For people who want to make a meaningful impact in a growing business, this is an opportunity worth exploring.

Our Purpose

✅ Empower Australian businesses to trade confidently with their customers.

Our Mission

🏆 We aim to be number one in our industry by delivering unique data insights and innovative products.

Your role & team 🚀

This is an opportunity to build AI that matters and see the difference your work makes.

As a AI Product Engineer at CreditorWatch, you'll build production-grade AI products and agentic systems that help Australian businesses make smarter decisions, manage risk and trade with confidence.

You'll work at the intersection of product innovation and platform engineering, taking ambitious ideas from discovery through to production. You'll have genuine ownership of complex AI initiatives, while helping shape the shared capabilities, frameworks and engineering standards that enable AI to scale across CreditorWatch.

This isn't about inheriting a finished playbook. You'll be joining an emerging capability with plenty of room to experiment, challenge assumptions and influence how we build and deliver AI. Working closely with Product, Engineering, Data and Infrastructure, you'll solve meaningful problems and deliver secure, reliable and scalable solutions used by our customers and teams.

📍 Location: Sydney CBD
💼 Working arrangements: Full-time, hybrid
🤝 Reporting to: Head of AI Platform

What you'll own 🔍🤖 Build production-grade AI solutions
  • Design, build and operate AI products, APIs, RAG solutions and agentic workflows that solve real customer and business problems.
  • Own complex AI initiatives end-to-end, from discovery and architecture through to implementation, evaluation, deployment and ongoing improvement.
  • Turn emerging AI capabilities into practical, reliable experiences that deliver measurable value.
🏗️ Shape our AI engineering platform
  • Develop shared AI capabilities, reusable frameworks and self-service patterns for model orchestration, prompt management, agent execution and tool integration.
  • Establish engineering standards and best practices that help teams build and deploy AI consistently and at scale.
  • Influence the architecture and technical foundations that underpin our broader AI ecosystem.
🔐 Engineer for quality, security and scale
  • Establish standards for AI testing, evaluation, observability, security, governance and production reliability.
  • Build solutions that are maintainable, scalable and resilient, balancing experimentation with sound engineering discipline.
  • Identify opportunities to improve performance, reliability and cost across our AI systems.
🤝 Lead through collaboration and technical influence
  • Partner with Product, Engineering, Data and Infrastructure teams to turn business problems into effective technical solutions.
  • Provide architecture guidance, mentor engineers and contribute to technical decision-making across teams.
  • Share knowledge, document patterns and help lift AI engineering capability across CreditorWatch.
What success looks like in your first six months 🏁
  • AI in production: You've delivered meaningful AI products or capabilities into production, with clear customer or business value.
  • End-to-end ownership: You're confidently driving complex initiatives from problem definition through to deployment and continuous improvement.
  • Reusable foundations: Shared frameworks, tooling and patterns are making it easier for other teams to build and deploy AI solutions.
  • Engineering excellence: AI testing, evaluation, observability and security practices are becoming part of how we build and operate.
  • Cross-functional impact: You're building strong relationships across Product, Engineering, Data and Infrastructure, influencing decisions and getting things done.
  • A scalable AI capability: You're helping establish the technical foundations and standards that will support CreditorWatch's next phase of AI adoption.
What you'll bring 🧠
  • AI engineering experience: Proven experience designing, building and operating production-grade AI systems, ideally in customer-facing or business-critical environments.
  • Strong engineering foundations: Solid software engineering, system design and operational discipline, with the ability to build maintainable and scalable solutions.
  • AI architecture: Sound judgement across LLM architecture, RAG, model orchestration, agentic workflows and tool integration.
  • Production mindset: Experience with AI evaluation, observability, security, reliability and the practical challenges of running AI systems in production.
  • Platform thinking: An appreciation for reusable frameworks, shared capabilities and developer experience, rather than building one-off solutions.
  • Pragmatic problem-solving: You're comfortable navigating ambiguity, challenging assumptions and making sensible technical trade-offs.
  • Ownership: You take responsibility for outcomes, move initiatives forward and balance speed of delivery with long-term quality.
  • Communication: You can explain complex technical concepts clearly and collaborate effectively with both technical and non-technical stakeholders.
Tech stack & experience that will help 🔧
  • AI observability & evaluation: Langfuse, MLflow, OpenTelemetry and Datadog.
  • Data & retrieval: PostgreSQL, OpenSearch and vector databases.
  • Cloud & delivery: AWS, Docker and GitHub.
  • Agentic AI: Experience designing and operating agentic or multi-agent systems in production.
  • AI governance: Practical experience with LLM evaluation, AI safety, governance and compliance controls.
  • Platform engineering: Experience building shared platforms, frameworks or developer capabilities adopted across multiple teams.
  • Regulated environments: Experience delivering technology in regulated or risk-sensitive environments.
  • Technical leadership: A track record of mentoring, providing architecture direction and driving cross-team engineering initiatives.
A note on AI ✨

Use it. We'd think less of you if you didn't.

We see AI as an opportunity to improve how we work, and we're interested in people who are already experimenting with it in practical ways.

Write the first draft of your application yourself, then use AI to sharpen it rather than replace your thinking. You can also expect to use AI during at least one stage of the interview process. We're interested in how you work with it, not whether you can work without it.

The perks? They’re pretty good 🎁

🏋️ Fitness First – Access to a Fitness First Platinum gym membership to help you stay active.

☕ Daily Fuel – Barista-made coffee, breakfast, snacks, lunches and drinks on us. You’re welcome!

📱 Phone Credits – $50 per month towards your phone plan. One less bill to worry about.

❤️ Wellness Days – An additional day off each month to recharge, focus on your wellbeing or spend time on what matters outside work.

💆 Monthly Massages – In-house massages to work out those knots and help you reset.

🎉 Fun Stuff – From wine tasting with a sommelier and sailing to escape rooms, darts, boat days and team activities, there’s always something happening. We also host Bring Your Family to Work Day, giving the people who matter most a chance to see where you spend your working day.

🏢 A Great Place to Work – Enjoy our state-of-the-art office space in the heart of Sydney CBD, designed to bring people together, collaborate and do great work.

📈 Learn & Grow – We’re big on development. With opportunities to build new skills, take on new challenges and explore career pathways, we want you to keep growing alongside the business.

🫶 Employee Assistance Program (EAP) – Access confidential support and resources to help you navigate personal or work-related challenges and look after your wellbeing.

We’re committed to you ❤️

We value open communication, celebrating wins and creating an inclusive workplace where everyone can thrive. We’re proud to be an equal opportunity employer and welcome people from all backgrounds.

Ready to join us? If you’re excited by the opportunity, we’d love to hear from you. Apply now.

Skills Required

  • Proven experience designing, building, and operating production-grade AI systems
  • Strong software engineering, system design, and operational discipline
  • Experience with LLM architecture, RAG, model orchestration, agentic workflows, and tool integration
  • Experience with AI evaluation, observability, security, reliability, and production operations
  • Ability to build reusable frameworks, shared capabilities, and developer platforms
  • Pragmatic problem-solving and ability to navigate ambiguity and technical trade-offs
  • Ownership of outcomes and ability to balance delivery speed with long-term quality
  • Clear communication with technical and non-technical stakeholders
  • Experience with Langfuse, MLflow, OpenTelemetry, or Datadog
  • Experience with PostgreSQL, OpenSearch, and vector databases
  • Experience with AWS, Docker, and GitHub
  • Experience designing and operating agentic or multi-agent systems in production
  • Practical experience with LLM evaluation, AI safety, governance, and compliance controls
  • Experience building shared platforms, frameworks, or developer capabilities adopted across teams
  • Experience delivering technology in regulated or risk-sensitive environments
  • Track record of mentoring, providing architecture direction, and driving cross-team engineering initiatives
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sydney, NSW
213 Employees
Year Founded: 2010

What We Do

CreditorWatch is a leading Australian data and technology company that provides businesses with access to unique data and innovative products. By using our platform, our customers can confidently manage their commercial relationships, improve productivity and reduce financial risk. As a commercial credit reporting bureau, CreditorWatch offers a complete suite of credit reporting products and data insights covering the entire customer lifecycle, from customer onboarding and credit decision automation to credit risk management and automated collections.

Similar Jobs

Distru Logo Distru

Product Engineer

Cannabis • Enterprise Web • Software
In-Office or Remote
7 Locations
37 Employees
200K-300K Annually
Hybrid
Sydney, New South Wales, AUS
80 Employees
In-Office or Remote
7 Locations
41866 Employees
In-Office or Remote
7 Locations
41866 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account