The Senior AI Software Engineer, Python will be responsible for making Scorpion’s Conversational Intelligence Platform production-grade by building reliable, observable, and scalable infrastructure for real-time AI workloads, including LLM orchestration, streaming responses, and event-driven messaging across multiple communication channels.
This role owns the runtime reliability of systems that process LLM inference pipelines, manage backpressure across async workloads, and maintain clean service boundaries with downstream teams. Operating within an established architecture, the Senior AI Software Engineer, Python is responsible for the operational excellence required to make the platform production-ready.
What Your Success Will Look Like- Own the reliability of the event-driven messaging layer, including backpressure management, idempotency, dead-letter handling, and retry strategies.
- Build and operate the infrastructure that runs LLM orchestration workloads at scale.
- Own the operational data layer for the CI runtime, including state management, session persistence, and real-time data access patterns.
- Own observability for the CI platform, including structured logging, distributed tracing (OpenTelemetry), and error tracking (Sentry).
- Maintain and harden the interfaces between CI and downstream platforms, including contract testing, versioning, and failure handling.
- Conduct code reviews and mentor team members on Python engineering practices and production readiness.
- Own production support for CI infrastructure, including on-call responsibilities and incident response.
- Experience
- 5+ Years of Experience or Relevant Experience.
- Developing production-grade Python services at scale.
- Operating real-time or high-throughput infrastructure supporting AI/ML workloads.
- Designing and operating distributed, event-driven systems in production environments.
- Hard / Technical Skills
- Deep command of Python internals: async/await lifecycle, event loop mechanics, GIL implications for concurrency strategy, memory profiling.
- Production experience with Pydantic, type systems, and structured data modeling in high-throughput services.
- Strong opinions on code organization, error handling patterns, and testability in long-lived Python codebases.
- Hands-on experience operating LLM inference infrastructure at scale.
- Deep experience with NoSQL data modeling: partition strategy, consistency tradeoffs, query cost optimization, and hot-partition avoidance.
- Experience with event-driven architecture in production: backpressure, idempotency, dead-letter handling, retry strategies.
- Proficiency with observability tooling: distributed tracing (OpenTelemetry), structured logging, error tracking (Sentry).
- Experience with Azure cloud platform services.
- Professional / Core Skills
- Ability to negotiate technical boundaries with teams that own upstream and downstream services.
- Clear, direct communication in design discussions, incident response, and code review.
- Winning Mindset: When our clients win, we win.
- Genuine Care: We only succeed when we are truly invested in our clients and each other.
- Unmatched Results: We deliver more than expected–and then some–driving the best results and impacting lives.
- Constant Improvement: We believe there is always a better way. We learn we ask “What if?” we build and then do it again.
- Unbeatable Teamwork: We come from different backgrounds but have the same vision. We only get there by doing it together, as a team.
We acknowledge that states have passed legislation promoting pay transparency. As a national employer, Scorpion has made the decision to post our expected pay rate or pay range (as applicable) in all our job postings, regardless of geographic location.
- The base salary range is $135,000 (entry-level) - $175,000 (highly experienced), exclusive of fringe benefits. If you are hired at Scorpion, your final base salary compensation will be determined based on factors such as geographic location, skills, education, and/or experience. Additionally, we believe in the importance of pay equity and consider the internal equity of our current team members as a part of any final offer. Please keep in mind that the range mentioned above is the total salary range for the role. Hiring at the maximum of the range would not be typical in order to allow for future & continued salary growth.
- The compensation package may also include incentive compensation opportunities in the form of discretionary bonuses or commissions.
We invest in our employees by offering them diverse benefits from best-in-class carriers. These benefits provide enough choice and flexibility to keep our employees and their families healthy and happy—today and tomorrow.
- 100% employer-paid medical, dental, and vision insurance
- Flexible paid time off, so you can rest, relax, and recharge away from work
- Paid parental leave
- Paid cell phone and service
- Remote office allowance
- Professional development and development courses
- Regular manager check-ins to drive performance and career growth through Lattice
Work Location & Flexibility
Scorpion supports a range of work arrangements, including in-office, hybrid, and remote roles. For positions designated as remote, employees who live within commuting distance of a Scorpion office may be asked to work from the office based on team needs, collaboration opportunities, or business priorities. Specific expectations will be discussed during the interview process.
Skills Required
- 5+ years of relevant experience
- Developing production-grade Python services at scale
- Operating real-time or high-throughput infrastructure supporting AI/ML workloads
- Designing and operating distributed, event-driven systems in production
- Deep command of Python internals (async/await, event loop, GIL, memory profiling)
- Production experience with Pydantic, type systems, and structured data modeling
- Hands-on experience operating LLM inference infrastructure at scale
- Deep experience with NoSQL data modeling (partitioning, consistency, hot-partition avoidance)
- Experience with event-driven architecture: backpressure, idempotency, dead-letter handling, retries
- Proficiency with observability tooling: distributed tracing (OpenTelemetry), structured logging, error tracking (Sentry)
- Experience with Azure cloud platform services
- Production support experience including on-call and incident response
- Strong communication and ability to negotiate technical boundaries with other teams
What We Do
At Scorpion Enterprises, we provide a wealth of knowledge to collaborate and build end-to-end strategies for our clients. We check Business Data, Audience Analytics, and Websites and Social Media statistics. With these data-driven insights in place, we form an effective strategy to ensure that our outreach plan goes a long way. We dive deep into understanding clients’ brands and companies to obtain and keep the clients’ customers satisfied. Every project is different, but they all start with one thing in common. We want to know everything: where the client started, where they want to go next, what they value, who their customers are and why they care about them. The only way to solve a problem is to understand it from every angle. Fortunately, we have a proven method to quench our insatiable curiosity. Our attention to detail is impressive too. We have a senior manager on board, fully responsible for delivering excellence in every way possible from beginning to end. Our plans cover some of the best locations, strategic timing, and compelling messages based on the clients’ potential customers.
