.jpeg){kind=icon}
Design and develop scalable backend services and REST APIs using Python, FastAPI/Flask/Django.
Build and integrate Generative AI/LLM-based applications, including RAG, AI agents, embeddings, and tool/function calling.
Work with Azure OpenAI and other LLM providers.
Use AI frameworks such as LangChain, LlamaIndex, LangGraph, or similar.
Implement LiteLLM for LLM gateway, routing, fallback, and usage/cost management.
Implement rate limiting, throttling, caching, retries, and API quotas for scalable services.
Use Langfuse for LLM observability, tracing, prompt management, token/cost tracking, and evaluation.
Design and work with PostgreSQL/MySQL, MongoDB, and Redis.
Deploy and manage applications using Microsoft Azure, Docker, and CI/CD.
Develop unit/integration tests, troubleshoot production issues, and optimize performance and cost.
Participate in system design, code reviews, and technical architecture discussions.
Required
5–7 years of software development experience with strong Python and backend development skills and hands-on experience in Generative AI/LLM applications.
Strong understanding of REST APIs, microservices, RAG, embeddings, vector databases, prompt engineering, AI agents, rate limiting, and distributed systems.
Hands-on experience with Azure OpenAI, LiteLLM, and Langfuse is preferred, along with exposure to LangChain/LlamaIndex/LangGraph or similar AI frameworks.
Experience with Microsoft Azure, Docker, CI/CD, databases, Redis, API security, and cloud-native application development is required.
Strong problem-solving, communication, ownership, and ability to build production-grade AI solutions are essential.
Skills Required
- 5-7 years of software development experience
- Strong Python and backend development skills
- Hands-on experience developing Generative AI and LLM applications
- Understanding of REST APIs, microservices, RAG, embeddings, vector databases, prompt engineering, AI agents, rate limiting, and distributed systems
- Hands-on experience with Azure OpenAI, LiteLLM, and Langfuse
- Exposure to LangChain, LlamaIndex, LangGraph, or similar AI frameworks
- Experience with Microsoft Azure, Docker, CI/CD, databases, Redis, API security, and cloud-native application development
- Strong problem-solving, communication, ownership, and production AI solution development abilities
Arrow Electronics, Inc. Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Arrow Electronics, Inc. and has not been reviewed or approved by Arrow Electronics, Inc..
-
Affordable Benefits — Medical coverage includes multiple options with income-tiered employer contributions that substantially reduce costs for lower-wage employees (the base plan was heavily subsidized for earners under $55,000). These affordability measures, alongside EAP and telemedicine, help the overall package offset middling base pay in some roles.
-
Parental & Family Support — New parents receive fully paid leave (six weeks at 100% pay in prior materials, with more recent reporting of up to 12 weeks fully paid for the delivering parent in the U.S.). Backup dependent care and related family supports are also provided.
-
Leave & Time Off Breadth — Many salaried roles have unlimited PTO, while hourly staff receive competitive accrual-based PTO, with added flexibility from floating holidays and observance of MLK Day. These options indicate a broad time-off framework across employee groups.
Arrow Electronics, Inc. Insights
What We Do
A Fortune 500 company, ranked #133 in 2024, with over 22,000 employees worldwide, Arrow guides innovation forward for over 220,000 leading technology manufacturers and service providers. With 2023 sales of $33 billion, Arrow develops technology solutions that improve business and daily life. Arrow.com is the easiest place for innovators to create, make and manage technology.
Why Work With Us
Arrow is much more than products and services. We are a team of many backgrounds in a global ecosystem, working toward one common goal: to help customers create a better tomorrow, where innovation improves the quality of life and the benefits of technology are more accessible to all. Join us in building a better tomorrow for many!
Gallery
