We're looking for an experienced Senior Software Engineer with experience in building AI based products to join our Bright Insights Business Unit. You'll play a crucial role in building AI-powered features that turn our digital shelf and market share data into actionable insights, working alongside a talented and passionate team.
Responsibilities- End-to-end feature development for AI-powered analytics on rich datasets, from architecture to production.
- Mentor teammates and partner with Product, Data Science, and Design to deliver reliable conversational flows.
- Design secure, low-latency data retrieval and AI integration pipelines (function calling, agentic workflows, etc…) for internal datasets and APIs.
- Build and scale integrations to data sources - defining schemas, queries, and caching strategies; continuously improve backend components to deliver a top‑notch user experience with efficient resource trade‑offs.
- Establish quality guardrails, automated tests/evaluations, and observability; optimize for scalability, performance, and cost; run A/B tests.
- Optimize context engineering and data retrieval strategies - balancing relevance, latency, and token efficiency to deliver accurate AI-powered insights.
*Bright Insights offers actionable ecommerce data analysis for retailers, analysts, and investors: https://brightdata.com/products/insights
Requirements- 6+ years in software development, including 3+ years with Python; experience with .NET C# or Java.
- Practical experience with LLM-based systems: prompt engineering, context optimization, retrieval-augmented generation, function calling, embeddings, and vector databases
- Experience building APIs and microservices; strong software design, testing, and debugging skills
- Front-end development in JavaScript and React; experience with data visualization/charting is an advantage
- Understanding of data retrieval optimizations, caching strategies, and query performance tuning
- Work experience in a cloud environment, preferably AWS; CI/CD, containers (Docker/Kubernetes), and monitoring/observability
- Proven track record delivering reliable, low-latency, cost-efficient production systems
- Solid understanding of SQL and data modeling; familiarity with NoSQL technologies
- Excellent communication skills in English.
Skills Required
- 6+ years in software development, including 3+ years with Python; experience with .NET C# or Java
- Practical experience with LLM-based systems: prompt engineering, context optimization, retrieval-augmented generation, function calling, embeddings, and vector databases
- Experience building APIs and microservices; strong software design, testing, and debugging skills
- Front-end development in JavaScript and React
- Experience with data visualization/charting
- Understanding of data retrieval optimizations, caching strategies, and query performance tuning
- Work experience in a cloud environment (preferably AWS); CI/CD, containers (Docker/Kubernetes), and monitoring/observability
- Proven track record delivering reliable, low-latency, cost-efficient production systems
- Solid understanding of SQL and data modeling
- Familiarity with NoSQL technologies
- Excellent communication skills in English
What We Do
Bright Data is the world’s #1 web data platform, supporting the public data needs of over 20,000 organizations in nearly every industry. Our solutions are leveraged to fuel AI as well as research, monitor, and analyze web data for smarter decisions. Bright Data offers a complete web data platform, from award-winning proxy networks and AI-powered web scraping tools, to dynamically refreshed datasets, an unparalleled retail and e-commerce data intelligence suite, and fully managed data services. Making public web data accessible is essential to keeping markets openly competitive and providing different data types to power LLMs. As an industry leader, we are committed to defending public web data. Bright Data has proven that ethical and transparent scraping practices for legitimate business use and social good initiatives are legally sound. We are very proud to lead innovation in web data, with +5,500 granted patent claims.
