Senior Software Engineer (Big Data)
Let’s be unstoppable together!
At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We’re a global company dedicated to fostering inclusivity and belonging. We value and celebrate the unique experiences, cultures, and viewpoints that each individual brings. By embracing a wide range of backgrounds, skills, expertise, and beyond, we create a stronger, more innovative environment for our employees, clients, and communities. Circana is proud to be Certified™ by Great Place To Work®. This prestigious award is based entirely on what current employees say about their experience working at Circana.
Learn more at www.circana.com.
What will you be doing?
- As a part of this team, you’ll work alongside the brightest minds. As a senior Big Data engineer, evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders.
- Design, develop, and maintain highly scalable data processing applications.
Job Responsibilities
- Write efficient, reusable and well documented code
- Deliver big data projects using PySpark, Python, SQL
- Maintain and tune existing Spark applications to the fullest.
- Find opportunities for optimizing existing spark applications.
- Work closely with QA, Operations and various teams to deliver error free software on time.
- Actively lead / participate daily agile / scrum meetings.
- Take responsibility for Apache Spark development and implementation.
Requirements
- Engineering graduates in computer science backgrounds preferred with 6+ years of software development experience with Hadoop framework components(HDFS, Spark, Spark, Scala, PySpark)
- Excellent at verbal, written and presentation skills
- Ability to present and defend a solution with technical facts & business proficiency
- Understanding of data-warehousing and data-modeling techniques
- Strong data engineering skills
- Knowledge of Core Java, Linux, SQL, and any scripting language
- At least 4+ years of experience using Python / Scala, Spark, SQL
- Knowledge of shell scripting is a plus
- Knowledge of Core and Advance Java is a plus.
- Experience in developing and tuning spark applications
- Excellent understanding of spark architecture, data frames and tuning spark
- Strong knowledge of database concepts, systems architecture, and data structures is a must Process oriented with strong analytical and problem solving skills
- Experience in writing Python standalone applications dealing with PySpark API
Circana Behaviors
As well as the technical skills, experience and attributes that are required for the role, our shared behaviors sit at the core of our organization. Therefore, we always look for people who can continuously champion these behaviors throughout the business within their day-to-day role:
- Stay Curious: Being hungry to learn and grow, always asking the big questions
- Seek Clarity: Embracing complexity to create clarity and inspire action
- Own the Outcome: Being accountable for decisions and taking ownership of our choices
- Center on the Client: Relentlessly adding value for our customers
- Be a Challenger: Never complacent, always striving for continuous improvement
- Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect and integrity
- Commit to each other: Contributing to making Circana a great place to work for everyone
Location
This position can be located in the following area(s): Pune/Bangalore
Note –
“An offer of employment may be conditional upon successful completion of a background check in accordance with local legislation and our candidate privacy notice. Your current employer will not be contacted without your permission”.
Skills Required
- 6+ years of software development experience with Hadoop framework components (HDFS, Spark, Scala, PySpark)
- At least 4+ years of experience using Python/Scala, Spark, SQL
- Experience in developing and tuning Spark applications and understanding Spark architecture and data frames
- Strong data engineering skills and understanding of data-warehousing and data-modeling techniques
- Knowledge of Core Java, Linux, SQL, and any scripting language
- Experience writing Python standalone applications using the PySpark API
- Excellent verbal, written and presentation skills; ability to present and defend technical solutions
- Strong knowledge of database concepts, systems architecture, and data structures
- Engineering degree in computer science
- Knowledge of shell scripting
- Knowledge of Core and Advanced Java
Circana Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Circana and has not been reviewed or approved by Circana.
-
Leave & Time Off Breadth — Unlimited PTO for many exempt roles and paid holidays are frequently highlighted. Feedback suggests these time‑off policies are a notable strength of the package.
-
Parental & Family Support — Paid parental leave is available in the U.S. and is described as competitive and well‑received. Company communications emphasize equal/neutral parental leave, reinforcing family support.
-
Wellbeing & Lifestyle Benefits — A broad slate of extras—such as adoption assistance, tuition/educational assistance, volunteer time off, and EAP—adds to the overall package. Feedback suggests these lifestyle‑oriented offerings complement core medical, dental, and vision coverage.
Circana Insights
What We Do
Circana is the leading advisor on the complexity of consumer behavior. Through unparalleled technology, advanced analytics, cross-industry data and deep expertise, we provide clarity that helps almost 7,000 of the world’s leading brands and retailers take action and unlock business growth. We understand more about the complete consumer, the complete store, and the complete wallet so our clients can go beyond the data to apply insights, ignite innovation, meet consumer demand, and outpace the competition. Circana is hiring! To view our current openings, please visit our IRI and NPD LinkedIn company pages.
