Software Engineer - ETL Developer with Python

Posted 2 Days Ago
Be an Early Applicant
Gurgaon, Gurugram, Haryana, IND
In-Office
Mid level
Consulting
The Role
Design, build, and maintain scalable ETL pipelines using Python and SQLAlchemy. Transform large structured and unstructured datasets, optimize SQL queries, model data for BI/ML, integrate AWS data services and real-time streaming, and prototype agentic AI solutions to automate and enhance data workflows while collaborating with cross-functional teams.
Summary Generated by Built In

We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will possess advanced technical expertise in Python programming, relational databases, and ETL processes, with a strong foundation in data modeling, transformation, and processing of both structured and unstructured data. This role will also play a pivotal part in expanding our data engineering capabilities to incorporate agentic AI solutions, driving automation and intelligence across our data workflows. 

Key Responsibilities: 

  • Design, develop, and maintain scalable and robust data pipelines and ETL systems using Python and SQLAlchemy. 

  • Transform and process large datasets from diverse sources, ensuring data integrity, quality, and consistency. 

  • Optimize and build efficient SQL queries for data retrieval and manipulation; manage and interact with relational databases (MSSQL, PostgreSQL, Oracle, etc.). 

  • Collaborate with cross-functional teams to understand data requirements and deliver innovative solutions. 

  • Implement data models and structures to support business intelligence, analytics, and machine learning initiatives. 

  • Leverage advanced Python programming techniques and libraries (e.g., Pandas, Numpy) to solve complex data challenges. 

  • Architect and implement agentic AI solutions to automate data processes, enhance pipeline intelligence, and support next-generation analytics. 

  • Work with AWS cloud services related to data engineering ( AWS Batch, S3, Lambda, etc.). 

  • Stay abreast of emerging trends in data engineering and AI and proactively recommend improvements. 

  • Integrate real-time data streaming solutions (e.g., Kafka, Kinesis) into data pipelines. 

Technical Skills: 

Python Programming Language: 

  • Level: Advanced 

  • Key Concepts: Multi-threading, Multi-processing, Regular Expressions, Exception Handling, Generators, Decorators, Context Managers, Asyncio, Type Hinting, and best practices for scalable code. 

  • Libraries: Pandas, Numpy, SQLAlchemy, etc.  

Data Modelling and Data Transformation: 

  • Level: Advanced 

  • Key Areas: ETL, processing structured and unstructured data, data quality, and integrity. 

Relational Databases: 

  • Level: Advanced 

  • Key Areas: Query Optimization, Query Building, Experience with ORMs like SQLAlchemy, Exposure to databases such as MSSQL, PostgreSQL, Oracle, etc. 

Agentic AI / Automation: 

  • Exposure to or interest in agentic AI frameworks and tools (e.g., LangChain, OpenAI APIs, or similar). 

  • Experience integrating AI/ML models into data pipelines is a plus. 

Cloud Technologies: 

  • Good experience with AWS data engineering services (Athena, AWS Batch, S3, Lambda, etc.). 

Real-Time Streaming: 

  • Experience with real-time data streaming platforms (Kafka, Kinesis, etc.) is a plus. 

Programming Paradigms: 

  • Functional and Object-Oriented Programming (OOPS): Intermediate 

Problem Solving: 

  • Strong analytical and problem-solving skills for feature development and automation. 

Qualifications: 

  • Bachelor’s or master's degree in computer science, Engineering, or a related field. 

  • Proven experience as a Data Engineer or in a similar role. 

  • Experience with agentic AI or automation frameworks is a plus. 

  • Excellent communication and teamwork abilities. 

  • Ability to work in a fast-paced, agile environment. 

What’s in it for you: 

  • Opportunities for professional growth and development 

  • Exposure to a talented technical team, providing an environment that encourages learning and skill enhancement. 

  • Collaborative and inclusive work environment. 

#LI-SP7

Who are we?

At Gartner, Inc. (NYSE:IT), we guide the leaders who shape the world.

Our mission relies on expert analysis and bold ideas to deliver actionable, objective business and technology insights, helping enterprise leaders and their teams succeed with their mission-critical priorities.

Since our founding in 1979, we’ve grown to 20,000 associates globally who support over 13,000 client enterprises in ~90 countries and territories. We do important, interesting and substantive work that matters. That’s why we hire associates with the intellectual curiosity, energy and drive to want to make a difference. The bar is unapologetically high. So is the impact you can have here.

What makes Gartner a great place to work?

Our vast, virtually untapped market potential offers limitless opportunities – opportunities that may not even exist right now – for you to grow professionally and flourish personally. How far you go is driven by your passion and performance.

We hire remarkable people who collaborate and win as a team. Together, our singular, unifying goal is to deliver results for our clients.

Our teams are inclusive and composed of individuals from different geographies, cultures, religions, ethnicities, races, genders, sexual orientations, abilities and generations.

We invest in great leaders who bring out the best in you and the company, enabling us to multiply our impact and results. This is why, year after year, we are recognized worldwide as a great place to work.

Gartner is the world authority on AI

At Gartner, you’ll join a company at the very center of the AI revolution. Gartner has proactive, objective guidance throughout clients’ AI journeys. We set the standard for how organizations leverage artificial intelligence to drive meaningful impact. You’ll have access to unmatched resources, expertise, and technology, and play a key role in helping Gartner and our clients innovate and grow as we leverage AI to transform business and technology landscapes.

It’s an exciting time to be at Gartner, with limitless opportunities to make a real impact, grow your skills, and build a lasting, meaningful career in a field that’s reshaping the way we operate. If you’re passionate about AI and want to be part of a team that’s guiding the leaders who shape the world, Gartner is the place for you.

What do we offer?

Gartner offers world-class benefits, highly competitive compensation and disproportionate rewards for top performers.

In our hybrid work environment, we provide the flexibility and support for you to thrive — working virtually when it's productive to do so and getting together with colleagues in a vibrant community that is purposeful, engaging and inspiring.

Ready to grow your career with Gartner? Join us.


The policy of Gartner is to provide equal employment opportunities to all applicants and employees without regard to race, color, creed, religion, sex, sexual orientation, gender identity, marital status, citizenship status, age, national origin, ancestry, disability, veteran status, or any other legally protected status and to seek to advance the principles of equal employment opportunity.

Gartner is committed to being an Equal Opportunity Employer and offers opportunities to all job seekers, including job seekers with disabilities. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access the Company’s career webpage as a result of your disability. You may request reasonable accommodations by calling Human Resources at +1 (203) 964-0096 or by sending an email to [email protected].

Job Requisition ID:111578

By submitting your information and application, you confirm that you have read and agree to the country or regional recruitment notice linked below applicable to your place of residence.

Gartner Applicant Privacy Link: https://jobs.gartner.com/applicant-privacy-policy


For efficient navigation through the application, please only use the back button within the application, not the back arrow within your browser.

Skills Required

  • Advanced Python programming (multithreading, multiprocessing, asyncio, type hinting, scalable code)
  • Experience with Pandas and Numpy
  • Experience with SQLAlchemy and ORMs
  • Designing and implementing ETL pipelines and data transformations
  • Relational database experience and query optimization (MSSQL, PostgreSQL, Oracle)
  • Experience with AWS data services (Athena, AWS Batch, S3, Lambda)
  • Data modeling and working with structured and unstructured data, ensuring data quality and integrity
  • Bachelor's or master's degree in Computer Science, Engineering, or related field
  • Proven experience as a Data Engineer or similar role
  • Experience with real-time streaming platforms (Kafka, Kinesis)
  • Exposure to agentic AI frameworks or OpenAI APIs; integrating AI/ML into pipelines
  • Strong communication, teamwork, and ability to work in an agile environment

Gartner Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Gartner and has not been reviewed or approved by Gartner.

  • Strong & Reliable Incentives Pay is considered strong in sales through robust commission structures with uncapped earning potential and accelerators. High performers can meaningfully increase total earnings when attainment aligns with targets.
  • Healthcare Strength Health coverage is described as comprehensive, including medical, dental, and vision plans, preventive care, mental health support via an EAP, and annual HSA contributions. Flexible care options and wellness resources add breadth.
  • Parental & Family Support Paid parental leave is offered for all parents, alongside programs for fertility, nursing, child, and elder care. Dependent care supports and family-focused resources reinforce work-life balance.

Gartner Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Stamford, CT
17,843 Employees
Year Founded: 1979

What We Do

Gartner, Inc. is the world’s leading research and advisory company and a member of the S&P 500. We equip business leaders with indispensable insights, advice and tools to achieve their mission-critical priorities today and build the successful organizations of tomorrow.

Similar Jobs

ZS Logo ZS

Senior Engineer

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
3 Locations
15000 Employees

ZS Logo ZS

Scientist

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
3 Locations
15000 Employees

Bose Logo Bose

Account Manager

Automotive • eCommerce • Hardware • Music • Retail • Software • Wearables
Hybrid
2 Locations
2900 Employees

Optum Logo Optum

Channel Specialist - Events and Executive Client Engagement - Gurgaon and Pune

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Gurgaon, Gurugram, Haryana, IND
160000 Employees

Similar Companies Hiring

Quantum Rise Thumbnail
Software • Professional Services • Natural Language Processing • Machine Learning • Consulting • Automation • Artificial Intelligence
Chicago, Illinois
20 Employees
Northslope Thumbnail
Artificial Intelligence • Information Technology • Software • Analytics • Consulting • Generative AI
London, GB
100 Employees
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account