Data Engineer with Expertise in Data Pipelines, Cloud Platforms, and Big Data Technologies

Posted 4 Days Ago
Be an Early Applicant
Gachibowli, Rangareddy, Telangana, IND
In-Office
Senior level
Fintech • Financial Services
The Role
The Data Engineer will design and maintain scalable data pipelines, collaborate with teams to translate requirements into solutions, and optimize data for analytics and reporting.
Summary Generated by Built In

Job Summary
Synechron is seeking an experienced Data Engineer to design, develop, and maintain scalable, secure, and efficient data pipelines and architectures. This role involves working closely with cross-functional teams to translate business needs into robust data solutions that support analytics, reporting, and operational initiatives. The Data Engineer will leverage emerging technologies and best practices to optimize data flow, quality, and security, contributing to the organization’s data-driven decision-making capabilities.

Software Requirements

Required:

  • Strong proficiency in data integration and pipeline development using tools such as IBM DataStage, Apache NiFi, or similar ETL platforms

  • Experience with programming languages such as Python, Java, or Shell scripting for workflow automation and data processing

  • Knowledge of SQL and NoSQL databases (e.g., Oracle, SQL Server, MongoDB, DynamoDB) for data management and query optimization

  • Familiarity with cloud-based data services (AWS, Azure, Google Cloud) and hybrid cloud architectures

  • Understanding of data security, privacy, and compliance standards applicable to enterprise data environments

Preferred:

  • Experience with big data platforms (Hadoop, Spark, Kafka) for large-scale data processing

  • Knowledge of data cataloging, metadata management tools, or data governance frameworks

Overall Responsibilities

  • Design, develop, and deploy scalable, reliable data pipelines and architectures aligned with enterprise standards

  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and develop effective solutions

  • Optimize data workflows for performance, throughput, and cost-efficiency, including tuning and monitoring

  • Ensure data quality, consistency, and security within all data architecture components

  • Conduct data validation, testing, and troubleshooting to resolve technical issues promptly

  • Document data flow processes, architecture designs, and system configurations

  • Stay current with emerging data management technologies and best practices, recommending improvements and innovations

Technical Skills (By Category)

Programming Languages:

  • Essential: Python, Java, Shell scripting

  • Preferred: SQL for data querying and transformation

Databases/Data Management:

  • Experience with relational databases (Oracle, SQL Server) and NoSQL platforms (MongoDB, DynamoDB)

  • Skills in data modeling, data transformation, and query optimization

Cloud Technologies:

  • Experience deploying, managing, and monitoring data solutions on cloud platforms such as AWS, Azure, or Google Cloud

  • Understanding of cloud-native data architectures, serverless data services, and hybrid cloud integration

Frameworks and Libraries:

  • Data processing and orchestration tools such as Apache Spark, Kafka, Apache NiFi, or equivalent

  • Data governance, metadata management, or cataloging tools (preferred)

Development Tools and Methodologies:

  • Version control via Git

  • Workflow automation and scheduling (Airflow, Azure Data Factory, or similar)

  • Agile project management practices (Scrum, Kanban)

Security Protocols:

  • Implementation of data encryption, role-based access control, and compliance standards

  • Knowledge of data privacy regulations (GDPR, CCPA) as applicable to data architectures

Experience Requirements

  • Minimum of 7 years of experience in data engineering, data integration, or related roles

  • Proven success designing and maintaining scalable data pipelines and architectures in enterprise environments

  • Experience in cloud data solution deployment, big data processing, or hybrid cloud architectures

  • Prior domain experience in banking, fintech, or retail sectors is preferred

  • Alternative candidates: extensive project experience, relevant certifications, or contributions to open-source data projects

Day-to-Day Activities

  • Build, test, and deploy scalable data pipelines and architectures for enterprise use

  • Collaborate with cross-functional teams to gather requirements and translate them into technical specifications

  • Optimize data workflows for performance, security, and cost-efficiency, including tuning and troubleshooting

  • Conduct data validation and quality assurance activities

  • Automate data workflows and deployment processes, ensuring high system availability and reliability

  • Monitor system health, troubleshoot issues, and implement performance improvements

  • Document architecture, workflows, and configurations for support and knowledge transfer

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Data Science, Information Technology, or related fields

  • Certifications such as AWS Certified Data Analytics, Microsoft Azure Data Engineer, or similar are advantageous

  • Strong commitment to continuous learning and staying current with evolving data management technologies

Professional Competencies

  • Strong analytical and troubleshooting skills for large-scale data solutions

  • Ability to work autonomously and collaboratively across teams

  • Excellent communication skills to articulate complex technical concepts to diverse stakeholders

  • Adaptability to new tools, technologies, and shifting project priorities

  • A proactive learning and innovation mindset for process and architecture improvements

  • Effective time and priority management to meet project deadlines

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

Top Skills

Apache Nifi
AWS
Azure
DynamoDB
GCP
Hadoop
Java
Kafka
MongoDB
Oracle
Python
Shell Scripting
Spark
SQL
SQL Server
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Maharashtra
12,827 Employees
Year Founded: 2001

What We Do

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,700+, and has 48 offices in 19 countries within key global markets. For more information on the company, please visit our website: www.synechron.com.

Similar Jobs

S&P Global Logo S&P Global

Data Engineer

Fintech • Analytics
In-Office
Hyderabad, Telangana, IND
26747 Employees
In-Office
Hyderabad, Telangana, IND
10211 Employees
50K-120K Annually

Experian Logo Experian

Senior Data Engineer

Big Data • Marketing Tech • Analytics
In-Office
Hyderabad, Telangana, IND
16292 Employees
In-Office
3 Locations
26747 Employees

Similar Companies Hiring

Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account