Design, implement and deliver large scale enterprise applications using big data open-source solutions such as Apache Hadoop, Apache Spark, Kafka, and Elastic Search. Implement data pipelines and data driven applications using Python on distributed computing frameworks like Hadoop, Apache Spark, etc.
Responsibilities- Use AWS services and GCP services to build data pipelines and migrate on-prem data pipelines and data applications to Cloud infrastructure.
- Proficient in using AWS cloud-based services to implement batch and online steaming applications.
- Work closely with Data science teams to integrate data, algorithms into data lake systems and automate different Machine Learning workflows and assist with data infrastructure needs.
- Experience in working both, On-Prem and Cloud.
- Design and implement efficient data pipelines (ETLs) in order to integrate data from a variety of sources into Data Warehouse.
- Design and implement data model changes that align with warehouse standards.
- Design and implement backfill or other warehouse data management processes.
- Develop and execute testing strategies to ensure high quality warehouse data.
- Provide documentation, training, and consulting for data warehouse users.
- Perform requirement and data analysis in order to support warehouse project definition.
- Excellent database troubleshooting skills.
- Working technical knowledge of PowerShell.
- Strong object-oriented design and analysis skills.
- Verbal and written communication skills and the ability to interact professionally with a diverse group, executives, managers, and subject matter experts.
- Working in agile methodology, involve in Grooming, Sprint Planning, and daily Scrum meetings.
- Position may work at various and unanticipated worksites throughout the United States. Telecommuting permitted.
Requires a Bachelor’s degree Computer Science, Engineering, or a directly related field plus five (5) years of software engineering experience. Experience must include: Two (2) years of experience in: SQL scripting; Big data technologies: HDFS, YARN, Spark, Hive, Sqoop, Impala, Airflow, Zookeeper, and Kafka; Enterprise GitHub: branch, release, DevOps, and CI/CD pipeline; and Data engineering or ETL development. Three (3) months of experience in: Snowflake or other cloud-based data platforms (AWS, GCP, Databricks) and Python web frameworks: Django or Flask. Employer will also accept a Master’s degree plus three (3) years of engineering experience in lieu of Bachelor’s plus five (5) years of software engineering experience.
40 hours/week, 9:00am-5:00pm, Salary range: $190,000 to $193,000 per year.
To apply: Send resume and cover letter to [email protected]. Must cite job title and code EXL78 in response. This notice is subject to ExlService.com, LLC's employee referral program. EEO/Minorities/Females/Vets/Disabilities
Skills Required
- Bachelor's degree in Computer Science, Engineering, or directly related field (or Master's plus three years experience)
- Five (5) years of software engineering experience
- Two (2) years of SQL scripting experience
- Two (2) years' experience with big data technologies: HDFS, YARN, Spark, Hive, Sqoop, Impala, Airflow, Zookeeper, Kafka
- Two (2) years' experience with Enterprise GitHub workflows, branching, releases, DevOps and CI/CD pipelines
- Two (2) years' experience in data engineering or ETL development
- Three (3) months' experience with Snowflake or other cloud-based data platforms (AWS, GCP, Databricks)
- Three (3) months' experience with Python web frameworks: Django or Flask
- Working technical knowledge of PowerShell
- Experience using AWS and GCP services to build and migrate data pipelines and implement batch and streaming applications
- Proficiency in Python for implementing data pipelines on distributed computing frameworks (Hadoop, Spark)
What We Do
Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments. At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations. Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale. Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact. We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition. At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward. For more information, visit www.exlservice.com.
