Role Overview
We are seeking an experienced Senior Data Engineer with strong Scala development expertise to build and support large-scale data processing solutions. This role will focus on developing high-performance data pipelines and applications using Spark and the Hadoop ecosystem, supporting critical enterprise data platforms. The ideal candidate brings strong problem-solving skills, a deep understanding of distributed data processing, and an engineering mindset that considers the full lifecycle of code—from design and development through deployment, performance optimization, and long-term production stability.
Design, develop, and maintain scalable data pipelines and distributed data processing applications using Scala and Spark.
Build and optimize large-scale batch and data processing frameworks within the Hadoop ecosystem.
Write efficient and maintainable Scala-based applications for enterprise data platforms.
Develop and maintain SQL-based queries and transformations for data processing and validation.
Collaborate with data architects, engineers, and business stakeholders to translate business requirements into scalable data solutions.
Ensure data pipeline performance, reliability, and stability in production environments.
Troubleshoot and resolve performance issues across distributed systems.
Contribute to best practices around data engineering, code quality, testing, and operational support.
Support production environments and continuously improve monitoring, resiliency, and stability of data systems.
- Bachelor’s degree in Computer Science, Information Technology, or related field.
8–10 years of experience in data engineering or software development roles.
Strong Scala development experience (primary programming language).
Hands-on experience with Apache Spark for distributed data processing.
Experience working within the Hadoop ecosystem (HDFS, Hive, YARN, or related technologies).
Basic to intermediate SQL skills for querying and manipulating data.
Strong problem-solving and analytical skills.
Demonstrated ability to design solutions while considering the entire software lifecycle, including performance, monitoring, and production stability.
Experience working in Corporate & Investment Banking (C&IB) environments.
Familiarity with large-scale enterprise data platforms handling high data volumes.
Experience with data pipeline optimization and performance tuning.
Exposure to modern data platforms, streaming frameworks, or cloud-based data services.
Experience working in Agile development environments.
About Techstra Solutions
Techstra Solutions is a certified woman-owned (WBENC) management consulting firm specializing in strategy, technology, and implementation services for large organizations undergoing digital and talent transformation. Our experienced team partners with clients to co-create innovative solutions in applications, data, AI, and automation that accelerate measurable, sustainable change. From advisory consulting through technical execution, we are dedicated to driving world-class business solutions that fit your strategic requirements and deliver results. For more information: www.techstrasolutions.com
Top Skills
What We Do
Techstra Solutions is a certified woman-owned consulting firm that provides strategy, technology and implementation support to large organizations undergoing digital and talent transformation. The rapid pace of technology innovation required to remain competitive, juxtaposed with the slow rate of change in many organizations, causes most to struggle. To be successful companies must drive new ways of working including the use of technology/analytics and new skillsets (hard/soft) deep into their culture so that they are able to rapidly and continuously react to change. They must also apply new approaches that empower their employees, ensuring its sustainability. At Techstra Solutions we focus on four key areas, otherwise known as the 4 A’s: Automation (Robotic Process Automation (RPA)/Intelligent Automation), Analytics (Reporting/Analytics/AI/ML), Application Modernization (Cloud, Mobility, etc), and Agile-based solutions (DevOps).
.png)
.png){kind=logo}
