The Role
Design, implement, and maintain highly scalable data pipelines and reusable ingestion/validation frameworks using Scala/Spark/Java. Collaborate on requirements, build CI/CD and test automation scripts, support incident recovery, and optimize distributed systems. Work with cloud services, databases, and SQL to enable large-scale data processing and transformations.
Summary Generated by Built In
-Collaborate with users and project team on requirements and expectations
-Analyze business requirements, create proper data solutions that meets functional and non-functional requirements
-Design and implement highly scalable and robust data pipelines in Scala/Spark/Java for processing of extreme large amount of data
-Create and maintain reusable frameworks for data ingestion, validation, normalization, and transformation
-Create scripts for test automation, CI/CD, data migrations, data validations
-Provide technical support for incident recovery
Requirements
-Minimum 3~6 years of working experience as developer or data engineer
-Strong programming skills and has software development experience in Scala, Java or Python
-Deep understanding of distributed systems (Hadoop, Spark, etc.) and its optimization
-Experience in public cloud technologies, preferably Azure
-Good knowledge of Oracle database, MS-SQL Server, Linux, networking
-Proficient in SQL, shell scripting, git, unit testing, CI/CD tools
-Understanding of design principles, coding standards and best practices
-Strong learning ability and problem-solving skills
-Excellent communication, presentation, and interpersonal skills
Preferable:
-Understanding of REST API, NoSQL, micro-services, ETL
-Hand-on experience with Cloud services is preferred
-Understanding of streaming data processing and change data capture is preferred
-Experience with BI tools is preferred
Skills Required
- 3-6 years experience as developer or data engineer
- Software development experience in Scala, Java or Python
- Deep understanding of distributed systems (Hadoop, Spark) and optimization
- Experience with public cloud technologies (preferably Azure)
- Knowledge of Oracle database and MS-SQL Server
- Proficient in SQL
- Proficient in shell scripting
- Experience with Linux and networking
- Proficient with git
- Familiarity with unit testing and CI/CD tools
- Understanding of design principles, coding standards and best practices
- Strong learning ability, problem-solving, and communication skills
- Understanding of REST API, NoSQL, micro-services, ETL
- Hands-on experience with cloud services
- Understanding of streaming data processing and change data capture
- Experience with BI tools
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
NexusCorp LLC (operating as Nexus Corporation) helps businesses achieve their goals through custom software development, IT consulting, statement-of-work delivery, contingent workforce and direct-hire solutions, and payroll services. It designs, builds, tests, and maintains scalable digital applications; analyzes systems to improve technology use; and supplies specialized professionals and structured project delivery. Its client-first approach emphasizes compliance, integrity, innovation, and tailored business outcomes.
.png)
