Valleysoft, a reputable IT services company, is seeking a skilled Data Engineer to join our dynamic team. The successful candidate will be responsible for designing, developing, and maintaining scalable data solutions to support business analytics and decision-making processes.
Key Responsibilities:
- Design, build, and optimize data pipelines and ETL processes for collecting, transforming, and storing data across multiple sources.
- Develop and maintain data warehouses, data marts, and data lakes to enable efficient data access and analysis.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver relevant solutions.
- Ensure data quality, consistency, and security throughout the data lifecycle.
- Monitor and troubleshoot data pipeline performance and implement improvements.
- Keep up-to-date with emerging data engineering technologies and best practices.
Requirements
- Build and maintain data warehouse and data marts, including ODS and internal departmental marts.
- Gather, process, maintain, and analyze large datasets, ensuring data accuracy and quality.
- Design, automate, and support ETL pipelines and data flows across multiple applications.
- Create logical and physical data flow models and mapping designs for ETL processes.
- Strong SQL skills (performance tuning, index management) and solid understanding of database structures.
- Strong understanding of data modeling concepts.
- Familiarity with SQL and NoSQL storage, and Big Data technologies (Hive, Impala, YARN, Kafka, etc.).
Informatica-specific requirements:
- Hands-on experience with Informatica PowerCenter development (mappings, sessions, workflows).
- Strong knowledge of Informatica transformations (e.g., Lookup, Joiner, Aggregator, Expression, Router, Sorter) and performance tuning.
- Experience with Informatica Developer.
- Experience with Informatica B2B is a plus.
- Ability to design, automate, monitor, and troubleshoot ETL jobs, including scheduling.
Banking sector requirements (preferred):
- Previous experience in the banking sector, preferably business banking, including working with banking datasets.
- Strong understanding of data quality and reconciliation expectations in banking environments.
- Experience working under regulated environments and change control practices is a strong plus.
Benefits
- Private Health Insurance
- Training & Development
Skills Required
- 3+ years data engineering experience
- Build and maintain data warehouses, data marts, and ODS
- Design, automate, support, monitor, and troubleshoot ETL pipelines and scheduling
- Gather, process, maintain, and analyze large datasets ensuring data accuracy and quality
- Strong SQL skills including performance tuning and index management
- Strong understanding of data modeling concepts
- Familiarity with SQL and NoSQL storage and Big Data technologies (Hive, Impala, YARN, Kafka)
- Hands-on experience with Informatica PowerCenter development (mappings, sessions, workflows)
- Knowledge of Informatica transformations and performance tuning
- Experience with Informatica Developer
- Informatica B2B experience
- Experience creating logical and physical data flow models and mapping designs for ETL
- Experience in banking sector with regulated environments and change control practices
- Ensure data quality, consistency, and security throughout the data lifecycle
What We Do
- Valleysoft is a regional IT services provider serving clients around the world. Since 2006, Valleysoft has been working with global partners, such as IBM, in different industries to solve complex business and technical problems ranging from enterprise-class application development and maintenance to worldwide process management. - As client-focused and process-oriented company, Valleysoft stands as a vendor neutral and capability rich professional organization. Our maturity in quality delivery and operational discipline shows through our work. Our operational maturity enables us to provide high-quality services with repeatable and predictable results at optimized efficiency in both level of efforts and economic model. As a result, we are able to deliver to our clients world-class services at best values.
