The Role
Build and maintain a centralized banking data platform, developing batch and streaming pipelines, data transformations, quality validation, reconciliation, governance, and downstream data services. Use AWS, Databricks, Spark, Delta Lake, dbt, SQL, and Python to support regulatory reporting, risk management, analytics, and enterprise applications. Troubleshoot pipeline issues, ensure traceability and access controls, and collaborate with senior engineers and banking partners in an agile environment.
Summary Generated by Built In
Overview
Under the mission of "Money Forward. Move your life forward," Money Forward aims to resolve the financial concerns and anxieties of individuals and businesses through the power of technology.
We have partnered with Sumitomo Mitsui Financial Group, Inc. and Sumitomo Mitsui Banking Corporation to establish a new company in preparation for the launch of a new digital bank.
We are currently seeking candidates for the position of Data Engineer as part of this initiative.
*Based on the press release announced on April 16, 2025.
※ This position involves employment with Money Forward, Inc., and a secondment to the new company (SMBC Money Forward Bank Preparatory Corporation). The evaluation system and employee benefits will follow the policies of Money Forward, Inc.
Responsibilities and Duties
As a Mid-level Data Engineer in the MIDAS (Management Integration & Data Analytics System) Data Platform Team, you will build from scratch and maintain the central data hub connecting most systems within one of Japan's more innovative digital banks. You will work with modern cloud-based data technologies to ingest data from various banking systems, apply complex business logic, and serve it to downstream systems for enterprise management, regulatory reporting, risk management, and many other applications. Due to the high expectations in the banking domain, you will face complex data engineering challenges including data quality, reconciliation across systems, time-critical data processing, and complete traceability. This mid-level position allows you to work with increasing independence on data pipeline development while collaborating closely with senior engineers and the technical lead for guidance on complex problems.
Requirements
Required Skills and Experience
- 5-8 years of experience in data engineering or analytics engineering
- Strong proficiency in SQL and working knowledge of Python
- Hands-on experience building data pipelines using tools like Databricks, dbt, or similar
- Experience with AWS and its object storage
- Understanding of data modeling concepts including dimensional modeling and fact/dimension tables
- Experience with data quality validation and testing
- Ability to debug and troubleshoot data pipeline issues
- Experience with version control (Git) and basic understanding of CI/CD concepts
- Understanding of basic data governance: access control and audit logging
- Good problem-solving skills and ability to work with moderate independence
- Good communication skills and willingness to ask questions when blocked
- Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field, or equivalent practical experience
Preferred Skills and Experience
While not specifically required, tell us if you have any of the following.
- Experience in financial services, fintech, or regulated industries
- Basic knowledge of banking domain concepts: core banking, payments, or regulatory reporting
- Exposure to data platforms in regulated environments (FISC Guidelines, GDPR, APPI)
- Hands-on experience with Databricks platform or AWS native data services
- Experience with performance tuning: partitioning strategies, file formats, query optimization
- Experience building REST APIs with Python (FastAPI, Flask, or similar)
- Knowledge of streaming data pipelines (Kafka, Kinesis, or similar)
- Basic experience with Terraform
- Experience with BI tools (QuickSight, Tableau, Looker, PowerBI)
- Experience with data visualization and dashboard design
- Interest in obtaining certifications (AWS Certified Data Analytics, Databricks certifications)
- Experience in AI development and/or experience in using AI tools to improve development processes.
- Money Forward recently announced our AI Strategy roadmap which focuses on improving AI-driven operational efficiencies, as well as integrating AI agents into our products to deliver better value to our users.
Language Requirements
- English: Business level
- TOEIC score of 700 or above(Note: If you have other qualifications or experiences demonstrating English proficiency, such as EIKEN Pre-1, EIKEN 2nd Grade (CSE score 1950+), TOEFL iBT 60+, IELTS 5.0+, or Cambridge FCE), feel free to discuss with us). For those without a TOEIC 700+ equivalent score, they will be asked to take a designated test during the interview process (generally after the first interview).
Technology Stack
- Cloud Infrastructure :
- AWS (primary cloud platform in Tokyo region)
- S3 for data lake storage with VPC networking for secure connectivity
- AWS IAM for security and access management
- Data Lakehouse Architecture :
- Modern lakehouse architecture using Delta Lake for ACID transactions, time-travel, and schema evolution
- Columnar storage formats (Parquet) optimized for analytics
- Bronze/Silver/Gold medallion architecture for progressive data refinement
- Partition strategies and Z-ordering for query performance
- Unity Catalog for centralized governance and metadata management
- Orchestration & Processing :
- Databricks Workflows for managed workflow orchestration
- Distributed data processing with Apache Spark on Databricks clusters
- Serverless compute and auto-scaling clusters for cost optimization
- Streaming and batch ingestion patterns with Databricks AutoLoader
- Data Transformation :
- dbt (data build tool) for SQL-based analytics engineering
- Delta Live Tables for declarative ETL pipelines with built-in data quality
- SQL and Python for data transformations
- Incremental materialization strategies for efficiency
- Query & Analytics :
- Databricks SQL for high-performance analytics queries
- Serverless and auto-scaling SQL warehouses for variable workloads
- Auto-scaling compute for variable workloads
- Query result caching and optimization
- REST APIs for data serving to downstream consumers
- Data Quality & Governance :
- Automated data quality with Delta Live Tables expectations and Great Expectations
- Cross-system reconciliation and validation logic
- Fine-grained access control with column/row-level security using Unity Catalog
- Automated data lineage tracking for regulatory compliance
- Audit logging and 10-year data retention policies
- Business Intelligence :
- Amazon QuickSight and/or Databricks SQL Dashboards
- Integration with enterprise BI tools (Tableau, PowerBI, Looker)
Tools Used
- Version Control : GitHub
- CI/CD : GitHub Actions
- Infrastructure as Code : Terraform
- Monitoring : Databricks monitoring, AWS CloudWatch integration
- AI-Assisted Development : Claude Code, GitHub Copilot, ChatGPT
Development Structure
We operate in a small, agile team while collaborating closely with partners from the banking industry. The MIDAS team is growing rapidly, aiming for more than 10 data engineers within this year.
Skills Required
- 5–8 years of experience in data engineering or analytics engineering
- Strong proficiency in SQL
- Working knowledge of Python
- Hands-on experience building data pipelines with Databricks, dbt, or similar tools
- Experience with AWS and object storage
- Understanding of dimensional data modeling, including fact and dimension tables
- Experience with data quality validation and testing
- Ability to debug and troubleshoot data pipeline issues
- Experience with Git or other version control systems
- Basic understanding of CI/CD concepts
- Understanding of data governance, access control, and audit logging
- Good problem-solving skills and ability to work with moderate independence
- Good communication skills and willingness to ask questions when blocked
- Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field, or equivalent practical experience
- Business-level English proficiency
- TOEIC score of 700 or equivalent English qualification
- Experience in financial services, fintech, or regulated industries
- Knowledge of core banking, payments, or regulatory reporting
- Experience with regulated data platforms, FISC Guidelines, GDPR, or APPI
- Hands-on experience with Databricks or AWS native data services
- Experience with partitioning, file formats, and query performance optimization
- Experience building Python REST APIs using FastAPI, Flask, or similar
- Knowledge of streaming data pipelines using Kafka, Kinesis, or similar
- Basic experience with Terraform
- Experience with QuickSight, Tableau, Looker, or Power BI
- Experience with data visualization and dashboard design
- Interest in obtaining AWS Data Analytics or Databricks certifications
- Experience in AI development or using AI tools to improve development processes
Money Forward, Inc. Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Money Forward, Inc. and has not been reviewed or approved by Money Forward, Inc..
-
Healthcare Strength — Health coverage is considered comprehensive, with company-paid checkups, gynecological exams, flu vaccinations, and 24/7 medical advice including telemedicine and house-call options.
-
Flexible Benefits — Work flexibility is highlighted through remote work for all employees, flextime or discretionary work systems, and shorter-hours options that support varied needs.
-
Equity Value & Accessibility — Equity participation is described as attractive, featuring an employee stock ownership plan with a company incentive equal to 15% of contributions and tax-advantaged savings options.
Money Forward, Inc. Insights
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Money Forward, Inc. is a Japanese SaaS financial technology company that develops personal finance management tools and cloud-based services for individuals, businesses, accounting professionals, and financial institutions. Its platform supports household finance, accounting, tax, expense management, payments, and other back-office operations. The company serves consumer and corporate markets through integrated digital products and aims to operate as a comprehensive technology-driven financial platform.
