Senior Data Engineer

Posted 21 Days Ago
Be an Early Applicant
Warszawa, Mazowieckie
5-7 Years Experience
Fintech • Payments • Financial Services
The Role
Seeking a Senior Data Engineer with experience in building complex data pipelines, working with Apache Airflow, Spark, Python, SQL and noSQL data stores, deployment automation tools, and cloud environments. Responsibilities include designing and building data pipelines, optimizing data stores, and collaborating with data analysts and UX researchers.
Summary Generated by Built In

We are looking for you, if you:

  • have hands-on experience building complex data pipelines,

  • have experience with Apache Airflow, Spark, Python,

  • have experience in setting up and optimizing both SQL and noSQL data stores (MS-SQL, Hive), as well as familiarity with object storage services (e.g., S3),

  • have experience with deployment and provisioning automation tools (e.g., Docker, Kubernetes, CI/CD).

You'll get extra points for:

  • experience working in cloud environment (e.g., Azure DevOps, GCP),

  • Extensive experience with Spark, Hadoop, SQL & relational databases, data models and ETL pipelines

  • experience in building GitLab CICD pipelines

  • experience in managing and further developing distributed systems and clusters for batch processing,

  • knowledge of MLOps architecture and practices,

  • Experience with modern data modeling concepts and large scale data warehousing architecture.

Your responsibilities:

Your passion is to work with the latest concepts and technologies in the field of Data Engineering. As an engineer, you will be responsible to design and build the data pipelines for one of many use cases catering stakeholder requirements such as which clients have the worst carbon emission footprint – so ING can decide to discontinue doing business with them, collaborate with the data analysts and UX researchers to create the best user experience and insights for our users. Your day-to-day activities can look like this: implementing new features in Kedro/PySpark, testing them in Apache Airflow, deploying it in our in-house platform running on Kubernetes, as well as optimizing the data in the permanent data store.

Information about team:

The Wholesale Banking Advanced Analytics team is a team of 100+ people that has the mission to make Wholesale Banking in ING data-driven. We do this by combining UX research and engineering with data science to deliver high-value solutions and products for our organization. We work in a fun and creative environment, and we’re dedicated to bringing out the best in both each other and our projects. We have offices in Amsterdam (main office), Warsaw, Katowice, Bucharest and Manila.

The role naming convention in the global ING job architecture will be “Engineer IV”.

Top Skills

Python
The Company
Amsterdam, North Holland
65,710 Employees
On-site Workplace

What We Do

ING is a pioneer in digital banking and on the forefront as one of the most innovative banks in the world. As ING, we have a clear purpose that represents our conviction of people’s potential. We don’t judge, coach, or tell people how to live their lives. However big or small, modest or grand, we empower people and businesses to realise their vision for a better future. We made the promise to make banking frictionless, removing barriers to progress, and make people confident in their financial decisions. As a global bank we have a huge opportunity – and responsibility – to make an impact for the better. We can play a role by financing change, sharing knowledge, and innovating. Being sustainable is in all the choices we make—as a lender, as a partner and through the services we offer our customers

Jobs at Similar Companies

Energy CX Logo Energy CX

Talent Acquisition Specialist

Greentech • Professional Services • Business Intelligence • Consulting • Energy • Financial Services • Utilities
Easy Apply
Chicago, IL, USA
55 Employees

MassMutual India Logo MassMutual India

BI Support Developer

Big Data • Fintech • Information Technology • Insurance • Financial Services
Hyderabad, Telangana, IND

TBD Logo TBD

Staff Engineer

Blockchain • Fintech • Financial Services • Cryptocurrency
Remote
Hybrid
New York, NY, USA
190 Employees
240K-359K Annually

Similar Companies Hiring

TBD Thumbnail
Fintech • Financial Services • Cryptocurrency • Blockchain
New York, NY
190 Employees
Energy CX Thumbnail
Utilities • Professional Services • Greentech • Financial Services • Energy • Consulting • Business Intelligence
Chicago, IL
55 Employees
MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account