Senior Data Engineer

Posted 3 Days Ago
Be an Early Applicant
2 Locations
Remote
Senior level
Information Technology • Software
The Role
Build and maintain petabyte-scale ETL/ELT pipelines and data infrastructure using Databricks, AWS, Snowflake, Python, SQL, and Airflow. Architect batch and real-time workflows, improve data quality and governance, implement testing, lineage, metadata management, and CI/CD, and apply AI tools for anomaly detection. Lead technical design decisions, mentor junior engineers, and collaborate cross-functionally to translate business needs into scalable technical solutions.
Summary Generated by Built In

M Science is a data-driven research and analytics firm, uncovering new insights for leading financial institutions and corporations. We come to work every day to create actionable insights from alternative data. M Science is revolutionizing research, discovering new data sets and pioneering methodologies to provide actionable intelligence. Our research teams have decades of experience working with massive amounts of unstructured data in near real-time to discern critical insights that help clients make smarter, more informed decisions. We combine the best of finance, data and technology to create a truly unique value proposition for both financial services firms and major corporations.

We're looking for a Senior Data Engineer who is passionate about building robust, scalable data infrastructure and pipelines. You'll work with petabytes of data daily using cutting-edge technologies including Databricks, SQL, Python, Airflow, and modern AI development tools. This role requires someone who can architect solutions, mentor junior engineers, and drive technical excellence across our data platform.

NOTE: This role requires flexible working hours to ensure at least 2 hours of overlap with colleagues based on both the US East Coast and West Coast. Expected working schedule: 12:00–20:00 CET.

Responsibilities:
  • Design, build, and maintain scalable ETL/ELT pipelines processing petabytes of data;
  • Architect data solutions using modern cloud technologies (AWS, Databricks, Snowflake);
  • Implement real-time and batch processing workflows using Apache Airflow;
  • Optimize data storage and retrieval patterns for analytical workloads;
  • Implement comprehensive data quality frameworks and monitoring systems;
  • Establish data governance standards and best practices;
  • Build automated testing and validation for data pipelines;
  • Develop data lineage and metadata management solutions;
  • Lead technical design reviews and architecture decisions;
  • Mentor junior data engineers and promote best practices;
  • Drive adoption of modern development practices including CI/CD for data pipelines;
  • Leverage AI coding assistants (Cursor, Claude, GitHub Copilot) to accelerate development;
  • Implement AI-driven data quality checks and anomaly detection;
  • Stay current with emerging AI tools and their applications in data engineering.
Requirements:
  • 3-8 years of data engineering experience;
  • Expert-level SQL - Complex queries, performance optimization, window functions;
  • Advanced Python - Object-oriented programming, async/await, data processing libraries;
  • Apache Airflow - DAG development, custom operators, workflow orchestration;
  • Databricks - Spark optimization, Delta Lake, Unity Catalog governance;
  • Cloud Platforms - AWS (S3, EMR, Lambda, Glue) or equivalent;
  • Data Modeling - Dimensional modeling, data vault, modern data stack patterns;
  • Experience mentoring junior engineers and leading technical initiatives;
  • Strong communication skills for cross-functional collaboration;
  • Experience with Agile methodologies and project management;
  • Ability to translate business requirements into technical solutions.
Will be a plus:
  • Experience in financial services, fintech, or data intelligence companies;
  • Background in consumer retail, digital media, or technology verticals;
  • Advanced degree in Computer Science, Statistics, Mathematics, or related field.
What we offer:
  • 20 days of vacation;
  • Public holidays;
  • Mobilization reservation available upon successful completion of the probation period (for Ukrainian colleagues);
  • The exchange of experience and work with talented colleagues;
  • Last but not least - valuable compensation for your efforts.

Skills Required

  • 3-8 years of data engineering experience
  • Expert-level SQL, including complex queries, performance optimization, and window functions
  • Advanced Python, including object-oriented programming, async/await, and data processing libraries
  • Apache Airflow experience with DAG development, custom operators, and workflow orchestration
  • Databricks experience with Spark optimization, Delta Lake, and Unity Catalog governance
  • AWS experience, including S3, EMR, Lambda, and Glue, or equivalent cloud platforms
  • Data modeling experience, including dimensional modeling, data vault, and modern data stack patterns
  • Experience mentoring junior engineers and leading technical initiatives
  • Strong communication skills for cross-functional collaboration
  • Experience with Agile methodologies and project management
  • Ability to translate business requirements into technical solutions
  • Experience in financial services, fintech, or data intelligence companies
  • Background in consumer retail, digital media, or technology verticals
  • Advanced degree in Computer Science, Statistics, Mathematics, or a related field
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Kadima
294 Employees

What We Do

Globaldev Group provides end-to-end software development services and builds skillful teams of specialists to fuel your business’ growth. Leveraging our extensive 12-year background and deep industry knowledge, we have established ourselves as a reliable partner for numerous enterprises, SMEs, and startups. Globaldev Group is an ISO/IEC 27001 certified company. ▪️️ Global Teams ▪️ Globaldev offers R&D team extensions to both emerging technology companies and global corporations. Empowered by our global talent pool, we excel at connecting our clients with high-skilled specialists. Hiring, onboarding, and continuous management are all included in our comprehensive set of services, enabling our clients to quickly scale their teams and achieve their product development and implementation goals. ▪️ Global Engineering ▪️ - Obtain a custom-designed solution from scratch - Scale or enhance your current software infrastructure - Stay ahead with the latest cutting-edge technologies - Access a comprehensive range of services from a single vendor As a full-stack development company, we are equipped to fulfill all your business requirements. Whether it's product discovery, proof of concept, UX design, or development, Globaldev serves as your all-in-one solution provider.

Similar Jobs

AeroVect Logo AeroVect

Senior Data Engineer

Aerospace • Automation
In-Office or Remote
12 Locations
23 Employees
In-Office or Remote
Warsaw, Warszawa, Masovian, POL
1516 Employees

Benjamin Logo Benjamin

Senior Data Engineer

Information Technology • Internet of Things • Financial Services
Remote
27 Locations
78 Employees

MARGO Logo MARGO

Senior Data Engineer

Information Technology • Consulting
In-Office or Remote
Warsaw, Warszawa, Mazowieckie, POL
358 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account