Data Engineer

Posted 3 Days Ago
Be an Early Applicant
2 Locations
Remote
Senior level
Information Technology • Software
The Role
Build and optimize large-scale data pipelines and datasets for analytics, experimentation, and machine learning. Responsibilities include cleansing and structuring raw data, implementing QA and anomaly detection, developing reusable workflows and frameworks, managing repositories, automating production pipelines, improving logging, troubleshooting infrastructure issues, documenting processes, conducting code reviews, and mentoring team members. The role requires collaboration with engineering, product, analyst, and infrastructure teams.
Summary Generated by Built In

M Science is a data-driven research and analytics firm, uncovering new insights for leading financial institutions and corporations. We come to work every day to create actionable insights from alternative data. M Science is revolutionizing research, discovering new data sets and pioneering methodologies to provide actionable intelligence. Our research teams have decades of experience working with massive amounts of unstructured data in near real-time to discern critical insights that help clients make smarter, more informed decisions. We combine the best of finance, data and technology to create a truly unique value proposition for both financial services firms and major corporations.

We’re looking for exceptional data engineers who will work with petabytes of data daily using diverse technologies like Databricks, SQL, Python, Airflow, and others. You will be expected to effectively partner with upstream engineering teams and downstream consumers, including analysts and product engineers. In this role, you will build datasets to support analytics, experimentation, and machine learning. Specifically, you will build out standards for pipelining at scale, including establishing common operators, workflows/DAGs, and optimizing existing products.

NOTE: This role requires flexible working hours to ensure at least 2 hours of overlap with colleagues based on both the US East Coast and West Coast. Expected working schedule: 12:00–20:00 CET.

Responsibilities:
  • Manage and improve pipeline for cleansing, filtering, and structuring raw datasets for the purposes of company and customer analysis.
  • Implement QA procedures to proactively identify data anomalies and issues.
  • Implement new products and features created by analyst teams using best practices.
  • Work with other team members and internal stakeholders on infrastructure projects, documentation, QA and code reviews.
  • Build and manage Repos.
  • Continuously seek opportunities to standardize code and automate production pipelines.
  • Create and contribute to frameworks that improve the efficacy of logging data, while working with infrastructure to triage issues and resolve.
  • Mentor team members by giving/receiving actionable feedback.
Requirements:
  • 3-7 years of experience as a data engineer.
  • Preference given to those that have worked in a similar type role within a data intelligence company or within our desired verticals including consumer retail & brands, digital media and technology.
  • Expertise in data engineering in a cloud environment (Python, Databricks, AWS, Airflow, Snowflake, SQL).
  • SQL & Python required.
  • Working knowledge of PySpark and distributed computing.
  • Strong people and management skills to interact with product managers and data analysts.
  • Familiarity with software development methods such as Scrum and TDD.
  • General project management skills.
  • Ability to clearly articulate project plans, technical requirements, methodologies, and takeaways to both technical and non-technical stakeholders.
  • Bachelor’s or higher degree, or significant experience in Statistics, Mathematics, Computer Science, or a similar quantitative discipline.
  • Ability to thrive in a culture of quality and personal accountability.
What we offer:
  • 20 days of vacation.
  • Public holidays.
  • Mobilization reservation available upon successful completion of the probation period (for Ukrainian colleagues).
  • The exchange of experience and work with talented colleagues.
  • Last but not least - valuable compensation for your efforts.

Skills Required

  • 3-7 years of experience as a data engineer
  • Experience in a similar role within a data intelligence company or relevant verticals such as consumer retail, brands, digital media, or technology
  • Expertise in cloud-based data engineering using Python, Databricks, AWS, Airflow, Snowflake, and SQL
  • SQL and Python proficiency
  • Working knowledge of PySpark and distributed computing
  • Strong people and management skills for interacting with product managers and data analysts
  • Familiarity with software development methods such as Scrum and TDD
  • General project management skills
  • Ability to articulate project plans, technical requirements, methodologies, and takeaways to technical and non-technical stakeholders
  • Bachelor's or higher degree, or significant experience in Statistics, Mathematics, Computer Science, or a similar quantitative discipline
  • Ability to work in a culture of quality and personal accountability
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Kadima
294 Employees

What We Do

Globaldev Group provides end-to-end software development services and builds skillful teams of specialists to fuel your business’ growth. Leveraging our extensive 12-year background and deep industry knowledge, we have established ourselves as a reliable partner for numerous enterprises, SMEs, and startups. Globaldev Group is an ISO/IEC 27001 certified company. ▪️️ Global Teams ▪️ Globaldev offers R&D team extensions to both emerging technology companies and global corporations. Empowered by our global talent pool, we excel at connecting our clients with high-skilled specialists. Hiring, onboarding, and continuous management are all included in our comprehensive set of services, enabling our clients to quickly scale their teams and achieve their product development and implementation goals. ▪️ Global Engineering ▪️ - Obtain a custom-designed solution from scratch - Scale or enhance your current software infrastructure - Stay ahead with the latest cutting-edge technologies - Access a comprehensive range of services from a single vendor As a full-stack development company, we are equipped to fulfill all your business requirements. Whether it's product discovery, proof of concept, UX design, or development, Globaldev serves as your all-in-one solution provider.

Similar Jobs

Rain Logo Rain

Data Engineer

Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3 • Infrastructure as a Service (IaaS)
Remote or Hybrid
30 Locations
100 Employees
128K-167K Annually

Rain Logo Rain

Platform Engineer

Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3 • Infrastructure as a Service (IaaS)
In-Office or Remote
30 Locations
100 Employees
136K-170K Annually

Addepto Logo Addepto

Data Engineer

Artificial Intelligence • Big Data • Computer Vision • Machine Learning • Consulting • Conversational AI • Generative AI
In-Office or Remote
Warszawa, Mazowieckie, POL
55 Employees

Capco Logo Capco

Data Engineer

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
Poland
6000 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account