Staff Engineer – Data Platform and Lakehouse

Posted 17 Days Ago
Hiring Remotely in New York, NY
In-Office or Remote
180K-220K Annually
Senior level
Artificial Intelligence • Information Technology • Business Intelligence
The Role
Lead the design and implementation of a cloud-native Data Platform for AI and analytics, collaborating with cross-functional teams to enhance product offerings.
Summary Generated by Built In
Company Description

Curinos empowers financial institutions to make better, faster and more profitable decisions through industry-leading proprietary data, technologies and insights. With decades-long expertise in the financial services industry and a relentless focus on the future, Curinos technology and analytics ecosystem allows clients to anticipate customer needs and optimize their go-to market decisions in an increasingly competitive market.

Curinos operates in a hybrid/remote model, and this position is fully remote in the United States or hybrid in the Greater New York, Boston or Chicago metropolitan areas.

Job Description

We are seeking and experienced  Staff Engineer – Data Platform and Lakehouse  to lead the design and implementation of our cloud-native Data Platform  that support AI, advanced analytics, and machine learning applications in our ecosystem of B2B SaaS applications in the FinTech vertical You’ll work with a diverse team of talented engineers, AI and ML scientists, and product managers to build our next generation data and AI platforms, support migration of products from legacy infrastructure, and help product engineering teams leverage the Data platform and Lakehouse to launch new products and build new genAI applications. As a company that specializes in data-driven insights, the reliability, scalability, and effectiveness of our data & AI platforms are integral to our product offerings.  This role requires deep technical expertise, strategic thinking, and strong collaboration across engineering, data science, and product teams.

Responsibilities:

  • Design and implement scalable, secure, and maintainable data platforms on Databricks and AWS cloud infrastructure.
  • Provide architectural leadership across engineering domains, ensuring consistency, scalability, and resilience
  • Architect distributed data processing systems using Apache Spark and optimize for performance and scalability.
  • Lead development of reusable data pipelines and workflows using Databricks Workflows.
  • Translate business objectives into platform capabilities in collaboration with Product Managers and cross-functional teams.
  • Support AI/ML initiatives through robust data engineering, including feature engineering, model deployment.
  • Champion best practices in ETL/ELT, data quality, monitoring, observability, and Agile development.
  • Drive adoption of data governance standards: access control, metadata management, lineage, and compliance.
  • Establish and maintain CI/CD pipelines and DevOps automation for data infrastructure.
  • Evaluate and integrate emerging technologies to enhance development, testing, deployment, and monitoring.

Salary Range: $180,000 -$220,000 (plus bonus)

Qualifications

Desired Skills and Expertise:

  • 15+ years of experience in software development, covering the full SDLC: ideation, design, development, testing, deployment, and support.
  • Strategic mindset, capable of aligning technical decisions with business goals and driving architectural vision.
  • Excellent collaboration and communication skills across functions, including data scientists, MLOps engineers, and product managers.
  • Advanced proficiency in Python and SQL, with a strong foundation in software engineering principles.
  • Extensive experience with distributed computing frameworks, particularly Apache Spark, including performance tuning and scalability.
  • Required hands-on experience with Databricks, including Unity Catalog, Feature Store, and Delta Live Tables.
  • Proficiency in data pipeline orchestration tools using Databricks Workflows, Airflow, or AWS Glue; Databricks required.
  • Strong command of data engineering best practices and tools, including ETL/ELT design, data quality validation, monitoring, and observability. Experience with Monte Carlo preferred.
  • Proven ability to build scalable, cloud-native data architectures on Databricks, AWS, Azure, or GCP; Databricks required.
  • Experience enabling AI/ML workloads including feature engineering, model deployment, and real-time processing.
  • Strong understanding of data governance and security, including access control, data lineage, compliance, and metadata management.

 

Additional Information

Why work at Curinos?  

  • Competitive benefits, including a range of Financial, Health and Lifestyle benefits to choose from 
  • Flexible working options, including home working, flexible hours and part time options, depending on the role requirements – please ask! 
  • Competitive annual leave, floating holidays, volunteering days and a day off for your birthday!
  • Learning and development tools to assist with your career development 
  • Work with industry leading Subject Matter Experts and specialist products 
  • Regular social events and networking opportunities 
  • Collaborative, supportive culture, including an active DE&I program 
  • Employee Assistance Program which provides expert third-party advice on wellbeing, relationships, legal and financial matters, as well as access to counselling services 

Applying: 

We know that sometimes the 'perfect candidate' doesn't exist, and that people can be put off applying for a job if they don't meet all the requirements. If you're excited about working for us and have relevant skills or experience, please go ahead and apply. You could be just what we need! 

If you need any adjustments to support your application, such as information in alternative formats, special requirements to access our buildings or adjusted interview formats please contact us at [email protected] and we’ll do everything we can to help.

Inclusivity at Curinos: 

We believe strongly in the value of diversity and creating supportive, inclusive environments where our colleagues can succeed.  As such, Curinos is proud to be an Equal Opportunity Employer. We do not discriminate on the basis of race, color, ancestry, national origin, religion, or religious creed, mental or physical disability, medical condition, genetic information, sex (including pregnancy, childbirth, and related medical conditions), sexual orientation, gender identity, gender expression, age, marital status, military or veteran status, citizenship, or other protected characteristics. 

Top Skills

Airflow
Spark
AWS
Aws Glue
Azure
Databricks
GCP
Python
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
3,741 Employees
Year Founded: 1998

What We Do

Informa is a leading international intelligence, events and scholarly research group. We're here to champion the specialist, connecting people with knowledge to help them learn more, know more and do more.

We're a FTSE 100 company with 10,000 colleagues working in over 30 countries and a presence in all major regions, including North America, South America, Asia, Europe, the Middle East and Africa.

Informa has five business divisions: Informa Markets, Informa Connect, Informa Tech, Informa Intelligence and Taylor & Francis.

We are home to hundreds of leading brands, serving businesses and professionals who work in any one of dozens of specialist markets through brands such as Citeline, Arab Health, CPhI and EBD Group in Pharma, Pharma Ingredients and Biotech; SuperReturn, EPFR and FBX in Finance; Lloyd's List in Maritime; New Hope and Natural Products Expo in Health & Nutrition; Routledge, CRC Press and F1000 Research in Academic Publishing; Black Hat in Cybersecurity; AI Summit in Artificial Intelligence; and many more.

Similar Jobs

Motive Logo Motive

Operations Manager

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Easy Apply
Remote
United States
110K-169K Annually

Atticus Logo Atticus

Senior Full-stack Engineer

Insurance • Legal Tech • Social Impact
In-Office or Remote
2 Locations
170K-200K Annually

Kustomer Logo Kustomer

Head of Demand Generation

Artificial Intelligence • Enterprise Web • Machine Learning • Natural Language Processing • Software • Conversational AI • Automation
In-Office or Remote
2 Locations

SambaSafety Logo SambaSafety

Customer Onboarding Specialist - Temporary

Insurance • Logistics • Software • Transportation • Business Intelligence
Remote or Hybrid
United States
19-22

Similar Companies Hiring

Compa Thumbnail
Software • Other • HR Tech • Business Intelligence • Artificial Intelligence
Irvine, CA
48 Employees
Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account