Lead Architect

Posted 2 Days Ago
Be an Early Applicant
New York, NY, USA
In-Office
150K-200K Annually
Senior level
Artificial Intelligence • Consulting
The Role
Lead Architect will design and deliver large-scale, cloud-native data platforms on Azure and Snowflake, build ETL/ELT pipelines with ADF and Databricks, optimize Spark and Snowflake performance, integrate diverse data sources, implement governance and CI/CD, and enable analytics and ML/AI use cases for enterprise clients.
Summary Generated by Built In

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets; an ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work® Institute and recognized as a 'Cool Vendor' and a 'Vendor to Watch' by Gartner.
 

Please visit Fractal | Intelligence for Imagination for more information about Fractal.
 

Role Overview

We are looking for a Lead Architect – Azure & AI to join our growing data engineering practice. In this role, you will architect and deliver large-scale, cloud-native data solutions on Azure and Snowflake, enabling advanced analytics, ML/AI workloads, and enterprise data governance. You will work closely with cross-functional stakeholders to design resilient, scalable data platforms that drive business impact for Fortune 500 clients.
 

Key Responsibilities

  • Design, build, and optimize end-to-end data pipelines leveraging Azure Data Factory, Databricks, and Snowflake for large-scale data ingestion, transformation, and loading.
  • Develop and maintain ETL/ELT workflows for structured, semi-structured (JSON, XML, Parquet), and unstructured data from on-premises systems, cloud platforms, APIs, flat files, RDBMS, and streaming sources.
  • Write efficient, production-grade code in Python (PySpark) and SQL for advanced data transformations, workflow orchestration, and automation.
  • Architect scalable Snowflake solutions including schema design, Virtual Warehouse configuration, query performance tuning, and cost-efficient data storage and retrieval strategies.
  • Leverage Azure Synapse and Snowflake for advanced analytics and data warehouse solutions, including MPP (Massively Parallel Processing) architectures.
  • Partner with business and technology stakeholders to design DataMart and Data Lake solutions supporting analytics, reporting, and ML/AI use cases.
  • Implement data quality frameworks, governance policies, lineage tracking, and metadata management across multiple environments.
  • Optimize Spark workloads on Databricks for distributed processing at scale; deploy and manage reusable Notebooks and Jobs in production.
  • Integrate NoSQL stores (Cosmos DB, MongoDB, etc.) and build hybrid solutions spanning Snowflake and Azure services.
  • Leverage Azure Cognitive Search and Elasticsearch for indexing and unstructured data search integration.
  • Drive DevOps best practices including CI/CD pipelines, source control (Git), and automated deployments via Azure DevOps and Jenkins.
  • Ensure adherence to enterprise data security, cataloging, and access-control policies across all data assets.
     

Required Skills

  • 8+ years of experience as a Data Engineer with deep expertise in Azure Data Services (ADF, Synapse, Databricks) and Snowflake.
  • Strong background in the Insurance domain with hands-on Azure Data Engineering experience (ADB + PySpark/Python + Snowflake).
  • Proficiency in SQL (complex queries, stored procedures, functions, views) and Python/PySpark programming.
  • Proven experience designing and implementing ETL/ELT pipelines with Azure Data Factory and orchestrating complex, multi-step workflows.
  • Comprehensive Snowflake expertise: Star/Snowflake schema design, role-based security, performance tuning, query optimization, and pipeline features (Snowpipe, Tasks, Streams).
  • Solid understanding of Spark architecture with hands-on experience in performance tuning, data partitioning, and distributed processing.
  • Experience integrating data from RDBMS, SFTP, APIs, Kafka, Event Hub, and big-data platforms (Hadoop, Hive).
  • Familiarity with NoSQL database design (Cosmos DB or equivalent) and streaming data pipeline patterns.
  • Knowledge of ML/AI data preparation workflows; ability to refactor traditional ML code for distributed execution on Spark/Databricks.
  • Strong command of Agile methodologies, DevOps practices, and CI/CD deployment frameworks.

Preferred Skills

  • Exposure to data search and indexing technologies such as Elasticsearch or Azure Cognitive Search.
  • Azure Data Engineer Associate certification (DP-200/201/203) or SnowPro Core/Advanced Architect certification.
  • Experience working on data platforms serving analytics and AI use cases in large enterprise environments.

Pay

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is: $150,000 – $200,000. In addition, you may be eligible for a discretionary bonus for the current performance period.
 

Benefits

As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company. In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a "free time" PTO policy, allowing you the flexibility to take time needed for either sick time or vacation.
 

Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Hiring Related Queries

India: [email protected]

Outside India: [email protected]

This inbox does not process resume submissions. All applications must be made through posted job openings

Not the right fit?  Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!

Skills Required

  • 8+ years experience as a Data Engineer with deep expertise in Azure Data Services (ADF, Synapse, Databricks) and Snowflake
  • Strong background in the Insurance domain with hands-on Azure Data Engineering (ADB + PySpark/Python + Snowflake)
  • Proficiency in SQL (complex queries, stored procedures, functions, views)
  • Proficiency in Python and PySpark for production-grade data transformations and orchestration
  • Proven experience designing and implementing ETL/ELT pipelines using Azure Data Factory and orchestrating multi-step workflows
  • Comprehensive Snowflake expertise including schema design, role-based security, performance tuning, Snowpipe, Tasks, and Streams
  • Solid understanding of Spark architecture with hands-on performance tuning, partitioning, and distributed processing on Databricks
  • Experience integrating data from RDBMS, SFTP, APIs, Kafka, Event Hub, and big-data platforms (Hadoop, Hive)
  • Familiarity with NoSQL database design (Cosmos DB or equivalent such as MongoDB) and streaming pipeline patterns
  • Knowledge of ML/AI data preparation workflows and ability to refactor ML code for distributed execution on Spark/Databricks
  • Experience implementing data quality frameworks, governance policies, lineage tracking, and metadata management
  • Strong command of Agile methodologies, DevOps practices, CI/CD pipelines, source control (Git), and automated deployments (Azure DevOps, Jenkins)
  • Exposure to data search and indexing technologies such as Elasticsearch or Azure Cognitive Search
  • Azure Data Engineer Associate (DP-200/201/203) or SnowPro Core/Advanced certification
  • Experience working on data platforms serving analytics and AI use cases in large enterprise environments

Fractal Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Fractal and has not been reviewed or approved by Fractal.

  • Healthcare Strength Health coverage includes medical, dental, and vision along with tax‑advantaged accounts and EAP in the U.S., indicating a broad core package. Feedback suggests core protections exist across regions, though specifics can vary by location.
  • Leave & Time Off Breadth Time‑off programs include generous PTO, paid holidays and sick time, paid volunteer time, and sabbaticals in some areas. Some accounts also describe manager‑approved or flexible PTO approaches alongside hybrid/WFH latitude.
  • Flexible Benefits Work arrangements commonly include remote/hybrid options and flexible schedules. Flexibility is frequently highlighted as part of the overall value proposition.

Fractal Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
5,262 Employees

What We Do

Fractal is one of the most prominent players in the Artificial Intelligence space. Fractal's mission is to power every human decision in the enterprise and brings AI, engineering, and design to help the world's most admired Fortune 500® companies. Fractal's products include Qure.ai to assist radiologists in making better diagnostic decisions, Crux Intelligence to assists CEOs, and senior executives make better tactical and strategic decisions, Theremin.ai to improve investment decisions, and Eugenie.ai to find anomalies in high-velocity data & Samya.ai to drive next-generation Enterprise Revenue Growth Management. Fractal has more than 3,000 employees across 16 global locations, including the United States, UK, Ukraine, India, Singapore, and Australia. Fractal has consistently been rated as India's best companies to work for, by The Great Place to Work® Institute, featured as a leader in Customer Analytics Service Providers Wave™ 2021, Computer Vision Consultancies Wave™ 2020 & Specialized Insights Service Providers Wave™ 2020 by Forrester Research, and recognized as an "Honorable Vendor" in 2021 Magic Quadrant™ for data & analytics by Gartner.

Similar Jobs

Celonis Logo Celonis

Architect

Big Data • Information Technology • Productivity • Software • Analytics • Business Intelligence • Consulting
Hybrid
New York, NY, USA
3000 Employees
162K-191K Annually

Braze Logo Braze

Architect

Marketing Tech • Mobile • Software
Easy Apply
Hybrid
New York City, NY, USA
2000 Employees
103K-193K Annually

Bright Vision Technologies Logo Bright Vision Technologies

Architect

Artificial Intelligence • Information Technology • Software • Consulting
In-Office
2 Locations
53 Employees
175K-200K Annually

Citi Logo Citi

Architect

Fintech • Financial Services
In-Office
2 Locations
223850 Employees
177K-265K Annually

Similar Companies Hiring

Legora Thumbnail
Artificial Intelligence • Legal Tech • Software
Chicago, Illinois
700 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account