Principal Architect - Databricks

Posted 7 Days Ago
Be an Early Applicant
Hiring Remotely in Dallas, TX, USA
In-Office or Remote
Expert/Leader
Big Data • Analytics • Business Intelligence • Big Data Analytics
The Role
Lead design and implementation of a Databricks-driven data ecosystem, including lakehouse/EDW, IoT and streaming ingestion pipelines, ILM, global data governance, and dataset creation for advanced analytics.
Summary Generated by Built In

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best analytics global consulting team in the world.

Job Summary

We are seeking a highly skilled Principal Data Architect to design and implement our next-generation data ecosystem. You will lead the technical strategy for end-to-end data management, data warehousing, and IoT ingestion pipelines. The ideal candidate brings mastery in cloud data platforms (Azure or AWS) and advanced data governance.

Key Responsibilities

Data Architecture: Design Databricks-driven enterprise data warehousing (EDW), lakehouse, and business intelligence (BI) systems.

IoT & Stream Ingestion: Build scalable pipelines using Azure Hub, Device SDK, DPS, and Stream Analytics.

Data Management: Implement information lifecycle management (ILM) from data ingestion to archiving.

Data Strategy: Define, build, and enforce global data governance and master data management practices.

Dataset Creation: Extract and manipulate unstructured data into connected datasets for advanced analytics.


Requirements
  • Core Cloud Data Platform (Must Have)
    • Databricks: Strong proficiency in building optimized spark pipelines, delta lakes, and lakehouses.
  • Cloud Ecosystem (Option A: Azure Suite)
    • IoT Infrastructure: Azure Hub, Device SDK, Device Provisioning Services (DPS), and Device Twins.
    • Compute & Storage: Azure Functions, Cosmos DB, and Azure Stream Analytics.
  • Cloud Ecosystem (Option B: AWS Alternative)
    • IoT Infrastructure: AWS IoT Core, IoT Device Management, and IoT Device Defender.
    • Compute & Storage: AWS Lambda, DynamoDB, Amazon Kinesis, and EMR.
  • Data Engineering & Governance
    • BI & EDW: Deep expertise in enterprise data warehousing and business intelligence tools.
    • Data Modeling: Proven ability to manage both structured and unstructured data assets.
  • Qualifications & Soft Skills
    • Communication: Ability to translate complex technical concepts clearly to diverse technical teams.
    • Collaboration: Demonstrated teamwork skills with a proven track record in cross-functional environments.
    • Experience: Extensive background in end-to-end data management principles and data lifecycle execution.

Good to have-Experience in architecting and building Azure IoT platforms/apps with good exposure to containerization and server less architecture.


Benefits

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.

Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.

Skills Required

  • Strong proficiency in Databricks including optimized Spark pipelines, Delta Lake, and lakehouse architecture.
  • Experience designing enterprise data warehousing (EDW) and business intelligence systems.
  • Experience building IoT and streaming ingestion pipelines (Azure IoT Hub, Device SDK, DPS, Device Twins, Azure Stream Analytics).
  • Experience with Azure compute and storage services (Azure Functions, Cosmos DB).
  • Experience with AWS IoT and analytics alternatives (AWS IoT Core, IoT Device Management, IoT Device Defender, AWS Lambda, DynamoDB, Amazon Kinesis, EMR).
  • Proven data modeling skills for structured and unstructured data.
  • Experience implementing information lifecycle management (ingestion through archiving).
  • Define and enforce global data governance and master data management practices.
  • Strong communication and cross-functional collaboration skills.
  • Extensive background in end-to-end data management principles and execution.
  • Experience with containerization and serverless architectures (good to have).

Tiger Analytics Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Tiger Analytics and has not been reviewed or approved by Tiger Analytics.

  • Fair & Transparent Compensation Feedback suggests pay is viewed as fair and market-aligned for many roles and geographies. Consistent, on-time pay and competitive packages in key markets reinforce a generally positive baseline.
  • Healthcare Strength Feedback suggests U.S. medical coverage is strong, with administration via a known benefits platform and plan options seen positively. Health insurance is often regarded as a bright spot within the package.
  • Leave & Time Off Breadth Feedback suggests generous PTO, paid sick days and holidays, and flexible PTO alongside remote-work options. These elements indicate broad time-off provisions available on paper.

Tiger Analytics Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Bengaluru, Bengaluru
5,000 Employees
Year Founded: 2011

What We Do

Tiger Analytics is a global leader in AI and Analytics, helping Fortune 1000 companies solve their toughest challenges. We offer fullstack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission to push the boundaries of what AI and analytics can do to help enterprises navigate uncertainty and move forward decisively. Our purpose is to provide certainty to shape a better tomorrow. Our team of 4000+ technologists and consultants are based in the US, Canada, the UK, India, Singapore, and Australia, working closely with clients across CPG, Retail, Insurance, BFS, Manufacturing, Life Sciences, and Healthcare. We are Great Place to Work-Certified™ and have been recognized by analyst firms such as Forrester, Gartner, Everest, ISG, HFS, and others. Ranked among the ‘Best’ and ‘Fastest Growing’ analytics firms lists by Inc., Financial Times, Economic Times and Analytics India Magazine. In India, our offices are located in Chennai, Hyderabad and Bangalore.

Similar Jobs

Collectors Logo Collectors

Senior Software Engineer

Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Remote or Hybrid
US
2246 Employees
141K-229K Annually

Collectors Logo Collectors

Senior Software Engineer

Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Remote or Hybrid
US
2246 Employees
141K-229K Annually

PwC Logo PwC

Oracle Fusion Field Service Implementation Senior Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
64 Locations
370000 Employees
124K-280K Annually

PwC Logo PwC

Product Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
62 Locations
370000 Employees
91K-322K Annually

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account