Principal Data Engineer - R01560587

Posted 4 Days Ago
Be an Early Applicant
San Francisco, CA
Hybrid
140-150 Annually
Expert/Leader
Information Technology
The Role
Design and implement scalable data architectures using Snowflake, optimize performance, develop data pipelines in Python, manage AWS data solutions, and ensure data security with best practices.
Summary Generated by Built In
Principal Data Engineer

Primary Skills

  • Snowflake data architecture and data engineering
  • ETL Fundamentals, Zero Copy Cloning, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Snowflake Data Exchange, Time Travel and Fail Safe, Snowpipe, SnowSQL, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures

Job requirements


  • Experience Range: 12 - 15 years of experience, including significant hands-on expertise in Snowflake data architecture and data engineering

  • Key Responsibilities:
  • Design and implement scalable Snowflake data architectures to support enterprise data warehousing and analytics needs
  • Optimize Snowflake performance through advanced tuning, warehousing strategies, and efficient data sharing solutions
  • Develop robust data pipelines using Python and DBT, including modeling, testing, macros, and snapshot management
  • Implement and enforce security best practices such as RBAC, data masking, and row-level security across cloud data platforms
  • Architect and manage AWS-based data solutions leveraging S3, Redshift, Lambda, Glue, EC2, and IAM for secure and reliable data operations
  • Orchestrate and monitor complex data workflows using Apache Airflow, including DAG design, operator configuration, and scheduling
  • Utilize version control systems such as Git to manage codebase and facilitate collaborative data engineering workflows
  • Integrate and process high-volume data using Apache ecosystem tools such as Spark, Kafka, and Hive, with an understanding of Hadoop environments

  • Required Skills:
  • Advanced hands-on experience with Snowflake, including performance tuning and warehousing strategies
  • Expertise in Snowflake security features such as RBAC, data masking, and row-level security
  • Proficiency in advanced Python programming for data engineering tasks
  • In-depth knowledge of DBT for data modeling, testing, macros, and snapshot management
  • Strong experience with AWS services including S3, Redshift, Lambda, Glue, EC2, and IAM
  • Extensive experience designing and managing Apache Airflow DAGs and scheduling workflows
  • Proficiency in version control using Git for collaborative development
  • Hands-on experience with Apache Spark, Kafka, and Hive
  • Solid understanding of Hadoop ecosystem
  • Expertise in SQL (basic and advanced), including SnowSQL, PLSQL, and T-SQL
  • Strong requirement understanding, presentation, and documentation skills; ability to translate business needs into clear, structured functional/technical documents and present them effectively to stakeholders.

  • Preferred Skills:
  • Experience with Salesforce Data Cloud integration
  • Familiarity with data cataloging tools such as Alation
  • Exposure to real-time streaming architectures
  • Experience working in multi-cloud environments
  • Knowledge of DevOps or DataOps practices
  • Certifications in data cloud technologies

  • Desired Qualifications:
  • Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field
  • Relevant certifications in Snowflake, AWS, or data engineering technologies are highly desirable

Top Skills

Apache Airflow
Spark
AWS
Dbt
Ec2
Git
Glue
Hadoop
Hive
Iam
Kafka
Lambda
Python
Redshift
S3
Snowflake
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Chennai
2,676 Employees
Year Founded: 2014

What We Do

Brillio is the leader in global digital business transformation, applying technology with a human touch. We help businesses define internal and external transformation objectives, and translate those objectives into actionable market strategies using proprietary technologies. With 2600+ experts and 13 offices worldwide, Brillio is the ideal partner for enterprises that want to quickly increase their core business productivity, and achieve a competitive edge, with the latest digital solutions.

Similar Jobs

Sendbird Logo Sendbird

Lead Threat Detection and Response Engineer

Digital Media • Mobile • Software • Conversational AI
Easy Apply
Hybrid
San Mateo, CA, USA
240 Employees
225K-260K Annually

Collectors Logo Collectors

Intermediate Customer Care Representative, PSA Vault or eBay (Work Onsite)

Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
In-Office
Santa Ana, CA, USA
2246 Employees
20-22 Hourly

Collectors Logo Collectors

Senior Manager, CRM (Marketplace)

Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Remote or Hybrid
US
2246 Employees
133K-177K Annually

Collectors Logo Collectors

Director, Finance & Strategy (Operations)

Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Hybrid
2 Locations
2246 Employees
173K-243K Annually

Similar Companies Hiring

Axle Health Thumbnail
Logistics • Information Technology • Healthtech • Artificial Intelligence
Santa Monica, CA
19 Employees
Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account