Lead Data Engineer - R01548769

Primary Skills

• Data Modelling Fundamentals, Data Warehousing, ETL Fundamentals, Modern Data Platform Fundamentals, PLSQL, T-SQL, Stored Procedures, Python, Snowflake Data Exchange, Snowpipe, SnowSQL, SQL, SQL (Basic + Advanced), Time Travel and Fail Safe, Zero Copy Cloning

Secondary Skills

• Azure, AI/ML

Specialization

• Snowflake Data Architecture: Lead Data Engineer

Job requirements

• Brillio LLC is a fast growing, pure play Digital Transformation Solutions and Services firm backed by Bain Capital private equity. Founded in 2014 and headquartered in Silicon Valley, Brillio is focused on delivering design led solutions for our customers. We are not an IT Services company trying to pivot and support the “next big thing.” As a digitally native company, everything we have done and will continue to do, will have this laser focus.
• Our culture is driven by Brillio’s Core Values and it is the foundation of who we are as an organization. We equip and empower our employees to push boundaries with an ‘Founder’s Mindset’ spirit as they craft ‘Customer Success’ stories. With our customer-centric approach, we deliver ‘Excellence and Innovation’ at every level of our collaboration and this is what fuels Brillio’s growth story. While we are proud of our journey so far, ‘ Care and Compassion’ about our customers, employees and the community where we thrive in. We strive to stay committed to lighting up 100,000 young minds through our CSR efforts.
•  
• Role: Senior Data Engineer
• Location: Atlanta, GA
• Full-Time
•  
• The ideal candidate will have extensive expertise in data engineering, with a focus on data warehousing, Snowflake, streaming data pipelines, Kafka, Debezium, BI and reporting tools, embedded reporting, and ETL processes. This role will involve designing, implementing, and optimizing scalable data solutions to support business intelligence, analytics, and AI/ML needs.
Key Responsibilities
• Data Pipeline Development: Design, build, and maintain robust ETL/ELT pipelines for efficient data ingestion, transformation, and integration from diverse sources.
• Data Warehousing: Architect and optimize data warehouse solutions using Snowflake, ensuring scalability, performance, and reliability.
• Streaming Data Pipelines: Develop and manage real-time data streaming pipelines using technologies such as Kafka and Debezium.
• ERP Integration: Collaborate with ERP system teams to ensure seamless integration of enterprise data into the data ecosystem. Understand SSO, embedded reporting scenarios.
• BI and Reporting: Work with BI tools (e.g., OAS, Domo, etc) to enable embedded reporting solutions and provide actionable insights.
• Data Modeling: Design scalable data models (e.g., star schema, snowflake schema) to support analytics and reporting needs.
• Collaboration: Partner with cross-functional teams including to understand requirements and deliver tailored solutions.
• System Monitoring & Optimization: Monitor system performance, troubleshoot issues, and implement optimizations to enhance efficiency.
Required Skills & Qualifications Technical Expertise:
• Proficiency in Snowflake architecture and SQL for complex queries.
• Hands-on experience with Kafka for real-time data streaming.
• Familiarity with cloud platforms such as AWS and Azure.
• Knowledge of ERP systems integration.
Data Engineering Skills:
• Expertise in data modeling techniques (e.g., star schema, snowflake schema).
• Solid understanding of access control mechanisms and SSO protocols.
• Experience in designing scalable ETL/ELT pipelines.
Soft Skills:
• Strong problem-solving abilities in ambiguous environments.
• Excellent communication skills for collaborating across teams.
Preferred Qualifications
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Experience migrating on-premise systems to cloud-based platforms.
• Familiarity with modern CI/CD pipelines for deployment automation.
•