Principal Data Engineer

Lovelytics is a Databricks-focused data and AI consulting firm specializing in artificial intelligence, data, and analytics solutions. Since partnering with Databricks in 2019, Lovelytics has experienced exponential growth, growing from 50 people to over 340 over the past 3 years. Lovelytics is a trusted partner for many of the most high-profile enterprise clients in Media & Entertainment, Manufacturing, Retail & CPG, Healthcare & Life Sciences, and Financial Services.
We are seeking an accomplished & Databricks Certified Principal Consultant with specialized expertise in delivering strategic Databricks and data engineering solutions for our clients at Lovelytics. As a pivotal member of our team, you will serve as a data and analytics solution architect, leading technical engagement and architecture initiatives encompassing data warehousing, ETL development, data integrations, and data modeling.

Location: This role is open to remote candidates in the following states: AZ, CA, DC, VA, MA, MD, FL, GA, IL, IN, KS, NC, NJ, NY, PA, OR, TN, TX, WA
This role is not open for work sponsorship at this time.

Primary Responsibilities:

• Design end-to-end data pipelines leveraging Databricks for ETL, streaming, and batch processing.
• Architect data lakes and warehouses on Databricks, ensuring scalability, reliability, and performance.
• Collaborate with stakeholders and other capability team members to translate business requirements into technical specifications and scalable solutions.
• Implement best practices for data governance, security, and optimization within the Databricks environment.
• Collaborate with Technical Directors to identify market trends, implement internal initiatives, and contribute thought leadership through blogs and innovative solutions.
• Apply deep technical knowledge to address client challenges and expand business opportunities, and at times, engage in client-facing pre-sales and pursuit activities.
• Manage projects, ensuring milestones are achieved within set timelines and budgetary constraints.
• Provide technical guidance and support across various project facets, from data integration to troubleshooting.

Required Skills & Experience:

• Bachelor's degree in Computer Science or related field.
• 8+ years of data engineering experience within cloud-based analytics architectures, with at least 4 years in a traditional consulting environment and role.
• Proven experience as a Solution Architect or Data Engineer, with a focus on Databricks.
• Strong proficiency in building and optimizing big data pipelines using Databricks Delta and Apache Spark.
• Solid understanding of cloud platforms (Azure, AWS, or GCP) and their integration with Databricks.
• Expertise in SQL, Python, or Scala for data manipulation and analysis.
• Familiarity with Machine Learning model development or ML Ops is advantageous.
• Excellent communication skills, crucial for effective client interaction and management.
• Relevant certifications such as Databricks Data Engineer Professional and Databricks Machine Learning Professional are desirable.

What We Offer:

• Exciting projects with diverse clients across various industries globally.
• Collaborative environment fostering rapid skill development and innovation.
• Opportunity to work alongside seasoned data engineers and grow professionally.
• Encouragement to challenge norms, develop new technologies, and refine methodologies.
• A vibrant, diverse team of data enthusiasts, experience seekers, and entrepreneurial minds dedicated to continuous improvement.

Lovelytics is an Equal Opportunity Employer. This means you don’t have to worry about whether your application process will be fair. We consider all applicants without regard to race, color, religion, age, ancestry, ethnicity, gender, gender identity, gender expression, sexual orientation, veteran status, or disability.