Databricks Engineer

Posted Yesterday
Be an Early Applicant
Pittsburgh, PA, USA
In-Office
Entry level
Cloud • Information Technology • Consulting
The Role
Work with senior data engineers to design, build, and optimize Databricks/Spark data pipelines and Lakehouse solutions. Write PySpark and SQL, implement ETL/ELT, perform data validation and performance tuning, support governance and CI/CD, collaborate with analysts and stakeholders, and document designs.
Summary Generated by Built In
Role Overview
We are seeking a Junior Databricks Engineer to join our team. This role is ideal for a recent master's graduate who is passionate about big data, cloud technologies, and modern data platforms. The successful candidate will work alongside a senior data staff to design, build, and optimize data pipelines and analytics solutions using the Databricks Lakehouse Platform. We're looking for someone who is eager to learn, enjoys solving technical challenges, and thrives in a collaborative, team-oriented environment. This is an excellent opportunity to gain hands-on experience with enterprise-scale data engineering projects while being mentored by experienced professionals.
Key Responsibilities   
  • Develop and maintain data pipelines using Databricks and Apache Spark.
  • Assist in building scalable ETL/ELT processes to ingest, transform, and curate data from multiple sources.
  • Collaborate with senior engineers to design and implement Lakehouse solutions following Medallion Architecture best practices.
  • Write efficient PySpark and SQL code to process large datasets.
  • Support data validation, testing, and troubleshooting to ensure data quality and reliability.
  • Participate in performance tuning and optimization of Databricks workloads.
  • Assist with implementing data governance, security, and access controls.
  • Work closely with data analysts, AI engineers, and business stakeholders to understand data requirements.
  • Contribute to CI/CD processes, source code management, and deployment automation.
  • Participate in Agile ceremonies including sprint planning, daily standups, retrospectives, and code reviews.
  • Document technical designs, data flows, and implementation standards.

Required Qualifications
  • Master's degree in Computer Science, Data Engineering, Data Science, Information Systems, or a related technical discipline.
  • Strong understanding of data engineering concepts and relational databases.
  • Experience with Python and SQL through academic projects, internships, or personal work.
  • Knowledge of Apache Spark fundamentals.
  • Familiarity with Databricks or cloud-based analytics platforms.
  • Understanding of data modeling and ETL/ELT processes.
  • Knowledge of Git and version control best practices.
  • Strong analytical, problem-solving, and debugging skills.
  • Excellent communication and collaboration abilities.

Preferred Qualifications 

  • Hands-on experience with Databricks through coursework, internships, certifications, or personal projects.
  • Experience with Microsoft Azure, AWS, or Google Cloud Platform.
  • Familiarity with Delta Lake and Medallion Architecture.
  • Knowledge of Azure Data Factory, Microsoft Fabric, or similar data integration tools.
  • Exposure to data warehousing concepts and dimensional modeling.
  • Experience with Power BI or Tableau.
  • Databricks certifications are a plus.
  • Understanding of data governance and data quality principles.
  • Passionate about modern data engineering technologies.
  • Eager to learn from experienced engineers and continuously improve technical skills.
  • Strong team player who enjoys collaborating across technical and business teams.
  • Curious mindset with a willingness to explore new tools and technologies.
  • Highly organized with strong attention to detail.
  • Self-motivated, adaptable, and receptive to feedback.
  • Committed to delivering high-quality, scalable solutions.

Location: Pittsburgh, PA (relocation assistance is offered)

About Techstra Solutions 
Techstra Solutions is a certified woman-owned (WBENC) management consulting firm specializing in strategy, technology, and implementation services for large organizations undergoing digital and talent transformation. Our experienced team partners with clients to co-create innovative solutions in applications, data, AI, and automation that accelerate measurable, sustainable change. From advisory consulting through technical execution, we are dedicated to driving world-class business solutions that fit your strategic requirements and deliver results. For more information: www.techstrasolutions.com

Skills Required

  • Master's degree in Computer Science, Data Engineering, Data Science, Information Systems, or related technical discipline
  • Strong understanding of data engineering concepts and relational databases
  • Experience with Python and SQL through academic projects, internships, or personal work
  • Knowledge of Apache Spark fundamentals
  • Familiarity with Databricks or cloud-based analytics platforms
  • Understanding of data modeling and ETL/ELT processes
  • Knowledge of Git and version control best practices
  • Strong analytical, problem-solving, and debugging skills
  • Excellent communication and collaboration abilities
  • Hands-on experience with Databricks through coursework, internships, certifications, or personal projects
  • Experience with Microsoft Azure, AWS, or Google Cloud Platform
  • Familiarity with Delta Lake and Medallion Architecture
  • Knowledge of Azure Data Factory, Microsoft Fabric, or similar data integration tools
  • Exposure to data warehousing concepts and dimensional modeling
  • Experience with Power BI or Tableau
  • Databricks certifications
  • Understanding of data governance and data quality principles
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Pittsburgh, PA
16 Employees
Year Founded: 2012

What We Do

Techstra Solutions is a certified woman-owned consulting firm that provides strategy, technology and implementation support to large organizations undergoing digital and talent transformation. The rapid pace of technology innovation required to remain competitive, juxtaposed with the slow rate of change in many organizations, causes most to struggle. To be successful companies must drive new ways of working including the use of technology/analytics and new skillsets (hard/soft) deep into their culture so that they are able to rapidly and continuously react to change. They must also apply new approaches that empower their employees, ensuring its sustainability. At Techstra Solutions we focus on four key areas, otherwise known as the 4 A’s: Automation (Robotic Process Automation (RPA)/Intelligent Automation), Analytics (Reporting/Analytics/AI/ML), Application Modernization (Cloud, Mobility, etc), and Agile-based solutions (DevOps).

Similar Jobs

M&G Logo M&G

Data Engineer

Fintech • Financial Services
In-Office
3 Locations
2729 Employees

M&G Logo M&G

Data Engineer

Fintech • Financial Services
In-Office
3 Locations
2729 Employees

PwC Logo PwC

Data Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
34 Locations
370000 Employees
77K-202K Annually

EXL Logo EXL

Platform Engineer

Information Technology • Database • Consulting
Remote or Hybrid
United States
30246 Employees

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account