Sr Engineer, Data Engineering

Posted Yesterday
Be an Early Applicant
Knoxville, TN, USA
In-Office
Senior level
Logistics • Retail • Travel • Energy
The Role
Develops, documents, and maintains data engineering processes supporting big data, data lake, and lakehouse infrastructure. Collaborates with analytics teams and business stakeholders to implement data solutions, troubleshoot complex platform issues, tune code, review architecture and testing, and protect data integrity. The role also mentors junior team members, supports cross-functional projects, and ensures compliance with organizational standards and policies.
Summary Generated by Built In
Company Description

Pilot Company is an industry-leading network of travel centers with more than 30,000 team members and over 750 retail and fueling locations in 44 states and six Canadian provinces. Our energy and logistics division serves as a top supplier of fuel, employing one of the largest tanker fleets and providing critical services to oil operations in our nation's busiest basins. Pilot Company supports a growing portfolio of brands with expertise in supply chain and retail operations, logistics and transportation, technology and digital innovation, construction, maintenance, human resources, finance, sales and marketing.

Founded in 1958 by Jim A. Haslam II and currently led by CEO Adam Wright, our founding values, people-first culture and commitment to giving back remains true to us today. Whether we are serving guests, a fellow team member, or a trucking company, we are dedicated to fueling people and keeping North America moving.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status or any other characteristic protected under applicable federal, state, or local law.

Military encouraged to apply.

Job Description

The purpose of this job is to provide technical expertise for research, development and modification of data engineering processes and workflows in support of big data infrastructure for Pilot Travel Centers in the retail and energy space. 

  1. Research, develop, document, and modify Data Engineering processes and jobs per data architecture and modeling requirements; collaborate with Data Analytics team members such as Data Strategists and Data Scientists 
  2. Collaborate with business stakeholders to understand data needs including data velocity, veracity, and access patterns 
  3. Provide technical expertise to implement Data and Analytics specifications 
  4. Serve on cross-functional project teams and provide perspective for the Data Analytics team on executing key deliverables 
  5. Troubleshoot complex, escalated issues including connection, failed jobs, application errors, server alerts and space thresholds within predefined service level agreements (SLAs) 
  6. Proactively maintain and tune all code according to internally documented Data Engineering standards and best practices 
  7. Review and ensure appropriate documentation for all new development and modifications of the Data Lake processes and jobs 
  8. Perform code and process reviews and oversee testing for solutions developed, and ensure integrity and security of institutional data 
  9. Educate business stakeholders on the usage and benefits of the  
  10. Data Lake/Lakehouse and related technologies 
  11. Mentor and guide less experienced team members and provide feedback on project work  
  12. Model behaviors that support the company’s common purpose; ensure guests and team members are supported at the highest level 
  13. Ensure all activities are in compliance with rules, regulations, policies, and procedures 
  14. Complete other duties as assigned 

Qualifications

  • Bachelor’s degree in computer science, engineering, information technology, or related field, required. 
  • Minimum eight (8) years of technology operations experience required. 
  • Experience in the commodities and energy space preferred. 
  • Strong SQL knowledge and skills required 
  • Strong knowledge of Relational Databases like Oracle, Postgres or SQL Server required  
  • Experience with Apache Spark or Spark-streaming, Message Queue technologies and Python required 
  • Strong knowledge of enterprise data warehouse (EDW) data models with a focus on Star Schema data modeling techniques required 
  • Experience with unified data platforms such as Databricks or Snowflake preferred 
  • Strong knowledge of Cloud Data platforms such as Amazon Web Services (AWS), Azure or Google Cloud preferred 
  • Excellent analytical skills and the ability to identify solutions to complex data problems 
  • Ability to provide excellent customer service 
  • Excellent written and verbal communication skills 
  • Willingness to learn and embrace new technologies 
  • Ability to mentor and motivate a diverse team; ensure team and individual accountability and performance standards are met 
  • Ability to prioritize, multitask and manage multiple projects successfully in a fast-paced and dynamic environment 
  • Strong organizational skills with attention to detail 
  • Ability to communicate and interact effectively with different levels of the organization to negotiate, problem solve, complete projects and influence decision making  
  • Self-motivated with ability to work both independently and within teams in order to establish and meet deadlines, goals, and objectives 

 

Additional Information

  • Travel required less than 10% 
  • General office work requiring sitting or standing for long periods of time 
  • Able to lift up to 30 lbs. 
  • Able to work evenings, weekends and odd hours as needed 

Skills Required

  • Bachelor's degree in computer science, engineering, information technology, or a related field
  • Minimum eight years of technology operations experience
  • Strong SQL knowledge and skills
  • Strong knowledge of relational databases such as Oracle, PostgreSQL, or SQL Server
  • Experience with Apache Spark or Spark Streaming, message queue technologies, and Python
  • Strong knowledge of enterprise data warehouse data models, particularly star schema modeling
  • Experience in the commodities and energy space
  • Experience with unified data platforms such as Databricks or Snowflake
  • Strong knowledge of cloud data platforms such as AWS, Azure, or Google Cloud
  • Excellent analytical skills and ability to solve complex data problems
  • Excellent written and verbal communication skills
  • Ability to mentor and motivate a diverse team
  • Ability to prioritize, multitask, and manage multiple projects
  • Strong organizational skills and attention to detail
  • Ability to work independently and collaboratively to meet deadlines and objectives
  • Willingness to work evenings, weekends, and odd hours as needed

Pilot Company Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Pilot Company and has not been reviewed or approved by Pilot Company.

  • Healthcare Strength Health coverage includes medical, dental, and vision plans plus complimentary virtual care, physical therapy, surgical services, and targeted programs for sleep and metabolic conditions. HSAs/FSAs and prescription access options broaden utility and support ongoing care.
  • Parental & Family Support Paid parental leave offers bonding time, with additional paid recovery time available for birthing parents where eligible. Adoption assistance helps offset family‑building costs.
  • Affordable Benefits Some travel center team members can enroll in low‑cost health plan options. Prescription savings programs further reduce out‑of‑pocket costs for care.

Pilot Company Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Knoxville, TN
30,000 Employees
Year Founded: 1958

What We Do

Pilot Company is a travel center and energy company owned by Berkshire Hathaway, operating gas stations and convenience stores. It provides services such as diesel fuel, truck parking, and showers for travelers.

Similar Jobs

Optum Logo Optum

Senior Software Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Brentwood, TN, USA
160000 Employees
92K-164K Annually

UOB Logo UOB

Senior Security Engineer

Financial Services
In-Office
North Tower Forest, TN, USA
25000 Employees

Photon Logo Photon

Senior Engineer

Agency • Information Technology
In-Office or Remote
2 Locations
5017 Employees
52K-184K Annually

Photon Logo Photon

Senior Engineer

Agency • Information Technology
In-Office or Remote
2 Locations
5017 Employees
46K-161K Annually

Similar Companies Hiring

PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account