Lead Data Engineer

Posted 5 Days Ago
Hiring Remotely in US
Remote
139K-155K Annually
Expert/Leader
Logistics • Software • Transportation
Truckstop is a leader in transportation technology and freight matching solutions.
The Role
The Lead Data Engineer will create and maintain data pipelines, handle complex data transformations, and collaborate with development teams. Responsibilities include optimizing queries, automating processes, and improving data systems. The role requires troubleshooting and incident resolution while providing leadership to the team.
Summary Generated by Built In

At Truckstop, we have transformed the entire freight-moving lifecycle with our SaaS solutions. From freight matching to payments and everything in between, we are the trusted partner for carriers, brokers, and shippers alike. We lead this industry forward with our One Team mindset committing to principles such as assume positive intent, have each other’s back, and be your authentic self. Our drive for greatness produces high expectations, yet our regard for humans is even higher. Join a team of brilliant minds and generous hearts who care deeply about other's success.  

Position Summary: 

As members of the Application Services team, Data engineers are responsible for creating and maintaining data pipelines, assembling complex datasets, and extracting, transforming, and loading data from a variety of data sources. Data engineers consult with development squads and data scientists to deliver product features and with cloud database administrators to resolve data related technical issues. Data engineers also identify and implement process improvements for greater reliability and performance.

Performs work with a high degree of latitude. Handles the most complex issues. Possesses expert knowledge of subject matter. Provides leadership, coaching, and/or mentoring to subordinate a group. May act as technical lead or first-level supervisor. Bachelor's degree or equivalent professional experience required; Computer Science or Engineering preferred. Minimum of 8 or more years of experience.

Data engineers work as members of a Center of Excellence and participate in projects to ensure that Truckstop has hygienic, accurate, data available at the point of need.

Data Engineers may troubleshoot production issues and respond to incidents.

Essential Job Functions: 

  • Create, automate, and maintain data pipelines. Assemble complex data sets that meet business requirements.
  • Extract, transform, and load data from a variety of data sources using SQL and big data tools and technologies.
  • Identify, design, and implement internal process improvement including automating manual processes, optimizing data delivery, re-designing infrastructure for greater reliability and performance.
  • Write and optimize queries, write lambda functions, perform source to target mapping and data modeling.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Work as a member of the data engineering chapter on a development squad to deliver product features and resolve data related technical issues.
  • Work as a member of the data management center of excellence on data quality projects.
  • Work with information security to keep our data secure.
  • Work with data architects, database administrators, and data engineers to continually improve our data systems.
  • Work with IT operations to resolve data related technical issues and respond to data related major incidents.
  • Create data tools to assist data analysts and data scientists in building and optimizing our product into an innovative industry leader.
  • Troubleshoot operations and database issues for internal and external customers.
  • Perform incident resolution and root cause analysis of critical outages. Implement solutions to systematic failures. Provide on-call support, including after hours.
  • Assist with documentation of the environments that support our products.
  • Other duties as assigned.

Position Requirements: 

  • Bachelor's degree or equivalent professional experience required; Computer Science or Engineering preferred.
  • Strong experience in SQL and Python.
  • Experience with relational SQL and NoSQL Databases; MS SQL, PostgreSQL, Snowflake, MongoDB, MySQL, MariaDB, Elastic stack.
  • Experience building and optimizing reliable, idempotent data pipelines (streaming or batch) using ETL tools such as Matillion, Apache NiFi, Kafka and Spark.
  • A successful history applying software engineering principles to build data infrastructure tools/libraries to automate and scale data pipelines.
  • Understanding of applying logging and metrics to monitor and detect data pipeline performance issues.
  • Solid understanding of Data warehousing theory and concepts. 
  • Working knowledge of data modeling and source to target mapping with a demonstrated understanding of data schema design and indexes, when to apply fact-based vs. time-based vs. relational and when to apply NoSQL approaches such as key-value, document, and column data stores.
  • Understanding of Statistical and Machine Learning (ML) terminology with experience deploying and monitoring ML-models in a production environment.
  • Experience working in a modern cloud-based environment a plus; Azure, AWS, Docker, Kubernetes. Data Warehouse
  • Experience with Linux.
  • Familiarity with Kubernetes, Lambda functions, Cloud Watch, SNS, S3, Glacier.
  • Minimum of 8 or more years of experience.



At Truckstop we are dedicated to creating a workplace that is equitable, inclusive, and inspiring for every employee. In an effort to provide greater transparency, we are sharing the base salary range for this position. The position is also eligible for a yearly bonus. Final salary is based on a number of factors including market location, job-related knowledge, education/training, certifications, key skills, experience, internal peer equity as well as business considerations.

The anticipated base pay range for this position is :

$139,000$155,000 USD

The above description covers the most significant duties performed but does not include other related occasional work that may be assigned or is completed by the employee. 

Truckstop provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. 
Truckstop participates in the E-Verify program. Learn more about the E-Verify program here: https://www.e-verify.gov/

Truckstop Privacy Policy

Top Skills

SQL
The Company
HQ: Boise, ID
900 Employees
Remote Workplace
Year Founded: 1995

What We Do

At Truckstop, our One-Team mindset has transformed big dreams into epic success. We commit to principles such as assume positive intent, have each other’s back, and be your authentic self. This results in a feeling of connectedness, so no one feels isolated in a remote work world. Together, we build technology that determines the future of freight.

Partners make the impact.
We call our employees partners because we are interdependent upon each other to achieve greatness. From day one, we empower our partners with the freedom to innovate, take smart risks, and voice bold ideas. This autonomy allows our partners to think big and make an impact.

Imagine greatness and own it.
Imagine a place where you are equipped to drive your career – where exploration is encouraged, and opportunities present themselves to the curious. This is Truckstop.com. Our TLC (Truckstop Learning Center) and AI Talent Marketplace are examples of tools that help our partners develop new and critical skills. We are committed to empowering our partners to own their greatness.

Flexibility to help you balance.
We encourage our partners to embrace the richness of North America like the trucker who drives its highways. Whether seaside, countryside, or citified, wherever our partners draw inspiration from is where we want them to be. If it’s in an office or working from home, we set them up with the resources they need to excel.

The best of two worlds.
After 25 years of steady growth and profitability, Truckstop.com caught the eye of tech investor ICONIQ Capital. They saw how our breakthrough SaaS solutions impact an $800 billion industry. Our partners enjoy the stability of historical success yet are primed for exponential growth.

Why Work With Us

We are creating a culture of brilliant minds and generous hearts who care deeply about other's success. Our drive for greatness produces high expectations, yet our regard for humans is even higher.

Gallery

Gallery

Similar Jobs

Capital One Logo Capital One

Lead Data Engineer, Data Mgmt Optimization - Shopping (Remote)

Fintech • Machine Learning • Payments • Software • Financial Services
Remote
Hybrid
McLean, VA, USA
55000 Employees
171K-195K Annually

CapTech Logo CapTech

Lead Data Engineer (AWS, Azure, GCP)

Information Technology • Consulting
Remote
Chicago, IL, USA
1100 Employees

CapTech Logo CapTech

Lead Data Engineer (AWS, Azure, GCP)

Information Technology • Consulting
Remote
Reston, VA, USA
1100 Employees

CapTech Logo CapTech

Lead Data Engineer (AWS, Azure, GCP)

Information Technology • Consulting
Remote
Columbus, OH, USA
1100 Employees

Similar Companies Hiring

Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
RunPod Thumbnail
Software • Infrastructure as a Service (IaaS) • Cloud • Artificial Intelligence
Charlotte, North Carolina
53 Employees
Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account