Data Engineer (Kafka)

Sorry, this job was removed at 9:36 a.m. (CST) on Friday, November 18, 2022
Find out who’s hiring remotely Nationwide
See all Remote jobs Nationwide
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

About the Role

In the world of transportation, data is constantly moving, and Kafka is the roadway that keeps that traffic running smoothly to its destination. As a technical expert, you must be comfortable working across teams on multiple, high impact projects. You will be a valued part of a team that is constantly maturing Kafka use and event-driven architecture. Members of this team are responsible for the overall use and implementation of Kafka components including the Confluent platform, observability, governance, best practices, and solution development. An understanding of Kafka principles and enterprise integration patterns is required.

In order to be successful:

  • You are a self-directed person who can identify priorities.
  • You are a detail-oriented person who takes pride in keeping data correct and always having a backup plan.
  • You are a problem-solver who might write a script or find a tool to get things done when there isn't an established solution.
  • You want to learn and grow in the event-driven world.
  • You love Kafka! When you hear terms like "event-driven" or "real-time streaming" you're ready to dive in!

Responsibilities

  • Develop and implement solutions using Kafka.
  • Administer and improve use of Kafka across the organization including Kafka Connect, ksqlDB, Streams, and custom implementations.
  • Work with multiple teams to ensure best use of Kafka and data-safe event streaming.
  • Understand and apply event-driven architecture patterns and Kafka best practices. Enable development teams to do the same.
  • Assist developers in choosing correct patterns, event modeling, and ensuring data integrity.
  • Continuous learning to be a Confluent/Kafka subject matter expert.
  • Work with Kafka and Confluent API's (e.g. metadata, metrics, admin) to provide pro-active insights and automation.
  • Work with SRE's to ensure Kafka-related metrics are exported to New Relic.
  • Perform regular reviews of performance data to ensure efficiency and resiliency.
  • Contribute regularly to event-driven patterns, best practices, and guidance.
  • Review feature release and change logs for Kafka, Confluent, and other related components to ensure best use of these systems across the organization.
  • Work with lead to ensure all teams are aware of technology changes and impact.
  • Develop an expert-level understanding of data migration and CDC as it relates to Kafka using Kafka Connect and Debezium.
  • Acquire a deep understanding of source and sink connector technical details for a variety of platforms including PostgreSQL, MS SQL Server, Snowflake, and others as required.

Requirements

  • Be able to describe the primary components of Kafka and their function (brokers, zookeeper, topics).
  • At least two years of experience supporting applications in a production environment.
  • You will be expected to read and navigate code in multiple languages. Multi-language fluency and writing is not required.
  • Proficiency in at least one programming language and one scripting language.
  • Proficiency with Docker containers.
  • Ability to participate in and contribute to code management in GitHub including actively collaborating in peer-reviews, feature branches, and resolving conflicts and commits.
  • Excellent written and verbal communication skills.
  • Strong sense of responsibility with a bias towards action.
  • Comfortable self-directing and prioritizing your own work.
  • Microservices experience is a plus.
  • Distributed tracing experience a plus.
  • An understanding of any cloud (Azure preferred) infrastructure and components is a plus but is not required.

 

About Mastery

 

Mastery Logistics Systems is building the world’s first lovable Transportation Management System, or TMS.

Our customers – large transportation companies and shippers who need those companies – have struggled with systems that are outdated or inadequate. As shippers or transportation service providers, our customers have in the past been forced to use multiple systems to manage dedicated fleet operations, outsourced or insourced trans management, one way trucking, truckload brokerage, LTL, and Intermodal, or to sub-optimize one or more of those functions by attempting to fit it into a TMS that is adequate at another function.

Mastermind TMS allows our customers to bring all of these functions into a single platform, providing flexibility, visibility, control, and efficiency. Today’s unprecedented global supply chain upheavals underscore how important the transportation industry is. We are building a system to allow this industry to work faster, smarter and more efficiently.

The challenges in this industry are big and exciting! We are tackling everything from fast and efficient data input to ingesting large amounts of data and applying AI to looking at blockchain to securely digitize paperwork. If you are passionate about humanizing an industry, automating in innovative ways, building for quality and scale, helping make people's lives easier and touching every part of our economy then this is the place for you.

Mastery Logistics Systems is committed to continuing to build an incredible company. We are a masterful mosaic of incredible people. We are specialists and experienced in our respective fields. We are dedicated to continuous improvement both professionally and personally. We are a collective group of really good people. We have different interests, backgrounds & talents and we work together to create really cool stuff! We believe in diversity of thought and are mindful and inclusive. We have deep respect for each other and work diligently at adding the right people to our teams.

At this moment we are all working from home and doing our part to combat the Covid 19 virus. We are creatively building our new work habits. We are respectful of each other’s time and personal life. We have flexible schedules but share in the mission that we are building and need to get it done. We offer an excellent suite of benefits. We are dedicated to finding new ways to add perks as we live and work from home.

Our team has the domain knowledge and connections to make an impact, and we’re looking for experienced and thoughtful people to who thrive on creating and building great products. We want people who have a true passion for servicing and taking care of our customers. We need people who are flexible problem solvers, thrive on collaboration and consistently know how to communicate their solutions well. We are small and nimble – which is evident in how quickly we could pivot to our new reality. Each member of the team can make a tremendous impact both technically and culturally. While a start-up, we are well-funded, have an initial paying customer with which to test and launch, and are founded by top experts and veterans in the logistics industry.

Join us – you’ll love it – let’s build a masterpiece!

 

Benefits

 

Mastery takes great pride in providing our employees a robust and highly competitive benefit package. Our benefits include Medical, Dental and Vision insurance covering 90% of premium costs. Company paid life insurance for 1x salary. Legal, AD&D, Additional Life and other employee assistance benefits. We have a 401k savings plan with a 4% match. We provide opportunities for professional growth and development. We fully support our work from home initiative as we do our part to combat the Covid 19 crisis. We have a manage your life and schedule Paid Time Off program. We are fully devoted to finding creative perks and benefits since we cannot currently enjoy our cool office culture. Our philanthropic partner is St. Jude Children’s Research Hospital.

 

We are an equal opportunity employer and actively seek a diverse community of professionals. Veterans, Women, non-binary, people of color, LGBTQIA, we welcome all to apply! 

 

Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Candidate Location Eligibility:
Albuquerque, NM
Ann Arbor, MI
Atlanta, GA
Austin, TX
Baltimore, MD
Baton Rouge, LA
Birmingham, AL
Boise, ID
Boston, MA
Buffalo, NY
Charleston, SC
Charlotte, NC
Chicago, IL
Cincinnati, OH
Cleveland, OH
Colorado, CO
Columbus, OH
Dallas-Fort Worth, TX
Dayton, OH
Des Moines, IA
Detroit, MI
Fayetteville-Springdale-Rogers, AR
Greensboro, NC
Hampton Roads, VA
Hartford, CT
Houston, TX
Huntsville, AL
Indianapolis, IN
Jacksonville, FL
Kansas City, MO
Las Vegas, NV
Lexington, KY
Lincoln, NE
Little Rock, AR
Los Angeles, CA
Louisville, KY
Madison, WI
Memphis, TN
Miami, FL
Milwaukee, WI
Minneapolis–Saint Paul, MN
Nashville, TN
New Orleans, LA
New York City, NY
Ogden, UT
Oklahoma City, OK
Omaha, NE
Orlando, FL
Other US Location
Palm Bay-Melbourne-Titusville
Pensacola, FL
Peoria, IL
Philadelphia, PA
Phoenix – Mesa – Scottsdale, AZ
Pittsburgh, PA
Portland, ME
Portland, OR
Providence, RI
Provo, UT
Raleigh-Durham, NC
Reno, NV
Richmond, VA
Rochester, NY
Sacramento, CA
Salt Lake City, UT
San Antonio, TX
San Diego, CA
San Francisco, CA
San Luis Obispo, CA
Santa Cruz, CA
Seattle, WA
Spokane, WA
St. Louis, MO
Tallahassee, FL
Tampa Bay, FL
Tucson, AZ
Tulsa, OK
Washington DC
Wichita, KS
Wilmington, NC

Technology we use

  • Engineering
  • Product
    • C#Languages
    • GolangLanguages
    • JavascriptLanguages
    • PythonLanguages
    • RubyLanguages
    • ReactLibraries
    • FlaskFrameworks
    • Node.jsFrameworks
    • Ruby on RailsFrameworks
    • PostgreSQLDatabases
    • RedisDatabases
    • Google AnalyticsAnalytics
    • MixpanelAnalytics
    • InVisionDesign
    • JIRAManagement
    • TrelloManagement

An Insider's view of Mastery Logistics Systems

What’s the vibe like in the office?

I've never been surrounded with this many high quality engineers. I learn something new everyday from my peers.

Peter

Senior Software Engineer

What does your typical day look like?

What's exciting about this phase of Mastery is that every day we're both pushing forward our initial product as well as building out the company itself. So a typical day involves defining upcoming features, prototyping, interviewing candidates, and working with the team to establish our processes. Everyone gets to contribute in multiple ways.

Chris Wallace

Director of Product Management

How has your career grown since starting at the company?

I began at Mastery as a Client Technologies Apprentice, learned about the logistics industry and was offered a full-time role as Release & Resource Management Specialist. I've always loved to write, show my creative side, and working with Mastery allows me to explore a new industry and my creative outlet while working with top-tier people everyday.

Vanessa

Release and Resource Management Specialist

What is your vision for the company?

Mastery is on a mission to empower our customers to thrive in complexity. Our vision is to create a transportation management system that people love to use.

Jeff

CEO, Founder

What are Mastery Logistics Systems Perks + Benefits

Mastery Logistics Systems Benefits Overview

Mastery Logistics Systems is committed to providing a great, inclusive working environment by challenging our team members while being respectful of your time and the needs of your personal life. That’s why we encourage time exploring innovative ideas alongside more standard daily tasks.

Culture
Volunteer in local community
Mastery employees are encouraged and supported to be involved in their communities or support local volunteer efforts.
Partners with nonprofits
We are a proud partner to St. Jude and offer opportunities to get involved in events in different locations or virtually throughout the year.
Open door policy
OKR operational model
Pair programming
Open office floor plan
Flexible work schedule
Your work schedule may vary, based on your role, team and region, however Mastery supports no-meeting Fridays, no slacking after 7 pm, and other initiatives that support a flexible work schedule.
Remote work program
Some of our roles are completely remote, while others may be hybrid or onsite. This is based on a number of factors specific to the needs of the role and location, pending manager's discretion.
Health Insurance & Wellness Benefits
Disability insurance
Dental insurance
Vision insurance
Health insurance
Mastery offers several health plans for individuals and families.
Life insurance
Mental health benefits
Our benefits include a number of options, including a coaching program at no additional cost to employees, administered through a third party provider, for an employee's personal or professional use.
Financial & Retirement
401(K)
401(K) matching
Mastery provides employees with a 401(k) matching plan, matching up to 4%.
Performance bonus
Vacation & Time Off Benefits
Unlimited vacation policy
Office Perks
Company-sponsored happy hours
We have virtual and in-person meet-ups on occasion, often adding a learning component with an expert on-hand to guide us through an activity on employee selected topics.
Pet friendly
We have a dedicated pets channel to share our pets and pet adventures with one another virtually from anywhere.
Professional Development Benefits
Promote from within
Continuing education available during work hours
Our onboarding program teaches industry and company basics, so if you are new to logistics, you can learn along with your colleagues. Our training is available after onboarding for ongoing reference.

Additional Perks + Benefits

The team at Mastery is building a one-of-a-kind product and dedicated to its success. You will see a multitude of options to learn, ask for help, get support and feel supported in your role. No meeting Fridays, no Slack after 7 pm, and other supportive guideposts that help you drive work/life balance are found here at Mastery. The company provides frequent opportunities to socialize and network with one another. You will be encouraged to grow and learn from your team and empowered to do very meaningful work - supporting moving goods into the hands of consumers through our software products and support of our clients.

More Jobs at Mastery Logistics Systems

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about Mastery Logistics SystemsFind similar jobs like this