Data Engineer - Databricks

Posted 23 Days Ago
Tampa, FL, USA
In-Office
Senior level
Financial Services
The Role
The Data Engineer will develop end-to-end data pipelines, optimize data architectures, and implement machine learning solutions to enhance business intelligence capabilities.
Summary Generated by Built In

This position is Hybrid in Tampa, FL.

We are seeking a Data Engineer with strong Databricks expertise to modernize and scale our Business Intelligence (BI) capabilities. This role will design and build data pipelines, deploy machine learning solutions, and operationalize intelligent analytics to drive decision-making across the organization. The ideal candidate blends data engineering best practices with applied machine learning, MLOps, and AI.

Key Responsibilities 

Project Responsibility: End-to-end data pipelines and integrations

Technical Competencies:

  • Advanced SQL optimization and complex query design
  • Kafka streaming applications and connector development
  • Databricks workflow development with medallion architecture
  • Data governance implementation and compliance
  • Performance tuning for large-scale data processing
  • Data security and privacy best practices
  • Apache NiFi pipeline development for invoice and PO processing
  • Integration with purpose-built data stores (Druid, MongoDB, OpenSearch, Postgres)
  • Build and maintain end-to-end ML pipelines for training, deployment, and monitoring of models.
  • Design and optimize data architectures for large-scale ML workloads
  • Explore and implement LLM-based solutions, RAG architectures, and generative AI for business use cases.

Soft Skills:

  • Cross-functional collaboration with product and engineering teams
  • Technical mentoring for junior data engineers
  • Analytical thinking for complex data problems
  • Stakeholder communication for data requirements
  • Process improvement and efficiency focus
  • Quality mindset for data accuracy and reliability Vendor Management:
  • Direct communication with data platform vendors
  • Evaluates vendor tools for specific data use cases
  • Provides technical feedback on vendor product roadmaps
  • Coordinates with vendors for data integration projects

 

Qualifications:

Bachelor’s/Master’s in Computer Science, Data Engineering, Statistics, or related field.

5+ years in data engineering; 2+ years applying ML in production. 

Our Benefits:  

  • Hybrid Work  
  • Employer Matched 401K  
  • Company Paid Medical Insurance Option for Employee and Dependent Children  
  • Company Paid Dental Insurance for Employee   
  • Company Paid Vision Insurance for Employee   
  • Company Paid Long and Short-Term Disability  
  • Company Paid Life and AD&D Insurance  
  • 18 Paid Vacation Days a Year  
  • Six Paid Holidays  
  • Employee Recognition Programs  
  • Holiday Bonus  
  • Incentive Compensation  
  • Community Outreach Opportunities  
  • Business Casual Dress Code  

  

About Fintech:  

Fintech, a pioneering accounts payable (AP) automation solutions provider, has dedicated nearly 35 years to automating invoice processing between retail and hospitality businesses, and their supply chain partners. Backed by leading investors TA Associates and General Atlantic, it stands as a leader in this sector. Its flagship product, PaymentSource®, was first built for the alcohol industry to provide invoice payment automation between alcohol distributors and their customers across all 50 states. Today, it is utilized by over 267,000 businesses nationwide for invoice payment and collection associated with all B2B business transactions. This proven platform automates invoice payment, streamlines payment collection, and facilitates comprehensive data capture for over 1.1 million business relationships. Recognizing operational hurdles, Fintech expanded its payment capabilities to include scan-based trading/consignment selling for its vendors and retailers and built an advanced CRM tool with functionality to fortify vendor, supplier, and distributor field execution, addressing diverse profit center challenges. For more information about Fintech and its range of solutions, please visit www.fintech.com.  

Fintech is a Drug-Free Workplace. Fintech is an Equal Opportunity Employer that does not discriminate on the basis of actual or perceived race, color, creed, religion, national origin, ancestry, citizenship status, age, sex or gender (including pregnancy, childbirth and pregnancy-related conditions), gender identity or expression (including transgender status), sexual orientation, marital status, military service and veteran status, physical or mental disability, genetic information, or any other characteristic protected by applicable federal, state, or local laws and ordinances. Fintech’s management team is dedicated to this policy with respect to recruitment, hiring, placement, promotion, transfer, training, compensation, benefits, employee activities, access to facilities and programs and general treatment during employment. We E-Verify.  

Equal Opportunity Employer
This employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights notice from the Department of Labor.

Skills Required

  • Bachelor's/Master's in Computer Science, Data Engineering, Statistics, or related field
  • 5+ years in data engineering
  • 2+ years applying machine learning in production
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Tampa, FL
1,116 Employees
Year Founded: 1991

What We Do

Fintech (Financial Information Technologies) is a payment and data solution for the alcohol industry. We're dedicated to saving businesses time and money by offering a safe, secure way for alcohol purchases to be paid electronically. Using Fintech’s award winning system, both alcohol distributors and retailers are able to regulate alcohol payments and control purchases. As a result, businesses can ensure invoices are paid on time, utilize detailed reconciliation reporting, and guarantee state liquor law compliance. Immediate Benefits: • Elimination of cash, checks and money orders • Enhanced security and prevention of loss and fraud • Quicker deliveries (time reduced by an average of 15 minutes per delivery) • Electronic invoicing with line-item detail reporting • Analysis of purchase data to help businesses control alcohol spend • Assurance of state liquor law compliance Since its start in 1991, Fintech has been committed to providing the alcohol industry with a superior data and electronic payment service that refines financial security and preserves the integrity of businesses within the structure of the liquor laws governed by each state.

Similar Jobs

PwC Logo PwC

Data Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
34 Locations
370000 Employees
77K-202K Annually

PwC Logo PwC

Data Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
35 Locations
370000 Employees
99K-232K Annually

Enverus Logo Enverus

Manager, Power Markets

Big Data • Information Technology • Software • Analytics • Energy
In-Office or Remote
5 Locations
1800 Employees
115K-130K Annually

MetLife Logo MetLife

Business Procedures Analyst

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
United States
43000 Employees
42K-72K Annually

Similar Companies Hiring

Granted Thumbnail
Mobile • Insurance • Healthtech • Financial Services • Artificial Intelligence
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account