Senior Databricks Engineer

Join Our Team at Duncan Solutions, LLC

Duncan Solutions, LLC, is a full-service transportation management company that focuses on connecting people, technology, and data to make cities more livable and efficient. As a leading provider of parking and tolling management solutions, we support municipal and commercial clients with citation processing, debt collection, DMV registered owner identification, back-office transaction processing, image review, customer service center and customer experience (CX) operations, integrated on-street parking management, and more.

WORK LOCATION

This is a remote position with eligibility in the following states: AZ, CA, CO, CT, DE, FL, GA, IL, IN, IA, KS, LA, MD, MA, MI, MO, NJ, NY, NC, OH, PA, TN, TX, VA, WA, WI, D.C., Candidates must reside in one of the following locations for consideration.

Please note: Duncan Solutions, LLC, does not provide visa sponsorship now or in the future. Candidates must be legally authorized to work in the United States without current or future sponsorship requirements. 

PAY TRANSPARANCY

This role will offer $105,000 – $115,000 annually/hourly, depending on experience, skills, and location.

Employees may also be eligible for performance-based incentives and additional benefits as part of our total rewards package.

POSITION SUMMARY

We are seeking a highly experienced and self-driven Senior AWS / QuickSight / Databricks Analyst/Developer to join our Data & Analytics team. The ideal candidate will have a proven track record of architecting and developing scalable data solutions on AWS, building advanced dashboards and visualizations with Amazon QuickSight, and developing data pipelines and analytics workflows using Databricks.

You will play a critical role in delivering enterprise-grade data solutions and enabling actionable insights across the organization. This is a hands-on technical role requiring advanced skills in data engineering, data visualization, and cloud architecture.

What You'll Do

• Design, develop, and optimize end-to-end data pipelines using Databricks (PySpark, Delta Lake).
• Architect and manage data lakes and data warehouses in AWS (S3, Redshift, Glue, Athena, Lake Formation).
• Create and maintain interactive dashboards and reports using Amazon QuickSight, including advanced calculated fields, parameters, and row-level security.
• Develop ETL/ELT processes to ingest, transform, and curate data for analytics and reporting.
• Collaborate with business stakeholders, data scientists, and other developers to gather requirements and translate them into scalable data solutions.
• Implement CI/CD pipelines, version control (Git), and automated deployment strategies for data and analytics solutions.
• Monitor and optimize performance across data pipelines, queries, and dashboards.
• Ensure compliance with data governance, security, and privacy policies.
• Provide technical leadership and mentorship to junior team members.
  

What You Need to Succeed

• 10+ years of experience in data analytics, data engineering, or business intelligence.
• 5+ years of hands-on experience with core AWS services (S3, Redshift, Glue, Lambda, IAM, CloudFormation).
• 4+ years of experience developing and publishing dashboards in Amazon QuickSight.
• 5+ years of experience working in Databricks, with expertise in PySpark, Delta Lake, SQL, and performance tuning.
• Deep understanding of data modeling, data warehousing, and data lake architecture.
• Proven experience building high-performance, large-scale data pipelines and analytics platforms.
• Strong proficiency in SQL, Python, and Spark.
• Experience with DevOps practices and tools such as Git, Jenkins, Terraform, etc.
• Excellent communication and stakeholder engagement skills.
  

Preferred Qualifications:

• AWS Certification (e.g., AWS Certified Data Analytics – Specialty, Solutions Architect).
• Experience integrating Databricks and AWS services.
• Familiarity with BI governance frameworks and data cataloging tools (e.g., AWS Glue Data Catalog, Alation).

Physical Demands and Working Conditions

• Primarily a sedentary position requiring prolonged periods of sitting or standing at a workstation. Frequent use of a computer and keyboard; repetitive wrist/hand movements and fine motor skills for typing and mouse use.

• Ability to walk/drive between client site locations for on-site support and meetings. 
  

WHAT WE OFFER

Duncan Solutions, LLC, offers a professional environment, stability, upward mobility, and a wide breadth of benefits. We offer our full-time regular employees who meet eligibility criteria the following which include:

Medical, Dental, & Vision Insurance

• Medical, Dental, & Vision Insurance
• Healthcare & Dependent Flexible Spending Accounts (FSA)
• Health Savings Account (HSA) with Employer Contribution
• Company Paid Life and AD&D Insurance
• Company Paid Short- & Long-Term Disability
• Employee Assistance Program (EAP)
• Business Travel Accident Insurance
• Corporate Travel Discounts
• Bonus & Incentive Compensation Programs
• 401(k) with Employer Match (Traditional/Roth/Safe Harbor)
• Corporate Travel Discounts
• Bonus & Incentive Compensation Programs
• 401(k) with Employer Match (Traditional/Roth/Safe Harbor)
  

Paid Time Off

• 9 Company Holidays
• PTO Accrual
• Sick Time Accrual
• Parental Leave
• Jury Duty
• Bereavement
  

Other Voluntary Benefits

• Life and AD&D Insurance for Employees/Spouse/Child(ren)
• Critical Illness
• Accident Insurance
• Identity Theft Insurance
• Pre-paid Legal Insurance
  

Duncan Solutions, LLC is proud to be an Equal Opportunity Employer. We actively encourage applications from everybody. All qualified job applicants will receive consideration without regard to race, color, religion, creed, national origin, aboriginality, genetic information, ancestry, marital status, sex, sexual orientation, gender identity or expression, physical or mental disability, pregnancy, veteran status, age, political affiliation or any other non-merit characteristic.

Please visit our website to learn more about us https://www.duncansolutions.com/

To view all of our current job opportunities, please visit
 https://businessprocessingsolutions.bamboohr.com/careers