Senior Data Engineer (DataBricks)

Posted 5 Days Ago
Crofton, MD, USA
In-Office
Senior level
Information Technology • Consulting • Cybersecurity
The Role
Lead Databricks engineering efforts for enterprise-scale data and analytics platforms in hybrid cloud environments. Design, develop, integrate, and maintain data solutions; resolve technical issues; guide architecture and engineering teams; ensure data quality and observability; coordinate client installations; manage expectations; contribute to product roadmaps; and support deployment, maintenance, modernization, and troubleshooting at customer and Navy sites.
Summary Generated by Built In

Job Title: Senior Data Engineer (DataBricks)

Job Type: Full Time/Contract

Location: Northern Virginia, Maryland, DC

Clearance: Secret

Who is Ardalyst Defense, LLC?

Ardalyst Defense, LLC is a Maryland, Service-Disabled Veteran-Owned Small Business (SDVOSB) that provides engineering services and technical, analytical and cyberspace operations services to integrated U.S. government agency operations. Ardalyst personnel have decades of direct operations experience in full-scope Cyberspace Operations - at the Service, Joint and National Agency levels.

Are you an Ardalyst?

Ardalyst is a mashup of Ardent, meaning “passionate” and Catalyst, meaning “change agent.” To be an Ardalyst means to be passionate about creating and sustaining meaningful transformations.

Speak your mind – Collaboration is at the heart of everything we do and our belief in diversity of people supports our goal for diversity in thought. “Ardalysts” (that’s just what we call ourselves) come ready to contribute and find solutions.

Focus On Your Strengths – We invest in understanding the strengths and weaknesses of each employee so that you can shine at what YOU do best.

See Yourself Grow – Ardalysts have cited being encouraged to take educated risk, kick-start progress, and advance their skills as one of their favorite things about working at Ardalyst and we’re determined to keep it that way.

Job Description

We are seeking an experienced Databricks Engineer to support the design, development, integration, and maintenance of enterprise-scale data and analytics solutions in hybrid cloud environments. In this role, you will lead Databricks implementations, develop data processing and analytics capabilities using modern data engineering technologies, and provide technical guidance throughout the solution lifecycle. You will collaborate with stakeholders to define technical requirements, resolve complex data and infrastructure challenges, ensure data quality and observability, and support the successful deployment of scalable, cloud-based data platforms that enable mission and business objectives.

Duties and Responsibilities

As a lead engineer for Databricks integration for designing, developing, enhancing, and maintaining enterprise-scale data projects, the following skills are required:

  • Develop and deliver the client installation plan through coordination with clients and the project team
  • Act as escalation point for technical issues from clients and other system engineers
  • Manage client expectations regarding solution functionality, deployment processes, and realistic timelines
  • Provide subject matter expert in solution architecture for hybrid cloud environments
  • Collaborate with Leadership Team to review and contribute to Product Roadmaps
  • Identify the organizational impact of the technical solution architecture
  • Provide technical leadership to the engineering team, as necessary
  • Travel as required to customer sites, naval installations, shipyards, and vessels in support of installation, maintenance, modernization, and troubleshooting activities.
  • Perform other related duties as assigned by supervisors, team leads, or program management.

Required Skills/Qualifications

Senior Databricks engineer with 5 years’ experience with knowledge of databases, data warehousing, data analytics, or related data technologies.

  • Associate’s degree in information technology, Networking, Cybersecurity, or a related field, or an equivalent combination of education, military training, and relevant experience.
  • Active DoD Secret Security Clearance required.
  • Hybrid cloud data and infrastructure design with implementation experience utilizing typical data quality functions involving standardization, transformation, rationalization, linking, and matching.
  • Seven (7) years’ experience in Python and SQL for data analysis, data processing, or problem-solving., to include experience working with in-memory computing using R, Python, Spark, PySpark, Kafka, and Scala.
  • Seven (7) years' experience identifying data source telemetry and routing it for operational observability
  • Excellent communication (written and oral) and interpersonal skills

Benefits

  • Competitive salary commensurate with experience
  • Paid Time Off (PTO)
  • Paid Holidays
  • 401(k) Retirement Plan
  • Health, Dental, Vision and Life insurance
  • Short Term and Long-Term Disability insurance
  • Monetary assistance with training and certifications

What Ardalyst Offers You

  • The opportunity to support meaningful Navy missions while working alongside experienced IT, engineering, and cybersecurity professionals.
  • A collaborative environment where employees are encouraged to contribute ideas, expand their technical skills, and take on new challenges.
  • Exposure to a wide range of technologies, systems, and operational environments that support professional growth and hands-on experience.
  • Opportunities for training, certification development, and continued learning.

Disclaimer

Ardalyst Defense, LLC is an EOE that empowers employees, no matter their race, color, religion, sex, gender identity, sexual orientation, national origin, disability, veteran status, or other protected characteristic—to meet and exceed customer expectations and thrive in a collaborative and dynamic work environment.

Skills Required

  • At least five years of experience with Databricks, databases, data warehousing, data analytics, or related data technologies.
  • Associate's degree in information technology, networking, cybersecurity, or a related field, or equivalent education, military training, and relevant experience.
  • Active Department of Defense Secret security clearance.
  • Experience designing and implementing hybrid cloud data and infrastructure solutions.
  • Experience with data quality functions including standardization, transformation, rationalization, linking, and matching.
  • Seven years of experience with Python and SQL for data analysis, data processing, or problem-solving.
  • Experience with R, Python, Spark, PySpark, Kafka, and Scala for in-memory computing.
  • Seven years of experience identifying data source telemetry and routing it for operational observability.
  • Excellent written, oral, and interpersonal communication skills.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Annapolis, MD
52 Employees
Year Founded: 2013

What We Do

Ardalyst is a cybersecurity and digital transformation company that helps public and private organizations strengthen cyber defenses, meet regulatory requirements, and expand their businesses. It combines cybersecurity services with Microsoft-focused productivity and security solutions, cloud and business applications, DevOps, cyber resiliency, digital risk management, consulting, IT support, and related transformation capabilities through implementation, ongoing support, and strategic guidance for organizations of varying sizes.

Similar Jobs

In-Office or Remote
Columbia, MD, USA
25 Employees

MongoDB Logo MongoDB

Senior Manager, Procurement

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
United States
5550 Employees
76K-149K Annually

MassMutual Logo MassMutual

Consultant

Big Data • Fintech • Information Technology • Insurance • Financial Services
Remote or Hybrid
United States
6000 Employees
138K-181K Annually

Sage Logo Sage

Regional Sales Leader (East Coast)

Hardware • Healthtech • Software • Analytics
Remote or Hybrid
USA
95 Employees
200K-425K Annually

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account