Senior Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Charlotte, NC, USA
In-Office
Senior level
Artificial Intelligence • Information Technology • Software • Consulting
The Role
Design and maintain scalable data pipelines and ETL/ELT workflows using Databricks, Python, PySpark, Spark SQL, Delta Lake, and cloud platforms. Build batch and real-time processing solutions, integrate enterprise data sources and APIs, implement data quality and governance controls, and optimize performance. Support AI Agent configuration and integration, including RAG workflows, within enterprise data environments. Insurance industry experience is preferred.
Summary Generated by Built In
Senior Data Engineer - Onsite
Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations.
We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications. As we continue to grow, we're looking for a skilled to join our dynamic team and contribute to our mission of transforming business processes through technology.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.
Job Title: Senior Data Engineer
Job Location: Charlotte, NC.
Job Type: Onsite, Contract on W2
Experience Required: 13+ Years

Job Description:
The Data Engineer with strong hands-on expertise in Databricks and Python to join our insurance industry client in Charlotte, NC. The ideal candidate will have extensive experience designing, developing, and maintaining scalable data engineering solutions using Databricks, Python, and modern cloud-based data platforms. Additionally, the candidate should have exposure to AI Agent configuration, development, and implementation, including integrating AI-powered capabilities into enterprise data workflows.

Candidates with prior experience in the insurance industry, particularly in building data solutions for policy administration, claims processing, underwriting, billing, or customer analytics, will be preferred.

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines using Databricks and Python.
  • Build and optimize ETL/ELT workflows for processing structured and unstructured data.
  • Develop data transformation solutions using PySpark, Spark SQL, and Python.
  • Work with Databricks Lakehouse architecture, Delta Lake, and Unity Catalog.
  • Implement batch and real-time data processing solutions.
  • Develop reusable data engineering frameworks and optimize data processing performance.
  • Integrate data from multiple enterprise systems, APIs, databases, and cloud platforms.
  • Implement data quality checks, validation, monitoring, and error-handling mechanisms.
  • Collaborate with data architects, data scientists, AI engineers, and business stakeholders.
  • Support AI Agent configuration, development, and implementation within enterprise workflows.
  • Integrate AI Agents with enterprise data sources, APIs, and backend services.
  • Assist in implementing Retrieval-Augmented Generation (RAG) workflows and AI-powered data solutions.
  • Follow best practices for data security, governance, scalability, and performance.

Required Skills:

  • Strong hands-on experience with Databricks and its ecosystem.
  • Strong programming experience in Python.
  • Hands-on experience with PySpark, Spark SQL, and Apache Spark.
  • Experience building complex ETL/ELT data pipelines.
  • Strong understanding of data warehousing, data lakes, and Lakehouse architecture.
  • Experience with Delta Lake and Databricks workflows.
  • Experience with SQL and relational databases.
  • Understanding of cloud platforms such as AWS, Azure, or GCP.
  • Exposure to AI Agent configuration, development, and implementation.
  • Understanding of REST APIs and integration with enterprise applications.

Would you like to know more about this opportunity? For immediate consideration, please send your resume directly to [email protected] or contact us via phone at 908-505-3899
At BVTeck, we are committed to providing equal employment opportunities and fostering an inclusive work environment. We encourage applications from all qualified individuals regardless of race, ethnicity, religion, gender identity, sexual orientation, age, disability, or any other protected status. If you require accommodations during the recruitment process, please let us know.
Position offered by "No Fee agency.”

Skills Required

  • 13+ years of professional experience
  • Strong hands-on experience with Databricks and its ecosystem
  • Strong programming experience in Python
  • Hands-on experience with PySpark, Spark SQL, and Apache Spark
  • Experience building complex ETL/ELT data pipelines
  • Strong understanding of data warehousing, data lakes, and Lakehouse architecture
  • Experience with Delta Lake and Databricks workflows
  • Experience with SQL and relational databases
  • Understanding of AWS, Azure, or GCP
  • Exposure to AI Agent configuration, development, and implementation
  • Understanding of REST APIs and enterprise application integration
  • Prior insurance industry experience, especially policy administration, claims processing, underwriting, billing, or customer analytics
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Bridgewater, NJ
53 Employees
Year Founded: 2020

What We Do

Bright Vision Technologies is a minority-owned organization founded in July 2020 and based in New Jersey, USA. The company specializes in delivering top-tier staffing and IT consulting services, including custom computer programming and systems design. Additionally, they are a product engineering firm with a flagship AI-powered talent intelligence and enterprise automation platform called Lumina, which helps transform IT into a strategic asset for their valued partners.

Similar Jobs

SoFi Logo SoFi

Senior Data Engineer

Fintech • Mobile • Software • Financial Services
Easy Apply
Remote or Hybrid
United States
4500 Employees
125K-234K Annually

Optum Logo Optum

Senior Data Engineer

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Hybrid
Raleigh, NC, USA
160000 Employees
92K-164K Annually

The Aerospace Corporation Logo The Aerospace Corporation

Senior Supplier Quality Engineer - Data Analytics

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Remote or Hybrid
2 Locations
4600 Employees
97K-146K Annually

PwC Logo PwC

Applied AI Health Data System Engineer-Senior Manager

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
65 Locations
370000 Employees
124K-280K Annually

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account