Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations.
We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications. As we continue to grow, we're looking for a skilled to join our dynamic team and contribute to our mission of transforming business processes through technology.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.
Job Title: Senior Data Engineer
Job Location: Charlotte, NC.
Job Type: Onsite, Contract on W2
Experience Required: 13+ Years
Job Description:
The Data Engineer with strong hands-on expertise in Databricks and Python to join our insurance industry client in Charlotte, NC. The ideal candidate will have extensive experience designing, developing, and maintaining scalable data engineering solutions using Databricks, Python, and modern cloud-based data platforms. Additionally, the candidate should have exposure to AI Agent configuration, development, and implementation, including integrating AI-powered capabilities into enterprise data workflows.
Candidates with prior experience in the insurance industry, particularly in building data solutions for policy administration, claims processing, underwriting, billing, or customer analytics, will be preferred.
Key Responsibilities- Design, develop, and maintain scalable data pipelines using Databricks and Python.
- Build and optimize ETL/ELT workflows for processing structured and unstructured data.
- Develop data transformation solutions using PySpark, Spark SQL, and Python.
- Work with Databricks Lakehouse architecture, Delta Lake, and Unity Catalog.
- Implement batch and real-time data processing solutions.
- Develop reusable data engineering frameworks and optimize data processing performance.
- Integrate data from multiple enterprise systems, APIs, databases, and cloud platforms.
- Implement data quality checks, validation, monitoring, and error-handling mechanisms.
- Collaborate with data architects, data scientists, AI engineers, and business stakeholders.
- Support AI Agent configuration, development, and implementation within enterprise workflows.
- Integrate AI Agents with enterprise data sources, APIs, and backend services.
- Assist in implementing Retrieval-Augmented Generation (RAG) workflows and AI-powered data solutions.
- Follow best practices for data security, governance, scalability, and performance.
Required Skills:
- Strong hands-on experience with Databricks and its ecosystem.
- Strong programming experience in Python.
- Hands-on experience with PySpark, Spark SQL, and Apache Spark.
- Experience building complex ETL/ELT data pipelines.
- Strong understanding of data warehousing, data lakes, and Lakehouse architecture.
- Experience with Delta Lake and Databricks workflows.
- Experience with SQL and relational databases.
- Understanding of cloud platforms such as AWS, Azure, or GCP.
- Exposure to AI Agent configuration, development, and implementation.
- Understanding of REST APIs and integration with enterprise applications.
Would you like to know more about this opportunity? For immediate consideration, please send your resume directly to [email protected] or contact us via phone at 908-505-3899
At BVTeck, we are committed to providing equal employment opportunities and fostering an inclusive work environment. We encourage applications from all qualified individuals regardless of race, ethnicity, religion, gender identity, sexual orientation, age, disability, or any other protected status. If you require accommodations during the recruitment process, please let us know.
Position offered by "No Fee agency.”
Skills Required
- 13+ years of professional experience
- Strong hands-on experience with Databricks and its ecosystem
- Strong programming experience in Python
- Hands-on experience with PySpark, Spark SQL, and Apache Spark
- Experience building complex ETL/ELT data pipelines
- Strong understanding of data warehousing, data lakes, and Lakehouse architecture
- Experience with Delta Lake and Databricks workflows
- Experience with SQL and relational databases
- Understanding of AWS, Azure, or GCP
- Exposure to AI Agent configuration, development, and implementation
- Understanding of REST APIs and enterprise application integration
- Prior insurance industry experience, especially policy administration, claims processing, underwriting, billing, or customer analytics
What We Do
Bright Vision Technologies is a minority-owned organization founded in July 2020 and based in New Jersey, USA. The company specializes in delivering top-tier staffing and IT consulting services, including custom computer programming and systems design. Additionally, they are a product engineering firm with a flagship AI-powered talent intelligence and enterprise automation platform called Lumina, which helps transform IT into a strategic asset for their valued partners.









