Lead Data Engineer – PySpark & Cloud Integration

OFFSHORE only

Job Summary:
Looking for a developer who has hands-on experience with Databricks/Pyspark , Java, Webservices.  Position is long-term and will likely be renewed annually. 

Minimum Qualifications and Job Requirements:

* Must be a team player.
 * Must have at least 5 years of IT development experience.
 * Must have strong analytical and problem-solving skills.
 * Must have experience in designing solutions, performing code reviews, and mentoring junior engineers.
 * Must have strong SQL and backend experience and be working on data-driven projects.
 * Must have the following experience:
Python/PySpark
SQL/ PL/SQL
Databricks
 * Java/C#
 * Preferred to have the following experience:
Azure
Kafka
Node JS
Azure Data Factory 

Essential Job Functions:

- Understands the full picture and helps operations with monitoring, dashboards, etc.
- Work with the architect on the design
- Constantly keeps an eye on the cost and performance of the system
- Work with BA on the integration requirements
- Ability to troubleshoot performance issues and other functional issues
- Attention to detail and documents the key decisions made
- Able to mentor or guide junior developers and do code reviews
- Ability to handle fast-paced projects and willing to look into production issues

Other Responsibilities: 

* Document and maintain project artifacts.
* Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief Information Officer.
* Safeguard the company’s assets.
* Adhere to the company’s compliance program.
* Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
* Maintain focus on customer service, efficiency, quality, and growth.
* Collaborating with additional team members
* Other duties as assigned.