Hadoop and Spark Developer Lead
Sorry, this job was removed at 5:16 a.m. (CST) on Wednesday, January 11, 2023
By clicking Apply Now you agree to share your profile information with the hiring company.
Job Description:
Position Summary
Hadoop and Spark Lead will work on one or more projects in the Hadoop data lake, including technical deliverables as per business needs.
Daily Responsibilities
- Sound understanding and experience with Hadoop ecosystem (Cloudera).
- Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.
- Experience in working with a Big Data implementation in production environment
- Experience inHDFS, Map Reduce, Hive, impala, Linux/Unix technologies is mandatory.
- Experience in Kafka/spark is an added advantage.
- Able to analyze the existing shell scripts/python/Scala code to debug any issues or enhance the code.
- Sound knowledge of relational databases (SQL) and experience with large SQL based systems.
- Strong IT consulting experience in various data warehousing engagement, handling large data volumes, architecting big data environments.
- Deep understanding of algorithms, data structures, performance optimization techniques and software development in a team environment.
- Benchmark and debug critical issues with algorithms and software as they arise.
- Work with line of business (LOB) personnel, external vendors, and internal Data Services team to develop system specifications in compliance with corporate standards for architecture adherence and performance guidelines.
- Support multiple projects with competing deadlines.
Required Skills
- Bachelor's degree in a technical or business-related field, or equivalent working experience.
- Seven years of experience in data warehousing architectural approaches and minimum 4 years in big data (Cloudera).
- Exposure to and strong working knowledge of distributed systems.
- Excellent understanding of client-service models and customer orientation in service delivery.
- Ability to grasp the 'big picture' for a solution by considering all potential options in impacted area.
- Aptitude to understand and adapt to newer technologies.
- Assist in the evaluation of new solutions for integration into the Hadoop Roadmap/Strategy.
- The desire to learn new soft and technology skills and the desire to coach, mentor and train peers throughout the organization.
- The ability to work with team mates in a collaborative manner to achieve a mission.
- Presentation skills to prepare and present to large and small groups on technical and functional topics
Desired Skills
- Previous experience in the financial services industry.
- Broad BofA technical experience and good understanding of existing testing/operational processes and an open mind on how to enhance those.
- Understanding of industry trends and relevant application technologies.
- Experience in designing and implementing analytical environments and business intelligence solutions.
Shift:
1st shift (United States of America)
Hours Per Week:
40
Read Full Job Description