Sr. Big Data Platform Engineer
Description
Hybrid
This is a Hybrid position within our Organization . The role will allow employees to work offsite but will also require onsite work based on business needs. The selected candidate will be expected to commute to the innovation center to which they are assigned as their primary GM facility. This position requires an employee to be onsite 1-3 times per week.
In this exciting and visible role, you will be responsible and accountable for the design, implementation, configuration, and successful transition to an open source Hadoop distribution from a commercial variant. This will include:
- Following standard installation recommendations, configuring the technologies to match the needs of the function being served, and delivering to project schedules.
- Expertise in the Hadoop platform to function independently for day to day tasks.
- Work with several technical teams to rationalize throughput and sizing demand to define efficient and effective solutions that bring together technologies from all areas.
- Being a technical resource to numerous project teams simultaneously.
- Being a pivotal force in multi-functional teams and to support the platform tenants.
- Work with project teams to develop robust system designs that meet the criteria for functionality, stability, performance, and resiliency to deliver effective data platforms for our business.
- Lead as platform engineer, to gather requirements, obtain information from other support groups, execute project tasks, deliver systems, and provide support through the lifecycle of the platform.
- Responsibilities include ensuring IT standards are met, production readiness processes are followed, and a quality system product is delivered and turned over to Production Support personnel.
- Holds themselves and others accountable for demonstrating GMs values and cultural behaviors. Models GM behaviors and creates a forward-thinking culture.
Knowledge
The role requires expert knowledge of the Hadoop ecosystem, platform stack, networking, robust knowledge of general IT concepts. Thorough knowledge of system design principles to include reliability, availability, scalability, knowledge of peripheral domains is necessary.
Additional Description
Requirements
- 3+ years experience with Hadoop and associated components (Yarn, Spark, Hive, HDFS, Hue, etc)
- Experience in full stack troubleshooting and performance analysis
- Experience in troubleshooting job throughput and platform health
- Experience with Chef, scripting and other automation tools
- Knowledge of Hadoop security methodology (Kerberos, Knox, Ranger, etc)
- Ability to perform on a high-performance team
- Ability to optimize the performance of jobs and platforms
- Experience working on teams with a heavy emphasis on DevOps
- Good problem-solving skills and being able to come up with designs for complex engineering problems
- Experience with Go, Java, Python and Scala a plus
- Experience with Spectrume Scale/ESS a plus
- Understanding of GIT and CI/CD practices and tools (preferably Azure)
COMPENSATION
The median level of salary compensation for this role is $86,460 - $113,760
BONUS POTENTIAL
An incentive pay program offers payouts based on company performance, job level, and individual performance.
BENEFITS
GM offers a variety of health and well-being benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more.
About GM
Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all.
Why Join Us
We aspire to be the most inclusive company in the world. We believe we all must make a choice every day - individually and collectively - to drive meaningful change through our words, our deeds and our culture. Our Work Appropriately philosophy supports our foundation of inclusion and provides employees the flexibility to work where they can have the greatest impact on achieving our goals, dependent on role needs. Every day, we want every employee, no matter their background, ethnicity, preferences, or location, to feel they belong to one General Motors team.
Total Rewards | Benefits Overview
From day one, we're looking out for your well-being-at work and at home-so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources.
Diversity Information
General Motors is committed to being a workplace that is not only free of discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that workforce diversity creates an environment in which our employees can thrive and develop better products for our customers. We understand and embrace the variety through which people gain experiences whether through professional, personal, educational, or volunteer opportunities. GM is proud to be an equal opportunity employer.
We encourage interested candidates to review the key responsibilities and qualifications and apply for any positions that match your skills and capabilities.
Equal Employment Opportunity Statements
The policy of General Motors is to extend opportunities to qualified applicants and employees on an equal basis regardless of an individual's age, race, color, sex, religion, national origin, disability, sexual orientation, gender identity/expression or veteran status. Additionally, General Motors is committed to being an Equal Employment Opportunity (EEO) Employer and offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us at [email protected] or call us at 800-865-7580. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.