Principal Hadoop Administrator

| Hybrid
Sorry, this job was removed at 1:53 p.m. (CST) on Saturday, July 9, 2022
Find out who's hiring in Chicago, IL.
See all Developer + Engineer jobs in Chicago, IL
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

Company Description
Job Description
We are currently seeking a talented Principal Hadoop Admin for managing Big data, with DevOps experience on Linux Infrastructure. You will help optimize and integrate new infrastructure via continuous integration methodologies.
What You Will Be Doing:

  • Establish milestones for necessary contributions from departments and develop processes to facilitate their collaboration
  • Support cloud and On-Prem servers including security configurations, patching, and troubleshooting.
  • Develop scripts for automating client/server functions
  • Monitor automated systems recovery solutions
  • Assist other scrum team engineers in creating practical demonstrations of proposed solutions and demonstrating them to other members of the team
  • Provide detailed specifications for proposed solutions including materials, manpower and time necessary
  • Provide clear goals for all areas of a project and develop steps to oversee their timely execution
  • Work closely with engineering professionals within the company to maintain hardware and software needed for projects to be completed efficiently
  • Mentor and train other engineers throughout the company and seek to continually improve processes companywide
  • Work alongside project management teams to successfully monitor progress and implementation of initiatives
  • Responsible for implementation and ongoing administration of Hadoop infrastructure
  • Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
  • Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, HBase and Yarn access for the new users
  • Cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager Enterprise, etc.
  • Performance tuning of Hadoop clusters and Spark routines
  • Screen Hadoop cluster job performances and capacity planning
  • Monitor Hadoop cluster connectivity and security
  • Manage and review Hadoop log files
  • File system management and monitoring
  • HDFS support and maintenance
  • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability
  • Collaborating with application teams to perform Hadoop updates, patches, version upgrades when required
  • Work with Vendor support teams on support tasks
  • General operational expertise such as good troubleshooting skills, understanding of system's capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks
  • The most essential requirements are: They should be able to deploy Hadoop cluster, monitor critical parts of the cluster, and troubleshoot failures
  • Solid Understanding on premise and Cloud network architectures
  • Additional Hadoop skills like Sentry, Spark, Kafka, Oozie, etc


Preferred Skills

  • Kerberos administration skills
  • Experience with Cloudera or Hortonworks distribution
  • Familiarity with DevOps tools like Ansible, Fabric, Shell/Python scripting
  • 5 years hand-on experience on Cloud platforms - AWS or Azure
  • Experience in large project implementation using: AWS EC2, ELB, S3, IAM, ECS etc.
  • Experience developing engineering applications for a large corporation
  • Demonstrated project development and leadership skills
  • Current understanding of best practices regarding system security measures
  • Experience working together with teams from several departments to facilitate the orderly execution of a proposed project plan
  • Professional experience and a high-level understanding of working with various operating systems and their implications
  • Knowledge of Troubleshooting Core Java Applications is a plus
  • Proven track record in incorporating latest operational tools into big data platforms
  • Kubernetes working knowledge


What You Need for this Position

  • Bachelor's in Computer Science or related discipline preferred
  • 10+ years of Linux system administration
  • 10+ years of Hadoop infrastructure administration


Qualifications
Additional Information
When you're one of us, you get to run with the best. For decades, we've been helping marketers from the world's top brands personalize experiences for millions of people with our cutting-edge technology, solutions and services. Epsilon's best-in-class identity gives brands a clear, privacy-safe view of their customers, which they can use across our suite of digital media, messaging and loyalty solutions. We process 400+ billion consumer actions each day and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Positioned at the core of Publicis Groupe, Epsilon is a global company with more than 8,000 employees around the world. Check out a few of these resources to learn more about what makes Epsilon so EPIC:

  • Culture: https://www.epsilon.com/us/about-us/our-culture-epsilon
  • DE&I: https://www.epsilon.com/us/about-us/diversity-equity-inclusion
  • CSR: https://www.epsilon.com/us/about-us/corporate-social-responsibility
  • Life at Epsilon: https://www.epsilon.com/us/about-us/epic-blog


Great People Deserve Great Benefits
We know that we have some of the brightest and most talented associates in the world, and we believe in rewarding them accordingly. If you work here, expect competitive pay, comprehensive health coverage, and endless opportunities to advance your career.
Epsilon is an Equal Opportunity Employer. Epsilon's policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable federal, state or local law. Epsilon also prohibits harassment of applicants and employees based on any of these protected categories.
Epsilon will provide accommodations to applicants needing accommodations to complete the application process.
REF126732J
#LI-AM1

Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about EpsilonFind similar jobs