Hadoop Administration

Reposted 12 Days Ago
Be an Early Applicant
Foster City, CA, USA
In-Office
Senior level
Information Technology • Professional Services • Software • Consulting
The Role
Administer and maintain Hadoop clusters: install/configure upgrades, monitor performance and capacity, implement security (Kerberos/LDAP), manage HDFS, scheduling (Oozie/enterprise schedulers), troubleshoot, tune MapReduce jobs, and coordinate cross-functional infrastructure and DR/backup activities.
Summary Generated by Built In
Company Description

Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.

Job Description

  • At least 4 years of experience in Implementation and Administration of Hadoop infrastructure
  • At least 2 years of experience Architecting, Designing, Implementation and Administration of Hadoop infrastructure
  • At least 2 years of experience in Project life cycle activities on development and maintenance projects.
  • Should be able to provide Consultancy to client / internal teams on which product/flavor is best for which situation/setup
  • Operational expertise in troubleshooting , understanding of system’s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks
  • Hadoop, MapReduce, HBase, Hive, Pig, Mahout
  • Hadoop Administration skills: Experience working in Cloudera Manager or Ambari, Ganglia, Nagios
  • Experience in using Hadoop Schedulers - FIFO, Fair Scheduler, Capacity Scheduler
  • Experience in Job Schedule Management - Oozie or Enterprise Schedulers like Control-M, Tivoli
  • Good knowledge of Linux (RHEL, Centos, Ubuntu)
  • Experience in setting up Ad/LDAP/Kerberos Authentication models
  • Experience in Data Encryption technique

Responsibilities:-

  • Upgrades and Data Migrations
  • Hadoop Ecosystem and Clusters maintenance as well as creation and removal of nodes
  • Perform administrative activities with Cloudera Manager/Ambari and tools like Ganglia, Nagios
  • Setting up and maintaining Infrastructure and configuration for Hive, Pig and MapReduce
  • Monitor Hadoop Cluster Availability, Connectivity and Security
  • Setting up Linux users, groups, Kerberos principals and keys
  • Aligning with the Systems engineering team in maintaining hardware and software environments required for Hadoop
  • Software installation, configuration, patches and upgrades
  • Working with data delivery teams to setup Hadoop application development environments
  • Performance tuning of Hadoop clusters and Hadoop MapReduce routines
  • Screen Hadoop cluster job performances and capacity planning
  • Data modelling, Database backup and recovery
  • Manage and review Hadoop log files
  • File system management, Disk space management and monitoring (Nagios, Splunk etc)
  • HDFS support and maintenance
  • Planning of Back-up, High Availability and Disaster Recovery Infrastructure
  • Diligently teaming with Infrastructure, Network, Database, Application and Business Intelligence teams to guarantee high data quality and availability
  • Collaborating with application teams to install operating system and Hadoop updates, patches and version upgrades
  • Implementation of Strategic Operating model in line with best practices
  • Point of Contact for Vendor escalations
  • Ability to work in team in diverse/ multiple stakeholder environment
  • Analytical skills

Qualifications

  • Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
  • At least 7 years of experience within the Information Technologies.

Additional Information

** U.S. citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.

Note:-

  1. This is a Full-Time Permanent job opportunity for you.
  2. Only US Citizen, Green Card Holder, GC-EADH4-EAD & L2-EAD can apply.
  3. No OPT-EAD, TN Visa & H1B Consultants please.
  4. Please mention your Visa Status in your email or resume.

Skills Required

  • 4+ years implementation and administration of Hadoop infrastructure
  • 2+ years architecting, designing and implementing Hadoop infrastructure
  • 2+ years project life cycle experience on development and maintenance projects
  • 7+ years overall Information Technology experience
  • Experience with Hadoop ecosystem components: Hadoop, MapReduce, HBase, Hive, Pig, Mahout
  • Experience with Cloudera Manager or Ambari, Ganglia, Nagios for administration and monitoring
  • Experience with Hadoop schedulers: FIFO, Fair Scheduler, Capacity Scheduler (YARN)
  • Experience with job schedule management: Oozie or enterprise schedulers (Control-M, Tivoli)
  • Strong Linux administration skills (RHEL, CentOS, Ubuntu)
  • Experience setting up AD/LDAP/Kerberos authentication models
  • Experience with data encryption techniques, HDFS support, backup and recovery
  • Experience in performance tuning, capacity planning, and cluster upgrades/data migrations
  • Bachelor's degree or foreign equivalent (or equivalent progressive experience)
  • Ability to provide consultancy and work effectively with cross-functional teams and vendors
  • Experience with log/file system management and monitoring tools (Nagios, Ganglia, Splunk)
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
87 Employees
Year Founded: 2007

What We Do

SonSoft Inc. is a global consulting and IT services firm specializing in software development, software consultancy, and Information Technology Enabled Services (ITES). The company provides a range of expertise including business consulting, systems integration, application development, and product engineering, helping clients re-engineer and re-invent their businesses to compete in a changing marketplace.

Similar Jobs

In-Office
San Jose, CA, USA
87 Employees

SonSoft Inc. Logo SonSoft Inc.

Hadoop Administration

Information Technology • Professional Services • Software • Consulting
In-Office
Foster City, CA, USA
87 Employees

Wipfli Logo Wipfli

Manager, Financial Reporting - FQHC Industry Clients

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
3000 Employees
97K-145K Annually

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Lead Supervisor I

eCommerce • Fashion • Retail • Sales • Wearables • Design
Hybrid
Viejas Stop, CA, USA
16000 Employees
16-25 Hourly

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account