Big Data/Hadoop Administrator

Posted 17 Days Ago
Be an Early Applicant
Atlanta, GA, USA
In-Office
Senior level
Information Technology • Professional Services • Software • Consulting
The Role
Build, configure, and maintain open-source Hadoop clusters and related ecosystem (HDFS, Spark, Kafka, Hive, YARN, Oozie). Ensure high availability, real-time streaming support, cluster performance, capacity planning, security, patching, node lifecycle, logs, and collaborate with architects and dev teams.
Summary Generated by Built In
Company Description

Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.

Job Description

Required:

Ø Must have at least 7 years of experience as Hadoop administrator.

Ø Must have experience building and administrating open source Hadoop environment or product without licensed distribution, warranty and support.

Ø Must have experience implementing and administrating Hadoop environment using distributions like Cloudera Express (preferred), Apache or Hortonworks.

Ø Must have good UNIX or Linux experience preferably Red Hat.

Ø Must have experience supporting High availability and Real-time streaming environment.

Ø General operational expertise such as good troubleshooting skills, understanding of system’s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks.

Ø Experience in Hadoop skills like MR, Hive, Pig, Spark, Kafka, Oozie, etc… is an advantage.

Ø Knowledge of Troubleshooting Core Java Applications is a plus.

Ø Good to have knowledge on Puppet/Chef/Ansible.

Ø Good to have knowledge or experience in supporting MySQL & NoSQL Databases like Cassandra & HBase.

Responsibilities:

Ø Responsible to build Hadoop Platform & Infrastructure from the scratch

Ø Aligning with development and architecture teams to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.

Ø Responsible create security layer for Hadoop environment.

Ø Working with data delivery teams to setup new Hadoop users, including access to HDFS, Hive, Pig and MapReduce, etc.

Ø Cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager Express or other open source tools.

Ø Screen Hadoop cluster job performances and capacity planning

Ø Monitor Hadoop cluster connectivity and security

Ø Manage and review Hadoop log files.

Ø File system management and monitoring.

Ø HDFS support and maintenance.

Ø Responsible to build a Hadoop Infrastructure that guarantees high data quality and availability.

Ø Collaborating with Sys Admins to install operating system and Hadoop updates, patches, version upgrades when required.

Ø Interact with the business users, Enterprise Architects and Technical Leads to gather the requirements.

Ø Experienced in building or administrating Hadoop cluster with HDFS, Spark, Kafka, Zookeeper, Impala, Hive, Yarn, Hue, Oozie, etc.

Ø Experienced in setting up high availability and disaster recovery Infrastructure across different data centers.

Ø Experienced in building or administrating a Real-time streaming environment.

Qualifications

Qualifications Basic:

• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.

Additional Information

** U.S. citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.

Note:-

  1. This is a Full Time job oppurtunity.
  2. Only US CitizenGreen Card HolderGC-EADH4-EADL2-EADTN VIsa can apply.
  3. No OPT-EAD and H1B for this position.
  4. Please mention your email id in your email or resume.

Skills Required

  • Minimum 7 years experience as a Hadoop administrator
  • Experience building and administrating open-source Hadoop environments (no licensed distributions)
  • Experience implementing/administrating Hadoop using Cloudera Express, Apache, or Hortonworks
  • Strong UNIX/Linux experience (preferably Red Hat)
  • Experience supporting high availability and real-time streaming environments
  • Operational expertise: troubleshooting, capacity planning, OS/memory/CPU/storage/network fundamentals
  • Experience building Hadoop platform and infrastructure from scratch
  • Experience with Hadoop ecosystem components: HDFS, MapReduce, Hive, Pig, Spark, Kafka, Oozie, Zookeeper, Impala, YARN, Hue
  • Bachelor's degree or foreign equivalent (or applicable experience in lieu)
  • Authorization to work in the U.S.; employer does not sponsor visas (US Citizen, Green Card, GC-EAD, H4-EAD, L2-EAD, TN Visa allowed)
  • Experience with configuration management tools (Puppet, Chef, Ansible)
  • Knowledge of troubleshooting Core Java applications
  • Experience supporting MySQL and NoSQL databases such as Cassandra and HBase
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
87 Employees
Year Founded: 2007

What We Do

SonSoft Inc. is a global consulting and IT services firm specializing in software development, software consultancy, and Information Technology Enabled Services (ITES). The company provides a range of expertise including business consulting, systems integration, application development, and product engineering, helping clients re-engineer and re-invent their businesses to compete in a changing marketplace.

Similar Jobs

SonSoft Inc. Logo SonSoft Inc.

Big Data Hadoop Admin

Information Technology • Professional Services • Software • Consulting
In-Office
Atlanta, GA, USA
87 Employees

ZS Logo ZS

Senior Industrial IT/OT Integration Specialist

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
9 Locations
15000 Employees
160K-177K Annually

ZS Logo ZS

Consultant

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
8 Locations
15000 Employees
160K-177K Annually

People Inc. Logo People Inc.

Senior Software Engineer

AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech
Remote or Hybrid
US
3500 Employees
160K-195K Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account