Big Data Architect (with ETL Background)

Posted 2 Days Ago
Be an Early Applicant
New York, NY, USA
In-Office
Junior
Information Technology • Professional Services • Software • Consulting
The Role
Design, build, and support a data lake: manage ingestion, data management, and client consumption. Implement Big Data platforms (HDFS, YARN), optimize Hive (partitioning, reducer/block sizing), develop Spark jobs (Python/Scala), work with ETL tools (Informatica) and NoSQL (Cassandra, Drill, Impala) in AWS. Meet deadlines, handle multiple tasks, and communicate with stakeholders.
Summary Generated by Built In
Company Description

SonSoft is an IT Staffing and consulting firm and duly organized under the laws of the Commonwealth of Georgia. We are growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.

Job Description

  • The Data Lake engineer should come from the background of a Big Data Architect. The position will be in support of data management, ingestion, and client consumption. This individual has an absolute requirement to be well versed in Big Data fundamentals such as HDFS and YARN. More than a working knowledge of Hive is required with understanding of partitioning/reducer size/block sizing/etc.
  • Preferably, the candidate has a strong knowledge of Spark on either Python or Scala.
  • Good Spark knowledge is required.
  • Knowledge of other industry ETL tools (including No SQL) such Cassandra/Drill/Impala/etc. is a plus.
  • They should of 1 year exp. in these technologies implemented in cloud (AWS).So they should have the associated cloud experience in AWS.
  • Ability to meet deadlines and handle multiple tasks, decisive with strong leadership qualities, flexible in work schedules and possess good communication skills.
  • Skills/Qualifications: BE, BTech, MCA, Worked on Informatica PowerCenter, and other informatica products. Should have Strong Analytical and interpersonal skills with good written and verbal communication

Additional Information

** U.S. citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.

Note:-

  1. This is a Full-Time Permanent job opportunity for you.
  2. Only US Citizen, Green Card Holdercan apply.
  3. No  , H4-EAD & L2-EADTN Visa, GC-EAD OPT-EAD & H1B Consultants please.
  4. Please mention your Visa Status in your email or resume.

Skills Required

  • Experience with HDFS and YARN
  • Strong Hive knowledge (partitioning, reducer/block sizing)
  • Good Spark knowledge
  • Spark development using Python or Scala
  • Experience implementing these technologies in AWS (around 1 year)
  • Experience with Informatica PowerCenter and other Informatica products
  • BE, BTech, or MCA degree
  • Knowledge of NoSQL technologies (Cassandra, Apache Drill, Impala)
  • Strong analytical, interpersonal, written and verbal communication skills
  • Authorization to work in the U.S. (US Citizen or Green Card Holder); employer cannot sponsor visas
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
87 Employees
Year Founded: 2007

What We Do

SonSoft Inc. is a global consulting and IT services firm specializing in software development, software consultancy, and Information Technology Enabled Services (ITES). The company provides a range of expertise including business consulting, systems integration, application development, and product engineering, helping clients re-engineer and re-invent their businesses to compete in a changing marketplace.

Similar Jobs

SonSoft Inc. Logo SonSoft Inc.

Data Architect

Information Technology • Professional Services • Software • Consulting
In-Office
New York, NY, USA
87 Employees

SonSoft Inc. Logo SonSoft Inc.

Data Architect

Information Technology • Professional Services • Software • Consulting
In-Office
New York, NY, USA
87 Employees

ZS Logo ZS

Consultant

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
7 Locations
15000 Employees
120K-137K Annually

Pfizer Logo Pfizer

Vice President, US Commercial AI Product Lead, AIA

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office
New York City, NY, USA
121990 Employees
274K-457K Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account