Cloud Data Engineer

Posted 10 Hours Ago
Hiring Remotely in San Francisco, CA
Remote
Expert/Leader
Information Technology • Consulting
The Role
The Cloud Data Engineer will design and implement scalable data processing solutions using PySpark and AWS Big Data technologies, oversee the integration of Palantir, optimize AWS Cloud services, manage AWS Batch workflows, and mentor junior staff while ensuring data quality and compliance with industry standards.
Summary Generated by Built In

Company Description

Derex Technologies Inc specializes in providing IT consulting, staffing solutions and software services. Globally headquartered in Harrison New Jersey since 1996 Derex delivers the highest quality technology professionals and an array of customized IT talent solutions designed to improve productivity and drive results to global clients throughout North America.

With over two decades of unparalleled experience, Derex provides supports to its clientele, across such industries as Systems Integration, Banking and Finance, Telecommunications, Pharmaceutical and Life Sciences, Energy, Healthcare, Technology, Transportation, and local and federal Government agencies.

Job Description

Job Title: Cloud Data Engineer
Experience: 10 to 14 Yrs

Remote work – but need candidates from San Francisco, CA
Job Summary: We are seeking an experienced Cloud Data Engineer with 10 to 14 years of experience to join our dynamic team. The ideal candidate will have strong technical skills in PySpark, Palantir, AWS Cloud, AWS Big Data, and AWS Batch. This hybrid role requires proficiency in English and offers a day shift schedule. Engineer will play a crucial role in designing and implementing innovative solutions that drive our company's success.
Responsibilities:
- Cloud Data Engineer Design and implement scalable data processing solutions using PySpark and AWS Big Data technologies.
- Oversee the integration of Palantir into our data architecture to enhance data analysis and decision-making capabilities.
- Provide expertise in AWS Cloud services to optimize performance, security, and cost-efficiency.
- Develop and manage AWS Batch workflows to ensure efficient data processing and job scheduling.
- Collaborate with cross-functional teams to gather requirements and translate them into technical solutions.
- Ensure data quality and integrity through robust data validation and cleansing processes.
- Monitor and troubleshoot data pipelines to maintain seamless data flow and minimize downtime.
- Implement best practices for data governance and compliance with industry standards.
- Mentor and guide junior team members to foster a culture of continuous learning and improvement.
- Conduct performance tuning and optimization of data processing jobs to achieve optimal efficiency.
- Stay updated with the latest advancements in data technologies and incorporate them into our architecture.
- Provide technical support and troubleshooting for data-related issues to ensure timely resolution.
- Prepare and present technical documentation and reports to stakeholders for transparency and informed decision-making.
Qualifications:
- Possess a strong background in PySpark, Palantir, AWS Cloud, AWS Big Data, and AWS Batch.
- Demonstrate excellent problem-solving skills and the ability to work independently and collaboratively.
- Exhibit proficiency in English with strong communication skills for effective interaction with team members and stakeholders.
- Show a proven track record of designing and implementing complex data solutions in a hybrid work environment.
- Have a deep understanding of data governance, security, and compliance best practices.
- Display the ability to mentor and guide junior team members to achieve project goals.
- Maintain a proactive approach to staying updated with the latest industry trends and technologies.





Regards,

 

Manoj

Derex Technologies INC

Contact : 973-834-5005 Ext 206

Additional Information

All your information will be kept confidential according to EEO guidelines.

Top Skills

Pyspark
The Company
HQ: Harrison, NJ
24 Employees
On-site Workplace
Year Founded: 1996

What We Do

DEREX Technologies, Inc. established in 1996 is engaged nationally in providing professional computer services, including management consulting firm. We provide expert services nationwide to Fortune 500 companies and other private and public organizations in the United States. Derex provides a multi-faceted portfolio of products and services to its clients, including complete IT solutions.

Jobs at Similar Companies

MassMutual India Logo MassMutual India

Intern

Big Data • Fintech • Information Technology • Insurance • Financial Services
Hyderabad, Telangana, IND

Silverfort Logo Silverfort

Commercial Sales Manager- East

Information Technology • Sales • Security • Cybersecurity • Automation
Remote
8 Locations
357 Employees

Jobba Trade Technologies, Inc. Logo Jobba Trade Technologies, Inc.

Senior Back End Developer

Cloud • Information Technology • Productivity • Professional Services • Software
Remote
Hybrid
Chicago, IL, USA
45 Employees

Similar Companies Hiring

MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana
Silverfort Thumbnail
Security • Sales • Information Technology • Cybersecurity • Automation
SG
357 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account