Data Engineer

Posted Yesterday
San Francisco, CA, USA
In-Office
150K-150K Annually
Expert/Leader
Agency • Professional Services • Consulting
The Role
Lead design and implementation of a scalable Big Data Audience Management platform (500+ TB). Own data pipelines (ingest, validation, transformation, storage) using Spark and Scala, mentor engineers, perform R&D on new technologies, and partner with product managers to meet roadmap and business needs.
Summary Generated by Built In
Company Description

Punch is a full service digital agency based out of New York, Silicon Valley, LA, Boston, Stockholm and Phuket, Thailand. Here at Punch, we take pride in tackling our clients’ most challenging tasks. Founded by a group of former Google Engineers and now with over 75 staff, Punch is now leading the way in creating new cutting-edge technology.

We're looking for innovative thinkers with a hunger to expand their knowledge!
We are building a more technical world.Go ahead and check out some of our work here: www.punch-agency.com

Job Description

We are seeking an extremely talented senior/lead data engineer to design & implement highly reliable & scalable Audience Management Big Data Platform (500+ Terabytes).

Responsibilities:

- Build, enhance and scale our existing Big Data Platform to process 500+ Terabytes of data from various 3rd party providers.

- Technically own the complete data pipeline module including data ingestion, validation, transformation & storage in the data platform.

- Design and write clean, robust, server-side code using Spark & Scala.

- Perform R & D to evaluate new technologies, generate different ideas & patentable IP to communicate value for company

- Work closely with team members & mentor them technically

- Partner with product managers to support product roadmap & business needs

Required Skills:

- 10 - 15 years experience in software development primarily in Big Data domain using Spark & Hadoop eco system.

- 5+ Years of experience in Spark & Scala (Skill Level: 8 or more out of 10)

- Bachelors degree in Computer Science or equivalent.

- 5+ years experience designing, building and launching extremely efficient & reliable data pipelines to move data (both large and small amounts) using modern data architecture/tools.

- Strong background (5+ years) in ETL processing for large amount of data (250+ Terabytes)

- Multiple years of experience working with 250+ Terabytes of data for ETL using Spark & Scala

- 3+ years experience working in Agile environment (SCRUM)

Nice To Have Skills:

- Experience in digital marketing (Good Domain knowledge on digital marketing Industry)

- Experience working with AWS (S3, EMR, EC2, RDS)

Job Type: Full-time

Required education:

  • Bachelor's

Required experience:

  • designing, building: 5 years

Job Type: Full-time

Required education:

  • Bachelor's

Required experience:

  • designing, building: 5 years

Qualifications

Required Skills:

- 10 - 15 years experience in software development primarily in Big Data domain using Spark & Hadoop eco system.

- 5+ Years of experience in Spark & Scala (Skill Level: 8 or more out of 10)

- Bachelors degree in Computer Science or equivalent.

- 5+ years experience designing, building and launching extremely efficient & reliable data pipelines to move data (both large and small amounts) using modern data architecture/tools.

- Strong background (5+ years) in ETL processing for large amount of data (250+ Terabytes)

- Multiple years of experience working with 250+ Terabytes of data for ETL using Spark & Scala

- 3+ years experience working in Agile environment (SCRUM)

Nice To Have Skills:

- Experience in digital marketing (Good Domain knowledge on digital marketing Industry)

- Experience working with AWS (S3, EMR, EC2, RDS)

Job Type: Full-time

Required education:

  • Bachelor's

Required experience:

  • designing, building: 5 years

Job Type: Full-time

Required education:

  • Bachelor's

Required experience:

  • designing, building: 5 years

Additional Information

We are a team of former Google Engineers and Designers based in Silicon Valley, New York and Phuket, Thailand.

All of our core engineers are paid in the $150,000 range or greater and we also provide our engineers the opportunity to work, all expenses paid, from our Phuket, Thailand office one month a year as a creative outlet to work and enjoy life to the fullest.

In this role you will work with some of the most exciting projects in the industry today with a team of fast moving engineers and designers who have a passion for building disruptive products. 

Skills Required

  • 10-15 years software development experience in Big Data using Spark and the Hadoop ecosystem.
  • 5+ years experience with Spark and Scala (high proficiency).
  • Bachelor's degree in Computer Science or equivalent.
  • 5+ years designing, building, and launching efficient, reliable data pipelines using modern data architecture/tools.
  • 5+ years ETL processing experience for very large data volumes (250+ Terabytes).
  • Multiple years working with 250+ Terabytes of data for ETL using Spark and Scala.
  • 3+ years experience working in an Agile (SCRUM) environment.
  • Experience in digital marketing (domain knowledge).
  • Experience with AWS (S3, EMR, EC2, RDS).
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
2 Employees
Year Founded: 2007

What We Do

The Punch Agency is a strategic B2B marketing and full-service advertising agency that specializes in industrial marketing. Acting as a dedicated marketing partner, the company helps businesses align their brand, creative strategies, and digital presence to deliver measurable growth and success. They provide a comprehensive approach to help industrial sector clients integrate their branding and digital assets effectively.

Similar Jobs

PwC Logo PwC

Data Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
40 Locations
370000 Employees
63K-140K Annually

PwC Logo PwC

Data Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
42 Locations
370000 Employees
77K-202K Annually

GC AI Logo GC AI

Data Engineer

Artificial Intelligence • Legal Tech
In-Office or Remote
San Mateo, CA, USA
100 Employees
165K-350K Annually

PwC Logo PwC

Data Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
34 Locations
370000 Employees
77K-202K Annually

Similar Companies Hiring

Quantum Rise Thumbnail
Software • Professional Services • Natural Language Processing • Machine Learning • Consulting • Automation • Artificial Intelligence
Chicago, Illinois
20 Employees
Northslope Thumbnail
Artificial Intelligence • Information Technology • Software • Analytics • Consulting • Generative AI
London, GB
100 Employees
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account