Data Pipeline Engineer

FocusKPI is seeking a Data Pipeline Engineer to join one of our clients, a high-tech SaaS company. 
 
The team is seeking world-class server software engineers with experience in Big Data Infrastructure and Data warehousing to join their technology innovation group, which focuses on rapidly developing AI-driven, cloud-based end-to-end mobile applications and services. 
Data Pipeline Engineer IV involves building & managing pipelines and ETLs, requiring expertise with Spark, Iceberg, and Python coding as the main requirements.

Work Location: Mountain View, CA (Hybrid role, 4 days/week onsite mandatorily)
Duration: 12-month contract with potential to convert depending on the candidate's performance
Pay Range: $85/hr to $95/hr
**No C2C resumes are considered**
Responsibilities:

• Implement, maintain, and evolve the big data platform and infrastructure
• Responsible for designing, implementing, and maintaining backend REST API Services and ETL processes for Predictive Data Modeling, Machine Learning, Personalization, Recommendation, and Business Intelligence systems
• Perform extensive research and analysis to make optimal architecture and design decisions
• Write large amounts of code, perform code reviews, write unit tests, and documentation
• Interface with other groups, including Product Management, QA, and Operations · Create quick proof-of-concept prototypes
• Work in a scrum team with ML & Cloud Engineers

Qualifications:

• Minimum of 4+ years of hands-on experience in Big Data technologies like Apache Iceberg, Spark, Spark ML, & KafkaAnA 
• Master's in Computer Science or equivalent experience is preferred
• Expertise with Spark and Iceberg are mandatory to have
• Strong skills in statistical analysis: correlation analysis, regression analysis, univariate and multivariate analysis
• Programming Language: Python coding expertise is required
• Strong skills in algorithms, Data structures, UNIX/Linux, Scripting, Machine Learning (especially classification and unsupervised clustering), Data Modeling, Data warehousing, and Networking
• Hands-on experience in building REST API’s
• Team player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data Engineering
• Desire to learn fast and pick up the latest and greatest technologies

Preferred qualifications:

• Preferred 7+ years of experience in Big Data Technologies: AWS EMR, Iceberg, Spark, Kafka, & YARN
• Machine Learning: PyTorch, TensorFlow, Spark ML
• REST API: Flask, FastAPI, or Django
• Data Quality tools such as Monte Carlo, Great Expectations, or Databand
• Experience with teams using MLflow

**No C2C resumes are considered**
 

Thank you!

FocusKPI Hiring Team

Founded in 2010, FocusKPI, Inc. (FocusKPI) is a data science and technology firm specializing in predictive analytics practice and methodologies. FocusKPI is a US company headquartered in Silicon Valley, California, with an East Coast office in Boston, Massachusetts.