Requirements and Qualifications:
- 8+ years of relevant experience in the Data Engineering, ApacheSpark
Python, Pyspark, Unix, Hadoop Must have any 2 skill from below
- Strong proficiency in PySpark and Apache Spark.
- Solid experience with SQL, NoSQL databases (e.g., Hive, HBase, Cassandra).
- Hands-on experience with big data frameworks (Hadoop, Kafka, etc.).
- Expertise in cloud platforms (AWS, Azure, or GCP).
- Proficiency in Python programming and data manipulation.
- Knowledge of ETL tools, data lakes, and data warehouses.
- Experience in CI/CD, containerization (Docker, Kubernetes) is a plus.
- Strong problem-solving and analytical skills.
- Excellent communication and teamwork skills.
- Experience in systems analysis and programming of software applications
- Experience in managing and implementing successful projects
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Compensation, Benefits and Duration
Minimum Compensation: USD 48,000
Maximum Compensation: USD 170,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
Skills Required
- 8+ years of relevant experience in Data Engineering
- Strong proficiency in PySpark and Apache Spark
- Proficiency in Python programming
- Experience with Unix
- Experience with Hadoop and big data frameworks (e.g., Kafka)
- At least two of the following: Hive, SQL, MongoDB, Airflow, Gen-AI, ECS
- Solid experience with SQL and NoSQL databases (examples: Hive, HBase, Cassandra)
- Expertise in cloud platforms (AWS, Azure, or GCP)
- Knowledge of ETL tools, data lakes, and data warehouses
- Experience in CI/CD, containerization (Docker, Kubernetes)
- Experience in systems analysis and software application programming
- Strong problem-solving, analytical, communication, and teamwork skills
- Experience managing and implementing successful projects; ability to work under pressure and meet deadlines
What We Do
Photon.com has emerged as one of the world’s largest and fastest-growing Digital Agencies. We work with 40% of the Fortune 100 on their Digital initiatives and are known for our ability to integrate Strategy Consulting, Creative Design, and Technology at scale. Please visit www.photon.com to learn more about us, how we work, and our customer case studies. Digital Transformation Starts Here.
