The Role
Develop and maintain applications using PySpark, optimize performance, collaborate with business users, and implement projects based on specifications.
Summary Generated by Built In
Roles and
Responsibilities:
- Responsible
for developing and maintaining applications with PySpark
- Contribute
to the overall design and architecture of the application developed and
deployed.
- Performance
Tuning wrt to executor sizing and other environmental parameters, code
optimization, partitions tuning, etc
- Interact
with business users to understand requirements and troubleshoot issues.
- Implement
Projects based on functional specifications.
Must-Have
Skills:
- Relevant
Experience: 3-6 Years
- SQL -
Mandatory
- Python -
Mandatory
- SparkSQL -
Mandatory
- PySpark -
Mandatory
- Hive -
Mandatory
- HDFS and
Spark - Mandatory
- Scala -
Advantage
- Apache
Airflow - Advantage
Requirements
3-6 Years of Experience
Must Have: PySpark/Spark, Python, SQL, Knowledge on Hadoop ecosystem
Good to have: Airflow, Scala
Skills Required
- Experience in developing and maintaining applications with PySpark
- Proficiency in SQL
- Proficiency in Python
- Proficiency in SparkSQL
- Proficiency in Hive
- Experience with HDFS and Spark
- Familiarity with Scala
- Experience with Apache Airflow
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Marktine is a data science and technology company specializing in AI-powered solutions, digital transformation, and IT consulting, focused on leveraging data to help clients make complex business decisions and streamline operations.
