The Role
Design, build, and maintain scalable data pipelines using PySpark and Python. Ensure data quality and availability, optimize SQL databases and queries, collaborate with data teams, and monitor/troubleshoot pipeline performance.
Summary Generated by Built In
Design, develop, and maintain scalable data pipelines and systems.
Work closely with data scientists and analysts to ensure data quality and availability
Implement data integration and transformation processes using PySpark and Python.
Optimize and maintain SQL databases and queries.
Collaborate with cross-functional teams to understand data requirements and deliver solutions.
Monitor and troubleshoot data pipeline issues to ensure data integrity and performance. #LI-PA1
Skills Required
- Design, develop, and maintain scalable data pipelines and systems.
- Implement data integration and transformation processes using PySpark and Python.
- Optimize and maintain SQL databases and queries.
- Work closely with data scientists and analysts to ensure data quality and availability.
- Monitor and troubleshoot data pipeline issues to ensure data integrity and performance.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
