The Role
The Databricks Platform Administrator is responsible for installing, configuring, and maintaining Databricks clusters and workspaces. This role involves monitoring performance, implementing security policies, optimizing configurations, and collaborating with data engineers and scientists. Documentation and maintenance of backup strategies are also key tasks.
Summary Generated by Built In
- Install, configure, and maintain Databricks clusters and workspaces.
- Monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
- Implement and manage access controls and security policies to protect sensitive data.
- Perform regular software updates and patches.
- Optimize cluster configurations for performance and cost-effectiveness.
- Implement and enforce security policies, access controls, and encryption mechanisms.
- Stay up-to-date with security best practices and compliance requirements.
- Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
- Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
- Maintain detailed documentation of configurations, procedures, and best practices.
- Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions
- Bachelor's degree in a relevant field (computer science, data engineering, etc.)
- 2 to 3 years experience with Databricks Platform
- Strong knowledge of Apache Spark and Databricks architecture.
- Familiar with managing clusters, workspaces, notebooks, user group management.
- Familiar with configuring permissions.
- Can create notebooks related to cleanup/housekeeping and schedule/manage jobs through Databricks
- Willing to be assigned in Ortigas (fully onsite)
Top Skills
Spark
Databricks
The Company
What We Do
Your trusted business partner for IT solutions and services. Questronix has grown to be one of the largest IT solutions and service providers and systems integrator in the Philippines since 1987 that has earned awards and certificates through its focused professional team of experts
