The Role
Design, build, and maintain scalable ETL and real-time data processing systems on Databricks and AWS. Develop Spark-based pipelines, ensure data quality and governance, implement security controls, automate infrastructure with Terraform, and collaborate with analysts and engineers to resolve issues and optimize performance.
Summary Generated by Built In
Join the Pioneer Crypto Brand in the Philippines!
Coins is the most established crypto brand in The Philippines and has gained the trust of more than 18 million users. Through the easy-to-use mobile app, users can buy and sell a variety of different cryptocurrencies and access a wide range of financial services.
Coins is fully regulated by the Bangko Sentral ng Pilipinas (BSP) and is the first ever crypto-based company in Asia to hold both Virtual Currency and Electronic Money Issuer licenses from a central bank.
Responsibilities
- Design, develop, and maintain highly scalable, reliable, and efficient data processing systems with a strong emphasis on code quality and performance.
- Collaborate closely with data analysts, software developers, and business stakeholders to deeply understand data requirements and architect robust solutions to address their needs.
- Focus on the development and maintenance of ETL pipelines, ensuring seamless extraction, transformation, and loading of data from diverse sources into our data warehouse based on Data-bricks platform.
- Spearhead the development and maintenance of real-time data processing systems utilizing cutting-edge big data technologies such as Spark Streaming and Kafka.
- Establish and enforce rigorous data quality and validation checks to uphold the accuracy and consistency of our data assets.
- Act as a point of contact for troubleshooting and resolving complex data processing issues, collaborating with cross-functional teams as necessary to ensure timely resolution.
- Proactively monitor and optimize data processing systems to uphold peak performance, scalability, and reliability standards, leveraging advanced AWS operational knowledge.
- Utilize AWS services such as EC2, S3, Glue and Data-bricks to architect, deploy, and manage data processing infrastructure in the cloud.
- Implement robust security measures and access controls to safeguard sensitive data assets within the AWS environment.
- Stay abreast of the latest advancements in AWS technologies and best practices, incorporating new tools and services to continually improve our data processing capabilities.
Qualifications
- Bachelor’s or Master’s degree in Computer Science or a related field.
- Minimum of 5 years of hands-on experience as a Data Engineer, demonstrating a proven track record of designing and implementing sophisticated data processing systems.
- Good understanding of Data-bricks platform and Delta Lake.
- Familiar with data job scheduler tool such as Dagster.
- Proficiency in one or more programming languages such as Scala, Java, or Python.
- Deep expertise in big data technologies including Apache Spark for ETL processing and optimization.
- Proficient in utilizing BI tools such as Metabase for data visualization and analysis.
- Advanced understanding of data modeling, data quality, and data governance best practices.
- Outstanding communication and collaboration skills, with the ability to effectively engage with diverse stakeholders across the organization.
- Extensive experience in AWS operational management, including deployment, configuration, and optimization of data processing infrastructure within the AWS cloud environment.
- Strong understanding of AWS services such as EC2, S3, Glue and EMR, with the ability to architect scalable and resilient data solutions leveraging these services.
- Proficiency in AWS security best practices, with experience implementing robust security measures and access controls to protect sensitive data assets.
- Hands-on experience with automation and DevOps tools such as Terraform for infrastructure as code and automation purposes.
Join the Coins Team Now!
Meaningful Collaborations - The successful candidate will work cross-functionally with other relevant teams to carry out implementations that will improve and create an impact on customer experience.
Scalable Growth - Be part of a fast-growing organization with the vision to expand its territories outside APAC which will provide opportunities for career advancement.
A Space For Bright Ideas - Let your bright ideas be converted into meaningful changes! Coins culture welcomes new ideas backed up by data to create an impact.
Skills Required
- Bachelor's or Master's degree in Computer Science or related field.
- Minimum of 5 years experience as a Data Engineer.
- Good understanding of Databricks platform and Delta Lake.
- Familiarity with data job scheduler tools such as Dagster.
- Proficiency in Scala, Java, or Python.
- Deep expertise in Apache Spark for ETL processing and optimization.
- Experience with Spark Streaming and Kafka for real-time processing.
- Proficient in BI tools such as Metabase.
- Advanced understanding of data modeling, data quality, and data governance.
- Extensive AWS operational experience (deployment, configuration, optimization).
- Strong knowledge of AWS services (EC2, S3, Glue, EMR).
- Proficiency in AWS security best practices and access controls.
- Hands-on experience with Terraform for infrastructure as code.
- Strong communication and collaboration skills; English reading/writing.
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Coins.ph is on a mission to create an open financial system by providing everyone easy access to Web3 and digital assets. Launched in 2014, Coins.ph is the most established crypto brand in the Philippines and has gained the trust of more than 16 million users. Through the easy-to-use mobile app, users can buy and sell a variety of cryptocurrencies and access a wide range of financial services. We're a fast-growing startup looking for passionate, motivated, and exceptional people to join us in doing work that matters. Visit http://coins.ph/careers to learn more
.jpeg)
