Senior Data Engineer (Azure)
phData works exclusively in the realm of data and machine learning. By partnering with the biggest cloud data platforms (Snowflake, Azure, AWS, Cloudera), we’re able to help the world’s largest companies solve their toughest challenges.
Our work is challenging and our standards are high, but we invest heavily in our employees, starting with a 2-4 week bootcamp to ensure you’ll be successful. Plus, you’ll get to work with the brightest minds in the industry and the latest data platforms on the market. And, because the data and ML industry is changing rapidly, you will always have the opportunity to learn - whether that’s a new technology, diving deeper into your preferred stack, or picking up an entirely new skill set.
Even though we're growing extremely fast, we maintain a remote-first, exciting work environment. We hire top performers and allow them the autonomy to deliver results. Our award-winning workplace fosters learning, creativity, teamwork. Most importantly, our team has the option to work from the conveniences of their home or work from our state of art Bangalore office located in the heart of the city.
- 2022 Snowflake Partner of the Year
- 2022 Best Places to Work
- Best Places to Work (2017, 2018, 2019, 2020, 2021)
- Inc. 5000 Fastest Growing US Companies (2019, 2020, 2021)
- Minneapolis/St. Paul Business Journal’s Fast 50 (2021)
- Snowflake Elite, Snowpark Accelerated & Snowflake Partner of the Year (2020 & 2021)
Technical Requirements
- Requires solid experience with Azure and hands-on experience in implementing (development/testing/deployment/hypercase-support) big data applications using
- Apache Spark (Databricks or Data Flow)
- Azure Data Factory
- Azure Storage - ADLS Gen2 & Other storage options within Azure ecosystem
- Azure SQL Database
- Cosmos DB
- Synapse (SQL + Spark)
- Azure DevOps & CI/CD
- Azure Security like Key Vault & its integration with Azure services.
- Overall experience working with Azure Portal + Azure CLI
- Solid understanding of SQL alongside traditional/conventional data warehousing design patterns
- Good understanding of scripting language (preferred Bash)
- Develop analytical functionality and complex transformation that will be finally deployed in production data platforms
- Hands-on experience troubleshooting, optimizing, and enhancing data pipelines and bringing improvements
- Experience & good proficiency with at least one programming language (preferred Python)
- Worked and deployed at least one data engineering application using Azure cloud-native data platform
- Strong troubleshooting and performance tuning skills
- Very well versed with continuous integration and deployment procedure
- Ability to analyze business requirement user stories and translate them into system requirement specifications
- Experience working under the agile delivery methodology
Behavioral Requirement
- Demonstrated ability to work independently as well as with team and customer/client stakeholders
- Good communication skills and documentation (project/process/product as applicable) skills
- Good & collaborative team player with in-house team as well as hybrid team where there are members from client side, vendor side as well as in-house resources
- Good organizational and time management skills
- An ability to work to deadlines
- A good eye for detail
- Must be ready to learn and adapt to new technologies
Qualifications Requirements
- BE/BTech in Computer Science or MCA with sound industry experience
- A minimum of 5 years’ experience in hands-on development in production ready big data engineering solutions
- Solid Programming Language Experience (Java or Scala or Python) (Production Grade)
- Work iteratively in a team with continuous collaboration
Perks and Benefits
- Medical Insurance for Self & Family
- Medical Insurance for Parents
- Term Life & Personal Accident
- Wellness Allowance
- Broadband Reimbursement
- Professional Development Allowance
- Reimbursement of Skill Upgrade Certifications
- Certification Bonus