- Partner with Product Managers, and Solution Architects to define and analyze customer’s technical requirements.
- Provides technical input to Statement of Work for External Service Providers
- Ability to break down product management stories into detailed design specifications for medium to complex business problems.
- Experience with building data pipeline from several business applications
- Ability to collaborate with business stakeholders to identify and meet data requirements.
- Guides team members on the use of design patterns and adherence to code quality metrics
- Uses software code management tools and processes to ensure code traceability and good governance.
- Conducts code reviews with other team members (either internal or external service providers)
- Makes continuous improvement to our coding and test practices across applications.
- Works in DevOps team which uses continuous development, integration and testing with automated releases to lower and higher environments with application monitoring plus supporting the product.
- Experience performing root cause analysis on all data and processes to answer specific questions and identify opportunities for improvement.
- Participates in recommending emerging technologies and application solutions.
- Candidate with 9-11 years of experience in a Data Engineer role.
- Graduate degree in Computer Science or equivalent
- High Problem-Solving Skills with analytical thinking and logical reasoning
- Having experience working on Spark platform, Spark SQL, Python and common Python libraries.
- Working experience on cloud-based environments such as Databricks on Azure, ADF, PySpark etc.
- Hands on experience writing notebooks using Python/Spark
- Hands on experience in reporting tools like PowerBI, MicroStrategy.
- Well versed with relational databases, nonrelational databases, data streams, and file stores
- Experience with source control systems such as GitHub and Jenkins build and continuous integration tools.
- Automation using Linux shell & Python scripting.
Development experience with Enterprise integration patterns
Skills Required
- 9-11 years of experience in a Data Engineer role
- Graduate degree in Computer Science or equivalent
- Experience with Spark platform, Spark SQL and PySpark
- Proficiency in Python and common Python libraries
- Experience with Databricks on Azure and Azure Data Factory (ADF)
- Hands-on experience writing notebooks using Python/Spark
- Experience building data pipelines from multiple business applications
- Experience with reporting tools such as PowerBI and MicroStrategy
- Familiarity with relational and nonrelational databases, data streams, and file stores
- Experience with source control (GitHub) and CI/CD tools (Jenkins)
- Automation using Linux shell and Python scripting
- Development experience with enterprise integration patterns
What We Do
In 1969, Don and Doris Fisher opened the first Gap store on Ocean Avenue in San Francisco. They wanted to make it easier to find a great pair of jeans, and they did. Their denim and records store was a hit, and it grew to become one of the world’s most iconic brands. Today we’re represented in more than 1400 stores in over 40 countries, and online. We have headquarters in New York, London, Shanghai, Tokyo, and, of course, San Francisco. Our unique aesthetic is optimistic cool, elevated American style. Our clothes are crafted with care, with focused attention to thoughtful design. We believe in staying true to our heritage while creating what’s next. Don and Doris Fisher always wanted to “do more than sell clothes.” They wanted to support the people who ran their company, to be active in their communities, and to have a positive impact on the world. Their vision helped transform retail, and we’re still following their lead. We stand for freedom and possibility for all; we champion diverse ideas that transcend generations, geographies and genders.
