Location: LATAM - Remote
Are you passionate about turning messy, disconnected data into clean, actionable insights? Do you thrive on building custom solutions that bridge legacy systems with modern platforms? Are you fluent in Python, Databricks-certified, and excited by the challenge of automating complex data pipelines? If you are nodding along, then you belong with us!
We are looking for a skilled and driven Data Engineer & Integration Developer - Databricks to join our team. This role focuses on developing custom connectors for legacy systems, automating data extraction processes, and integrating data from diverse sources. The successful candidate will possess a Databricks certification, strong Python development expertise, a proven track record of working with complex data extraction scenarios, and excellent communication skills to collaborate effectively with Data Stewards and stakeholders.
Essential Duties and Responsibilities:
- Custom Connector Development: Design and develop Python-based custom connectors for legacy systems to facilitate seamless data integration.
- Automation and Data Extraction: Create automation scripts for data extraction from a variety of sources, including legacy systems, APIs, Excel files, SharePoint, and PDFs.
- Web Scraping: Utilize web scraping techniques to gather data from online sources, ensuring accuracy and reliability.
- Collaboration and Stakeholder Engagement: Work closely with Data Stewards and stakeholders to understand requirements, provide updates, and ensure that solutions align with business objectives.
- Integration and Deployment: Employ tools such as Airflow and DBT to ensure efficient integration and deployment of data workflows.
- Process Documentation: Create detailed technical documentation to support process replication, maintenance, and knowledge sharing.
- Continuous Improvement: Stay updated with emerging tools and techniques to enhance data integration and automation practices.
- Databricks Integration and Development: Design, develop, and optimize data workflows and pipelines within the Databricks platform, ensuring high performance, scalability, and alignment with best practices.
Qualifications:
- Databricks certification is required.
- 5+ years in a Data Scientist or related role.
- Proven expertise in data integration and automation.
- Familiarity with handling diverse and complex datasets.
- Proficiency in Python development.
- Experience with Airflow, dbt, and similar tools and frameworks.
- Experience with cloud providers.
- Expertise in web scraping and automation.
- Strong understanding of data extraction methods from various sources: legacy systems, APIs, Excel files, SharePoint, and PDFs.
- Demonstrated experience in designing and implementing data integration solutions.
- Fluent in English (spoken and written).
- Excellent communication and problem-solving skills.
- Ability to work effectively in a collaborative, remote environment.
- US Visa (preferred)
About Nimble Gravity
Nimble Gravity is a team of outdoor enthusiasts, adrenaline seekers, and experienced growth hackers. We thrive on solving complex challenges and believe that the right data can propel growth for any organization.
Nimble Gravity is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics, or any other protected status.
Similar Jobs
What We Do
Nimble Gravity is an international team of outdoor enthusiasts, adrenaline seekers, and growth hackers. We love solving hard problems and believe the right data can transform and propel growth for any organization. We leverage business acumen, data acquisition and engineering and AI/ML tools to generate impactful insights. We’ve built eCommerce operations that range from start-up to over $2B per year. We have the expertise and experience to make your web presence and eCommerce operations faster, bigger, and more profitable
