Senior Data Engineer, DriveLink

Plano, TX | Hybrid Option

6 Month+ Contract Opportunity

We are looking for a highly skilled and experienced Senior Data Engineer to join our DriveLink team. The ideal candidate will be responsible for designing, developing, and maintaining Extract, Transform, and Load (ETL) pipelines, ensuring the smooth flow of data between various sources and data systems. The role requires a deep understanding of Python programming, data manipulation, and ETL best practices to help our organization leverage data for improved decision-making.

Responsibilities:

• Design, develop, and maintain advanced ETL pipelines using Python and integrate them with Amazon Redshift for the extraction, transformation, and loading of data from various sources (databases, APIs, files, cloud storage, etc.).
• Cleanse, enrich, and transform data to meet business needs, ensuring the data quality, integrity, and consistency.
• Work with relational and NoSQL databases (e.g., MongoDB , MySQL, PostgreSQL) and ensure smooth data integration.
• Automate data workflows, error handling, and reporting, improving efficiency and reducing manual intervention.
• Optimize the performance of ETL jobs by improving processing times, query performance, and memory consumption.
• Work closely with data analysts, data scientists, and business stakeholders to understand their data requirements and ensure the ETL pipeline meets their needs.
• Follow industry best practices for software development, including version control (Git), unit testing, code reviews, and continuous integration/continuous delivery (CI/CD) processes.
• Troubleshoot and resolve issues related to ETL processes, data inconsistencies, or performance bottlenecks.
• Implement testing strategies for ETL processes and monitor pipeline performance and data quality.
• Create detailed documentation for ETL processes, data transformations, and Redshift schemas to facilitate collaboration and future maintenance.
• Perform advanced troubleshooting, debugging, and upgrading of existing systems.
• Translate research into impactful and high-performing products.
• Identify and address complex technical issues in both development and production environments.
• Make recommendations to team on resources to stay up to date with industry trends/developments.

Required Qualifications:

• 5+ years of experience working as a Software Engineer and/or Data Engineer
• Proven experience in Python programming and developing ETL pipelines
• Strong understanding of ETL concepts, tools, and frameworks
• Experience working with databases (SQL, NoSQL) and proficiency in writing complex SQL queries
• Knowledge of data warehousing concepts and experience with cloud data platforms (e.g., AWS, Google Cloud, Azure)
• Experience with Python libraries like Pandas, NumPy, and SQLAlchemy for data manipulation
• Experience with AWS ecosystem (S3, Lambda, Glue, etc.) and working within a cloud data architecture
• Familiarity with ETL frameworks such as Step Functions, Apache Airflow, Luigi, or similar
• Strong knowledge of data formats (CSV, JSON, XML, Parquet, etc.) and experience with data parsing and transformation
• Experience with version control using Git
• Experience with task scheduling and monitoring tools (e.g., Cron, Eventbridge, Apache Airflow, or Celery)
• Hands on experience applying current best practices and principles in software development
• Demonstrates advanced problem-solving, troubleshooting, decision making skills
• Ability to apply systems thinking to understand interdependencies and design solutions that achieve results
• Ability to learn and apply new technologies, programming practices, patterns, and methods
• Experience mentoring, providing technical guidance, and training more junior team members
• Ability to work independently and take ownership of tasks/assignments
• Experience effectively communicating complex technical information to stakeholders at all levels in a clear, concise, and meaningful manner to ensure effective collaboration and alignment throughout the project lifecycle
• Organized and detail-oriented
• Ability to develop healthy working relationships and collaborate with peers and leaders
• Exhibits integrity and high standards in work quality
• Excellent verbal and written communication skills
• Values diversity and differences amongst individuals in interactions

Excited about this opportunity, but don't meet 100% of the qualifications? We’d still love for you to apply! Toyota Connected is dedicated to building a diverse and inclusive workplace where unique experiences are valued and everyone has the opportunity to contribute. You may just be the right candidate for this or other Toyota Connected opportunities.

Location: This position is based in Plano, Texas. Toyota Connected encourages all employees to live within a reasonable commuting distance of their assigned work location for Hybrid work. 

What’s in it for you?

• Annual Patent-a-thons and Hackathons to embrace your superior creative thinking ability.
• Free catered lunches when working onsite. We try to keep it healthy, but Fridays are “cheat” days, so you can get your carbs on!
• Two fully stocked Nespresso bars for your coffee and tea fixes.
• No dress code! Come as you are. We know the smart people we hire don’t need to be told what to wear.
• Free covered garage parking to shield your vehicle from those sneaky storms and to protect your buns from the Texas sun.

Who Are We?

Toyota Connected was established in 2016 to infuse the power of big data and cloud intelligence into all aspects of the mobility experience so that driving a Toyota or Lexus is more personal, intuitive, and safe. We create and enable technologies that delight, simplify, and connect the lives of those who use our products. We believe this mobility revolution will empower our customers to use their vehicles in an array of exciting new ways. We support, celebrate, and thrive on the opportunity to provide Mobility for All.
Making a connected life a more human experience takes humans from all walks of life. Toyota Connected celebrates and is committed to a diverse and inclusive workplace that embraces you.

We are committed to creating an accessible and inclusive hiring process by providing reasonable accommodations as necessary for persons with disabilities or those affected by pregnancy, childbirth or related medical conditions. If you need to request an accommodation, please reach out to your Recruiter who will connect you with an HR Business Partner to discuss your requested accommodation. We only share the candidate information obtained through this process as necessary to fulfill our reasonable accommodation obligations and strive to create an unbiased and equitable experience for all.