The Role
The Data Engineer II will develop and support data pipelines, collaborate with teams, ensure data delivery, and lead projects while mentoring junior engineers.
Summary Generated by Built In
Data Engineer II
Location: Beachwood, OH
Shift: Monday - Friday 8-5pm (Onsite 4 days a week)
As a Data Engineer II, you will be leading the effort to develop, enhance, and support existing and new data pipelines, data ingestions, data storage, and traditional Data-warehouse/BI systems across medium and large sized projects concurrently.
You will support our software developers, database architects, data analysts and data scientists on vital initiatives and ensure optimal data delivery architecture consistent throughout ongoing projects. You will have the opportunity to influence our data and analytics roadmap by constant interactions with various business and technology teams.
You will lead the design of vital components and suggest/implement new frameworks and tools based on industry and technological trends and advances. You will also consult with process owners in reviewing, interpreting & developing systems in accordance with user requirements and ensuring code quality through proper documentation, best practices, and code reviews. Working in our collaborative environment, you will further develop your skills while also acting as a mentor and technical guide to other associate data engineers.
Responsibilities:
• Be the primary contact and lead support associate for multiple critical projects/data pipelines and integrations and resolve customer issues in a timely manner
• Collaborate with technical/business leaders, product owners, software engineers, data architects and data analysts to acquire and understand requirements / acceptance criteria
• Participate in defining Data Engineering Process and Technology strategies.
• Provide day-to-day task leadership and project reviews.
• Assemble large, complex data sets that meet functional / non-functional business requirements
• Produce deliverables for medium to large sized projects with clean, well-documented and easily maintainable code that adheres to defined coding standards
• Design and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build and leverage the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources both on premise and cloud
• Partner with cross functional teams to build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics
• Participate in building data security and data governance guidelines
• Ensure solution is sustainable across implementation and use, troubleshooting and analyzing open issues and bug-fixes and ensuring on-time delivery and hand-offs
• Communicate status and issues to team members and stakeholders
• Participate in Design and Deploy Tollgate reviews and gain buy in from cross-functional teams including QA, Architect, Security, Webmaster and Operations
• Contribute and Influence the discovery and decision-making process when changes to standards and technology are required (tools, conventions and design patterns)
• Assign projects and review deliverables from onshore and offshore software engineers
• Provide constructive input to department management regarding team members assigned to project
• Independently conduct new hire interviews
• Design and manage models to handle large datasets of existing structured and unstructured data
• Research and discover new methods to acquire data, and new applications for existing data
• Stay current with rapidly developing Data Engineering landscape and share knowledge internally and with customers
• Create recommendations for increasing data utilization based on understanding of data delivery environment
• Other duties as assigned
Qualifications:
• Bachelor’s Degree in Computer Science/Computer Engineering or equivalent years of software development experience required
• 10+ years of overall technology experience.
• 8+ years of Data Engineering, Data Modeling, and Data Warehousing experience required
• 2+ years of experience working with Agile teams preferred
• 1-2 years of experience leading medium to large projects
• Experience with Snowflake
• Experience with Azure Cloud
• Expert knowledge of full data engineering lifecycle
• Expert experience with Data Engineering tools such as Talend, BODS
• Strong experience with relational SQL and NoSQL databases
• Expert experience in building data pipelines, data ingestions, data integrations, data preparations, and traditional Data warehouses and DataMarts
• Strong experience in building processes supporting data transformation, data structures, metadata, dependency and workload management
• Strong analytic skills related to working with complex datasets
• Expertise in designing, validating and implementing multiple projects across the hybrid infrastructure (On-cloud to On-Premise and vice versa)
• Experience with big data tools such as Kafka
• Some experience with visualization tools such as Qlikview, Qliksense, Tableau, etc.
• In-depth knowledge of appropriate design frameworks and patterns and experience in implementing them.
• Knowledge of industry wide technology strategies and best practices
• Understanding of message queuing, stream processing, and highly scalable ‘big data’ data stores
• Solid written and oral communication skills; ability to present ideas in business-friendly and user-friendly language
Physical Requirements:
-The physical and mental demands described here are representative of those that must be met by an associate to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
-The associate will be required to: read; communicate verbally and/or in written form; remember and analyze certain information; and remember and understand certain instructions or guidelines.
-While performing the duties of this job, the associate may be required to stand, walk, and sit. The associate is frequently required to use hands to touch, handle, and feel, and to reach with hands and arms. The associate must be able to occasionally lift and/or move up to 25lbs/12kg.
-Specific vision abilities required by this job include close vision, distance vision, peripheral vision, depth perception and the ability to adjust focus.
Penske is an Equal Opportunity Employer
About Penske Logistics
Penske Logistics engineers state-of-the-art transportation, warehousing and supply chain management solutions that deliver powerful business results for market-leading companies. With operations in North America, South America, Europe and Asia, Penske and its associates help businesses move forward by increasing visibility and driving down supply-chain costs. Visit Penske Logistics to learn more.
Top Skills
Azure Cloud
Bods
Kafka
NoSQL
Qliksense
Qlikview
Snowflake
SQL
Tableau
Talend
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Penske Logistics is a Penske Transportation Solutions company. We provide supply chain management and logistics solutions to leading brands around the world. Penske Logistics delivers value through its design, planning and execution in transportation, warehousing, freight management, and dry-van truckload services. Penske offers customized supply chain and logistics solutions including: Dedicated Contract Carriage; Distribution Center Management; Freight Management; Freight Brokerage; Transportation Management Solutions (TMS); Lead Logistics Provider (LLP), Control Tower and 4PL Solutions. We serve a variety of industries including: automotive; food, beverage, grocery, wine and spirits; cold chain; convenience and drug stores; quick service restaurants (QSRs); retail; big box retailers; building and construction products; CPG; healthcare; industrial manufacturing; consumer appliances and consumer electronics; and many others.
.png)
