The Sr Data Engineer will design and manage data systems, pipelines, and management tools. They will oversee junior data engineers, recommend and deploy data models, and lead projects involving data collection and storage systems. This role will design, build, document, test, and maintain critical data pipelines from large volumes of data from internal and external data sources cross different platforms.
Job Responsibilities
- Define and manage the data architecture framework, standards, and principles, including modeling, metadata, security, reference, and master data. Define reference architecture, and models to provide a common vocabulary, reusable components, and industry best practices.
- Create solution frameworks integrating large or complex data sets
- Lead all data modeling efforts within DataBricks, including the design of data structures and the identification of business transformation logic.
- Analyzing and translating business requirements into conceptual and fully detailed logical data models.
- Creating logical data models based on existing applications and databases.
- Working with business architects, and data stewards to capture business requirements in a Logical Data Model.
- Transform the logical representation of the model into a physical representation and work with data engineering team to instantiate and manage the data.
- Contribute to assessment of appropriate data platform(s) for solutioning efforts.
- Collaborate with the BI and Analytics teams on creating the optimized, reusable semantic model, complete with metadata and lineage information.
- Define and govern data modeling and design standards, tools, best practices, and related development for enterprise data models
- Maintain the metadata - the "data about the data" describing the data model, its structure, and semantics
- Recommend data and design patterns for common business functionality
- Assist in multi-phase roadmaps within and across functional teams
- Provide insight and technology recommendations that result in enterprise solutions and architectural risk mitigation.
- Contribute to innovation strategies by exploring, investigating, recommending, benchmarking and implementing new data centric technologies for the platform.
- Identify, design, and implement internal process improvements such as automation of manual processes, optimization of data delivery and re-design of existing infrastructure for greater scalability.
- Build the infrastructure and processes required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and/or other data technologies.
- Create and maintain data-related documentation (e.g. data dictionaries, data maps, data models etc.)
- Work with data engineering and analytics experts to strive for greater functionality in our data systems and incorporation of industry best practices.
Required Qualifications
- 5+ years in data architecture, designing and building data assets and products.
- 5 or more years of data modeling and design experience with analytical and transactional data
- Detailed knowledge of data warehouse/Lakehouse technical architecture concepts, infrastructure component and ELT process.
- Experience with AWS
- In-depth understanding of relevant data engineering best practices
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases, technologies.
- Ability to thrive in a fast-paced environment, responding quickly to oversight and following instruction closely, while anticipating needs and developing efficiencies on repeat tasks.
- Excellent problem-solving, critical thinking and analytics skill with the ability to work in a cross-functional team.
- Quick self-motivated learner who can initiate and drive new projects in anticipation of management and client goals and objectives with little or no supervision
- Self-directed and comfortable supporting the data needs of multiple teams, systems and products.
- Must be able to adapt to change in direction and priorities in a project and deadline-oriented environment.
- Bachelor’s degree in Information Systems, Computer Sciences or other related fields or equivalent experience.
Preferred But Not Required
- Experience with DataBricks, ETL tools
- Version control tools such as GitHub
- Python or any other scripting language experience
- Adept in all phases of the SDLC
- Experience with big data tools: Hadoop, Spark, etc.
#LI-TD1
IMPORTANT NOTICE:
- This position description is intended to describe the level of work required of the person performing in the role and is not a contract. The essential responsibilities are outlined; other duties may be assigned as needs arise or as required to support the organization. All requirements may be subject to reasonable accommodation to applicants and colleagues who need them for medical or religious reasons.
Click here for some insight into our culture!
Top Skills
What We Do
BRP is now The Baldwin Group! We’ve updated our name to reflect our unified group of talented teams across the country.
The Baldwin Group is a cohesive group of experts in business insurance, employee benefits, retirement planning, and all areas of private and personal insurance. Since our founding in 2011, we’ve evolved from a local business into a national firm with a vast network of specializations and industry practices for the benefit of our more than two million clients across the country.
In addition, we have built excellent relationships with a wide range of insurance company partners. These relationships, coupled with our entrepreneurial and family-oriented culture, and deep expertise enable us to seamlessly deliver a breadth of innovative solutions to clients.
At The Baldwin Group, we help provide the solutions our clients need to have confidence and gain peace of mind as they pursue what’s possible for themselves, their families, and their businesses. Whether they are renting their first apartment or buying a larger home, opening a small business or taking their company public, we offer solutions to support them on every step of their journey. This has been our story since the beginning—we provide the indispensable expertise and quality insights that give our clients peace of mind to pursue their purpose, passion, and dreams. And that’s what The Baldwin Group will continue to do for years to come: we Protect the Possible℠.
_0.jpg)
