Principal duties and responsibilities:
- As a Data Engineer on our LAMP team, you will play a pivotal role in shaping the architecture and flow of transit data across systems. In this role, you will architect data solutions using modern engineering principles, ensuring scalability and reliability. Your competency in data modeling will be crucial for designing structures that support our business logic and analytical needs. Your analytical skills will be put to use tuning logic to optimizing data processing and retrieval performance.
- This role demands a blend of technical acumen in data engineering tools and practices, strategic thinking for technology selection, and the interpersonal skills to collaborate effectively within the team and broader organization. Your contributions will directly impact the efficiency and effectiveness of our data-driven strategies, making this a critical and rewarding position in our department.
Minimum experience and required skills:
- Proficient with Python
- Proficient with SQL and query optimization
- Experience with data management on local environments
- Experience with automated testing, including continuous integration (CI)
- Experience with Git workflows (such as pull requests) and code reviewing
- Experience with data pipeline architecture and deployment
- Experience with data modeling
- Experience with data quality analysis
- Ability to translate business requirements into technology
- Strong communication skills
- Strong analytical thinking and debugging abilities
- Attention to detail
Preferred experience and skills:
- Knowledge of transit data standards (such as GTFS, GTFS-RT, TODS, TIDES)
- Experience with Terraform / Infrastructure as Code tools
- Experience with AWS data tools and resource management
- Experience with cross-language data platforms like Arrow
Similar Jobs
What We Do
The Massachusetts Bay Transportation Authority, often referred to as the MBTA or simply The T, is the public operator of most bus, subway, commuter rail and ferry systems in the greater Boston, Massachusetts, area. The MBTA is the largest transit provider in New England, and the fifth largest in the country. The MBTA directly operates or contracts out for service using eight different modes: heavy rail, light rail, bus rapid transit, local/express bus, trackless trolley, commuter rail, commuter boat, and paratransit. In Boston, 55% of all work trips and 42% of all trips into downtown are made by transit. The MBTA district is made up of 175 communities with a total population of 4.7 million. Almost three-quarters of all Massachusetts residents live within the MBTA service area.
