Data Engineer

Posted 5 Days Ago
New York, NY, USA
In-Office
Mid level
Agency
The Role
Design, build, and maintain data models, ETL pipelines, and SQL-based solutions to support reporting and analytics. Analyze source systems for data quality, develop data integration using Databricks/Informatica/Pentaho, and produce documentation, dashboards, and BI artifacts (Power BI/OBIEE/Tableau) to support DSNY operations.
Summary Generated by Built In
Job Description

The New York City Department of Sanitation (DSNY) keeps New York City healthy, safe, and clean by collecting, recycling, and disposing of waste, cleaning City streets and vacant lots, and clearing snow and ice. DSNY is the nation's largest municipal sanitation agency, with nearly 10,000 employees, 59 district garages, and a fleet of more than 5,000 trucks, cars, and other types of equipment. The Department clears litter, snow, and ice from approximately 6,500 miles of City streets and removes debris from vacant lots as well as abandoned vehicles from City streets.
Under general supervision, with considerable latitude for the exercise of independent judgment and initiative, the incumbent will be responsible for the design, development, implementation, enhancement, documentation, and maintenance of database management systems, data integration solutions, custom applications, and related software functions supporting the Department of Sanitation's Operations Management Division (OMD).
The selected candidate will serve as a Data Engineer, performing complex data engineering, data integration, and analytical functions within a multi-platform enterprise environment. The role will support critical reporting, analytics, and operational initiatives across the DSNY Operations Management project portfolio.
Key Responsibilities:
- Perform data analysis, data profiling, data modeling, source-to-target mapping, and reporting activities for enterprise data and analytics projects.
- Develop and maintain conceptual, logical, and physical data models to support current and future operational, analytical, and reporting requirements.
- Analyze legacy and strategic source systems to assess data quality, identify inconsistencies, and recommend corrective actions to improve data integrity and governance.
- Collaborate with business stakeholders, technical teams, and external partners to design, develop, and support complex data integration pipelines using ETL tools such as Databricks, Informatica PowerCenter, Pentaho Data Integration (Kettle), and similar technologies.
- Develop, maintain, and enhance technical documentation, including data models, data dictionaries, source-to-target mapping documents, ETL specifications, process flows, and reporting artifacts.
- Develop and maintain SQL-based data solutions, including complex queries, stored procedures, database objects, and data transformation processes.
- Support business intelligence and reporting initiatives through the development of reports, dashboards, and analytical solutions utilizing platforms such as Oracle Business Intelligence Enterprise Edition (OBIEE), Power BI, and other enterprise reporting tools.
- Participate in the design and implementation of innovative data architecture and integration strategies to improve data sharing and interoperability across multiple business domains within DSNY and across City agencies.
- Support and maintain internal IT systems, applications, and databases, ensuring reliability, performance, and adherence to agency standards.
Required Qualifications:
- Strong proficiency in SQL and Python programming. Additional experience with pySpark preferred.
- Experience with data modeling, data analysis, ETL development, and database design.
- Experience with enterprise reporting and analytics platforms such as Power BI, OBIEE, Tableau, or similar tools.
- Knowledge of modern data platforms and cloud-based analytics environments; experience with Databricks is highly desirable.
Preferred Qualifications:
- Experience with Microsoft .NET technologies, including ASP.NET, C#, TypeScript, React or other modern web application framework.
- Experience with Java development and related technologies.
- Familiarity with data warehousing, data governance, cloud platforms, and enterprise data integration best practices.
-The ideal candidate will possess strong analytical and problem-solving skills, excellent communication abilities, and the capacity to work effectively with
IT INFRASTRUCTURE ENGINEER - 95714

Qualifications

1. A baccalaureate degree from an accredited college in computer science, engineering or a related field and four years of satisfactory full-time experience related to datacenter engineering and operations, cloud engineering and operations, complex IT infrastructure engineering; or,
2. A baccalaureate degree from an accredited college and eight years of satisfactory full-time experience related to datacenter engineering and operations, cloud engineering and operations, complex IT infrastructure engineering; or,
3. Education and/or experience which is equivalent to "1" or "2" above.

Additional Information

The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.

Skills Required

  • Proficiency in SQL
  • Proficiency in Python
  • Experience with PySpark
  • Experience with data modeling
  • Experience with data analysis
  • Experience with ETL development
  • Experience with database design
  • Experience with ETL tools such as Informatica PowerCenter and Pentaho Data Integration (Kettle)
  • Experience with enterprise reporting/BI platforms (Power BI, OBIEE, Tableau)
  • Experience with Databricks and modern cloud-based analytics platforms
  • Experience with Microsoft .NET technologies (ASP.NET, C#, TypeScript, React) and/or Java
  • Familiarity with data warehousing, data governance, and enterprise data integration best practices
  • Strong analytical and communication skills; ability to collaborate with stakeholders
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company

Similar Jobs

Upside Logo Upside

Data Engineer

Artificial Intelligence • Fintech • Machine Learning • Mobile • Payments • Retail • Software
Remote or Hybrid
4 Locations
275 Employees
215K-250K Annually

New York Life Insurance Company Logo New York Life Insurance Company

Data Engineer

Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
New York, NY, USA
12000 Employees
124K-177K Annually

PwC Logo PwC

Data Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
34 Locations
370000 Employees
77K-202K Annually

PwC Logo PwC

Data Engineer

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote or Hybrid
67 Locations
370000 Employees
77K-202K Annually

Similar Companies Hiring

Caxy Thumbnail
Software • Mobile • Enterprise Web • Artificial Intelligence • Agency
Chicago, IL
45 Employees
Digible Thumbnail
Social Media • PropTech • Marketing Tech • Digital Media • Artificial Intelligence • Agency • AdTech
PH
145 Employees
Fora Thumbnail
Agency • On-Demand • Professional Services • Sales • Software • Travel • Hospitality
New York, NY
200 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account