Data Engineer

This Data Engineer position supports the New York City Department of Sanitation's Operations Management Division, focusing on the design, development, and maintenance of database management systems, data integration pipelines, and analytics solutions. Core activities include data analysis, data modeling, ETL, SQL and Python development, and enterprise BI and reporting.

Location and Compensation

Location: New York, NY onsite. Compensation: USD 120,000 - 140,000 per year.

Responsibilities

• Conduct data analysis, profiling, modeling, source-to-target mapping, and reporting for enterprise data and analytics initiatives.
• Create and maintain conceptual, logical, and physical data models to support current and future operational, analytical, and reporting needs.
• Evaluate legacy and strategic source systems to assess data quality, identify inconsistencies, and propose corrective actions to enhance data integrity and governance.
• Collaborate with business stakeholders, technical teams, and external partners to design, develop, and support complex data integration pipelines using ETL tools such as Databricks, Informatica PowerCenter, Pentaho Data Integration (Kettle), and similar technologies.
• Develop, maintain, and improve technical documentation, including data models, data dictionaries, source-to-target mapping documents, ETL specifications, process flows, and reporting artifacts.
• Develop and maintain SQL-based data solutions, including complex queries, stored procedures, database objects, and data transformation processes.
• Support business intelligence and reporting initiatives by creating reports, dashboards, and analytical solutions using platforms such as OBIEE, Power BI, and other enterprise tools.
• Contribute to the design and implementation of innovative data architecture and integration strategies to improve data sharing and interoperability across DSNY and City agencies.
• Assist in maintaining internal IT systems, applications, and databases to ensure reliability and performance aligned with agency standards.

Requirements

• Strong proficiency in SQL and Python; additional experience with pySpark is preferred.
• Experience with data modeling, data analysis, ETL development, and database design.
• Experience with enterprise reporting and analytics platforms such as Power BI, OBIEE, Tableau, or similar tools.
• Knowledge of modern data platforms and cloud-based analytics environments; experience with Databricks is highly desirable.

Technologies

• SQL, Python, pySpark, Databricks
• Informatica PowerCenter, Pentaho Data Integration (Kettle)
• Oracle Business Intelligence Enterprise Edition (OBIEE), Power BI, Tableau
• ASP.NET, C#, TypeScript, React, Java
• Unix, Linux, shell scripting

Minimum Qualifications

• A bachelor's degree in computer science, engineering, or a related field plus four years of satisfactory full-time experience in datacenter engineering and operations, cloud engineering and operations, or complex IT infrastructure engineering; or
• A bachelor's degree plus eight years of satisfactory full-time experience in the same areas; or
• An education and/or experience equivalent to the above.

55A Program

This position is also open to qualified individuals with disabilities who are eligible for the 55-a Program. Indicate at the top of your resume and cover letter that you wish to be considered under the 55-a Program.

Public Service Loan Forgiveness

You may be eligible for federal loan forgiveness programs and state repayment assistance programs as a City of New York employee. For details, visit the U.S. Department of Education’s PSLF site at https://studentaid.gov/pslf/.

Residency Requirement

New York City residency is not required for this role.

Additional Information

The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and to providing a work environment free from discrimination and harassment based on legally protected status or characteristics, including sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.