The NYC Department of City Planning seeks a Data Engineer to design, deploy, and scale data infrastructure within the Information Technology Division, Geographic Data and Engineering unit. This onsite Manhattan role focuses on building data products and pipelines and publishing high quality public datasets with a geospatial emphasis through collaboration across teams. The position offers a salary of USD 100,000 to 112,000 per year and requires at least four years of relevant experience along with a bachelor’s degree in computer science, engineering, or a related field.
Responsibilities
- Design, deploy, and scale current infrastructure to maintain and improve data engineering processes, expanding capabilities and offerings.
- Assess the technologies used by the team and recommend new tools; ideate, design, and implement improvements to products and processes to ensure optimal tooling.
- Build data engineering products, including:
- operating data ingestion pipelines and managing data storage;
- running scripts that standardize, geocode, merge, aggregate, and perform basic spatial manipulations;
- reviewing outputs by writing custom scripts or using QAQC tools to identify errors, inconsistencies, and edge cases in datasets.
- Design new data products from concept to completion, collaborating with product owners on specifications, creating technical designs with teammates, aiding sprint planning, contributing to documentation, and delivering a finished product.
- Collaborate with other data engineers in sprint planning, design reviews, code reviews, and pair programming.
- Learn and wrangle complex legacy data systems and bring the infrastructure into a modern development stack.
- Share accomplishments and lessons learned with NYC Planning, other city agencies, and external audiences via talks, presentations, blogs, or other mediums.
Requirements
- A bachelor’s degree in computer science, engineering, or a related field from an accredited college and four years of satisfactory full‑time experience related to IT automation engineering, monitoring engineering, or management of infrastructure; or
- Eight years of satisfactory full‑time experience related to IT automation engineering, monitoring engineering, or management of infrastructure; or
- Education and/or experience equivalent to the above.
Technologies
- SQL (PostgreSQL, DuckDB, MySQL, SQL Server)
- Python
- Data Warehousing / Data Lakes
- dbt
- AWS, GCP, Azure
- Containerization
- CI/CD
- Git
- PostGIS
- GeoPandas
- BigQuery
- Snowflake
- Redshift
- Apache Spark
- Airflow
- Prefect
- Dagster
Benefits
- Public Service Loan Forgiveness
Additional Information
Residency: New York City Residency is not required for this position.
The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment free from discrimination and harassment based on protected characteristics.
Agency Overview
The Department of City Planning (DCP) plans for the future of New York City, working to create thriving and dynamic neighborhoods with housing and jobs, resilient infrastructure, and a vibrant public realm. The Department engages communities to develop inclusive plans, expands housing access and economic opportunity, and plans for long-term sustainability. The Information Technology Division (ITD) aims to deliver technology solutions that support agency needs and citywide requests, operating in hybrid environments to assist planners, urban designers, project managers, and executive leadership. The Geographic Data and Engineering (GDE) unit within ITD focuses on data strategy, governance, geospatial datasets, and the publication of data products for public use. This role contributes to continuing modernization and cross-agency data collaboration across the city.
