DeveloperJobs.io
← Back to all jobs

Job Description

The Data Engineer role sits on the Data Strategy team and supports SMBC Capital Markets and Nikko Securities teams, as well as related entities. This position focuses on building and evolving Azure-based data platform capabilities across reference data, pricing data, data pipelines, and API enablement using Python and PySpark.

Responsibilities

  • Design and develop a strategic data platform that supports reference data for securities and pricing, with expansion into additional data domains.
  • Build and evolve data engineering solutions on the Azure cloud platform in alignment with internal development standards, contributing to the Data Strategy team’s agenda.
  • Develop full-stack data engineering capabilities using Python and PySpark to enable scalable data processing and integration.
  • Implement and manage Azure-based data services, including Azure Data Factory, Azure Lake Gen2, Azure Databases, and Azure Data Fabric.
  • Support API enablement and integration using API Gateway management and Azure Functions, including API development with FastAPI or similar Python frameworks.

Requirements

  • 10+ years of relevant experience as a Data Engineer, including hands-on experience with Azure cloud.
  • Strong SQL skills, with experience across relational and/or NoSQL database technologies.
  • Proven experience implementing ETL/ELT processes and building data pipelines that are reliable, maintainable, and production-ready.
  • Working knowledge of Azure Databricks and the broader Azure data ecosystem.
  • Familiarity with the DevOps lifecycle including Git, Jenkins, and CI/CD to support continuous delivery.

Technology Stack

  • Azure
  • Python, PySpark
  • SQL
  • Azure Data Factory
  • Azure Lake Gen2
  • Azure Databases
  • Azure Data Fabric
  • API Gateway management
  • Azure Functions
  • FastAPI
  • Azure Databricks
  • Git, Jenkins
  • CI/CD
  • ETL/ELT

Location and Pay

  • Location: Jersey City, NJ (onsite)
  • Pay: USD 65 per hourly
  • Employment: $65/hr On W2

What’s in It for You

  • Contribute to a strategic digital transformation and modernize data capabilities across the Americas Division.
  • Work closely with the Data Strategy team to establish a reference data system for securities and pricing data.
  • Build solutions on an Azure cloud platform using modern data engineering services and patterns.
  • Collaborate on API and data integration capabilities using Azure Functions and API Gateway management.
  • Apply expertise in Python/PySpark, SQL, and ETL/ELT to deliver high-impact data platform capabilities.

Similar Jobs