Data Engineer
Backend Developer
Python
Azure
Azure Data Engineer
Azure Data Factory
Azure Data Lake
Azure Data Platform
Azure Functions
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Engineer
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Director
Data Factory
Data Factory Azure
Data Integration
Data Integration Tools
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
Engineer
ETL
Informatica
Information Technology (IT)
Microsoft Azure
Software Development
Spark
SQL
Job Description
The Data Engineer role sits on the Data Strategy team and supports SMBC Capital Markets and Nikko Securities teams, as well as related entities. This position focuses on building and evolving Azure-based data platform capabilities across reference data, pricing data, data pipelines, and API enablement using Python and PySpark.
Responsibilities
- Design and develop a strategic data platform that supports reference data for securities and pricing, with expansion into additional data domains.
- Build and evolve data engineering solutions on the Azure cloud platform in alignment with internal development standards, contributing to the Data Strategy team’s agenda.
- Develop full-stack data engineering capabilities using Python and PySpark to enable scalable data processing and integration.
- Implement and manage Azure-based data services, including Azure Data Factory, Azure Lake Gen2, Azure Databases, and Azure Data Fabric.
- Support API enablement and integration using API Gateway management and Azure Functions, including API development with FastAPI or similar Python frameworks.
Requirements
- 10+ years of relevant experience as a Data Engineer, including hands-on experience with Azure cloud.
- Strong SQL skills, with experience across relational and/or NoSQL database technologies.
- Proven experience implementing ETL/ELT processes and building data pipelines that are reliable, maintainable, and production-ready.
- Working knowledge of Azure Databricks and the broader Azure data ecosystem.
- Familiarity with the DevOps lifecycle including Git, Jenkins, and CI/CD to support continuous delivery.
Technology Stack
- Azure
- Python, PySpark
- SQL
- Azure Data Factory
- Azure Lake Gen2
- Azure Databases
- Azure Data Fabric
- API Gateway management
- Azure Functions
- FastAPI
- Azure Databricks
- Git, Jenkins
- CI/CD
- ETL/ELT
Location and Pay
- Location: Jersey City, NJ (onsite)
- Pay: USD 65 per hourly
- Employment: $65/hr On W2
What’s in It for You
- Contribute to a strategic digital transformation and modernize data capabilities across the Americas Division.
- Work closely with the Data Strategy team to establish a reference data system for securities and pricing data.
- Build solutions on an Azure cloud platform using modern data engineering services and patterns.
- Collaborate on API and data integration capabilities using Azure Functions and API Gateway management.
- Apply expertise in Python/PySpark, SQL, and ETL/ELT to deliver high-impact data platform capabilities.
Similar Jobs
S