Data Engineer
Aws Data Engineer
Cloud Data Engineering
Data
Data Analysis
Data Analytics
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Engineer
ETL
Informatica
Information Technology (IT)
Integration
Programming Language
Programming Languages
Software Development
SQL
Job Description
Trading Technologies is hiring a Data Engineer for its Data & Analytics engineering team to modernize a SQL Server platform to Snowflake and AWS while building and operating data pipelines.
Responsibilities
- Develop, maintain, and optimize complex SQL Server queries, stored procedures, functions, views, and data processing workflows
- Design and build scalable Snowflake solutions, including data models, SQL transformations, loading processes, and analytical workloads
- Assist with migrating large volumes of data and processing from SQL Server to Snowflake
- Review existing SQL Server logic and translate or redesign it for Snowflake when appropriate
- Build and maintain ETL/ELT pipelines using SQL, Python, and orchestration tools such as Apache Airflow
- Create data ingestion and processing workflows on AWS, including S3
- Perform performance tuning across SQL Server and Snowflake (query optimization, execution plans, indexing, statistics, warehouse sizing, workload optimization)
- Implement data validation and reconciliation processes to ensure migrated and transformed datasets are accurate and complete
- Troubleshoot production data issues, determine root causes, and implement long-term fixes
- Set up monitoring, logging, alerting, and operational controls for critical data pipelines
- Collaborate with software engineers, service managers, implementation teams, product teams, and DevOps
- Support and enhance existing Transaction Cost Analysis (TCA) products and develop new functionality
- Work with large-scale trade, market, benchmark, and financial data
Requirements
- Bachelor’s degree in Computer Science, Data Engineering, or a related field
- Hands-on experience with Snowflake and AWS Cloud services, with a focus on S3 and data services
- Strong hands-on SQL development experience
- Python & C# scripting experience
- Strong experience with Microsoft SQL Server, including complex queries, stored procedures, performance tuning, and troubleshooting
- Experience working with large datasets and production data systems
- Strong analytical and problem-solving skills
- Experience migrating SQL Server workloads to Snowflake or another cloud data platform
- Experience with Apache Airflow or similar orchestration technologies
- Experience with Git, CI/CD, Liquibase, and automated deployment processes
- Experience with data quality, reconciliation, and data governance
- Knowledge of capital markets, trading, market data, or financial systems
- Experience with Transaction Cost Analysis (TCA) or other financial analytics
- Snowflake or AWS certification
- Understand how to use AI effectively while independently validating generated code for correctness, security, performance, and maintainability
Technologies
- SQL, Python, C#
- Microsoft SQL Server, Snowflake
- ETL/ELT, SQL transformations
- Data pipelines, stored procedures, functions, views
- Query optimization, execution plans, indexing, statistics
- Warehouse sizing, workload optimization
- Apache Airflow
- AWS, S3
- Git, CI/CD, Liquibase
- Transaction Cost Analysis (TCA)
- Claude Code
Location and Compensation
- New York, NY (hybrid)
- USD 94,500 - 115,000 per year
Benefits
- Medical, Dental, and Vision insurance
- Flexible Spending Accounts (FSA) & Health Savings Accounts (HSA)
- 401(k) retirement plan
- Pre-tax transit and parking benefits
- Hybrid schedule: three days in-office collaboration per week, with flexibility to work remotely for the remaining two days
- 22 days of Paid Time Off (PTO) per year, with the option to roll over unused days
- One dedicated day per year for volunteering
- Two professional development days per year for uninterrupted professional development
- Additional PTO day during milestone anniversary years
- Robust paid holiday schedule with early dismissal
- Generous parental leave for all parents (including adoptive parents)
- Budget for tech accessories, including monitors, headphones, keyboards, and other office equipment
- Backup child and pet care, as well as tutoring services
- Milestone anniversary bonuses
- Stipend and subsidy contributions toward personally-owned cell phones
- Contributions for gym memberships and health/wellness initiatives
- Discounted healthcare premiums
- Healthy meal delivery program subsidies
AI-Assisted Development
- Encourage engineers to use modern AI-assisted development tools, such as Claude Code, to accelerate development, debugging, testing, refactoring, and migration work
- Candidates should understand how to use AI effectively while independently validating generated code for correctness, security, performance, and maintainability