Senior Data Engineer
Job Description
Benefits
- Group Medical
- Dental
- Vision
- Life
- Retirement Savings Program
- PSL
Avispa Technology invites you to join as a Senior Data Engineer to design, build, and optimize scalable data platforms and pipelines that power analytics and business intelligence for a leading music streaming company. This contract role is based in New York, NY with remote options, and offers a rate of USD 60 - 70 per hourly. You will collaborate across cross-functional teams, leveraging modern cloud and big data technologies to deliver robust data solutions.
Responsibilities
- Design, develop, and maintain scalable, high-performance data pipelines, ETL processes, and distributed data processing systems using Spark and related frameworks.
- Build and optimize data models and cloud-based data warehouse architectures while ensuring data quality, reliability, and performance.
- Craft complex SQL queries and data integration solutions to support analytics, reporting, and business intelligence initiatives.
- Collaborate with cross-functional teams to unify data from multiple sources, troubleshoot performance issues, and adopt scalable data engineering practices.
- Monitor, optimize, and maintain data platforms, while researching emerging technologies and driving continuous improvements to data engineering processes.
Requirements
- 5 years of Data Engineering experience.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Strong expertise with Python and Apache Spark.
- Strong understanding of distributed systems, data modeling, and ETL processes.
- Experience designing and maintaining scalable data pipelines.
- Experience with cloud-based data warehouse solutions such as AWS Redshift, Snowflake, or Teradata.
- Advanced SQL skills.
- Experience with Scala is preferred.
- Experience with Databricks is preferred.
Technologies
- Apache Spark
- Python
- AWS Redshift
- Snowflake
- Teradata
- SQL
- Scala
- Databricks
Shift
Monday to Friday, 9:00 am to 5:00 pm.