DeveloperJobs.io
← Back to all jobs

Job Description

Support ETL/ELT and data reliability for acquisition and marketing datasets using Databricks and related data tooling.

Responsibilities

  • Build and maintain ETL/ELT pipelines for acquisition reporting using Databricks, PySpark, SQL, and Unity Catalog under the guidance of senior engineers.
  • Assist with migrating Snowflake SQL scripts and transformations into Databricks Unity Catalog by updating queries, validating outputs, and helping apply data governance best practices.
  • Develop ingestion processes for marketing vendor data, including data parsing, normalization, and basic quality validations.
  • Implement and maintain data quality checks, monitoring, alerting, and issue triage workflows using Databricks, Snowflake, Airflow, and internal tooling.
  • Collaborate with the Data Reliability Engineering team on SLA monitoring, simple incident troubleshooting, and logging improvements.
  • Work with analytics and marketing stakeholders to understand dataset requirements and help ensure accuracy for dashboards and reporting.
  • Support performance tuning, logging, and ongoing pipeline reliability efforts.
  • Contribute to engineering best practices such as code reviews, documentation, and shared frameworks/tools.

Requirements

  • 4+ years of experience as a Data Engineer or in a similar role.
  • Strong SQL skills, including analytical SQL, complex joins, and window functions.
  • Hands-on experience with PySpark and/or Spark SQL in production.
  • Working knowledge of data modeling, ETL/ELT design patterns, and distributed data processing.
  • Experience building pipelines in Databricks, including Delta Lake, Unity Catalog, data governance, and lakehouse patterns.
  • Experience with AWS services such as S3, IAM, EC2, Glue, Lambda or related components.
  • Experience with Airflow or similar orchestration tools.
  • Experience with Git/GitHub, CI/CD, and modern DevOps practices.
  • Excellent communication skills and ability to work cross-functionally.
  • Experience building robust ingestion pipelines for semi-structured data formats such as JSON, Parquet, and CSV.

Technology Stack

  • Databricks, PySpark, SQL, Spark SQL
  • Unity Catalog (Databricks UC), Delta Lake, Lakehouse patterns
  • Snowflake
  • Airflow
  • AWS: S3, IAM, EC2, Glue, Lambda
  • Git, GitHub, CI/CD
  • JSON, Parquet, CSV

Location

  • California City, CA (onsite)

Minimum Experience

  • 4 years

Benefits

  • Interested cdds pl fwd CV's to [email protected].
  • Contact Deivy at 856 528 3312 extn 1221.

Similar Jobs