Data engineer
Apache Airflow
Automation
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Cloud Operations
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Governance
Data Integration
Data Integration Tools
Data Lakehouse
Data Management
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Data Warehousing
Database
Databases
Databricks
Engineer
ETL
Informatica
Integration
Pyspark
Snowflake
Spark
SQL
Unity Catalog
Workflow Orchestration
Job Description
Support ETL/ELT and data reliability for acquisition and marketing datasets using Databricks and related data tooling.
Responsibilities
- Build and maintain ETL/ELT pipelines for acquisition reporting using Databricks, PySpark, SQL, and Unity Catalog under the guidance of senior engineers.
- Assist with migrating Snowflake SQL scripts and transformations into Databricks Unity Catalog by updating queries, validating outputs, and helping apply data governance best practices.
- Develop ingestion processes for marketing vendor data, including data parsing, normalization, and basic quality validations.
- Implement and maintain data quality checks, monitoring, alerting, and issue triage workflows using Databricks, Snowflake, Airflow, and internal tooling.
- Collaborate with the Data Reliability Engineering team on SLA monitoring, simple incident troubleshooting, and logging improvements.
- Work with analytics and marketing stakeholders to understand dataset requirements and help ensure accuracy for dashboards and reporting.
- Support performance tuning, logging, and ongoing pipeline reliability efforts.
- Contribute to engineering best practices such as code reviews, documentation, and shared frameworks/tools.
Requirements
- 4+ years of experience as a Data Engineer or in a similar role.
- Strong SQL skills, including analytical SQL, complex joins, and window functions.
- Hands-on experience with PySpark and/or Spark SQL in production.
- Working knowledge of data modeling, ETL/ELT design patterns, and distributed data processing.
- Experience building pipelines in Databricks, including Delta Lake, Unity Catalog, data governance, and lakehouse patterns.
- Experience with AWS services such as S3, IAM, EC2, Glue, Lambda or related components.
- Experience with Airflow or similar orchestration tools.
- Experience with Git/GitHub, CI/CD, and modern DevOps practices.
- Excellent communication skills and ability to work cross-functionally.
- Experience building robust ingestion pipelines for semi-structured data formats such as JSON, Parquet, and CSV.
Technology Stack
- Databricks, PySpark, SQL, Spark SQL
- Unity Catalog (Databricks UC), Delta Lake, Lakehouse patterns
- Snowflake
- Airflow
- AWS: S3, IAM, EC2, Glue, Lambda
- Git, GitHub, CI/CD
- JSON, Parquet, CSV
Location
- California City, CA (onsite)
Minimum Experience
- 4 years
Benefits
- Interested cdds pl fwd CV's to [email protected].
- Contact Deivy at 856 528 3312 extn 1221.