DeveloperJobs.io
← Back to all jobs
D2 Technologies

Data Engineer

D2 Technologies
Herndon, VA $100k - $150k/yr Full time Posted 2d ago
Big Data Bigdata Cloud Data Engineering Cloud Data Platform Cloud Platform Cloud Platforms Data Data Analysis Data Analytics Data Architecture Data Engineer Data Engineering Data Governance Data Integration Data Integration Tools Data Lakehouse Data Management Data Pipeline Data Platform Data Processing Data Security Data Warehouse Database Databases Databricks Databricks Dlt Databricks Lakehouse Engineer ETL Informatica Pyspark Spark SQL
Apply Now

Job Description

D2 Technologies is hiring an experienced Data Engineer to help build and improve enterprise data platforms on the Databricks Lakehouse Platform. This hybrid role in Herndon, VA focuses on scalable ETL/ELT pipelines, high-performance processing with Apache Spark, and data transformation using SQL. You will also contribute to data quality, governance, and production support so analytics teams can trust the data they use.

Compensation: $100,000 to $150,000 per year (negotiable). Work mode: Hybrid remote in Herndon, VA 20192.

What you’ll do

  • Design, develop, and maintain scalable data engineering solutions using Databricks and Apache Spark.
  • Build and optimize high-performance ETL/ELT pipelines for large volumes of structured and unstructured data.
  • Develop, tune, and optimize complex SQL queries for data transformation and analytics.
  • Translate business requirements into scalable technical solutions.
  • Troubleshoot production issues and optimize data pipeline performance.
  • Ensure data quality, integrity, security, and governance across enterprise data platforms.
  • Collaborate with data architects, software engineers, analysts, and business stakeholders.
  • Participate in code reviews and follow software engineering best practices.
  • Create and maintain technical documentation for solutions, deployments, and operational support.
  • Support production releases and provide operational support as needed.

Key technologies

Work will center on Databricks, the Databricks Lakehouse Platform, Apache Spark (including PySpark and Spark SQL), SQL, ETL, ELT, and Delta Lake. You will also use tools such as Git and cloud services including Azure, AWS, and Google Cloud Platform, with exposure to Databricks Delta Live Tables (DLT), Unity Catalog, and CI/CD. PL/SQL is listed as a nice-to-have.

What you bring

  • U.S. Citizenship is required (Federal Project requirement).
  • Top Secret (TS) Security Clearance or Public Trust Clearance preferred.
  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field (or equivalent experience).
  • Hands-on experience developing and implementing data engineering solutions using Databricks.
  • Strong hands-on experience with the Databricks Lakehouse Platform.
  • Strong programming experience with Apache Spark (PySpark/Spark SQL).
  • Expert-level SQL skills, including writing, optimizing, and troubleshooting complex queries.
  • Strong analytical, critical thinking, and problem-solving skills.
  • Experience designing, developing, and supporting ETL/ELT pipelines.
  • Strong understanding of data modeling, data warehousing, and Delta Lake.
  • Experience using Git or other version control systems.
  • Excellent verbal and written communication skills.

Preferred background

  • Strong SQL query optimization and performance tuning skills.
  • Experience with Azure, AWS, or Google Cloud Platform.
  • Knowledge of CI/CD pipelines and DevOps practices.
  • Experience with Databricks Delta Live Tables (DLT) and Unity Catalog.
  • Nice to have: experience with PL/SQL.

Application screening: This is a Federal Project requiring US Citizenship. Applicants must answer whether they are a US citizen.

Similar Jobs