Data Engineer
Job Description
Silverthorne Advisory Group LLC supports Defense sector initiatives through technology delivery and mission-focused data engineering. This hybrid role in Washington, D.C. (on-site/hybrid with 2 days per week) helps design and maintain data infrastructure and engineering solutions within the Advana environment, with Palantir Foundry experience highly preferred.
What you’ll do
- Design, develop, and maintain end-to-end data pipelines using ETL processes and technologies including Databricks, Python, Spark, Scala, SQL, JavaScript/JSON, and Jupyter Notebooks.
- Build and optimize pipelines from scratch with a focus on scalability, reliability, efficiency, and high performance.
- Support data engineering and integration activities within the Advana platform.
- Use Palantir Foundry when applicable to support data integration, transformation, pipeline development, and analytics workflows.
- Perform data cleansing, integration, transformation, and quality assurance to maintain accurate, reliable datasets.
- Process and analyze large, complex datasets using big data technologies.
- Troubleshoot pipeline issues, identify root causes, and implement effective technical solutions.
- Develop and maintain data models, database structures, and data architectures to meet business and analytical requirements.
- Implement data governance standards, security controls, and best practices aligned with federal requirements.
- Collaborate with data scientists, analysts, engineers, and stakeholders to deliver dependable data solutions.
- Maintain technical documentation for pipelines, applications, workflows, and processes.
- Evaluate emerging data engineering technologies and recommend improvements to existing systems.
What you bring
- Secret security clearance or higher required; sponsorship may be available.
- Hands-on experience developing ETL pipelines and working with large datasets.
- Proficiency with data engineering technologies including: Databricks, Python, Apache Spark / PySpark, SQL, Scala, JavaScript / JSON, and Jupyter Notebooks.
- Experience designing, developing, and optimizing data pipelines from scratch.
- Strong understanding of data modeling, database design, data integration, and data governance.
- Experience working with big data technologies and complex data environments.
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication and collaboration skills.
- Ability to work independently and collaboratively in a fast-paced technical environment.
- Strong attention to detail and commitment to delivering high-quality solutions.
Highly preferred
- Hands-on experience with Palantir Foundry, including data pipelines, data integration, transformations, and data modeling.
- Experience working within the Advana data environment.
- Previous experience supporting Department of Defense (DoD) or other federal government agencies.
- Familiarity with Palantir Foundry tools such as Pipeline Builder, Code Repositories, and Ontology.
- Experience with cloud-based data platforms and enterprise data architectures.
- Understanding of federal financial management data, reporting, or analytics environments.
- Experience supporting business intelligence and visualization platforms such as Power BI or Qlik Sense.
Compensation and benefits
Salary: USD 120,000 - 140,000 per year. Compensation is determined based on experience, qualifications, technical expertise, location, and other applicable factors.
- Healthcare benefits: comprehensive medical, dental, and vision insurance plans for employees and their families.
- 401(k) retirement plan: 100% company match on employee contributions up to the first 6%, with access to Vanguard Admiral funds.
- Paid time off: generous paid leave based on length of service.
- Performance bonuses: bonus opportunities for employees who meet and exceed performance goals.
- Professional development: opportunities for training, certifications, and career advancement.
- Company retreats & team events: sponsored trips, team-building activities, and professional conferences.
- Flexible work from home: options available.
Employment type: Full-Time/Salaried. Experience level: All Levels. Industry: Federal Government / Department of Defense (DoD). Work arrangement: On-site/Hybrid 2-days a week.