Senior Data Engineer
Senior
Big Data
Bigdata
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Lead
Data Integration
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
Event Driven Architecture
Hybrid Cloud
Information Technology (IT)
Kafka
Pyspark
Scala
Software Development
Software Engineering
Spark
SQL
Streaming Data
Job Description
Ardalyst Defense, LLC is seeking a Senior Data Engineer (Databricks) to lead Databricks implementations and deliver enterprise-scale data and analytics capabilities for hybrid cloud environments. In this role, you will support the end-to-end solution lifecycle, providing technical guidance, integration support, and data quality and observability capabilities that enable mission and business objectives.
Role focus
- Lead Databricks implementations for enterprise-scale data and analytics solutions in hybrid cloud environments
- Support design, development, integration, and maintenance of scalable cloud-based data platforms
- Provide technical guidance across the solution lifecycle, including data quality and observability
Responsibilities
- Develop and deliver the client installation plan through coordination with clients and the project team
- Serve as the escalation point for technical issues from clients and other system engineers
- Manage client expectations related to solution functionality, deployment processes, and realistic timelines
- Act as a subject matter expert in solution architecture for hybrid cloud environments
- Collaborate with the Leadership Team to review and contribute to Product Roadmaps
- Identify the organizational impact of the technical solution architecture
- Provide technical leadership to the engineering team, as necessary
- Travel as required to customer sites, naval installations, shipyards, and vessels for installation, maintenance, modernization, and troubleshooting activities
- Perform other related duties as assigned by supervisors, team leads, or program management
Requirements
- Senior Databricks engineer with 5 years of experience, including knowledge of databases, data warehousing, data analytics, or related data technologies
- Associate’s degree in information technology, Networking, Cybersecurity, or a related field, or an equivalent combination of education, military training, and relevant experience
- Active DoD Secret Security Clearance required
- Hybrid cloud data and infrastructure design experience, including implementation of data quality functions such as standardization, transformation, rationalization, linking, and matching
- Seven (7) years of experience in Python and SQL for data analysis, data processing, or problem-solving, including in-memory computing experience using R, Python, Spark, PySpark, Kafka, and Scala
- Seven (7) years of experience identifying data source telemetry and routing it for operational observability
- Excellent communication (written and oral) and interpersonal skills
Technologies
- Databricks, Python, SQL, R, Spark, PySpark, Kafka, Scala
Location and travel
- Northern Virginia, Maryland, DC (hybrid)
- Travel as required to customer sites, naval installations, shipyards, and vessels for installation, maintenance, modernization, and troubleshooting activities
About Ardalyst Defense, LLC
- Ardalyst Defense, LLC is a Maryland, Service-Disabled Veteran-Owned Small Business (SDVOSB) providing engineering services and technical, analytical and cyberspace operations services to integrated U.S. government agency operations
- Ardalyst personnel have decades of direct operations experience in full-scope Cyberspace Operations at the Service, Joint, and National Agency levels
Benefits
- Competitive salary commensurate with experience
- Paid Time Off (PTO)
- Paid Holidays
- 401(k) Retirement Plan
- Health, Dental, Vision and Life insurance
- Short Term and Long-Term Disability insurance
- Monetary assistance with training and certifications
What Ardalyst offers you
- The opportunity to support meaningful Navy missions while working alongside experienced IT, engineering, and cybersecurity professionals
- A collaborative environment where employees are encouraged to contribute ideas, expand their technical skills, and take on new challenges
- Exposure to a wide range of technologies, systems, and operational environments that support professional growth and hands-on experience
- Opportunities for training, certification development, and continued learning
Similar Jobs
S