Data Engineer
Job Description
Steampunk is seeking a seasoned Data Engineer to lead and architect enterprise-grade data platforms, services, and pipelines. This on-site role in McLean, VA focuses on building reliable, high-performance data pipelines in cloud environments (preferably AWS), while collaborating in an Agile software development lifecycle. Steampunk is a Change Agent in the Federal contracting industry, serving clients in the Homeland, Federal Civilian, Health, and DoD sectors through a Human-Centered delivery methodology centered on shared accountability.
Compensation
Steampunk sets salary based on factors including geographic location, contractual requirements, education, knowledge, skills, competencies, and experience. The projected compensation range for this position is $110,000 to $160,000 per year. Annual salary is one component of Steampunk’s total compensation package.
What you’ll do
- Lead and architect data pipelines and ingest patterns that move raw data from data producers into an enterprise data ecosystem, prioritizing performance and reliability.
- Assess and understand ETL jobs, workflows, BI tools, and reports.
- Answer technical inquiries related to customization, integration, enterprise architecture, and feature/functionality of data products.
- Support the Agile software development lifecycle.
- Contribute to the growth of the Data Exploitation Practice.
What you bring
- Experience supporting ICE contract work.
- Experience working in Design Intelligence.
- Bachelor’s Degree and 6+ years of total experience (or equivalent experience and education).
- 6+ years of direct Data Engineering experience, including ability to inspect existing data pipelines, determine their purpose, and re-implement them efficiently in Databricks.
- Advanced SQL knowledge and experience with relational databases.
- Advanced working knowledge of NoSQL databases.
- Experience with message queuing, stream processing, and highly scalable big data data stores.
- Experience manipulating, processing, and extracting value from large, disconnected datasets.
- Experience working with structured and unstructured data for analysis.
- Experience with data modeling tools and processes.
- Experience aggregating and transforming data from multiple datasets to create data products.
- Experience working in an Agile environment.
Tools and technologies
You may work with: Python, SQL, Databricks, AWS Data Services, Hadoop, Spark, Kafka, Postgres, Cassandra, Azkaban, Luigi, Airflow, EC2, S3, RDS, Glue, Step Functions, Lamda, EMR, DynamoDB, DocumentDB, Redshift, Aurora, Athena, Snowflake, Storm, Spark-Streaming, R, Scala, Go.
Application process notes
- As part of the application process, you are expected to be on camera during interviews and assessments.
- Steampunk reserves the right to take your picture to verify your identity and prevent fraud.
- Steampunk participates in the E-Verify program.
Equal opportunity employer: Steampunk provides equal employment opportunities to all qualified applicants without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.