Data Engineer
Job Description
Corner Alliance is seeking a Data Engineer (4+ years) to support a federal government client. In this contract role, you will help extend the Controlled Vocabulary Curation System (CVCS) into a data ingestion hub for CHIPS METIS research data, with the goal of improving how figures, tables, and metadata move into the METIS Discovery Portal.
You will focus on automating document-to-data workflows, standardizing messy inputs into machine-readable CSVs, validating them against METIS schemas, and exposing the resulting pipelines through modules or microservices integrated into the existing CVCS web application.
Role summary
Build automated extraction and conversion pipelines to pull figures and tables from PDF and DOCX documents, normalize CSV outputs (including non-standard spreadsheet formats), and integrate the standardized results into the METIS Discovery Portal. The work also includes updating the CVCS interface so domain experts can validate extracted outputs and correct OCR errors.
Responsibilities
- Develop tools to detect, crop, and extract figures and charts from PDF/DOCX documents, capturing captions and identifying axis labels and units using OCR and layout analysis
- Implement algorithms to extract embedded tables while preserving row/column structure and headers, and tag extracted figures and tables against CVCS ontologies
- Update the CVCS user interface so domain experts can validate extracted figures and correct OCR errors in table headers
- Build a library of parsers that convert non-standard formats (including Excel with complex headers, legacy spreadsheets with merged cells, and instrument-specific ASCII dumps) into clean, machine-readable CSV files
- Validate generated CSV outputs against METIS data schemas for column naming and data types, using heuristic cleanup for issues like missing values, merged cells, and trailing metadata rows, and flag ambiguous cases for human review
- Integrate extraction and conversion tools as microservices or modules within the existing CVCS web application, and enable export of standardized CSVs and figure metadata to the METIS Discovery Portal
- Produce design, deployment, and API documentation, and maintain documented code in the client’s public GitHub repository
- Deliver demonstration presentations of extraction and data conversion workflows
- Prepare monthly progress reports covering progress, delays and mitigation, document processing statistics (figures extracted and OCR accuracy), CSV standardization success rates, and portal integration status
Requirements
- Bachelor’s degree (4-year) in Computer Science, Data Engineering, or a related field
- 4+ years of advanced Python programming, specifically Pandas and OCR libraries
- 4+ years of experience building OCR pipelines and table extraction logic
- 4+ years of experience with data format normalization and schema validation
- 4+ years of experience integrating microservices into web applications
- US citizenship or permanent residency and ability to pass a public trust background investigation
Technologies
- Python, Pandas, OCR
- Django, Docker, Git, GitHub
- Tesseract, REST APIs
Location and schedule
- On-site work as part of a dynamic team at the client’s Gaithersburg, MD campus, Monday through Friday, 8:30 a.m. to 5:00 p.m.
- Remote work may be authorized with advance approval from the client or when the campus is closed
Preferred experience / skills
- Experience with scientific or research data (instrument outputs, metadata, or ontologies)
- Experience with document layout analysis and PDF parsing tools (for example, Tesseract)
- Experience building REST APIs and working in web application frameworks such as Django, with Docker and Git/GitHub
- Experience with CI/CD pipelines and open-source or public repository contributions
- Prior experience supporting NIST’s Software and Systems Division, the CHIPS program, or METIS
Benefits
- 401k matching (4%)
- PTO: 3 weeks to start, 4 weeks (2-5 years), and 5 weeks (5 years+)
- Health, dental, vision
- Short- and long-term disability
- FSA accounts
- 4 weeks of paid parental leave
- 11 paid holidays (including your birthday off)
- Fitness & cell phone reimbursements
- Monthly all hands update meetings
- Annual in-person all hands team building day and evening out
- Regular check-ins for professional growth goals
- Semi-monthly one on one performance manager meetings
- Social team that coordinates monthly events
- Use of technology like Slack to support collaboration
Salary: Approximate salary estimate: $00 - $00 annually
Corner Alliance will never ask you to provide payment-related information during any part of the employment application process. Corner Alliance will only communicate with you through its ATS system JazzHR and/or emails generated by the corneralliance.com automated system. Beware of fake employment opportunities using Corner Alliance’s name.