Data Engineer
Backend Developer
Python
Data
Data Analysis
Data Engineer
Data Engineering
Data Integration
Data Pipeline
Data Processing
Data Processing Systems
Information Technology (IT)
Intelligent Document Processing
Optical Character Recognition
Programming
Programming Language
Programming Languages
Software Development
Job Description
Electrosoft is hiring a contract Data Engineer to support the NIST CHIPS METIS initiative by building automated extraction, normalization, and validation pipelines for scientific documents and instrument outputs.
Responsibilities
- Design and implement automated OCR and document layout analysis pipelines for PDFs and Microsoft Word documents.
- Build algorithms to extract figure captions, axis labels, measurement units, and related scientific metadata.
- Implement table extraction workflows that preserve row and column structure, headers, and data relationships.
- Integrate extracted metadata with controlled vocabularies and ontologies in the Controlled Vocabulary Curation System (CVCS).
- Develop and improve user interfaces for scientific domain experts to validate extracted content and correct OCR errors.
- Create Python-based parser libraries to convert proprietary instrument outputs, legacy spreadsheets, and non-standard text files into standardized CSV formats.
- Implement automated data normalization, schema validation, and quality assurance procedures to align with METIS data schemas.
- Develop heuristic data-cleaning capabilities for missing values, merged cells, inconsistent headers, and extraneous metadata.
- Integrate extraction and standardization tools as microservices or software modules within the existing CVCS web application architecture.
- Provide data export capabilities to support integration with the METIS Discovery Portal.
- Produce design documentation, implementation guides, API specifications, and deployment procedures.
- Develop, test, and maintain documented source code in GitHub repositories, including code intended for public release.
- Deliver technical demonstrations of extraction workflows, data conversion capabilities, and system enhancements.
- Monitor and report technical performance metrics, including document processing volumes, OCR accuracy, data conversion success rates, and system integration status.
- Collaborate with government scientists, developers, and technical stakeholders to identify requirements, troubleshoot issues, and improve system functionality.
Requirements
- Bachelor's degree (four-year) in Computer Science, Data Engineering, or a related field.
- 4 years of advanced Python programming experience, specifically with Pandas and OCR libraries.
- 4 years of experience with OCR pipelines and table extraction logic.
- 4 years of experience in data format normalization and schema validation.
- 4 years of experience integrating microservices into web applications.
- Experience developing and maintaining automated data processing and transformation pipelines.
- Knowledge of OCR and document processing technologies such as Tesseract, PaddleOCR, pdfplumber, Camelot, LayoutParser, or comparable tools.
- Familiarity with JSON Schema, XML/XSD, controlled vocabularies, and ontology-based metadata tagging.
- Experience with REST APIs, GitHub, and software development and deployment practices.
- Strong analytical, problem-solving, technical documentation, and communication skills.
- Must successfully complete a federal background investigation appropriate for an IT-Low Risk position and meet applicable HSPD-12/PIV credentialing requirements.
- Must be able to work on-site at the NIST campus in Gaithersburg, Maryland.
- Position is contingent upon contract award.
Key Technologies
- Python, Pandas, OCR libraries
- Tesseract, PaddleOCR
- pdfplumber, Camelot, LayoutParser
- JSON Schema, XML/XSD
- REST APIs, GitHub, GitHub repositories
- Microsoft Word, CSV
Location: Gaithersburg, MD (onsite)
Experience: 4+ years
Job type: contract
Similar Jobs
U