Processor
After a querier returns results, two Python packages clean and normalize them so entries from different libraries can sit in one catalog.
- libprocess processes results from libquery. API docs: oldvis.github.io/libprocess.
- libprocess_extensions processes results from libquery_extensions. API docs: oldvis.github.io/libprocess_extensions.
They map each source's schema onto a shared structure, extract fields, generate UUIDs, parse dates and authors, detect languages, and check URLs. Each data source has its own processing rules. The output is the unified dataset.