API Design ​

Each querier in libquery and libquery_extensions corresponds to a querier class that inherits BaseQuerier (Source).

BaseQuerier has abstract methods fetch_metadata and fetch_image . Note that fetch_metadata and fetch_image return None. Both methods use side effects to store fetched metadata and images on the local disk.

The fetched metadata is stored as a JSON Lines file. Each entry in the JSON Lines file follows the data structure MetadataEntry (Source).