Sarah Hoffmann af968d4903 introduce tokenizer modules ...

This adds the boilerplate for selecting configurable tokenizers.
A tokenizer can be chosen at import time and will then install
itself such that it is fixed for the given database import even
when the software itself is updated.

The legacy tokenizer implements Nominatim's traditional algorithms.

2021-04-30 11:29:57 +02:00

0 lines

Python

Raw Blame History