summaryrefslogtreecommitdiff
path: root/src/runtime/c/pgf/scanner.c
AgeCommit message (Collapse)Author
2020-07-11revert to using unconditional probabilities in the different lookup functionskrangelov
2020-05-16split unknown words by spaceskrangelov
2020-05-14lookupCohorts now detects and reports unknown words. Also:krangelov
- added added two filtering functions: filterLongest and filterBest - updated the PGF service to work with the new API
2020-03-05lookup_morpho, lookup_cohorts and fullform_lexicon now report the usual ↵krangelov
conditional probability. This turns out to be more useful for part of speech tagging
2019-06-30fully supported case-insensitive parsing/lookupkrangelov
2019-06-25the parser now ensures that all word senses are in the chartkrangelov
2019-05-28filter out empty cohortskrangelov
2019-05-28API for scanning for cohorts in an arbitrary textkrangelov