summaryrefslogtreecommitdiff
path: root/src/runtime/c/pgf/parser.c
AgeCommit message (Collapse)Author
2014-03-07added pgf_lookup_word_prefix which makes it possible to do simple word ↵kr.angelov
prediction
2013-12-10loading and unloading of languages in the C runtime and in the Python bindingskr.angelov
2013-11-22bugfix in the debug mode for the parserkr.angelov
2013-11-21bugfix in the C runtimekr.angelov
2013-11-18bugfix in the robust parserkr.angelov
2013-11-13bugfix in the C runtime which had made the parser up to 200 times slower for ↵kr.angelov
some sentences
2013-11-12added Predef.SOFT_BIND. This special token allows zero or more spaces ↵kr.angelov
between ordinary tokens. It is also used in the English RGL to attach the commas to the previous word.
2013-11-07factor of 3 speedup for the translation without slowing down the grammar ↵kr.angelov
loading. The parser still seems to be 8 times slower than before I introduced the BIND. At least the Android UI now feels a lot more comfortable
2013-11-06fix in the parsing with prekr.angelov
2013-11-06the content of ParseEngAbs3.probs is now merged with ParseEngAbs.probs. The ↵kr.angelov
later is now retrained. Once the grammar is compiled with the .probs file now it doesn't need anything more to do robust parsing. The robustness itself is controlled by the flags 'heuristic_search_factor', 'meta_prob' and 'meta_token_prob' in ParseEngAbs.gf
2013-11-01fix the robust parser for unknown tokenskr.angelov
2013-10-30use linref in the C linearizer. The robust linearization is now fully supportedkr.angelov
2013-10-30added the linref construction in GF. The PGF version number is now bumpedkr.angelov
2013-10-28another fix for 'pre'kr.angelov
2013-10-28fix the handling of 'pre' in the C runtimekr.angelov
2013-10-21bugfix for the custom literals in the C runtimekr.angelov
2013-10-09avoid warning in parser.c when debugging is OFFkr.angelov
2013-10-09a major redesign in the C runtime. The parser and the linearizer now fully ↵kr.angelov
support BIND. The following things are still broken: parseval, word completion, handling 'pre', the robust mode
2013-10-08fix the robust parser after the change of GuStringkr.angelov
2013-10-04GuString is now an ordinary C string - it makes live easier. In addition ↵kr.angelov
PgfSymbolKS, PgfExprFun and PgfLiteralStr now keep their strings as embedded flexible arrays. The latest change gives us the same compactness as the old representation but it is a lot easier to use.
2013-09-30better handling for nonExist in the C runtime. BIND is also supported in the ↵kr.angelov
linearizer but not in the parser yet
2013-09-27a major refactoring in the C and the Haskell runtimes. Note incompatible ↵kr.angelov
change in the PGF format!!! The following are the outcomes: - Predef.nonExist is fully supported by both the Haskell and the C runtimes - Predef.BIND is now an internal compiler defined token. For now it behaves just as usual for the Haskell runtime, i.e. it generates &+. However, the special treatment will let us to handle it properly in the C runtime. - This required a major change in the PGF format since both nonExist and BIND may appear inside 'pre' and this was not supported before.
2013-09-25fix the debug mode of the parser after the refactoring in libgukr.angelov
2013-09-17a major refactoring in the C runtime. GuList is now removed and replaced ↵kr.angelov
with GuSeq. The GuSeq/GuBuf API is simplified
2013-09-13remove leftcorner_cat_idx which is now redundantkr.angelov
2013-09-13minor optimization/refactoring in the grammar readerkr.angelov
2013-09-13the leftcorner indexing is now completely removed since it slowed down the ↵kr.angelov
loading without speeding up parsing a lot
2013-09-13fix the debug mode of the parser after the changes in the libgu APIkr.angelov
2013-09-12remove the logging from libgukr.angelov
2013-09-05remove the read and write modules from libgu. this simplifies the i/o layerkr.angelov
2013-09-04remove the dependency on the HAVE_STATEMENT_EXPRESSIONS flag. This reduces ↵kr.angelov
the dependency on the ./configure script
2013-08-23nonExist now does the expected thingkr.angelov
2013-08-21fix in the C parserkr.angelov
2013-08-19word completion in the C runtime now returns multi-word expressions and the ↵kr.angelov
category for every expression
2013-08-19fullFormLexicon in C and Pythonkr.angelov
2013-08-16implemented lookupMorpho for C and Pythonkr.angelov
2013-07-03the parser in the C runtime now checks for duplicated resultskr.angelov
2013-06-27C runtime: fix the debug modes in the parser and in the reasoner after the ↵kr.angelov
changes in the printer
2013-06-26patch for adjustable heuristics from Pythonkr.angelov
2013-05-07bug fix in the management of memory pools in the statistical parserkr.angelov
2013-05-06the statistical parser is now using two memory pools: one for parsing and ↵kr.angelov
one for the output trees. This means that the memory for parsing can be released as soon as the needed abstract trees are retrieved, while the trees themselves are retained in the separate output pool
2013-05-05fix the leftcorner filtering after the addition of word completionkr.angelov
2013-05-01word completion in the C runtime. The runtime/python/test.py example is now ↵kr.angelov
using readline with word completion
2013-04-26finally the statistical parser is able to return all possible abstract treeskr.angelov
2013-03-20the calculation of lexical_prob in the statistical parser doesn't work ↵kr.angelov
properly. It should be fixed but for now I just disabled the optimization
2013-03-20replace #if with #ifdef when checking for the optional bottom up filtering ↵kr.angelov
in the C runtime
2013-03-19the bottom up filtering in the C runtime is temporary disabled. It takes too ↵kr.angelov
much memory and even makes it impossible to load the Finnish and the German parsing grammars.
2013-03-11bugfix in the statistical parserkr.angelov
2013-02-19the parser in the C runtime should not crash if the start category is not ↵kr.angelov
defined
2013-02-12now the beam size for the statistical parser can be configured by using the ↵kr.angelov
flag beam_size in the top-level concrete module