summaryrefslogtreecommitdiff
path: root/src/runtime/haskell/PGF/Lexing.hs
AgeCommit message (Collapse)Author
2017-09-04eliminate modules PGF.Lexing, PGF.LexingAGreek. Make PGF.Utilities an ↵Krasimir Angelov
internal module in the runtime. These are not really part of the core runtime.
2017-06-02handling combination of &+ and &|aarne
2017-06-02handling capitalization (&|) in unlexer -bindaarne
2014-10-19(un)lexmixed: added the other math environments than $ used in latexaarne
2014-10-17one general case in dealing with backslash in latex lexing is enoughaarne
2014-10-17unlexing latex code: no space between closing $ and punctuationaarne
2014-10-17lexer for latex code: don't separate backslash from the macro name that it marksaarne
2014-04-09Change the type of PGF.Lexing.bindTok to [String] -> [String]hallgren
The old type was [String] -> String. This function was only used in GF.Text.Lexing.stringOp, which now uses (unwords . bindTok) instead, with no change in behaviour.
2014-04-09Unlexers: move capitalization of first word from GF.Text.Lexing to PGF.Lexinghallgren
The capitalization of the first word was done in GF.Text.Lexing.stringOp, but is now done in the functions unlexText and unlexMixed in PGF.Lexing. These functions are only used in stringOp and in PGFService (where the change is needed), so the subtle change in behaviour should not cause any bugs.
2014-04-09PGF Service: a bit more clever lexer=texthallgren
Only change the first word to lowercase if the original input is not found in the grammar's morphology. This allows parsing of sentenses starting with "I" in English, nouns in German and proper names in other languages, but it can make the wrong choice for multi-words.
2014-04-08Move basic lexing functions from GF.Text.Lexing to the new module PGF.Lexinghallgren
They are thus part of the PGF Run-Time Library, making it possible to add lexing functionality in PGF service in a natural way.