gf-core.git/src/runtime/haskell/PGF/Lexing.hs, branch master Unnamed repository; edit this file 'description' to name the repository. https://git.adelon.net/gf-core.git/atom?h=master 2017-09-04T09:43:37+00:00 eliminate modules PGF.Lexing, PGF.LexingAGreek. Make PGF.Utilities an internal module in the runtime. These are not really part of the core runtime. 2017-09-04T09:43:37+00:00 Krasimir Angelov kr.angelov@gmail.com 2017-09-04T09:43:37+00:00 urn:sha1:1f908fa7bf65f51540ccb2b70ca2bd00d9b3dedf handling combination of &+ and &| 2017-06-02T06:11:44+00:00 aarne aarne@chalmers.se 2017-06-02T06:11:44+00:00 urn:sha1:9e206496a7f226ec7166874153e348381c37154e handling capitalization (&|) in unlexer -bind 2017-06-02T06:06:57+00:00 aarne aarne@chalmers.se 2017-06-02T06:06:57+00:00 urn:sha1:d1eb0aa657e05f035d3679555e1b45401f1e3a25 (un)lexmixed: added the other math environments than $ used in latex 2014-10-19T17:43:39+00:00 aarne aarne@chalmers.se 2014-10-19T17:43:39+00:00 urn:sha1:84bce336fd2acc5b18e0e8792a82b682dacaab37 one general case in dealing with backslash in latex lexing is enough 2014-10-17T15:49:23+00:00 aarne aarne@chalmers.se 2014-10-17T15:49:23+00:00 urn:sha1:5c862a3c7bda63886426a785357bad03b839dfa9 unlexing latex code: no space between closing $ and punctuation 2014-10-17T07:04:50+00:00 aarne aarne@chalmers.se 2014-10-17T07:04:50+00:00 urn:sha1:2caf6fa125f7f91a7a78b7f0699a43c2d922e687 lexer for latex code: don't separate backslash from the macro name that it marks 2014-10-17T06:40:06+00:00 aarne aarne@chalmers.se 2014-10-17T06:40:06+00:00 urn:sha1:42cfacbf867184ae5bc495a247fa6fbeb8c90639 Change the type of PGF.Lexing.bindTok to [String] -> [String] 2014-04-09T17:39:21+00:00 hallgren hallgren@chalmers.se 2014-04-09T17:39:21+00:00 urn:sha1:50ea3d265c35b677b60aa6a465eb19bcd66d25ad The old type was [String] -> String. This function was only used in GF.Text.Lexing.stringOp, which now uses (unwords . bindTok) instead, with no change in behaviour. Unlexers: move capitalization of first word from GF.Text.Lexing to PGF.Lexing 2014-04-09T17:26:23+00:00 hallgren hallgren@chalmers.se 2014-04-09T17:26:23+00:00 urn:sha1:677d849840e3a5b8f69044ef43151908b0f6737b The capitalization of the first word was done in GF.Text.Lexing.stringOp, but is now done in the functions unlexText and unlexMixed in PGF.Lexing. These functions are only used in stringOp and in PGFService (where the change is needed), so the subtle change in behaviour should not cause any bugs. PGF Service: a bit more clever lexer=text 2014-04-09T14:13:18+00:00 hallgren hallgren@chalmers.se 2014-04-09T14:13:18+00:00 urn:sha1:04a6260eeaf626cf4774d087d8810d438f554b46 Only change the first word to lowercase if the original input is not found in the grammar's morphology. This allows parsing of sentenses starting with "I" in English, nouns in German and proper names in other languages, but it can make the wrong choice for multi-words.