gf-core.git/src/compiler/GF/Text/Lexing.hs, branch master Unnamed repository; edit this file 'description' to name the repository. https://git.adelon.net/gf-core.git/atom?h=master 2019-11-18T12:20:41+00:00 PGFService: revert unlexing change in PGFService to restore &+ behaviour 2019-11-18T12:20:41+00:00 Thomas Hallgren th-github@altocumulus.org 2019-11-18T12:20:41+00:00 urn:sha1:28f53e801aaf0d47b22f64467c2c760dff8fd6a9 eliminate modules PGF.Lexing, PGF.LexingAGreek. Make PGF.Utilities an internal module in the runtime. These are not really part of the core runtime. 2017-09-04T09:43:37+00:00 Krasimir Angelov kr.angelov@gmail.com 2017-09-04T09:43:37+00:00 urn:sha1:1f908fa7bf65f51540ccb2b70ca2bd00d9b3dedf add lexer and unlexer for Ancient Greek accent normalization 2016-02-23T16:30:39+00:00 leiss leiss@cis.uni-muenchen.de 2016-02-23T16:30:39+00:00 urn:sha1:df2901c9c0c18f67180a46916077032f91bac649 Change the type of PGF.Lexing.bindTok to [String] -> [String] 2014-04-09T17:39:21+00:00 hallgren hallgren@chalmers.se 2014-04-09T17:39:21+00:00 urn:sha1:50ea3d265c35b677b60aa6a465eb19bcd66d25ad The old type was [String] -> String. This function was only used in GF.Text.Lexing.stringOp, which now uses (unwords . bindTok) instead, with no change in behaviour. Unlexers: move capitalization of first word from GF.Text.Lexing to PGF.Lexing 2014-04-09T17:26:23+00:00 hallgren hallgren@chalmers.se 2014-04-09T17:26:23+00:00 urn:sha1:677d849840e3a5b8f69044ef43151908b0f6737b The capitalization of the first word was done in GF.Text.Lexing.stringOp, but is now done in the functions unlexText and unlexMixed in PGF.Lexing. These functions are only used in stringOp and in PGFService (where the change is needed), so the subtle change in behaviour should not cause any bugs. Move basic lexing functions from GF.Text.Lexing to the new module PGF.Lexing 2014-04-08T14:07:49+00:00 hallgren hallgren@chalmers.se 2014-04-08T14:07:49+00:00 urn:sha1:9cac98a3561386a9e190881ba64292f672f86500 They are thus part of the PGF Run-Time Library, making it possible to add lexing functionality in PGF service in a natural way. removed the unlines-lines wrapper from Lexing.unlexer to prevent empty lines when an unlexer (such as -bind or -unchars) is used as an option in linearization. Don't know really why the input had been broken into lines in the first place. You can see the effect by importing LangEng and running "gr -cat=Cl | l -table -bind" before and after recompiling GF. 2013-12-03T13:27:22+00:00 aarne aarne@chalmers.se 2013-12-03T13:27:22+00:00 urn:sha1:2ef28487effc8f51f92810bd326458e0bc6f3e35 use the native unicode support from GHC 6.12 2010-04-19T09:38:36+00:00 krasimir krasimir@chalmers.se 2010-04-19T09:38:36+00:00 urn:sha1:6313244eacf992fb10a5091bee28582e84540809 correct capitalization in unlexmixed; unlextext and unlexmixed now remove string literal quotes 2009-12-17T21:17:46+00:00 aarne aarne@chalmers.se 2009-12-17T21:17:46+00:00 urn:sha1:a4eb1800a4913121297eb83970718cd3895aa43f reorganize the directories under src, and rescue the JavaScript interpreter from deprecated 2009-12-13T18:50:29+00:00 krasimir krasimir@chalmers.se 2009-12-13T18:50:29+00:00 urn:sha1:f85232947e74ee7ef8c7b0ad2338212e7e68f1be