summaryrefslogtreecommitdiff
path: root/src/compiler/GF/Text/Lexing.hs
AgeCommit message (Collapse)Author
2019-11-18PGFService: revert unlexing change in PGFService to restore &+ behaviourThomas Hallgren
2017-09-04eliminate modules PGF.Lexing, PGF.LexingAGreek. Make PGF.Utilities an ↵Krasimir Angelov
internal module in the runtime. These are not really part of the core runtime.
2016-02-23add lexer and unlexer for Ancient Greek accent normalizationleiss
2014-04-09Change the type of PGF.Lexing.bindTok to [String] -> [String]hallgren
The old type was [String] -> String. This function was only used in GF.Text.Lexing.stringOp, which now uses (unwords . bindTok) instead, with no change in behaviour.
2014-04-09Unlexers: move capitalization of first word from GF.Text.Lexing to PGF.Lexinghallgren
The capitalization of the first word was done in GF.Text.Lexing.stringOp, but is now done in the functions unlexText and unlexMixed in PGF.Lexing. These functions are only used in stringOp and in PGFService (where the change is needed), so the subtle change in behaviour should not cause any bugs.
2014-04-08Move basic lexing functions from GF.Text.Lexing to the new module PGF.Lexinghallgren
They are thus part of the PGF Run-Time Library, making it possible to add lexing functionality in PGF service in a natural way.
2013-12-03removed the unlines-lines wrapper from Lexing.unlexer to prevent empty lines ↵aarne
when an unlexer (such as -bind or -unchars) is used as an option in linearization. Don't know really why the input had been broken into lines in the first place. You can see the effect by importing LangEng and running "gr -cat=Cl | l -table -bind" before and after recompiling GF.
2010-04-19use the native unicode support from GHC 6.12krasimir
2009-12-17correct capitalization in unlexmixed; unlextext and unlexmixed now remove ↵aarne
string literal quotes
2009-12-13reorganize the directories under src, and rescue the JavaScript interpreter ↵krasimir
from deprecated