summaryrefslogtreecommitdiff
path: root/src
AgeCommit message (Collapse)Author
2013-12-10French inflection display in androidaarne
2013-12-10bugfix in the grammar splitterkr.angelov
2013-12-10option --split-pgf replaces option --mk-index. This splits the PGF into one ↵kr.angelov
file for the abstract and one more for each concrete syntax. This is a preparation for being able to load only specific languages from the whole grammar.
2013-12-09new inflection_fi.xml, for stemmed and refactored ParseFinaarne
2013-12-07make ParseFin compile with Constructionaarne
2013-12-06Show relative file paths in error messageshallgren
This is to avoid one trivial reason for failures in the test suite.
2013-12-06GF.Compile.CheckGrammar: add source path to error message for circular ↵hallgren
definitions
2013-12-06GF shell: fix help text for generate_treeshallgren
Trees are not generated with increasing depth.
2013-12-03removed the unlines-lines wrapper from Lexing.unlexer to prevent empty lines ↵aarne
when an unlexer (such as -bind or -unchars) is used as an option in linearization. Don't know really why the input had been broken into lines in the first place. You can see the effect by importing LangEng and running "gr -cat=Cl | l -table -bind" before and after recompiling GF.
2013-12-03fix in inflection_en.xmlkr.angelov
2013-12-02ui/android/.../Translate.java uses Parse8 (change the name and language list ↵aarne
if you need something else)
2013-11-29Commment code and options relating to the old partial evaluatorhallgren
This means that the -old-comp and -new-comp flags are not recognized anymore. The only functional difference is that printnames were still normalized with the old partial evaluator. Now that is done with the new partial evaluator.
2013-11-29Move typePredefined from GF.Compile.Compute.AppPredefined to ↵hallgren
GF.Compile.TypeCheck.Primitives Also move the list of primitives
2013-11-29Move checkPredefError from GF.Compile.Compute.ConcreteLazy to GF.Grammar.Macroshallgren
Also simplified its type.
2013-11-29-optimize-pgf should also apply to the linrefskr.angelov
2013-11-28added caching to be able to quickly generate the inflection table for Finnishkr.angelov
2013-11-29added forms to Finnish xml tableaarne
2013-11-28html templates for Finnish noun and verb inflection startedaarne
2013-11-28bugfix in the android appkr.angelov
2013-11-28now the TTS is used only if there is actually a language model. this is ↵kr.angelov
better than using English for speaking Swedish
2013-11-28a bit of cleanup in the Android appkr.angelov
2013-11-28extension in the template format for inflection tables. This makes it ↵kr.angelov
possible to use the templates with Finish
2013-11-28GFI: adapt to character encoding changeshallgren
GF.Compile.Coding is not used any more.
2013-11-28SimpleEditor.Convert: adapt to recent character encoding changeshallgren
Things got simpler!
2013-11-28the Android App now show the valency patterns for verbs in English, ↵kr.angelov
Bulgarian and Swedish
2013-11-27better dictionary visualization in the Android Appkr.angelov
2013-11-27minor tweaks in the Android UIkr.angelov
2013-11-27fix the character encoding problem in the web view in the Android UIkr.angelov
2013-11-27added API in the C runtime and the Java binding for checking whether a given ↵kr.angelov
function is linearizable in a given language. This is used in the Android UI for better vizualizations
2013-11-27update the project files for the Java bindingkr.angelov
2013-11-27space leak in the Java bindingkr.angelov
2013-11-26Represent identifiers as UTF-8-encoded ByteStringshallgren
This was a fairly simple change thanks to previous work on making the Ident type abstract and the fact that PGF.CId already uses UTF-8-encoded ByteStrings. One potential pitfall is that Data.ByteString.UTF8 uses the same type for ByteStrings as Data.ByteString. I renamed ident2bs to ident2utf8 and bsCId to utf8CId, to make it clearer that they work with UTF-8-encoded ByteStrings. Since both the compiler input and identifiers are now UTF-8-encoded ByteStrings, the lexer now creates identifiers without copying any characters. **END OF DESCRIPTION*** Place the long patch description above the ***END OF DESCRIPTION*** marker. The first line of this file will be the patch name. This patch contains the following changes: M ./src/compiler/GF/Compile/CheckGrammar.hs -3 +3 M ./src/compiler/GF/Compile/GrammarToPGF.hs -2 +2 M ./src/compiler/GF/Grammar/Binary.hs -5 +1 M ./src/compiler/GF/Grammar/Lexer.x -11 +13 M ./src/compiler/GF/Infra/Ident.hs -19 +36 M ./src/runtime/haskell/PGF.hs -1 +1 M ./src/runtime/haskell/PGF/CId.hs -2 +3
2013-11-25Change how GF deals with character encodings in grammar fileshallgren
1. The default encoding is changed from Latin-1 to UTF-8. 2. Alternate encodings should be specified as "--# -coding=enc", the old "flags coding=enc" declarations have no effect but are still checked for consistency. 3. A transitional warning is generated for files that contain non-ASCII characters without specifying a character encoding: "Warning: default encoding has changed from Latin-1 to UTF-8" 4. Conversion to Unicode is now done *before* lexing. This makes it possible to allow arbitrary Unicode characters in identifiers. But identifiers are still stored as ByteStrings, so they are limited to Latin-1 characters for now. 5. Lexer.hs is no longer part of the repository. We now generate the lexer from Lexer.x with alex>=3. Some workarounds for bugs in alex-3.0 were needed. These bugs might already be fixed in newer versions of alex, but we should be compatible with what is shipped in the Haskell Platform.
2013-11-22fix in the GF keyboard for Androidkr.angelov
2013-11-22fix the export for CFG grammars with BIND, SOFT_BIND and nonExistkr.angelov
2013-11-22the GF syntax for identifiers is exteded with quoted forms, i.e. you could ↵kr.angelov
write for instance 'ab.c' and then everything between the quites is identifier. This includes Unicode characters and non-ASCII symbols. This is useful for automatically generated GF grammars.
2013-11-22bugfix in the debug mode for the parserkr.angelov
2013-11-21Some refactoring in GF.Compile and GF.Compile.GetGrammarhallgren
Move source transcoding function GF.Compile to GF.Compile.GetGrammar, in preparation for doing transcoding before lexing.
2013-11-21Some more monadic lifting changeshallgren
2013-11-21bugfix in the C runtimekr.angelov
2013-11-21the Java binding for lookupMorpho should release the local references ↵kr.angelov
created in a loop
2013-11-20fix in the Python bindingkr.angelov
2013-11-20Removed some code duplication in GF.Compile.Updatehallgren
2013-11-20Reduced clutter in monadic codehallgren
+ Eliminated vairous ad-hoc coersion functions between specific monads (IO, Err, IOE, Check) in favor of more general lifting functions (liftIO, liftErr). + Generalized many basic monadic operations from specific monads to arbitrary monads in the appropriate class (MonadIO and/or ErrorMonad), thereby completely eliminating the need for lifting functions in lots of places. This can be considered a small step forward towards a cleaner compiler API and more malleable compiler code in general.
2013-11-19GF shell: improved system_pipe (aka "?") commandhallgren
1. No temporary files are created. 2. The output of a system command is read lazily, making it feasible to process large or even infinite output, e.g. the following works as expected: ? "yes" | ? "head -5" | ps -lextext
2013-11-18bugfix in the robust parserkr.angelov
2013-11-18add gu_buf_insert in libgukr.angelov
2013-11-15fixes in the C runtime to avoid warnings when compiling on MacOSkr.angelov
2013-11-15pgf_read should open the grammar file in binary mode to prevent the Windows ↵kr.angelov
runtime from messing up the content.
2013-11-15pgf_reader_done should do nothing if the reading has failedkr.angelov