<feed xmlns='http://www.w3.org/2005/Atom'>
<title>gf-core.git/src/compiler/GF/Compile/ReadFiles.hs, branch master</title>
<subtitle>Unnamed repository; edit this file 'description' to name the repository.
</subtitle>
<id>https://git.adelon.net/gf-core.git/atom?h=master</id>
<link rel='self' href='https://git.adelon.net/gf-core.git/atom?h=master'/>
<link rel='alternate' type='text/html' href='https://git.adelon.net/gf-core.git/'/>
<updated>2015-06-23T12:58:14+00:00</updated>
<entry>
<title>Bump version of .gfo and .pgf files, improve error messages on version mismatch</title>
<updated>2015-06-23T12:58:14+00:00</updated>
<author>
<name>hallgren</name>
<email>hallgren@chalmers.se</email>
</author>
<published>2015-06-23T12:58:14+00:00</published>
<link rel='alternate' type='text/html' href='https://git.adelon.net/gf-core.git/commit/?id=22ba8d34ff00bde6aa83dc9bdcdd13de34799c08'/>
<id>urn:sha1:22ba8d34ff00bde6aa83dc9bdcdd13de34799c08</id>
<content type='text'>
Becacuse of the new special tokens added to the Symbol type, .gfo and .pgf
files produced with the current version of GF can not always be used with
older versions of GF and the PGF run-time system.

The PGF version number was increased from (2,0) to (2,1). GF can still
read version (2,0) and (1,0), so old PGF files continue to work.

The GFO version was increased from "GF03" to "GF04".
</content>
</entry>
<entry>
<title>ModuleName and Ident are now distinct types</title>
<updated>2014-10-21T19:20:31+00:00</updated>
<author>
<name>hallgren</name>
<email>hallgren@chalmers.se</email>
</author>
<published>2014-10-21T19:20:31+00:00</published>
<link rel='alternate' type='text/html' href='https://git.adelon.net/gf-core.git/commit/?id=391b301881bee7de9580f2c6d819144161e6a51d'/>
<id>urn:sha1:391b301881bee7de9580f2c6d819144161e6a51d</id>
<content type='text'>
This makes the documentation clearer, and can potentially catch more
programming mistakes.

</content>
</entry>
<entry>
<title>Experimental: parallel batch compilation of grammars</title>
<updated>2014-08-25T09:56:00+00:00</updated>
<author>
<name>hallgren</name>
<email>hallgren@chalmers.se</email>
</author>
<published>2014-08-25T09:56:00+00:00</published>
<link rel='alternate' type='text/html' href='https://git.adelon.net/gf-core.git/commit/?id=d84c5ef1715c3e4aed4098ee9c847e2dcc86cba4'/>
<id>urn:sha1:d84c5ef1715c3e4aed4098ee9c847e2dcc86cba4</id>
<content type='text'>
On my laptop these changes speed up the full build of the RGL and example
grammars with 'cabal build' from ~95s to ~43s and the zero build from ~18s
to ~5s.

The main change is the introduction of the module GF.CompileInParallel that
replaces GF.Compile and the function GF.Compile.ReadFiles.getAllFiles. At
present, it is activated with the new -j flag, and it is only used when
combined with --make or --batch. In addition, to get parallel computations,
you need to add GHC run-time flags, e.g., +RTS -N -A20M -RTS, to the command
line.

The Setup.hs script has been modified to pass the appropriate flags to GF
for parallel compilation when compiling the RGL and example grammars, but you
need a recent version of Cabal for this to work (probably &gt;=1.20).

Some additonal refactoring were made during this work. A new monad is used to
avoid warnings/error messages from different modules to be intertwined when
compiling in parallel, so some functios that were hardiwred to the IO or IOE
monads have been lifted to work in arbitrary monads that are instances in
the appropriate classes.


</content>
</entry>
<entry>
<title>Add lifted directory operations in GF.System.Directory to eliminate the need for liftIO in various places</title>
<updated>2014-08-20T17:47:08+00:00</updated>
<author>
<name>hallgren</name>
<email>hallgren@chalmers.se</email>
</author>
<published>2014-08-20T17:47:08+00:00</published>
<link rel='alternate' type='text/html' href='https://git.adelon.net/gf-core.git/commit/?id=21f429caf8c8cb4248457c16abaf0ad4f51c974a'/>
<id>urn:sha1:21f429caf8c8cb4248457c16abaf0ad4f51c974a</id>
<content type='text'>
</content>
</entry>
<entry>
<title>GF.Compile.ReadFiles: a simpler &amp; faster way to convert from Latin1 to UTF-8</title>
<updated>2014-08-19T14:27:15+00:00</updated>
<author>
<name>hallgren</name>
<email>hallgren@chalmers.se</email>
</author>
<published>2014-08-19T14:27:15+00:00</published>
<link rel='alternate' type='text/html' href='https://git.adelon.net/gf-core.git/commit/?id=61760e4205d03c5e05dbaa6cf2ff5ffdd1c43662'/>
<id>urn:sha1:61760e4205d03c5e05dbaa6cf2ff5ffdd1c43662</id>
<content type='text'>
</content>
</entry>
<entry>
<title>Refactoring in GF.Compile and GF.ReadFiles with an eye to parallel compilation</title>
<updated>2014-08-13T16:46:11+00:00</updated>
<author>
<name>hallgren</name>
<email>hallgren@chalmers.se</email>
</author>
<published>2014-08-13T16:46:11+00:00</published>
<link rel='alternate' type='text/html' href='https://git.adelon.net/gf-core.git/commit/?id=a06351b6250dd456299565f13eba6ed02dd2a07b'/>
<id>urn:sha1:a06351b6250dd456299565f13eba6ed02dd2a07b</id>
<content type='text'>
In particular, the function compileOne has been moved to the new module
GF.CompileOne and its type has been changed from

    compileOne :: ... -&gt; CompileEnv -&gt; FilePath -&gt; IOE CompileEnv

to

    compileOne :: ... -&gt; SourceGrammar -&gt; FilePath -&gt; IOE OneCompiledModule

making it more suitable for use in a parallel compiler.
</content>
</entry>
<entry>
<title>Convert from Text.PrettyPrint to GF.Text.Pretty</title>
<updated>2014-07-28T11:58:00+00:00</updated>
<author>
<name>hallgren</name>
<email>hallgren@chalmers.se</email>
</author>
<published>2014-07-28T11:58:00+00:00</published>
<link rel='alternate' type='text/html' href='https://git.adelon.net/gf-core.git/commit/?id=7a91afc02a0a245bf9fea248e61421a75c22137d'/>
<id>urn:sha1:7a91afc02a0a245bf9fea248e61421a75c22137d</id>
<content type='text'>
All compiler modules now use GF.Text.Pretty instead of Text.PrettyPrint
</content>
</entry>
<entry>
<title>GF.Compile.ReadFiles: reduced code duplication</title>
<updated>2013-12-16T14:04:57+00:00</updated>
<author>
<name>hallgren</name>
<email>hallgren@chalmers.se</email>
</author>
<published>2013-12-16T14:04:57+00:00</published>
<link rel='alternate' type='text/html' href='https://git.adelon.net/gf-core.git/commit/?id=2b16962835af120a332c5e54c3465a0d02e9b668'/>
<id>urn:sha1:2b16962835af120a332c5e54c3465a0d02e9b668</id>
<content type='text'>
</content>
</entry>
<entry>
<title>Change how GF deals with character encodings in grammar files</title>
<updated>2013-11-25T21:12:11+00:00</updated>
<author>
<name>hallgren</name>
<email>hallgren@chalmers.se</email>
</author>
<published>2013-11-25T21:12:11+00:00</published>
<link rel='alternate' type='text/html' href='https://git.adelon.net/gf-core.git/commit/?id=9d7fdf7c9a525a3b5659a566f76d26d151dcd664'/>
<id>urn:sha1:9d7fdf7c9a525a3b5659a566f76d26d151dcd664</id>
<content type='text'>
1. The default encoding is changed from Latin-1 to UTF-8.

2. Alternate encodings should be specified as "--# -coding=enc", the old
   "flags coding=enc" declarations have no effect but are still checked for
   consistency.

3. A transitional warning is generated for files that contain non-ASCII
   characters without specifying a character encoding:

	"Warning: default encoding has changed from Latin-1 to UTF-8"

4. Conversion to Unicode is now done *before* lexing. This makes it possible
   to allow arbitrary Unicode characters in identifiers. But identifiers are
   still stored as ByteStrings, so they are limited to Latin-1 characters
   for now.

5. Lexer.hs is no longer part of the repository. We now generate the lexer
   from Lexer.x with alex&gt;=3. Some workarounds for bugs in alex-3.0 were
   needed. These bugs might already be fixed in newer versions of alex, but
   we should be compatible with what is shipped in the Haskell Platform.
</content>
</entry>
<entry>
<title>Some more monadic lifting changes</title>
<updated>2013-11-21T15:01:04+00:00</updated>
<author>
<name>hallgren</name>
<email>hallgren@chalmers.se</email>
</author>
<published>2013-11-21T15:01:04+00:00</published>
<link rel='alternate' type='text/html' href='https://git.adelon.net/gf-core.git/commit/?id=fe065b5ee417f1f155edeeeafdf6f3d2c21da130'/>
<id>urn:sha1:fe065b5ee417f1f155edeeeafdf6f3d2c21da130</id>
<content type='text'>
</content>
</entry>
</feed>
