Ferdinand Majerech
|
492e36d28a
|
In-place UTF32->UTF-8 conversion in Reader.
|
2014-07-30 18:21:09 +02:00 |
|
|
Ferdinand Majerech
|
cc1aaf4ac8
|
dchar->char encoding now also has a version for non-validated dchars.
|
2014-07-30 18:20:22 +02:00 |
|
|
Ferdinand Majerech
|
f4c57b368b
|
Style/spaces.
|
2014-07-30 04:46:53 +02:00 |
|
|
Ferdinand Majerech
|
cf3bff517c
|
UTF-8 is now the default input encoding. UTF-16/32 is encoded into UTF-8.
|
2014-07-30 04:46:28 +02:00 |
|
|
Ferdinand Majerech
|
c1ffa05735
|
Removed redundant spaces.
|
2014-07-30 00:37:15 +02:00 |
|
|
Ferdinand Majerech
|
c473ef7dee
|
Removed -8 suffixes from Reader methods.
|
2014-07-30 00:13:48 +02:00 |
|
|
Ferdinand Majerech
|
eb266b4e27
|
Removed the -8 suffixes from Scanner methods.
|
2014-07-29 23:42:50 +02:00 |
|
|
Ferdinand Majerech
|
e5561285c3
|
Removed UTF-32 buffer offset.
|
2014-07-29 23:25:22 +02:00 |
|
|
Ferdinand Majerech
|
33b2a7ef68
|
Removed the UTF-32 buffer from Reader.
|
2014-07-29 23:23:45 +02:00 |
|
|
Ferdinand Majerech
|
736de8beb9
|
Reader now uses validation to get the number of characters in the UTF8 buffer.
|
2014-07-29 23:22:16 +02:00 |
|
|
Ferdinand Majerech
|
74c161c576
|
validateUTF8NoGC now calculates the number of characters in passed string.
|
2014-07-29 23:21:07 +02:00 |
|
|
Ferdinand Majerech
|
ffef7bf6fc
|
Removed UTF-32 parts of Reader API.
|
2014-07-29 23:15:08 +02:00 |
|
|
Ferdinand Majerech
|
d1aaec6a60
|
Removed the UTF-32 SliceBuilder.
|
2014-07-29 23:10:46 +02:00 |
|
|
Ferdinand Majerech
|
207cb249e0
|
Scanner style.
|
2014-07-29 23:08:37 +02:00 |
|
|
Ferdinand Majerech
|
8806cfc1b4
|
More @nogc in Scanner.
|
2014-07-29 23:08:03 +02:00 |
|
|
Ferdinand Majerech
|
18be6b2e5b
|
Removed UTF-32 scanLineBreak.
|
2014-07-29 23:01:05 +02:00 |
|
|
Ferdinand Majerech
|
6837156258
|
Block scalar scanning now works with UTF-8.
|
2014-07-29 20:58:00 +02:00 |
|
|
Ferdinand Majerech
|
19ed03cb3e
|
Low hanging fruit for using UTF-8 reader methods
|
2014-07-29 20:55:24 +02:00 |
|
|
Ferdinand Majerech
|
ecc168dc75
|
insert() for SliceBuilder8.
|
2014-07-29 20:52:39 +02:00 |
|
|
Ferdinand Majerech
|
58e19d75ad
|
Assert message fix.
|
2014-07-29 20:52:24 +02:00 |
|
|
Ferdinand Majerech
|
302995354c
|
Fixed a SliceBuilder8.Transaction compilation bug.
|
2014-07-29 14:43:53 +02:00 |
|
|
Ferdinand Majerech
|
510357f4c7
|
insert() instead of insertBack() for SliceBuilder.
|
2014-07-29 14:41:46 +02:00 |
|
|
Ferdinand Majerech
|
239152f793
|
UTF-8 scanPlain and callees.
|
2014-07-29 04:28:07 +02:00 |
|
|
Ferdinand Majerech
|
d80917419f
|
Removed obsolete UTF-32 methods.
|
2014-07-29 04:20:14 +02:00 |
|
|
Ferdinand Majerech
|
4a09338a7a
|
Directive scanning is now fully UTF-8.
|
2014-07-29 04:19:44 +02:00 |
|
|
Ferdinand Majerech
|
38143a2c64
|
Fixed NoGC appender unittest.
|
2014-07-29 04:18:34 +02:00 |
|
|
Ferdinand Majerech
|
31acd6aead
|
Removed obsolete comment.
|
2014-07-29 04:10:42 +02:00 |
|
|
Ferdinand Majerech
|
e565543080
|
Removed UTF-32 scanAlphaNumeric.
|
2014-07-29 04:10:30 +02:00 |
|
|
Ferdinand Majerech
|
ef735e280f
|
UTF-8 directive name scanning.
|
2014-07-29 04:10:16 +02:00 |
|
|
Ferdinand Majerech
|
4307ccbe82
|
Fixed a Reader compilation bug.
|
2014-07-29 03:18:54 +02:00 |
|
|
Ferdinand Majerech
|
952726aa5e
|
UTF-8 scanFlowScalar. **NOTE:** moved escaping to Parser; can't do it in-place
|
2014-07-29 03:18:37 +02:00 |
|
|
Ferdinand Majerech
|
252bf083a7
|
Fixed a potential Unicode bug.
|
2014-07-29 03:13:42 +02:00 |
|
|
Ferdinand Majerech
|
b789317df8
|
UTF-8 scanTag
|
2014-07-29 03:13:21 +02:00 |
|
|
Ferdinand Majerech
|
de6c1aacdb
|
UTF-8 scanTagHandle.
|
2014-07-29 03:11:38 +02:00 |
|
|
Ferdinand Majerech
|
40fe7090d9
|
UTF-8 scanTagURI.
|
2014-07-29 03:11:17 +02:00 |
|
|
Ferdinand Majerech
|
2003a950cb
|
UTF-8 scanURIEscapes.
|
2014-07-29 03:10:51 +02:00 |
|
|
Ferdinand Majerech
|
1cc07c263a
|
UTF-8 scanAnchor.
|
2014-07-29 03:09:59 +02:00 |
|
|
Ferdinand Majerech
|
2a524bbb5e
|
UTF-8 scanLineBreak.
|
2014-07-29 03:07:57 +02:00 |
|
|
Ferdinand Majerech
|
6dd53b55a0
|
UTF-8 scanAlphaNumeric.
|
2014-07-29 03:07:31 +02:00 |
|
|
Ferdinand Majerech
|
a9def88eed
|
Docfix.
|
2014-07-29 03:06:51 +02:00 |
|
|
Ferdinand Majerech
|
3880adf81d
|
UTF-8 SliceBuilder.
|
2014-07-29 03:01:16 +02:00 |
|
|
Ferdinand Majerech
|
cb64197bb1
|
nogcutil import.
|
2014-07-29 02:59:58 +02:00 |
|
|
Ferdinand Majerech
|
76cfd7704d
|
forward() invalidates last decoded offsets.
|
2014-07-29 02:59:33 +02:00 |
|
|
Ferdinand Majerech
|
2e156a8ece
|
UTF-8 prefix()/get()
|
2014-07-29 02:59:16 +02:00 |
|
|
Ferdinand Majerech
|
709ab00e44
|
A UTF-8 slice().
|
2014-07-29 02:58:04 +02:00 |
|
|
Ferdinand Majerech
|
56057b43ec
|
peek() now uses the UTF-8 buffer.
|
2014-07-29 02:57:19 +02:00 |
|
|
Ferdinand Majerech
|
ef9053d7f3
|
Keeping buffer8_ and buffer_ positions in sync.
|
2014-07-29 02:54:39 +02:00 |
|
|
Ferdinand Majerech
|
6addaa4cbe
|
Better comment.
|
2014-07-29 02:52:01 +02:00 |
|
|
Ferdinand Majerech
|
634418b599
|
Added UTF-8 version of the Reader buffer (for now, side by side with UTF-32)
|
2014-07-29 02:51:46 +02:00 |
|
|
Ferdinand Majerech
|
d3846f7970
|
Removed now unused function.
|
2014-07-29 02:00:32 +02:00 |
|
|
Ferdinand Majerech
|
5d78e76f6a
|
Error messages with non-ASCII chars will now show the char, not 'unknown'.
|
2014-07-29 02:00:13 +02:00 |
|
|
Ferdinand Majerech
|
7cf9dca57d
|
Function to encode *valid* UTF-32 to UTF-8
|
2014-07-29 01:59:22 +02:00 |
|
|
Ferdinand Majerech
|
cf15d55da0
|
Function to decode *valid* UTF-8
|
2014-07-29 01:58:59 +02:00 |
|
|
Ferdinand Majerech
|
53b39dc590
|
Updated copyright and description.
|
2014-07-29 01:58:22 +02:00 |
|
|
Ferdinand Majerech
|
6b8ff23859
|
A function to validate a UTF-8 string.
|
2014-07-29 01:58:00 +02:00 |
|
|
Ferdinand Majerech
|
61424b0ac6
|
A @nogc isValidDchar.
|
2014-07-29 01:57:07 +02:00 |
|
|
Ferdinand Majerech
|
cac25207f1
|
parseNoGC can work with code points directly.
|
2014-07-29 01:55:43 +02:00 |
|
|
Ferdinand Majerech
|
6e1239fdac
|
Removed unused/untested code from AppenderNoGCFixed.
|
2014-07-29 01:50:04 +02:00 |
|
|
Ferdinand Majerech
|
4a4e83112c
|
utf8Stride is now globally visible in reader.d
|
2014-07-28 23:21:43 +02:00 |
|
|
Ferdinand Majerech
|
45b15890ca
|
It should be enough to use \x instead of \u for \u0085
|
2014-07-28 23:19:59 +02:00 |
|
|
Ferdinand Majerech
|
645b191948
|
Removed todo garbage.
|
2014-07-26 23:38:59 +02:00 |
|
|
Ferdinand Majerech
|
f07aaeef87
|
Reader UTF decoding is now private.
|
2014-07-26 23:37:56 +02:00 |
|
|
Ferdinand Majerech
|
a8c32430ed
|
Minor style.
|
2014-07-26 23:37:33 +02:00 |
|
|
Ferdinand Majerech
|
ebe10ad8c4
|
Removed the Error and ErrorData aliases.
|
2014-07-26 23:31:13 +02:00 |
|
|
Ferdinand Majerech
|
2e7de5f9ed
|
checkDocumentStart func attribs.
|
2014-07-26 23:30:13 +02:00 |
|
|
Ferdinand Majerech
|
d5663b1e57
|
Scanner style.
|
2014-07-26 23:29:55 +02:00 |
|
|
Ferdinand Majerech
|
f76e4cfd02
|
Queue copyright.
|
2014-07-26 23:25:08 +02:00 |
|
|
Ferdinand Majerech
|
424e6e5f98
|
Queue whitespaces.
|
2014-07-26 23:24:41 +02:00 |
|
|
Ferdinand Majerech
|
2688591c6a
|
Better func attribs in Queue.
|
2014-07-26 23:23:59 +02:00 |
|
|
Ferdinand Majerech
|
9d480d1723
|
scanDirective is now nothrow and mostly @nogc.
|
2014-07-26 18:26:39 +02:00 |
|
|
Ferdinand Majerech
|
14a8e31fa5
|
Minor cleanup.
|
2014-07-26 18:20:57 +02:00 |
|
|
Ferdinand Majerech
|
f11fbf3b36
|
scanTagDirectiveValue returns handle length with return value, not ref param
|
2014-07-26 18:19:26 +02:00 |
|
|
Ferdinand Majerech
|
271eca053a
|
scanYAMLDirectiveValue is now nothrow @nogc.
|
2014-07-26 18:15:50 +02:00 |
|
|
Ferdinand Majerech
|
58b42750aa
|
scanYAMLDirectiveNumber now scans to slice.
|
2014-07-26 18:08:39 +02:00 |
|
|
Ferdinand Majerech
|
e055506b29
|
nothrow and some @nogc in tag directive scanning.
|
2014-07-26 17:48:50 +02:00 |
|
|
Ferdinand Majerech
|
d190b9d839
|
scanDirective now uses a slice.
|
2014-07-26 17:37:20 +02:00 |
|
|
Ferdinand Majerech
|
f48d254350
|
Updated copyright statement in parser.d
|
2014-07-26 16:43:39 +02:00 |
|
|
Ferdinand Majerech
|
388b74b332
|
Stripped spaces.
|
2014-07-26 16:43:02 +02:00 |
|
|
Ferdinand Majerech
|
db7fecf960
|
directiveToken no longer stores multiple values by zero-separating.
|
2014-07-26 16:41:04 +02:00 |
|
|
Ferdinand Majerech
|
b5259e6ada
|
Directive type is now a Token data member.
|
2014-07-26 16:38:15 +02:00 |
|
|
Ferdinand Majerech
|
3ae7c713ef
|
Added a directive type enum.
|
2014-07-26 16:37:38 +02:00 |
|
|
Ferdinand Majerech
|
27bccabca4
|
scanDirectiveIgnoredLine is now nothrow @nogc.
|
2014-07-26 13:42:22 +02:00 |
|
|
Ferdinand Majerech
|
5133257201
|
scanAnchor is now nothrow.
|
2014-07-26 13:31:31 +02:00 |
|
|
Ferdinand Majerech
|
60e0270ffa
|
A function to simplify building 'expected, but found' error messages.
|
2014-07-26 13:18:03 +02:00 |
|
|
Ferdinand Majerech
|
cf014150ca
|
Renamed setError() to error() for more compact error handling.
|
2014-07-26 13:06:35 +02:00 |
|
|
Ferdinand Majerech
|
33110e295e
|
scanAlphaNumeric, scanDirectiveName are now nothrow @nogc.
|
2014-07-26 12:50:58 +02:00 |
|
|
Ferdinand Majerech
|
e256d4c004
|
Removed the no longer used Appender from Scanner.
|
2014-07-26 04:24:30 +02:00 |
|
|
Ferdinand Majerech
|
f9ede1c409
|
scanAlphaNumeric and callers now work with slices.
|
2014-07-26 04:20:32 +02:00 |
|
|
Ferdinand Majerech
|
8b086caa40
|
Default scanToNextBreak now only skips, doesn't scan anything.
|
2014-07-26 03:16:27 +02:00 |
|
|
Ferdinand Majerech
|
ccdbc21e8f
|
Style
|
2014-07-26 03:16:01 +02:00 |
|
|
Ferdinand Majerech
|
08f8168889
|
SliceBuilder assert fixes.
|
2014-07-26 03:07:32 +02:00 |
|
|
Ferdinand Majerech
|
acc7617fab
|
Forgotten SliceBuilder methods that enable new Scanner code.
|
2014-07-26 03:06:51 +02:00 |
|
|
Ferdinand Majerech
|
09b11470ac
|
scanBlockScalar is now nothrow.
|
2014-07-26 02:53:05 +02:00 |
|
|
Ferdinand Majerech
|
6e2b9a7511
|
Code determining if a func scanned anything replaced by checking slice length.
|
2014-07-26 02:49:52 +02:00 |
|
|
Ferdinand Majerech
|
0ce9dc0b3a
|
lineBreak is a dchar instead of an array now.
|
2014-07-26 02:41:42 +02:00 |
|
|
Ferdinand Majerech
|
701b01dd20
|
Removed non-slice scanBlockScalarBreaks.
|
2014-07-26 02:34:28 +02:00 |
|
|
Ferdinand Majerech
|
f2cda9e799
|
Style.
|
2014-07-26 02:34:02 +02:00 |
|
|
Ferdinand Majerech
|
a19131417e
|
Updated alternate commented out code in scanBlockScalar
|
2014-07-26 02:33:49 +02:00 |
|
|
Ferdinand Majerech
|
fb93ad7cf1
|
scanBlockScalar now reads to a slice... and is a lot more complicated.
|
2014-07-26 02:33:16 +02:00 |
|
|
Ferdinand Majerech
|
7bbd5ab5b3
|
Style.
|
2014-07-26 02:30:05 +02:00 |
|