Ferdinand Majerech
|
1916b1953a
|
Loader doc fix.
|
2014-08-05 22:07:35 +02:00 |
|
Ferdinand Majerech
|
893b43edee
|
Style.
|
2014-08-05 21:31:42 +02:00 |
|
Ferdinand Majerech
|
fd93830243
|
Using the Scanner FastCharSearches wherever they apply.
|
2014-08-05 21:31:36 +02:00 |
|
Ferdinand Majerech
|
755eb4e468
|
Moved common FastCharSearch instantiations to Scanner body to minimize bloat.
|
2014-08-05 21:30:59 +02:00 |
|
Ferdinand Majerech
|
d505728824
|
Moved a branch outside of aloop in scanPlain() to improve performance.
|
2014-08-05 20:58:05 +02:00 |
|
Ferdinand Majerech
|
57d936ed0f
|
Scanner using prefixBytes() for optimization.
|
2014-08-05 20:57:30 +02:00 |
|
Ferdinand Majerech
|
3b303f6e82
|
An ASCII (bytes) version of prefix().
|
2014-08-05 20:56:59 +02:00 |
|
Ferdinand Majerech
|
8f94a40730
|
Doc fixes.
|
2014-08-05 20:56:30 +02:00 |
|
Ferdinand Majerech
|
568e75d3de
|
Removed decodeCount_, as it's no longer used.
|
2014-08-05 20:53:04 +02:00 |
|
Ferdinand Majerech
|
2b7ea42199
|
Removed the old (obsolete) Reader decoding method.
|
2014-08-05 20:52:43 +02:00 |
|
Ferdinand Majerech
|
92396b4cae
|
An optimized version of forward() with length == 1.
|
2014-08-05 20:52:05 +02:00 |
|
Ferdinand Majerech
|
34e6f55bd9
|
forward() now uses upcomingASCII_
|
2014-08-05 20:46:00 +02:00 |
|
Ferdinand Majerech
|
c828c6b132
|
peek()/slice() now use upcomingASCII()
|
2014-08-05 20:44:15 +02:00 |
|
Ferdinand Majerech
|
d9079de427
|
get() now calls slice() directly instead of through prefix().
|
2014-08-05 20:42:51 +02:00 |
|
Ferdinand Majerech
|
bfa2f1bd5c
|
Using checkASCII in Reader.
|
2014-08-05 20:42:22 +02:00 |
|
Ferdinand Majerech
|
e01c40ede5
|
Func to count consecutive ASCII chars starting at current Reader position.
|
2014-08-05 20:36:33 +02:00 |
|
Ferdinand Majerech
|
7409f3bbd9
|
ASCII optimizations for isPrintableValidUTF8.
|
2014-08-05 19:34:28 +02:00 |
|
Ferdinand Majerech
|
1c0702f3cd
|
Func to count the num of ASCII chars in string before the first UTF-8 sequence
|
2014-08-05 19:12:54 +02:00 |
|
Ferdinand Majerech
|
8902ea8806
|
Minor optimization.
|
2014-08-05 18:21:42 +02:00 |
|
Ferdinand Majerech
|
b2d0c74e56
|
Minor style fix.
|
2014-08-05 18:21:29 +02:00 |
|
Ferdinand Majerech
|
a89f9e93f7
|
Removed unnecessary memory allocations in Queue.
|
2014-08-05 18:20:57 +02:00 |
|
Ferdinand Majerech
|
a9333e3dd3
|
Fixed another 'in' parameter.
|
2014-08-05 18:15:07 +02:00 |
|
Ferdinand Majerech
|
9ea269de87
|
Removed obsolete 'final' from Reader methods.
|
2014-08-05 13:14:42 +02:00 |
|
Ferdinand Majerech
|
3d8de67771
|
Using peekByte() where possible in Scanner.
|
2014-08-05 13:14:15 +02:00 |
|
Ferdinand Majerech
|
078269be36
|
Queue no longer supports types with destructors.
|
2014-08-05 13:12:07 +02:00 |
|
Ferdinand Majerech
|
7539b40d3d
|
(optimization) Mark ctor now doesn't check file column for overflow.
|
2014-08-05 13:10:52 +02:00 |
|
Ferdinand Majerech
|
57afd47bb5
|
Doc fixes.
|
2014-08-05 01:53:17 +02:00 |
|
Ferdinand Majerech
|
fb9525bb00
|
Obsoleting decodeCount_.
|
2014-08-05 01:52:21 +02:00 |
|
Ferdinand Majerech
|
75ed314dd6
|
More FastCharSearch.
|
2014-08-05 01:51:32 +02:00 |
|
Ferdinand Majerech
|
0424ff5e77
|
Style.
|
2014-08-05 01:51:20 +02:00 |
|
Ferdinand Majerech
|
44885cde4e
|
Optimized fetchToken()
|
2014-08-04 02:26:14 +02:00 |
|
Ferdinand Majerech
|
7360e85a3a
|
More FastCharSearch based on profiling results.
|
2014-08-04 02:24:26 +02:00 |
|
Ferdinand Majerech
|
5a1e6e994d
|
Fixed a nasty rare bug caused by an assumption that 32 chars take 32 bytes.
|
2014-08-04 02:23:08 +02:00 |
|
Ferdinand Majerech
|
20048ea995
|
Using peekByte() in heavily used Scanner methods.
|
2014-08-04 02:22:09 +02:00 |
|
Ferdinand Majerech
|
8e63f62d7e
|
An optimized version of peek() that reads a byte, without decoding.
|
2014-08-04 02:20:13 +02:00 |
|
Ferdinand Majerech
|
a4befdd866
|
An optimized version of Reader.peek() with index == 0.
|
2014-08-04 02:19:34 +02:00 |
|
Ferdinand Majerech
|
063d9754d7
|
Queue now uses a freelist to minimize allocations.
|
2014-08-04 02:16:34 +02:00 |
|
Ferdinand Majerech
|
97e717df1b
|
Loader creates Constructor/Resolver lazily to avoid garbage when user-provided
|
2014-08-04 02:14:01 +02:00 |
|
Ferdinand Majerech
|
6aa50b8898
|
A benchmark Loader method that scans a file but throws away the tokens.
|
2014-08-02 23:26:46 +02:00 |
|
Ferdinand Majerech
|
c160156346
|
Fixed the string->char[] Token value move.
|
2014-08-02 23:25:56 +02:00 |
|
Ferdinand Majerech
|
aeee0758a7
|
Refactored FastCharSearch with more modern string mixin code.
|
2014-08-02 02:35:03 +02:00 |
|
Ferdinand Majerech
|
d32addacda
|
Slices now nonconst in all layers up to Parser, where they get cast to string.
|
2014-08-02 01:58:20 +02:00 |
|
Ferdinand Majerech
|
7b699c5903
|
UTF-8 validation now uses UTF-8 decoding code.
|
2014-08-02 01:37:16 +02:00 |
|
Ferdinand Majerech
|
b5da695d6b
|
More @nogc in Scanner.
|
2014-08-02 01:19:29 +02:00 |
|
Ferdinand Majerech
|
e6fdade4a6
|
Scanner now uses @nogc UTF decoding.
|
2014-08-02 01:16:29 +02:00 |
|
Ferdinand Majerech
|
e1209711af
|
UTF-8 decoding now has versions for validated and unvalidated strings.
|
2014-08-02 01:15:57 +02:00 |
|
Ferdinand Majerech
|
5932155435
|
Style.
|
2014-08-02 01:15:22 +02:00 |
|
Ferdinand Majerech
|
fad280060e
|
Better Constructor docs.
|
2014-08-01 23:01:34 +02:00 |
|
Ferdinand Majerech
|
f137db438e
|
Better Constructor funct attribs.
|
2014-08-01 23:01:24 +02:00 |
|
Ferdinand Majerech
|
66679a601c
|
Moved tinyendian.d out of the dyaml directory.
|
2014-08-01 02:56:37 +02:00 |
|
Ferdinand Majerech
|
a9fb68f340
|
Removed internals from DDoc.
|
2014-08-01 02:52:14 +02:00 |
|
Ferdinand Majerech
|
0f017646fc
|
Reverted doc style due to DDoc issues.
|
2014-08-01 02:51:35 +02:00 |
|
Ferdinand Majerech
|
fdf4cecddb
|
Backported a recent std.utf script.
|
2014-08-01 02:47:52 +02:00 |
|
Ferdinand Majerech
|
830aef8df5
|
Simpler grepping for 'std.stream'
|
2014-07-31 14:53:14 +02:00 |
|
Ferdinand Majerech
|
151871e1b3
|
Better Loader docs.
|
2014-07-31 14:52:40 +02:00 |
|
Ferdinand Majerech
|
276bed7fb6
|
Constructor unittests now use the new Loader ctor.
|
2014-07-31 02:55:38 +02:00 |
|
Ferdinand Majerech
|
68d9124b17
|
Removed Reader ctor from Stream.
|
2014-07-31 02:33:24 +02:00 |
|
Ferdinand Majerech
|
a74bc8cf3b
|
Reader unittests now construct Reader from a buffer.
|
2014-07-31 02:28:42 +02:00 |
|
Ferdinand Majerech
|
e100047572
|
Updated Loader examples.
|
2014-07-31 02:22:42 +02:00 |
|
Ferdinand Majerech
|
626337f6ed
|
More readable error throws in Loader.
|
2014-07-31 02:16:53 +02:00 |
|
Ferdinand Majerech
|
ddd89c22d5
|
Updated Loader unittest.
|
2014-07-31 02:09:44 +02:00 |
|
Ferdinand Majerech
|
e919f4be51
|
Added a char[] fromString.
|
2014-07-31 02:08:08 +02:00 |
|
Ferdinand Majerech
|
24a8e945bd
|
Removed docs of deprecated API.
|
2014-07-31 02:07:32 +02:00 |
|
Ferdinand Majerech
|
d18a41999e
|
Loader ctor from buffer, deprecated old API, constructing Reader from buffer.
|
2014-07-31 02:01:08 +02:00 |
|
Ferdinand Majerech
|
a23c41385a
|
Very minor Parser/Event @nogc/style.
|
2014-07-31 01:56:36 +02:00 |
|
Ferdinand Majerech
|
03d1183550
|
Added a Reader ctor from buffer and deprecated the ctor from Stream.
|
2014-07-31 01:56:06 +02:00 |
|
Ferdinand Majerech
|
4d6634f49b
|
Doc fixes.
|
2014-07-30 23:30:37 +02:00 |
|
Ferdinand Majerech
|
5da8561df4
|
Renamed buffer8_ to buffer_, bufferOffset8_ to bufferOffset_.
|
2014-07-30 23:26:44 +02:00 |
|
Ferdinand Majerech
|
4e2c3e6093
|
Only validate UTF-8 if we get UTF-8 input (UTF-16/32 validated at conversion)
|
2014-07-30 22:32:58 +02:00 |
|
Ferdinand Majerech
|
6c15bd95cc
|
Moved unused, but potentially useful Reader code to dyaml.unused.
|
2014-07-30 18:38:27 +02:00 |
|
Ferdinand Majerech
|
e58b092fe1
|
Removed an unsafe cast.
|
2014-07-30 18:23:40 +02:00 |
|
Ferdinand Majerech
|
492e36d28a
|
In-place UTF32->UTF-8 conversion in Reader.
|
2014-07-30 18:21:09 +02:00 |
|
Ferdinand Majerech
|
cc1aaf4ac8
|
dchar->char encoding now also has a version for non-validated dchars.
|
2014-07-30 18:20:22 +02:00 |
|
Ferdinand Majerech
|
f4c57b368b
|
Style/spaces.
|
2014-07-30 04:46:53 +02:00 |
|
Ferdinand Majerech
|
cf3bff517c
|
UTF-8 is now the default input encoding. UTF-16/32 is encoded into UTF-8.
|
2014-07-30 04:46:28 +02:00 |
|
Ferdinand Majerech
|
c1ffa05735
|
Removed redundant spaces.
|
2014-07-30 00:37:15 +02:00 |
|
Ferdinand Majerech
|
c473ef7dee
|
Removed -8 suffixes from Reader methods.
|
2014-07-30 00:13:48 +02:00 |
|
Ferdinand Majerech
|
eb266b4e27
|
Removed the -8 suffixes from Scanner methods.
|
2014-07-29 23:42:50 +02:00 |
|
Ferdinand Majerech
|
e5561285c3
|
Removed UTF-32 buffer offset.
|
2014-07-29 23:25:22 +02:00 |
|
Ferdinand Majerech
|
33b2a7ef68
|
Removed the UTF-32 buffer from Reader.
|
2014-07-29 23:23:45 +02:00 |
|
Ferdinand Majerech
|
736de8beb9
|
Reader now uses validation to get the number of characters in the UTF8 buffer.
|
2014-07-29 23:22:16 +02:00 |
|
Ferdinand Majerech
|
74c161c576
|
validateUTF8NoGC now calculates the number of characters in passed string.
|
2014-07-29 23:21:07 +02:00 |
|
Ferdinand Majerech
|
ffef7bf6fc
|
Removed UTF-32 parts of Reader API.
|
2014-07-29 23:15:08 +02:00 |
|
Ferdinand Majerech
|
d1aaec6a60
|
Removed the UTF-32 SliceBuilder.
|
2014-07-29 23:10:46 +02:00 |
|
Ferdinand Majerech
|
207cb249e0
|
Scanner style.
|
2014-07-29 23:08:37 +02:00 |
|
Ferdinand Majerech
|
8806cfc1b4
|
More @nogc in Scanner.
|
2014-07-29 23:08:03 +02:00 |
|
Ferdinand Majerech
|
18be6b2e5b
|
Removed UTF-32 scanLineBreak.
|
2014-07-29 23:01:05 +02:00 |
|
Ferdinand Majerech
|
6837156258
|
Block scalar scanning now works with UTF-8.
|
2014-07-29 20:58:00 +02:00 |
|
Ferdinand Majerech
|
19ed03cb3e
|
Low hanging fruit for using UTF-8 reader methods
|
2014-07-29 20:55:24 +02:00 |
|
Ferdinand Majerech
|
ecc168dc75
|
insert() for SliceBuilder8.
|
2014-07-29 20:52:39 +02:00 |
|
Ferdinand Majerech
|
58e19d75ad
|
Assert message fix.
|
2014-07-29 20:52:24 +02:00 |
|
Ferdinand Majerech
|
302995354c
|
Fixed a SliceBuilder8.Transaction compilation bug.
|
2014-07-29 14:43:53 +02:00 |
|
Ferdinand Majerech
|
510357f4c7
|
insert() instead of insertBack() for SliceBuilder.
|
2014-07-29 14:41:46 +02:00 |
|
Ferdinand Majerech
|
239152f793
|
UTF-8 scanPlain and callees.
|
2014-07-29 04:28:07 +02:00 |
|
Ferdinand Majerech
|
d80917419f
|
Removed obsolete UTF-32 methods.
|
2014-07-29 04:20:14 +02:00 |
|
Ferdinand Majerech
|
4a09338a7a
|
Directive scanning is now fully UTF-8.
|
2014-07-29 04:19:44 +02:00 |
|
Ferdinand Majerech
|
38143a2c64
|
Fixed NoGC appender unittest.
|
2014-07-29 04:18:34 +02:00 |
|
Ferdinand Majerech
|
31acd6aead
|
Removed obsolete comment.
|
2014-07-29 04:10:42 +02:00 |
|
Ferdinand Majerech
|
e565543080
|
Removed UTF-32 scanAlphaNumeric.
|
2014-07-29 04:10:30 +02:00 |
|
Ferdinand Majerech
|
ef735e280f
|
UTF-8 directive name scanning.
|
2014-07-29 04:10:16 +02:00 |
|