Ferdinand Majerech
|
92396b4cae
|
An optimized version of forward() with length == 1.
|
2014-08-05 20:52:05 +02:00 |
|
Ferdinand Majerech
|
34e6f55bd9
|
forward() now uses upcomingASCII_
|
2014-08-05 20:46:00 +02:00 |
|
Ferdinand Majerech
|
c828c6b132
|
peek()/slice() now use upcomingASCII()
|
2014-08-05 20:44:15 +02:00 |
|
Ferdinand Majerech
|
d9079de427
|
get() now calls slice() directly instead of through prefix().
|
2014-08-05 20:42:51 +02:00 |
|
Ferdinand Majerech
|
bfa2f1bd5c
|
Using checkASCII in Reader.
|
2014-08-05 20:42:22 +02:00 |
|
Ferdinand Majerech
|
e01c40ede5
|
Func to count consecutive ASCII chars starting at current Reader position.
|
2014-08-05 20:36:33 +02:00 |
|
Ferdinand Majerech
|
7409f3bbd9
|
ASCII optimizations for isPrintableValidUTF8.
|
2014-08-05 19:34:28 +02:00 |
|
Ferdinand Majerech
|
1c0702f3cd
|
Func to count the num of ASCII chars in string before the first UTF-8 sequence
|
2014-08-05 19:12:54 +02:00 |
|
Ferdinand Majerech
|
9ea269de87
|
Removed obsolete 'final' from Reader methods.
|
2014-08-05 13:14:42 +02:00 |
|
Ferdinand Majerech
|
57afd47bb5
|
Doc fixes.
|
2014-08-05 01:53:17 +02:00 |
|
Ferdinand Majerech
|
fb9525bb00
|
Obsoleting decodeCount_.
|
2014-08-05 01:52:21 +02:00 |
|
Ferdinand Majerech
|
8e63f62d7e
|
An optimized version of peek() that reads a byte, without decoding.
|
2014-08-04 02:20:13 +02:00 |
|
Ferdinand Majerech
|
a4befdd866
|
An optimized version of Reader.peek() with index == 0.
|
2014-08-04 02:19:34 +02:00 |
|
Ferdinand Majerech
|
c160156346
|
Fixed the string->char[] Token value move.
|
2014-08-02 23:25:56 +02:00 |
|
Ferdinand Majerech
|
7b699c5903
|
UTF-8 validation now uses UTF-8 decoding code.
|
2014-08-02 01:37:16 +02:00 |
|
Ferdinand Majerech
|
68d9124b17
|
Removed Reader ctor from Stream.
|
2014-07-31 02:33:24 +02:00 |
|
Ferdinand Majerech
|
a74bc8cf3b
|
Reader unittests now construct Reader from a buffer.
|
2014-07-31 02:28:42 +02:00 |
|
Ferdinand Majerech
|
03d1183550
|
Added a Reader ctor from buffer and deprecated the ctor from Stream.
|
2014-07-31 01:56:06 +02:00 |
|
Ferdinand Majerech
|
4d6634f49b
|
Doc fixes.
|
2014-07-30 23:30:37 +02:00 |
|
Ferdinand Majerech
|
5da8561df4
|
Renamed buffer8_ to buffer_, bufferOffset8_ to bufferOffset_.
|
2014-07-30 23:26:44 +02:00 |
|
Ferdinand Majerech
|
4e2c3e6093
|
Only validate UTF-8 if we get UTF-8 input (UTF-16/32 validated at conversion)
|
2014-07-30 22:32:58 +02:00 |
|
Ferdinand Majerech
|
6c15bd95cc
|
Moved unused, but potentially useful Reader code to dyaml.unused.
|
2014-07-30 18:38:27 +02:00 |
|
Ferdinand Majerech
|
e58b092fe1
|
Removed an unsafe cast.
|
2014-07-30 18:23:40 +02:00 |
|
Ferdinand Majerech
|
492e36d28a
|
In-place UTF32->UTF-8 conversion in Reader.
|
2014-07-30 18:21:09 +02:00 |
|
Ferdinand Majerech
|
f4c57b368b
|
Style/spaces.
|
2014-07-30 04:46:53 +02:00 |
|
Ferdinand Majerech
|
cf3bff517c
|
UTF-8 is now the default input encoding. UTF-16/32 is encoded into UTF-8.
|
2014-07-30 04:46:28 +02:00 |
|
Ferdinand Majerech
|
c1ffa05735
|
Removed redundant spaces.
|
2014-07-30 00:37:15 +02:00 |
|
Ferdinand Majerech
|
c473ef7dee
|
Removed -8 suffixes from Reader methods.
|
2014-07-30 00:13:48 +02:00 |
|
Ferdinand Majerech
|
e5561285c3
|
Removed UTF-32 buffer offset.
|
2014-07-29 23:25:22 +02:00 |
|
Ferdinand Majerech
|
33b2a7ef68
|
Removed the UTF-32 buffer from Reader.
|
2014-07-29 23:23:45 +02:00 |
|
Ferdinand Majerech
|
736de8beb9
|
Reader now uses validation to get the number of characters in the UTF8 buffer.
|
2014-07-29 23:22:16 +02:00 |
|
Ferdinand Majerech
|
ffef7bf6fc
|
Removed UTF-32 parts of Reader API.
|
2014-07-29 23:15:08 +02:00 |
|
Ferdinand Majerech
|
d1aaec6a60
|
Removed the UTF-32 SliceBuilder.
|
2014-07-29 23:10:46 +02:00 |
|
Ferdinand Majerech
|
ecc168dc75
|
insert() for SliceBuilder8.
|
2014-07-29 20:52:39 +02:00 |
|
Ferdinand Majerech
|
58e19d75ad
|
Assert message fix.
|
2014-07-29 20:52:24 +02:00 |
|
Ferdinand Majerech
|
302995354c
|
Fixed a SliceBuilder8.Transaction compilation bug.
|
2014-07-29 14:43:53 +02:00 |
|
Ferdinand Majerech
|
510357f4c7
|
insert() instead of insertBack() for SliceBuilder.
|
2014-07-29 14:41:46 +02:00 |
|
Ferdinand Majerech
|
4307ccbe82
|
Fixed a Reader compilation bug.
|
2014-07-29 03:18:54 +02:00 |
|
Ferdinand Majerech
|
a9def88eed
|
Docfix.
|
2014-07-29 03:06:51 +02:00 |
|
Ferdinand Majerech
|
3880adf81d
|
UTF-8 SliceBuilder.
|
2014-07-29 03:01:16 +02:00 |
|
Ferdinand Majerech
|
cb64197bb1
|
nogcutil import.
|
2014-07-29 02:59:58 +02:00 |
|
Ferdinand Majerech
|
76cfd7704d
|
forward() invalidates last decoded offsets.
|
2014-07-29 02:59:33 +02:00 |
|
Ferdinand Majerech
|
2e156a8ece
|
UTF-8 prefix()/get()
|
2014-07-29 02:59:16 +02:00 |
|
Ferdinand Majerech
|
709ab00e44
|
A UTF-8 slice().
|
2014-07-29 02:58:04 +02:00 |
|
Ferdinand Majerech
|
56057b43ec
|
peek() now uses the UTF-8 buffer.
|
2014-07-29 02:57:19 +02:00 |
|
Ferdinand Majerech
|
ef9053d7f3
|
Keeping buffer8_ and buffer_ positions in sync.
|
2014-07-29 02:54:39 +02:00 |
|
Ferdinand Majerech
|
6addaa4cbe
|
Better comment.
|
2014-07-29 02:52:01 +02:00 |
|
Ferdinand Majerech
|
634418b599
|
Added UTF-8 version of the Reader buffer (for now, side by side with UTF-32)
|
2014-07-29 02:51:46 +02:00 |
|
Ferdinand Majerech
|
4a4e83112c
|
utf8Stride is now globally visible in reader.d
|
2014-07-28 23:21:43 +02:00 |
|
Ferdinand Majerech
|
645b191948
|
Removed todo garbage.
|
2014-07-26 23:38:59 +02:00 |
|