Sönke Ludwig
26907c7489
Fix set up of OVERLAPPED struct for files.
2018-03-11 20:31:44 +01:00
Sönke Ludwig
3090bc2c7c
Implement filterPending for ConsumableQueue.
2018-03-11 20:31:44 +01:00
Sönke Ludwig
f5f64ee476
Use a single thread pool for all threaded file driver threads.
...
This avoids multiplying the number of threads by 5 for each thread that performs file I/O.
2018-03-11 14:46:55 +01:00
Sönke Ludwig
df78af96bb
Use a custom nogc_assert in cleanup code.
...
Unfortunately the built-in assert GC allocates an exception, which means that if called directly or indirectly form a finalizer, the assertion will not become visible and instead an InvalidMemoryOperationError is thrown.
This implements a custom nogc_assert() function that directly prints the assertion message and uses abort() to end the process.
2018-03-11 13:56:10 +01:00
Sönke Ludwig
9dc8b796e5
Get rid of OVERLAPPED_FILE.
...
The hEvent member is currently unused for files. Using it for the file handle makes the OVERLAPPED_CORE struct sufficient.
2018-03-11 00:27:14 +01:00
Sönke Ludwig
0e1d74cc41
Call Windows IO callbacks outside of completion routines.
...
Calling WinSock functions from inside of a completion routine results in undefined behavior, because the completion routine may be triggered within another WinSock function that enters an alertable wait state. For this reason, none of the callbacks that are triggered by overlapped I/O may be invoked directly from a completion routine.
To solve this, a ConsumableQueue is filled with all completion events that occur and is processed after each MsgWaitForMultipleObjectsEx call.
2018-03-10 22:59:21 +01:00
Sönke Ludwig
0b02c84b2b
Set ConnectionState.connected when accepting a connection. Fixes #54 .
2018-03-07 11:00:03 +01:00
Sönke Ludwig
008163e913
Fix setTCPNoDelay/setKeepAlive and add assertions.
...
Assertions make sure that socket query functions are not called with an invalid handle (resulting in strange out-of-memory errors).
2018-03-07 10:52:01 +01:00
Sönke Ludwig
43ef41d4fa
Fix deprecation warning on DMD 2.079.0.
2018-03-06 20:09:03 +01:00
Sönke Ludwig
3d2a2656bb
Robustness fix for WinAPIEventDriverWatchers.
...
Under certain (rare) circumstances, the receive buffer contains data from a file instead of the expected FILE_NOTIFY_INFORMATION structure. No signs of handle or buffer reuse could be found, so the cause for this remains unclear. Until the cause can be narrowed down, this keeps the issue visible while avoiding to crash the application.
2018-03-03 20:04:51 +01:00
Sönke Ludwig
fbd6927377
Improve robustness of file I/O callbacks for the WinAPI driver.
...
Explicitly gets the read/write slot from the handle map from within the callback instead of dereferencing the pointer assigned when starting the operation. This makes sure that no dangling reference is accessed. Instead, if the slot got reused before the callback is invoked (which is a bug), an assertion will be triggered if the slot now has a different handle type.
2018-03-03 19:56:54 +01:00
Sönke Ludwig
3a52e0f362
Fix cast from HANDLE to descriptor in the WinAPI driver.
...
Avoids truncation to 32-bit for 64-bit builds. Also improves robustness of the directory watcher shutdown procedure.
2018-03-03 19:56:54 +01:00
Sönke Ludwig
e8e8f85271
Add DatagramSocket.broadcast property. Fixes #47 .
2018-02-22 02:08:09 +01:00
Sönke Ludwig
b2b072dd80
Reduce the number of ChoppedVector index operations.
2018-02-22 01:58:49 +01:00
Sönke Ludwig
30f614a7ff
Merge pull request #50 from vibe-d/fix_watcher_cancellation
...
Fix watcher cancellation
2018-02-22 01:56:13 +01:00
Sönke Ludwig
0e7091d085
Fix invalid watcher slot access in the win32 driver.
...
The underlying file handle and the associated slot could previously be destroyed before the I/O callback had been finally called. Now the callback itself is responsible to destroying the handle.
2018-02-22 01:14:31 +01:00
Sönke Ludwig
c8f95f324b
Enable canceling win32 file I/O.
...
The CancelIOEx call was disabled just due to historical reasons.
2018-02-22 01:12:13 +01:00
Diederik de Groot
41312a589e
Remove static compiler __VERSION check. "import core.sys.dragonflybsd.netinet.in_" will work, when compiler support is there.
...
[See](https://github.com/vibe-d/vibe.d/pull/2028#discussion_r161077152 )
2018-01-11 10:40:37 +01:00
Diederik de Groot
e062e44f1c
Fix compilation on DragonFlyBSD
2018-01-09 15:23:23 +01:00
Sönke Ludwig
6e2938297b
Set O_CLOEXEC on the remaining FDs that are created by eventcore.
2017-12-19 22:10:14 +01:00
Hiroki Noda
214382dcb5
Set EFD_CLOEXEC
...
Add missing one.
2017-12-19 13:38:47 +09:00
Sönke Ludwig
8528b4ec00
Fix accidental resetting of O_NONBLOCK and set O_CLOEXEC on outgoing sockets, too.
2017-12-18 14:07:38 +01:00
Hiroki Noda
1179163150
Add O_CLOEXEC for some posix platform
2017-12-18 09:44:08 +01:00
Hiroki Noda
b252c97012
Set close-on-exec flag to prevent fd leakage for command execution
2017-12-18 09:44:08 +01:00
Hiroki Noda
83317bb2bf
Call __res_init on linux when getaddrinfo failed, fix #40
2017-12-17 11:55:20 +09:00
Sönke Ludwig
c3fa500c3b
Merge pull request #39 from kubo39/epoll-cloexec
...
Set EPOLL_CLOEXEC to prevent fd leakage for command executation
2017-12-16 18:58:40 +01:00
Sönke Ludwig
c45f7dc35e
Properly increment the waiter count during async TCP connect.
2017-12-16 17:55:13 +01:00
Hiroki Noda
277743914b
Set EPOLL_CLOEXEC to prevent fd leakage for command executation
...
This is for the same reason #38
2017-12-16 10:16:43 +09:00
Sönke Ludwig
9ca1a4c3a6
Fix inotify based directory watcher for recursive directory adds.
...
Newly added folders were not scanned recursively, which would result in sub folders that already exist or are added concurrently to not be watched.
2017-12-02 02:54:13 +01:00
Sönke Ludwig
29aee9ee52
Defer driver dispose in main thread to shared static ~this.
...
Allows dependent code to still access the driver from within their shared static ~this. vibe-core notably falls into this category.
2017-11-25 16:59:53 +01:00
Sönke Ludwig
2d4ccf454d
Properly increment waiter count for WinAPI file I/O operations.
2017-11-25 16:47:29 +01:00
Sönke Ludwig
07d2bafcac
Fix threading issues in the generic Posix event implementation.
...
Uses socketpair non-Linux systems and two separate UDP sockets on Windows for the cross-thread communication.
2017-11-25 11:42:19 +01:00
Sönke Ludwig
a5d4cf875c
Add adoptDatagramSocketInternal.
2017-11-25 00:26:44 +01:00
Sönke Ludwig
c8eb30f6f0
Remove polling threads from map.
2017-11-25 00:26:20 +01:00
Sönke Ludwig
31286e4580
Ensure the socket handle passed to callbacks is always valid on Posix.
2017-11-23 23:12:35 +01:00
Sönke Ludwig
4d00376873
Ensure proper reference count for created Posix events.
2017-11-23 23:12:35 +01:00
Sönke Ludwig
19879712e6
Fix shutdown procedure and rename event order for the polling watcher.
...
Renames should always be reported as removed->added instead of added->removed.
2017-11-23 23:11:16 +01:00
Sönke Ludwig
1d4fbc4fa2
Fixup poll driver.
2017-11-23 23:11:16 +01:00
Sönke Ludwig
c8fd340240
Fix destruction of PosixEventDriverEvents event.
...
The reference count was one too high and the waiter count was not properly decremented when an event got destroyed.
2017-11-23 23:11:16 +01:00
Sönke Ludwig
aa9a08f571
Explicitly dispose the event driver on thread shutdown.
...
Handle multiple calls to dispose() gracefully, because external code may already make an explicit call to dispose().
2017-11-23 23:11:16 +01:00
Sönke Ludwig
16e95b03e8
Fix WinAPI watcher to be consistent.
2017-11-22 17:14:31 +01:00
Sönke Ludwig
a9ae496fb4
Avoid "." path in InotifyEventDriverWatchers.
...
The vibe-core tests broke because a "/./" path segment slipped into the resulting paths.
2017-11-22 17:07:49 +01:00
Sönke Ludwig
5246593432
Fix handling recursive inotify based directory watchers.
2017-11-21 10:42:21 +01:00
Sönke Ludwig
0ec498207d
Gag directory modified events in win32.
2017-11-21 10:42:21 +01:00
Sönke Ludwig
99088e1202
Implement a generic polling based directory watcher.
...
This is used on platforms that don't have a specialized watcher implementation.
2017-11-21 10:42:21 +01:00
Sönke Ludwig
815db0727c
Change all invalid handle values to ~0 and improve FileChange.
...
FileChange now has the full path of a file split into the base path (as specified when creating the watcher), the sub directory, and the file name. This allows to work with less dynamic memory allocations internally.
2017-11-21 10:42:14 +01:00
Sönke Ludwig
3352423414
Fix decrementing the waiter count when destroying a WinAPI event with active waiters.
2017-11-21 00:09:41 +01:00
Sönke Ludwig
fdeef38ef4
Fix waiter count tracking for WinAPI directory watchers and avoid empty callbacks.
2017-11-20 15:59:35 +01:00
Sönke Ludwig
314bd2bb48
Fix WinAPI condition for outOfWaiters event loop exit reason.
...
Calling processEvents could previously block indefinitely even if there were no waiters left.
2017-11-20 15:59:35 +01:00
Sönke Ludwig
7cc6bec14a
Fix a possible range error when a win32 file watcher gets destroyed while waiting.
...
This is not a final solution, but avoids the fatal error and replaces it with, at worst, bogus change events being reported.
2017-11-17 18:35:48 +01:00
Sönke Ludwig
0897b1bc9e
Implement WinAPIEventDriverSockets.cancelConnectStream.
2017-11-12 14:41:08 +01:00
Sönke Ludwig
569b75e050
More detailed documentation for cancelConnectStream().
2017-11-12 14:34:58 +01:00
Boris-Barboris
36b0413d32
remove cabblack invocation
2017-11-11 15:44:13 +00:00
Boris-Barboris
0cac9d56e0
cancelConnectStream for Posix
2017-11-11 01:14:54 +00:00
Sönke Ludwig
c4550f0e59
Fix ThreadedFileEventDriver read/write issues.
...
I/O errors were being reported as IOStatus.ok instead of IOStatus.error, and the I/O operation finalization protocol had a potential race-condition when storing the number of bytes processed.
2017-10-30 22:54:14 +01:00
Sönke Ludwig
8799b7b01e
Add assertion.
2017-09-26 15:49:13 +02:00
Sönke Ludwig
60407b783b
Fix re-enqueuing of periodic timers. Fixes #25 .
...
Periodic timers were first re-enqueued and then removed, effectively causing them to stay at their old position, cutting off the tail of the timer queue.
2017-09-26 15:49:13 +02:00
Sönke Ludwig
a52d064c9e
Add multicast constant definitions for Solaris.
2017-09-26 15:45:51 +02:00
Sönke Ludwig
fc6c18faad
Add missing default parameter.
2017-09-23 15:00:46 +02:00
Sönke Ludwig
28e1a83057
Add an interface_index argument to joinMulticastGroup.
2017-09-11 13:35:34 +02:00
Sönke Ludwig
06c6e0a4ca
Add basic UDP multicast support.
...
This also adds a new setOption method to handle boolean socket options in a generic way.
2017-09-03 18:14:57 +02:00
Sönke Ludwig
07baa0f612
Improve performance of accepting incoming connections.
...
- Removes the accept() loop, as that doesn't measurably improve performance in practice. This also gives each connection the possibility to perform initial I/O before more concurrency is generated by accepting the next connection.
- Uses SOCK_NONBLOCK in conjunction with socket() and accept4() to save one additional syscall per connection.
2017-09-02 15:40:07 +02:00
Sönke Ludwig
fc5df2f949
Use level-triggered events for listening stream sockets.
...
The limit of 20 accepted connections per event invocation can otherwise lead to no more connections being accepted when more that 20 connections are available at a time. This is an adaptation of @Boris-Barboris pull request #21 to restrict the level triggered behavior to listening sockets. See also #20 .
2017-09-02 00:12:58 +02:00
Sönke Ludwig
eb595ef858
Fix always calling GC.addRange in ChoppedVector if necessary.
2017-08-26 22:33:00 +02:00
Sönke Ludwig
74352a9ac5
Avoid dangling socket slot access in the WinAPI driver.
...
When the last reference got released while a blocking socket operation was still in progress, the old slot was still accessed from the completion callback, leading to null pointer accesses or other issues.
2017-08-21 21:02:13 +02:00
Sönke Ludwig
44b43e8415
Fix error message.
2017-08-14 15:14:05 +02:00
Sönke Ludwig
a63907b9f7
Fix multiple bugs in ThreadedFileEventDriver.
...
- Errors were reported as "ok"
- The cancel state logic was flawed and could lose cancel requests
- Operations could be removed from the active sets before they actually finished, causing the callback to never get called
2017-08-14 01:58:42 +02:00
Sönke Ludwig
dd873ec6cf
Add example to get(Local/Remove)Address and fix some ddoc syntax errors.
2017-08-12 21:25:27 +02:00
Sönke Ludwig
09a67149bc
Use a linked list for the timer queue.
...
Improves insertion and deletion times for many pending timers considerably.
2017-07-21 21:35:10 +02:00
Sönke Ludwig
beef9c2567
Add a doubly linked list implementation.
2017-07-21 21:35:10 +02:00
Sönke Ludwig
1c666a0191
Fix send() return value handling.
...
A value of 0 doesn't indicate a closed connection as for recv().
2017-07-19 10:42:33 +02:00
Sönke Ludwig
9518ec4dce
Remove log noise for listening TCP sockets.
2017-07-14 12:35:17 +02:00
Sönke Ludwig
077c643e08
Fix 64-bit compile error.
2017-06-27 00:54:32 +02:00
Sönke Ludwig
a7e5b49943
Implement basic UDP support for the WinAPI driver.
...
Note that the IOMode.immediate semantics are not compatible with the current 0-udp.d test and will instead call the callback asynchronously. It appears that non-blocking semantics are generally not possible with overlapped sockets.
2017-06-26 23:37:33 +02:00
Sönke Ludwig
a263637bd3
Fix WSASend/WSARecv usage w.r.t. WSABUF parameter.
...
The documentation states that the buffer must be kept alive during the whole operation, so using a stack allocated buffer is illegal.
2017-06-26 23:31:22 +02:00
Sönke Ludwig
ef065762b3
Fix WinAPIEventDriverCore.waiterCount to include pending timers.
2017-06-26 23:28:15 +02:00
Sönke Ludwig
ca11fdec82
Implement WinAPI based TCP socket support.
2017-06-24 22:31:16 +02:00
Sönke Ludwig
ab796477e2
Move .userData to the socket driver.
...
Generally each FD type should have its own .userData property in the respective driver. This is important for drivers that don't have a unified file descriptor space and need to store user data in a type specific way.
2017-06-24 22:01:32 +02:00
Sönke Ludwig
d99eb1be34
Fix waiter count tracking in the Posix driver. Fixes #8 .
2017-06-10 10:27:55 +02:00
Sönke Ludwig
abf8587078
Add SmallIntegerSet.empty.
2017-06-10 10:27:20 +02:00
Sönke Ludwig
8e385d8b1d
Fix epoll status event masks. Fixes #10 .
2017-06-10 00:06:45 +02:00
Sönke Ludwig
1ff3d00020
Check return value of eventfd for errors.
2017-06-10 00:06:45 +02:00
Sönke Ludwig
f4ca542b92
Add assertions in ChunkedVector to detect failed memory allocations.
2017-06-10 00:06:45 +02:00
pinver
435e365c3a
idem, avoid to pollute the console as default
2017-04-25 16:32:01 +02:00
pinver
1be26214e6
avoid to pollute the console by default
2017-04-25 16:28:31 +02:00
Sönke Ludwig
872f1b12b9
For direction of getLocalAddress and getRemoteAddress.
2017-03-24 09:04:32 +01:00
Sönke Ludwig
420c361b5f
Fix WinAPI sockets stub.
2017-03-11 09:17:38 +01:00
Sönke Ludwig
758256c210
Fix compilation of the libasync driver stub.
2017-03-10 22:56:07 +01:00
Sönke Ludwig
1d330d6330
Extend datagram socket API.
...
Adds .setTargetAddress() and makes .getXAddress() work for datagram sockets, too.
2017-03-10 22:46:43 +01:00
Sönke Ludwig
2e5b13ee98
Add EventDriverSockets.getRemoteAddress.
2017-03-10 20:25:28 +01:00
Sönke Ludwig
a25b49228f
Properly count IO completion as an event in WinAPIEventDriverCore.processEvents.
2017-03-09 16:02:42 +01:00
Sönke Ludwig
bcc059e6d7
Fix bogus outOfWaiters event loop exit reason for active event waits.
2017-02-22 17:35:26 +01:00
Sönke Ludwig
578065f70a
Fix exit conditions in the WinAPI event loop.
2017-02-22 17:34:44 +01:00
Sönke Ludwig
f84139ba63
Fix infinite look when stopping timers with multiple others pending.
2017-02-22 17:33:03 +01:00
Sönke Ludwig
49521f2586
Remove debug output.
2017-01-31 10:06:51 +01:00
Sönke Ludwig
4b357c3326
Make sure the socket ref count can reach zero in user code.
2017-01-30 23:11:09 +01:00
Sönke Ludwig
490dc15128
Properly handle the case where a TCP connection gets immediately disconnected.
...
This can result in both, the write-ready and the disconnect events, to be triggered during the same event loop iteration.
2017-01-30 22:52:13 +01:00
Sönke Ludwig
773e09cd3d
Fix (immediate) detection of remove connection close for EPOLL.
2017-01-30 21:01:31 +01:00
Sönke Ludwig
5a5dcd6376
Remove debug output.
2017-01-30 20:11:40 +01:00
Sönke Ludwig
6851776358
Add EventDriverTimers.isUnique.
2017-01-30 19:54:38 +01:00