Commit graph

365 commits

Author SHA1 Message Date
Sönke Ludwig 194667a99f Fix reported status for disconnected message based Unix sockets.
Was reporting IOStatus.ok for a connection that was disconnected, possibly resulting in an endless loop (or recursion) of trying to read another (apparently zero sized) packet.
2020-05-25 14:37:55 +02:00
Sönke Ludwig 167745efb0 Fix CFRunLoop selection in multi-threaded scenarios.
CFRunLoopGetMain returns the main thread's run loop, as opposed to the one belonging to the calling thread.
2020-05-25 14:36:29 +02:00
Sönke Ludwig decbe7f6bd Work around possible hang of CFRunLoop with pending kqueue events. 2020-05-25 10:31:43 +02:00
Sönke Ludwig 49b2aff0c2 Move loop modules back to the posix package to work around compiler errors.
Older DMD frontend versions don't handle "package" protection within derived classes correctly.
2020-05-23 17:41:02 +02:00
Sönke Ludwig 0cdfe793af Implement an FSEvents based watcher for macOS.
Provides efficient and low latency directory watching on macOS when using the CFRunLoop based event loop.
2020-05-23 17:41:02 +02:00
Sönke Ludwig e28450f9f5 Implement a CFRunLoop based event loop.
This enables efficient integration of the kqueue based I/O processing with Apple OS based UI apps.

On top of that, an FSEvent based directory watcher can now be implemented to replace the inefficient generic watcher that is used on macOS right now.
2020-05-22 16:02:45 +02:00
Sönke Ludwig 4b1afa8d6c Allow to inherit from the kqueue loop implementation. 2020-05-22 09:59:25 +02:00
Sönke Ludwig aa3659fca6 Handle redundant cancelReceive calls gracefully and clean up the callback. 2020-05-22 09:59:25 +02:00
Sönke Ludwig 1f9a99a805 Fix potential access of an invalid waiter queue. 2020-05-22 09:59:25 +02:00
Sönke Ludwig 2f03f8dd42 Move Posix event loop implementations to their own package. 2020-05-19 10:10:15 +02:00
Sönke Ludwig b0ed2389fa Remove invalid assertion.
Since file descriptors are now identified using their validation counter, it is a valid operation to invalidate a slot that is still referenced.

This fixes a related test failure in vibe-core.
2020-05-18 15:09:34 +02:00
Sönke Ludwig 85dc8d54e6 Make file and pipe closing asynchronous.
CloseHandle can block for extended periods of time in certain cases, causing the whole thread to be blocked otherwise.
2020-05-12 09:47:06 +02:00
Sönke Ludwig 86ee5c9477 Remove FileChange.isDirectory.
isDir can be a huge performance issue when watching a network based directory and can effectively block the thread almost completely in case of frequent file changes. This does mean than high-level code now needs to perform the check manually, if required, and the free information provided by inotify goes unused.
2020-05-11 19:30:40 +02:00
Sönke Ludwig d7657b54e8 Move shared thread pool functionality to a separate module. 2020-05-11 17:09:14 +02:00
Sönke Ludwig a27abdb956 Fixup. 2020-05-11 17:09:14 +02:00
Sönke Ludwig 8c2790c66e
Merge pull request #140 from Cogitri/meson
Add support for building with meson
2020-05-11 17:06:42 +02:00
Sönke Ludwig 496e99c3b4 Make the API robust against using invalid handles. Fixes #105.
Introduces a "validationCounter" field for all handle types that gets incremented (at least) whenever an OS file descriptor/handle gets invalidated or re-allocated. This way, an old eventcore handle to a reused OS handle can always be distinguished from the current one to avoid interference.
2020-05-11 17:05:53 +02:00
Sönke Ludwig 768c6cf4c8
Merge pull request #143 from Geod24/deprecations
Fix a printf format deprecation triggered by 2.092
2020-05-11 17:03:01 +02:00
Geod24 3888f9f6a0 Fix a printf format deprecation triggered by 2.092 2020-05-11 11:14:03 +09:00
Hiroki Noda e6660486a3 Set close-on-exec flag for PipeFD 2020-04-09 21:36:19 +09:00
Rasmus Thomsen 409f9cac73 Add support for building with meson 2020-03-26 07:58:02 +01:00
Sönke Ludwig 8597d2ae34 Add missing ESHUTDOWN constant for macOS. 2020-03-18 07:59:41 +01:00
Sönke Ludwig 7c3fdc5ddf Fix possible hang after partial socket reads. 2020-03-17 15:15:19 +01:00
Sönke Ludwig 5c4e8be20a Add tests for TCP shutdown procedure and connection state handling. 2020-03-17 14:26:48 +01:00
Sönke Ludwig 3b44da604c Handle disconnects during socket read/write.
The connection state was not updated anymore since the changes in b32b329d15.

This fixes CI errors in vibe.d
2020-03-17 14:22:44 +01:00
Sönke Ludwig 215735f48f Use MonoTime for timers. 2020-03-15 21:29:27 +01:00
Sönke Ludwig 00b8607fc1 Fix IOMode.immediate for Windows sockets to guarantee calling the callback. 2020-03-15 20:33:52 +01:00
Sönke Ludwig e8ed523c08 Fix transferred byte counter for windows stream socket reads/writes.
Fixes read/write sizes that are sometimes reported too small.
2020-03-15 20:33:52 +01:00
Sönke Ludwig b32b329d15 Fix the approach to determine connect failures.
On macOS it could happen that both, onConnect and onConnectError, were triggered, resulting in seemingly overlapping connection attempts when they really were sequential. This in turn triggered a connection error leak test in vibe-core.

Now using only the write-ready flag plus the reported socket error status to determine failed connections, guaranteeing a single call back.
2020-03-15 18:49:54 +01:00
Geod24 e7688361ba Let malloc infer its attributes
Malloc should not force '@safe' or '@nogc' on constructors which are not.
For example, TaskPool's ctor is not '@nogc' but was assumed as such
thanks to the delegate cast happening in malloc.
Likewise, the ctor or the arguments might not be '@safe',
or any other attributes, but they were be mistakenly marked as such.
2020-01-13 17:01:04 +09:00
Hiroki Noda 3fd907edd4 Remove unused function: min 2020-01-10 14:17:24 +09:00
Sönke Ludwig 14a896be5d Attempt to fix crash in thread based DNS lookup.
Depending on the timing of starting and finishing DNS queries, `Thread.join` could be called on an instance that had already been `destroy`ed. To avoid this, the thread instance is now explicitly set to null, as well as resetting the "done" field to avoid redundant work for unused slots.

See vibe-d/vibe.d#2378.
2019-10-25 09:27:22 +02:00
The Dlang Bot 38536e0be9
Merge pull request #126 from Geod24/suppert
Update list of compilers to match vibe-core
merged-on-behalf-of: Sönke Ludwig <s-ludwig@users.noreply.github.com>
2019-10-08 21:25:41 +02:00
Sönke Ludwig b77adfcbd2 Add proper thread synchronization to EventDriverDNS_GAI. 2019-10-07 11:18:58 +02:00
Sönke Ludwig 5255645455 Start a thread for each DNS lookup. Fixes vibe-d/vibe.d#2378.
std.parallelism.Task.executeInNewThread leaks the thread's resources instead of reusing it in later calls. As a workaround, this commit starts a new thread for every lookup and properly tears it down afterwards. At a later point, this code should be changed to reuse the thread(s), if possible, to avoid the startup overhead.
2019-10-07 11:10:21 +02:00
Hiroki Noda 4aa6420662 Remove unused function safeYield 2019-09-26 20:33:05 +09:00
Benjamin Schaaf 782fc40152 Add MSG_NOSIGNAL flag to send call to avoid SIGPIPE (#128)
Add MSG_NOSIGNAL flag to send call to avoid SIGPIPE
merged-on-behalf-of: Sönke Ludwig <s-ludwig@users.noreply.github.com>
2019-09-06 19:15:30 +02:00
Geod24 312f49ce65 Remove outdate comments for unsupported compilers 2019-09-03 02:10:02 +09:00
Sönke Ludwig 20373d10db Fix indentation and remove unused imports/variables. 2019-08-23 19:55:55 +02:00
Sönke Ludwig 5c3afcc175 Ensure that a valid PID is passed to kill(). 2019-08-23 09:35:13 +02:00
Sönke Ludwig 01c2c26964 Fix Windows compilation.
Integrates the contents of StaticProcesses into PosixEventDriverProcesses to fully hide it form the Windows build. It also changes lockedProcessInfo to be a non-template function, as that lead to a linker error on macOS.
2019-08-23 09:35:13 +02:00
Sönke Ludwig f1c2eb779f Use the Posix process driver on all Posix operating systems. 2019-08-23 09:35:13 +02:00
Sönke Ludwig 7ebad49ed0 Rework the child process exit code to not rely in SIGCHLD.
It turns out that in a heterogeneous process where other parts of the code may start processes or threads and may be waiting for those to finish, it is not realistic to rely on signalfd or even SIGCHLD in general to get notified about child process exits. The only solid way appears to be to start a separate waiter thread that uses waitid/waitpid to wait for exited child processes in a blocking way.

This also fixes the hanging vibe.core.process test in vibe-core with DMD 2.087.x.
2019-08-23 09:35:12 +02:00
Sönke Ludwig 4724f14145 Avoid interference with other users of waitpid.
Instead of using waitpid(-1), explicitly waits on all known processes. This is inefficient for large numbers of child processes, but seems to be the only way to ensure to not interfere with other code that uses waitpid().
2019-08-23 09:35:12 +02:00
Sönke Ludwig 72234fc0a7 Return an invalid wait ID for processes.wait() if the process has already exited.
Avoids overlap with valid wait IDs, so that a paired cancelWait() doesn't cancel a different wait.
2019-08-23 09:35:12 +02:00
Sönke Ludwig 507fb5a0c9 Use waitpid to iterate over all exited child processes. Fixes #116. Closes #117. 2019-08-23 09:35:12 +02:00
Sönke Ludwig e1c6d99798 Fix indentation style. 2019-08-23 09:35:11 +02:00
Caleb Connolly c2e55122bf
Fix #119
Added missing import to fix `undefined identifier intptr_t`
2019-08-20 17:43:25 +00:00
Sönke Ludwig 9bb6be87c3 Fix possible access of freed directory watcher entries.
This mainly affected macOS, which currently uses the polling directory watcher. Since entries were freed during the loop, the remaining keys could point to already freed entries.
2019-08-19 23:59:11 +02:00
Sönke Ludwig cf33c3d859
Merge pull request #112 from BenjaminSchaaf/socket-fix
Fix socket not being in a connected state after connectStream
2019-08-17 14:44:48 +02:00