Commit graph

389 commits

Author SHA1 Message Date
Sönke Ludwig cd8d90b5c4 Fix 32-bit compilation error. 2021-01-12 18:40:58 +01:00
Sönke Ludwig 7c2fd87308 Increase I/O buffer size.
Uses a buffer size that is more reasonable for modern transfer speeds, while still providing enough granularity for cancellation. This heavily reduces the computational overhead on SSD drives.
2021-01-12 14:23:30 +01:00
Sönke Ludwig 55cd860ea3 Implement ThreadedFileEventDriver.truncate on Windows. 2021-01-12 11:49:05 +01:00
Sönke Ludwig 009bf7f5ed Add return value documentation to doProcessEvents. 2020-11-26 10:45:32 +01:00
Sönke Ludwig 206d3fa34e Add a note about signals to EventDriverCore.processEvents. 2020-11-26 09:48:00 +01:00
Sönke Ludwig 07d5ead617 Causes the event loop to exit on Posix when being interrupted by a signal.
Previously, the loop logic would simply retry the wait until the given timeout was actually reached (or an event got received), which could be forever. This change makes sure that after an interrupt the higher level code will get a chance to run to possibly handle the effects of the signal.

This is a fix for vibe-d/vibe-core#205.
2020-11-26 09:47:59 +01:00
Sönke Ludwig 046fedd934 Fix ThreadedFileEventDriver.getSize on Windows.
fstat doesn't work correctly on Windows, possibly due to a bad C header translation on Druntime. Also switches to _lseeki64/lseek64 to avoid 32-bit file length limitations on 32-bit systems.
2020-11-26 09:34:18 +01:00
Sönke Ludwig 4803399376 Avoid bogus file change notifications for the inotify implementation. 2020-10-24 16:42:03 +02:00
Tobias Pankrath 2fd765ba07 ChoppedVector: short-circuit opApply for elements after m_length 2020-09-06 21:42:56 +02:00
Geod24 26060a6e0b Remove some always-true conditions (versions not supported anymore) 2020-09-02 10:28:02 +02:00
Geod24 e564bba215 Trivial: Unify some spacing / style issues 2020-09-02 10:28:02 +02:00
Daniel Graczer a462db4e04 suppressing socketStream warnings during shutdown initiated by SIGINT 2020-08-31 13:58:20 +02:00
Geod24 a027c233c2 Add support for DMD 2.094 -preview=in switch
This will allow users to use -preview=in as soon as it's released.
Of course this had to uncovered a DMD bug in the process.
2020-08-31 05:00:03 +02:00
Andrej Mitrovic 6f62236b2d DNS allocateHandle(): Don't return handle in use
This is a second attempt at fixing the issue originally
mentioned in PR #152.

This will allocate a new handle if all of them are in use.
2020-08-31 02:21:05 +02:00
Tobias Pankrath 1fcc941b1f Improve documentation w.r.t to concurrent writes/reads 2020-08-31 02:19:53 +02:00
Andrej Mitrovic ac4aec341e dns: Set the result to null in cancelLookup()
When lookupHost() is called the handle returned
from allocateHandle() might be a reused handle.

The delegate will be cleared, but the result might
still be there and the assert in lookupHost()
will fail:

```
assert(!m_lookups[handle].result);
```
2020-08-19 08:03:45 +02:00
Márcio Martins deaebb18d8 Fix host lookups hanging with concurrency 2020-08-11 10:42:36 +02:00
Geod24 862b5d470c posix/dns: Fix SEGV on Musl when an error happens
When an error happens, the 'struct addrinfo' (ai)
passed to 'passToDNSCallback' can be 'null'.
It end up being passed to 'freeaddrinfo'.
With glibc, or on OSX, it is okay to pass a 'null'
pointer to 'freeaddrinfo', however this will cause
a SIGSEGV on Musl.
The standard defines that 'freeaddrinfo' must accept
what was given to 'getaddrinfo', and 'getaddrinfo'
does not accept null pointer, so the musl behavior
is not wrong per se.
2020-08-03 03:04:39 +02:00
Sönke Ludwig ab829efc7c Rearm the CFFileDescriptor before each CFRunLoop run.
Instead of rearming from within the callback, this enables the callback before the event loop is run and before the kqueue is cleared. This at least heavily reduces the cases where the CFRunLoop hangs instead of reporting a pending kqueue event. For this reason, the safety timeout has been increased to 5 seconds.
2020-05-28 16:43:20 +02:00
Sönke Ludwig eb9c49a577 Fix the FSEvent rename logic.
It turned out to be impossible to determine the source and target names for a rename operation, so the actual existence of the file has to be used.
2020-05-27 17:58:28 +02:00
Sönke Ludwig 8695b4d32c Ignore sentinel events for the FSEvents watcher.
This caused the watcher to be endlessly recreated in rapid succession.
2020-05-27 17:57:27 +02:00
Sönke Ludwig 9120982bed Fix watching symlinked paths with FSEvents.
The events reported always use the canonical path, which broke the relative path logic. TO counter this, the canonical path is now determined explicitly.
2020-05-27 17:56:28 +02:00
Sönke Ludwig a77f626b97 Implement an alternative workaround for CFRunLoop hangs.
Limits the timeout for the CFRunLoop call to one second, after which kqueue will be re-checked again manually, guaranteeing that if a hang occurs, it will be resolved after at most one second.
2020-05-27 12:45:53 +02:00
Sönke Ludwig a9344c8490 Revert "Work around possible hang of CFRunLoop with pending kqueue events."
This reverts commit decbe7f6bd.

Using level triggered events resulted in 100% CPU usage, because sockets receive a constant write-ready event. They register themselves with the event loop only once in the beginning for efficiency reasons and thus may receive these events without any active waiters.

In case of kqueue it would be possible to register dynamically only when waiting, without a big performance impact, but in case of the epoll API this would result in am excessive growth of kernel calls.
2020-05-27 12:29:44 +02:00
Sönke Ludwig 194667a99f Fix reported status for disconnected message based Unix sockets.
Was reporting IOStatus.ok for a connection that was disconnected, possibly resulting in an endless loop (or recursion) of trying to read another (apparently zero sized) packet.
2020-05-25 14:37:55 +02:00
Sönke Ludwig 167745efb0 Fix CFRunLoop selection in multi-threaded scenarios.
CFRunLoopGetMain returns the main thread's run loop, as opposed to the one belonging to the calling thread.
2020-05-25 14:36:29 +02:00
Sönke Ludwig decbe7f6bd Work around possible hang of CFRunLoop with pending kqueue events. 2020-05-25 10:31:43 +02:00
Sönke Ludwig 49b2aff0c2 Move loop modules back to the posix package to work around compiler errors.
Older DMD frontend versions don't handle "package" protection within derived classes correctly.
2020-05-23 17:41:02 +02:00
Sönke Ludwig 0cdfe793af Implement an FSEvents based watcher for macOS.
Provides efficient and low latency directory watching on macOS when using the CFRunLoop based event loop.
2020-05-23 17:41:02 +02:00
Sönke Ludwig e28450f9f5 Implement a CFRunLoop based event loop.
This enables efficient integration of the kqueue based I/O processing with Apple OS based UI apps.

On top of that, an FSEvent based directory watcher can now be implemented to replace the inefficient generic watcher that is used on macOS right now.
2020-05-22 16:02:45 +02:00
Sönke Ludwig 4b1afa8d6c Allow to inherit from the kqueue loop implementation. 2020-05-22 09:59:25 +02:00
Sönke Ludwig aa3659fca6 Handle redundant cancelReceive calls gracefully and clean up the callback. 2020-05-22 09:59:25 +02:00
Sönke Ludwig 1f9a99a805 Fix potential access of an invalid waiter queue. 2020-05-22 09:59:25 +02:00
Sönke Ludwig 2f03f8dd42 Move Posix event loop implementations to their own package. 2020-05-19 10:10:15 +02:00
Sönke Ludwig b0ed2389fa Remove invalid assertion.
Since file descriptors are now identified using their validation counter, it is a valid operation to invalidate a slot that is still referenced.

This fixes a related test failure in vibe-core.
2020-05-18 15:09:34 +02:00
Sönke Ludwig 85dc8d54e6 Make file and pipe closing asynchronous.
CloseHandle can block for extended periods of time in certain cases, causing the whole thread to be blocked otherwise.
2020-05-12 09:47:06 +02:00
Sönke Ludwig 86ee5c9477 Remove FileChange.isDirectory.
isDir can be a huge performance issue when watching a network based directory and can effectively block the thread almost completely in case of frequent file changes. This does mean than high-level code now needs to perform the check manually, if required, and the free information provided by inotify goes unused.
2020-05-11 19:30:40 +02:00
Sönke Ludwig d7657b54e8 Move shared thread pool functionality to a separate module. 2020-05-11 17:09:14 +02:00
Sönke Ludwig a27abdb956 Fixup. 2020-05-11 17:09:14 +02:00
Sönke Ludwig 8c2790c66e
Merge pull request #140 from Cogitri/meson
Add support for building with meson
2020-05-11 17:06:42 +02:00
Sönke Ludwig 496e99c3b4 Make the API robust against using invalid handles. Fixes #105.
Introduces a "validationCounter" field for all handle types that gets incremented (at least) whenever an OS file descriptor/handle gets invalidated or re-allocated. This way, an old eventcore handle to a reused OS handle can always be distinguished from the current one to avoid interference.
2020-05-11 17:05:53 +02:00
Sönke Ludwig 768c6cf4c8
Merge pull request #143 from Geod24/deprecations
Fix a printf format deprecation triggered by 2.092
2020-05-11 17:03:01 +02:00
Geod24 3888f9f6a0 Fix a printf format deprecation triggered by 2.092 2020-05-11 11:14:03 +09:00
Hiroki Noda e6660486a3 Set close-on-exec flag for PipeFD 2020-04-09 21:36:19 +09:00
Rasmus Thomsen 409f9cac73 Add support for building with meson 2020-03-26 07:58:02 +01:00
Sönke Ludwig 8597d2ae34 Add missing ESHUTDOWN constant for macOS. 2020-03-18 07:59:41 +01:00
Sönke Ludwig 7c3fdc5ddf Fix possible hang after partial socket reads. 2020-03-17 15:15:19 +01:00
Sönke Ludwig 5c4e8be20a Add tests for TCP shutdown procedure and connection state handling. 2020-03-17 14:26:48 +01:00
Sönke Ludwig 3b44da604c Handle disconnects during socket read/write.
The connection state was not updated anymore since the changes in b32b329d15.

This fixes CI errors in vibe.d
2020-03-17 14:22:44 +01:00
Sönke Ludwig 215735f48f Use MonoTime for timers. 2020-03-15 21:29:27 +01:00