summaryrefslogtreecommitdiff
path: root/internal/io/fs
AgeCommit message (Collapse)Author
2026-07-22feat: DTail fork — server/client feature developmentPaul Buetow
Squashed development of the snonux/dtail fork's product code (internal/, cmd/) since diverging from mimecast/dtail. Major areas: - Read/output path: the former "turbo" channel-less path is now the single, default server-side read/output path for cat/grep/tail and MapReduce; the old channel-based path and its config/env toggles were removed. - MapReduce: single aggregate implementation (server + serverless) fed directly by a processor pipeline, with input-exhausted finalization via the shutdown coordinator; high-concurrency and data-race fixes. - Journal source reads (journal:unit.service) via journalctl, Linux-gated behind a journal-v1 capability. - Auth-key fast reconnect: in-memory per-user public-key cache with TTL/max-keys, registered over an authenticated session (AUTHKEY), checked before authorized_keys. - Interactive query reload (--interactive-query) with SESSION START/UPDATE generation boundaries and capability negotiation. - Client-side deadlines: --timeout / --shutdownAfter as context deadlines; follow shutdown handling. - Client logging: diagnostics-only daily log by default, opt-in payload tee via --log-payload. - Numerous correctness fixes (buffer-pool double-recycle races, EOF-sentinel leaks, glob-expansion cap, TOCTOU in CSV parsing) with accompanying unit tests. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2024-03-29lint warningsPaul Buetow
2022-07-15gofmt permission file headersPaul Buetow
2022-02-15minor fix, add missing newlines to server messagesPaul Buetow
2021-12-06Refactor local context filter method to reduce its cognitive complexityPaul Buetow
2021-12-05buffer line.Line for performancePaul Buetow
2021-12-04refactorPaul Buetow
2021-12-04Refactor LContext handling to reduce cognitive method complexity.Paul Buetow
2021-12-04Refactor read method to reduce its Cognitive Complexity.Paul Buetow
2021-11-03Add integration test for long line splitting - Also fixed a bug regarding ↵Paul Buetow
this along the way
2021-11-02Bugfix: Dealing correctly with files without newline characters, also add ↵Paul Buetow
more tests
2021-10-31add dmap integration test with stdin input pipePaul Buetow
2021-10-30add support to read from stdin pipe in serverless mode, e.g. grep foo.log | ↵Paul Buetow
dmap "select from ...."
2021-10-27Fix --shutdownAfter client switchPaul Buetow
2021-10-24Fix deadlock around aggregating data + server max concurrent file read limiterPaul Buetow
2021-10-14add dgrep context integration testsPaul Buetow
2021-10-14Merging grep context from masterPaul Buetow
2021-10-10add another dmap test - reading 100 source files at oncePaul Buetow
fix a data race when reading multiple files on one server from the same session at once
2021-10-10vetting and linting and some code restylingPaul Buetow
2021-10-06enable faster shutdown - useful for dgrep/dmap and dcat commandsPaul Buetow
2021-10-02add dcat testPaul Buetow
2021-10-02move args to config packagePaul Buetow
logger package rewrite as dlog
2021-10-02add spartan modePaul Buetow
2021-10-02mapreduce tables are in colors now tooPaul Buetow
2021-08-281. Major performance gain by not checking for file truncation aftterPaul Buetow
each bytes read. 2. Introduce field separator to the protocol package.
2021-08-28use a byte.Buffer in the file readerPaul Buetow
2021-08-21read files bytewise for more control of whats happening - change transport ↵Paul Buetow
protocol for more control over newlines
2020-12-29Make Linux ACL support optional, as it requires CGo and makes the binary ↵Paul Buetow
less portable
2020-12-27make lint happyPaul Buetow
2020-09-04server side support for new regex packagePaul Buetow
2020-03-04can tail probe with a given timeout and then write a mapreduce resultPaul Buetow
2020-02-07Introduce drun command, refactor code to use context packagePaul Bütow