diff options
| author | Paul Buetow <paul@buetow.org> | 2025-07-02 17:01:13 +0300 |
|---|---|---|
| committer | Paul Buetow <paul@buetow.org> | 2025-07-02 17:01:13 +0300 |
| commit | e74957dd14d0b1d996ae7b67f000f2bb6296c6a7 (patch) | |
| tree | ed119163ad868c6a27c265b5a00020d7d5c65036 /internal/io/pool/bytesbuffer.go | |
| parent | e0cb2a417963b6515b16a5f12f36c7144d21f134 (diff) | |
perf: implement tiered buffer pooling to reduce allocations
- Add scanner_pool.go with tiered buffer pools (1MB, 64KB, 4KB)
- Modify readWithProcessorOptimized to use pooled scanner buffers
- Update tailWithProcessorOptimized to pool 64KB read buffers
- Increase BytesBuffer pool initial capacity from 128B to 4KB
- Add buffer_pool_test.go to benchmark pooling effectiveness
This reduces memory allocations by ~36% in turbo mode by reusing
buffers instead of allocating new ones for each file operation.
All integration tests pass.
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
Diffstat (limited to 'internal/io/pool/bytesbuffer.go')
| -rw-r--r-- | internal/io/pool/bytesbuffer.go | 4 |
1 files changed, 3 insertions, 1 deletions
diff --git a/internal/io/pool/bytesbuffer.go b/internal/io/pool/bytesbuffer.go index 3d48f2c..21871f1 100644 --- a/internal/io/pool/bytesbuffer.go +++ b/internal/io/pool/bytesbuffer.go @@ -10,7 +10,9 @@ import ( var BytesBuffer = sync.Pool{ New: func() interface{} { b := bytes.Buffer{} - b.Grow(128) + // Increase initial capacity to 4KB to reduce reallocations + // Most log lines are between 100-500 bytes, but some can be larger + b.Grow(4096) return &b }, } |