summaryrefslogtreecommitdiff
path: root/TOOD.md
AgeCommit message (Collapse)Author
2025-07-04feat: add Profile-Guided Optimization (PGO) supportPaul Buetow
- Add comprehensive PGO module in internal/tools/pgo/ - Integrate PGO into dtail-tools command with full CLI support - Add Makefile targets for PGO workflow: - make pgo: Full PGO workflow - make pgo-quick: Quick PGO with smaller datasets - make pgo-generate: Generate profiles only - make build-pgo: Build with existing profiles - make install-pgo: Install optimized binaries - Add convenience functions to data generator for PGO - Document PGO workflow in CLAUDE.md Performance improvements observed: - DCat: 3.8-7.0% additional improvement over turbo mode - DGrep: Up to 19% improvement for low hit rates - DMap: Variable impact, up to 64% for min_max on large files Benchmarks show total performance gains (pre-turbo → turbo+PGO): - DCat: 14-21x faster - DGrep: 9-15x faster - DMap: 9-29% faster 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-07-04docs: add turbo mode performance baseline and analysisPaul Buetow
This commit adds comprehensive performance benchmarking comparing DTail v4.3.0 (before turbo mode) with the current implementation that has turbo boost enabled by default. Performance Improvements: - DCat: 2,535% improvement (26.3x faster) - DGrep: 1,334-1,811% improvement (14-19x faster depending on hit rate) - DMap: 25-55% improvement for most query types Files added: - benchmarks/baselines/baseline_20250704_130947_turbo-enabled.txt New baseline with turbo mode enabled for future comparisons - doc/turbo_performance_analysis.md Detailed technical analysis of performance improvements including methodology, results, and implementation details - benchmark_comparison_report.md Summary report comparing v4.3.0 baseline with turbo-enabled baseline The turbo mode optimizations bypass channels for direct output operations and use direct line processing for MapReduce in server mode, resulting in dramatic performance improvements while maintaining compatibility. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>