blob: 89ce05a53619ec046a6ad2db5bdf18a67000529d (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
|
# Benchmark Comparison Report: v4.3.0 vs Turbo-Enabled
## Summary
This report compares the performance of DTail v4.3.0 (baseline) with the current version that has turbo boost mode enabled by default.
## Performance Improvements
### DCat Operations
- **10MB file**:
- v4.3.0: 9.363 MB/sec
- Turbo: 246.8 MB/sec
- **Improvement: 2,535% (26.3x faster)**
### DGrep Operations (10MB file)
- **1% hit rate**:
- v4.3.0: 25.38 MB/sec
- Turbo: 363.9 MB/sec
- **Improvement: 1,334% (14.3x faster)**
- **10% hit rate**:
- v4.3.0: 22.81 MB/sec
- Turbo: 342.6 MB/sec
- **Improvement: 1,402% (15.0x faster)**
- **50% hit rate**:
- v4.3.0: 16.14 MB/sec
- Turbo: 265.1 MB/sec
- **Improvement: 1,543% (16.4x faster)**
- **90% hit rate**:
- v4.3.0: 10.99 MB/sec
- Turbo: 210.0 MB/sec
- **Improvement: 1,811% (19.1x faster)**
### DMap Operations (10MB file)
- **Count query**:
- v4.3.0: 17.09 MB/sec
- Turbo: 21.77 MB/sec
- **Improvement: 27.4%**
- **Sum/Avg query**:
- v4.3.0: 13.54 MB/sec
- Turbo: 21.05 MB/sec
- **Improvement: 55.5%**
- **Min/Max query**:
- v4.3.0: 17.46 MB/sec
- Turbo: 21.80 MB/sec
- **Improvement: 24.9%**
- **Multi-field query**:
- v4.3.0: 21.85 MB/sec
- Turbo: 21.32 MB/sec
- **Slight decrease: -2.4%** (within margin of error)
## Key Findings
1. **Massive improvements in DCat and DGrep**: The turbo boost mode shows extraordinary performance gains for file reading (DCat) and searching (DGrep) operations, with improvements ranging from 14x to 26x faster.
2. **Moderate improvements in DMap**: MapReduce operations show more modest but still significant improvements of 25-55% for most query types.
3. **Consistent performance across hit rates**: DGrep performance improvements scale well across different hit rates, with even better improvements at higher hit rates.
## Technical Details
The turbo boost mode achieves these improvements through:
- Direct writing bypassing channels for cat/grep/tail operations
- Direct line processing without channels for MapReduce in server mode
- Batch processing to reduce lock contention
- Memory pooling to reduce garbage collection pressure
## Recommendation
The turbo boost mode delivers exceptional performance improvements and should remain enabled by default. The performance gains are substantial enough to justify any potential trade-offs in code complexity.
|
