summaryrefslogtreecommitdiff
path: root/benchmark_dmap_final.sh
AgeCommit message (Collapse)Author
2025-07-04chore: clean up temporary test scripts and logsPaul Buetow
Remove temporary test scripts and logs that were created during debugging of the MapReduce turbo mode issues. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-07-03fix: improve turbo mode MapReduce batch processing and shutdown sequencePaul Buetow
- Fixed batch processor to use synchronous processing during shutdown - Added processBatchAndWait method for guaranteed batch completion - Fixed Flush() to ensure all data is processed before file completion - Improved parser selection logic for table-based queries - Added extensive debug logging for troubleshooting - Increased wait times for serialization during shutdown These changes address data loss issues when processing multiple files concurrently in turbo mode. The batch processor now properly flushes all remaining data when files complete and during shutdown. Note: Integration tests still failing due to SSH authentication issues in test environment, but core turbo mode logic has been fixed. 🤖 Generated with Claude Code Co-Authored-By: Claude <noreply@anthropic.com>