summaryrefslogtreecommitdiff
path: root/integrationtests/dmap_test.go
AgeCommit message (Collapse)Author
2025-06-19Implement line ending preservation and address CLAUDE commentsPaul Buetow
- Fix server-side line ending preservation in plain mode by updating basehandler to not add protocol delimiters, preserving original CRLF/LF line endings - Add comprehensive documentation to ProcessLine methods in all processors - Remove all CLAUDE comments and replace with proper function documentation - Update DCat test to include --quiet flag for cleaner server output - Clean up PGO script and report files from scripts directory - Improve code formatting and consistency across processor files 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-06-18Fix DGrep color output and address all CLAUDE commentsPaul Buetow
- Fix DGrep color issue by adding brush.Colorfy() to GrepProcessor.formatLine() - Increase server channel buffer size from 100 to 1000 lines in healthhandler.go and serverhandler.go - Enable skipped tests: TestDCat2 and TestDCatColors now run in both serverless and server modes - Ensure consistent test files across modes: all DGrep and DMap tests use identical files and counts - Split directprocessor.go (1228 lines) into 6 focused files under 1000 lines each: - directprocessor.go (398 lines): Core processor and interface - grepprocessor.go (176 lines): Grep functionality with color support - catprocessor.go (104 lines): Cat functionality - tailprocessor.go (312 lines): Tail and following functionality - mapprocessor.go (198 lines): MapReduce functionality - aggregateprocessor.go (83 lines): Aggregate processing - Update CLAUDE.md with development guidelines and integration testing standards - Remove all CLAUDE comments after addressing underlying issues 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-06-18Add comprehensive server-based testing for DMap functionalityPaul Buetow
Implement dual-mode testing infrastructure for all DMap integration tests: - Update TestDMap1, TestDMap2, TestDMap3, TestDMap4Append, TestDMap5CSV to run in both serverless and server modes - Create dmap_server_helpers.go with server-based testing utilities and SSH connection management - Add small test data files to work within server channel buffer limitations: - small_mapr_testdata.log (16 lines from original mapr_testdata.log) - small_dmap5.csv.in (reduced CSV input for DMap5 testing) - Expected output files for all DMap test variants in server mode - All tests now establish SSH connections between dmap client and dserver binary when in server mode - Maintain backward compatibility with existing serverless test functionality Tests verified passing in both modes: - TestDMap1: MapReduce query variations with different WHERE clauses and SET operations - TestDMap2: Ordered aggregation queries with GROUP BY and ORDER BY - TestDMap3: Multiple file processing with reduced file count for server mode - TestDMap4Append: File append functionality with multiple runs - TestDMap5CSV: CSV format input/output processing with custom aggregations Technical improvements: - Consistent file naming between server and serverless modes to avoid path conflicts - Proper SSH trust handling with --trustAllHosts flag - Multiple server helper functions for single-run and multi-run scenarios - Intelligent file comparison selection (compareFiles vs compareFilesContents) 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>
2023-09-07add mapr aggregration on CSV integr testPaul Buetow
2022-03-14typoPaul Buetow
2022-03-14add integration test for "outfile append.."Paul Buetow
2022-03-14"append" now actually will append to an outfile now. previously we only ↵Paul Buetow
added the syntax to the mapr query
2021-12-21adjust integration tests to reflect the last datetime string changePaul Buetow
2021-12-12add set condition integraion testPaul Buetow
2021-12-08add string based mapreduce where clause integration testPaul Buetow
2021-12-08add where clause integration test to dmap1, all mapreduce token fields are ↵Paul Buetow
lower case
2021-12-08refactor dmap1 unit test to be more modularPaul Buetow
2021-11-02Refactor integration tests. Also fix the dmap1 PIPE testPaul Buetow
2021-10-31add dmap integration test with stdin input pipePaul Buetow
2021-10-29Dont use relaxed SSH Auth mode anymore for integration testsPaul Buetow
2021-10-24integration tests use a different known_hosts path and also dont read any ↵Paul Buetow
external config files
2021-10-24Fix deadlock around aggregating data + server max concurrent file read limiterPaul Buetow
2021-10-21add inventoryPaul Buetow
2021-10-20make pprof bind address configurablePaul Buetow
2021-10-19Set DTAIL_RUN_INTEGRATIONT_TEST to yes for integration testsPaul Buetow
2021-10-19Can configure DTail client not to mess with ~/.ssh/known_hosts via env var - ↵Paul Buetow
this is useful for running unit and integration tests in jenkins
2021-10-13add another dcat integration test - catting 100 files at oncePaul Buetow
2021-10-11refactorPaul Buetow
2021-10-10vetting and linting and some code restylingPaul Buetow
2021-10-10add dtail health check unit test.Paul Buetow
2021-10-03when a mapreduce outfile is specified also always write a outfile.query filePaul Buetow
2021-10-03add dmap testsPaul Buetow
generated by cgit v1.2.3 (git 2.25.1) at 2026-06-09 19:30:16 +0000