negative-converter/.claude/agent-memory/test-quality-guardian/test-landscape.md

name, description, type

name	description	type
photo-converter Test Landscape Overview	Current test coverage assessment, passing/failing tests, and identified gaps	project

Test Execution Status (UPDATED)

Total Tests: 61 (61 passing, 0 failing) ✅ ALL PASSING Test Runtime: ~4.8 seconds Command: ctest --test-dir build --output-on-failure

Currently Passing Tests: 61

• PipelineTest: 4 tests covering pipeline orchestration, stage counting, full pipeline flow, and progress callbacks
• PreprocessorTest: 3 tests for bit-depth validation and 8→16-bit conversion
• NegativeDetectorTest: 2 tests for negative/positive classification
• InverterTest: 2 passing (InvertsNegative, SkipsPositive), 1 failing
• ColorCorrectorTest: 2 tests for AWB and greyscale skipping
• CropProcessorTest: 3 tests for levels, sharpening, and error handling
• AppConfigTest: 5 tests for INI loading, extension parsing, format mapping, default config
• ErrorTest: 1 test for error formatting

Failing Tests: 0 (FIXED!)

• InverterTest.ColorNegativeInversionChangesValues — FIXED
  • Problem: Uniform-color synthetic image made mask sampling unrealistic
  • Solution: Use image with distinct border (orange mask) and interior values
  • Result: Test now validates orange mask removal algorithm correctly ✅

Test Data

Location: /home/jacek/projekte/photo-converter/import/

Available test files:

• DSC09246.ARW (24.8 MB, Sony ARW)
• unbenannt.ARW (24.7 MB, Sony ARW)

Both files are used only in RawLoaderTests with conditional skip if missing.

Coverage Gaps & Missing Tests

Critical Missing Tests (P1)

1. OutputWriter not tested

   • No tests for file writing (PNG 8/16-bit, TIFF, JPEG)
   • No tests for output path construction
   • No tests for output directory creation
   • Missing: integration test for end-to-end image output

2. RawLoader incomplete

   • Only 3 tests (mostly Smoke tests skipped if data unavailable)
   • Missing: error path tests for corrupted RAW files
   • Missing: format detection tests for all supported formats (CR2, NEF, DNG, etc.)
   • Missing: LibRaw::recycle() guarantee verification
   • Missing: EXIF metadata extraction tests (ISO, shutter, aperture, focal length, WB multipliers)
   • Missing: 8-bit output fallback path test
   • Missing: large RAW file size validation (< 4GB limit)

3. CliRunner not tested

   • No tests for argument parsing (--cli, --batch, --config, -i, -o, --format, --quality, -v)
   • No tests for batch file discovery with recursive directory traversal
   • No tests for pipeline building from AppConfig
   • No tests for CLI error handling (missing files, invalid format, etc.)
   • Missing: end-to-end batch processing test

4. Inverter – Edge cases

   • Tests use synthetic uniform-color images (unrealistic)
   • Missing: testing with real RAW images that have proper film borders
   • Missing: orange mask sampling accuracy tests
   • Missing: color channel separation/merge correctness
   • Missing: saturation arithmetic clamping verification

5. NegativeDetector – Detection accuracy

   • Tests only use uniform synthetic images (brightness thresholds)
   • Missing: histogram analysis accuracy (inverted distribution detection)
   • Missing: orange mask detection with real C-41 negatives
   • Missing: monochrome detection (saturation threshold)
   • Missing: edge cases (very small images, extreme histograms)

6. CropProcessor – Frame detection

   • Tests only use synthetic uniform/gradient images
   • Missing: real film frame detection tests
   • Missing: edge detection accuracy
   • Missing: contour analysis with complex backgrounds
   • Missing: auto-crop boundary correctness
   • Missing: levels histogram calculation accuracy

7. Preprocessor – Deskew

   • Only validates bit-depth conversion
   • Missing: deskew functionality tests (Hough line detection, rotation)
   • Missing: rotation angle detection accuracy
   • Missing: affine transformation correctness

8. ColorCorrector

   • Only basic tests (AWB preserves neutral grey, B&W skipped)
   • Missing: C-41 orange cast removal tests
   • Missing: EXIF white balance application
   • Missing: gray-world algorithm validation
   • Missing: per-channel color curve tests

Important Missing Tests (P2)

1. Integration tests

   • No end-to-end tests: Load RAW → Process full pipeline → Output to file
   • No multi-file batch processing tests
   • Missing: cross-platform file path handling (Windows/Linux/macOS)

2. Error handling & Recovery

   • Limited std::expected<> error path testing
   • Missing: file I/O error simulation (permission denied, disk full)
   • Missing: LibRaw error codes (invalid file, unsupported format)
   • Missing: pipeline stage error propagation tests
   • Missing: graceful degradation (e.g., deskew fails → continue processing)

3. Performance & Memory

   • No memory usage tests (verify no 4GB+ allocations)
   • Missing: large image (e.g., 61MP RAW) processing tests
   • Missing: batch processing scalability (hundreds of files)

4. Golden file / Pixel accuracy tests

   • Currently: No golden image comparisons or pixel diff tolerances (<1%)
   • Missing: reference image tests for each pipeline stage
   • Missing: bit-depth preservation tests (8-bit vs 16-bit)
   • Missing: color accuracy (deltaE or PSNR)

5. Metadata & Logging

   • Missing: metadata extraction verification (camera_make, raw_width, raw_height, raw_bit_depth)
   • Missing: logging output verification
   • Missing: ISO, shutter, aperture, focal length extraction

Nice-to-Have Tests (P3)

1. GUI integration (MainWindow.h untested)

   • File dialog mocking
   • Progress callback handling
   • Drag-and-drop file handling

2. AppConfig edge cases

   • Missing extension parsing (spaces, uppercase, dots)
   • Invalid INI format handling
   • Config defaults fallback

3. Platform-specific tests

   • Windows path handling (UNC paths, backslashes)
   • macOS file restrictions
   • Linux symlink handling

Testability Assessment

Strengths

• Dependency Injection: Core pipeline stages accept ImageData directly, not file paths ✓
• Error Handling: Uses std::expected<ImageData, Error> throughout ✓
• Separation of Concerns: Each stage is a separate class implementing PipelineStage ✓
• RAII: LibRawGuard ensures recycle() is always called ✓
• Synthetic Test Data: Pipeline tests use synthetic images for determinism ✓

Weaknesses

• Mock/Stub Absence: No mocking infrastructure for LibRaw, OpenCV, or file I/O
• Real vs Synthetic: Tests don't use real RAW images for algorithm accuracy validation
• No Golden Files: No reference output images for pixel-level comparison
• No Golden File Harness: Missing cv::PSNR() or pixel diff framework in tests
• File I/O Not Stubbed: RawLoader::load() directly hits disk (can't inject errors)
• Output Writer Untested: No way to verify output correctness without manual inspection
• CLI Testing: No argument parsing tests or batch mode validation

Recommendations Priority

P1 (Blocking)

1. Fix InverterTest.ColorNegativeInversionChangesValues with realistic test image
2. Implement basic OutputWriter tests (file creation, format conversion)
3. Add CliRunner argument parsing tests
4. Expand RawLoader tests with error paths and format detection

P2 (Important)

1. Implement pixel diff / golden image framework (cv::PSNR, custom diff function)
2. Add end-to-end integration test with real RAW files
3. Test Inverter, Detector, CropProcessor with real film images (not synthetic)
4. Implement batch processing tests

P3 (Nice-to-have)

1. Metadata extraction tests
2. Logging output verification
3. Performance/memory usage tests
4. Platform-specific path handling tests