ULTIMATE SOLUTION: Bypass filer entirely, download chunks directly!
The problem: Filer metadata is deleted instantly after write
- Directory listings return empty
- HTTP API can't find the file
- Even temporary paths are cleaned up
The breakthrough: Get chunk IDs from the WRITE operation itself!
Changes:
1. SeaweedOutputStream: Log chunk IDs in write message
Format: 'CHUNKS: [id1,id2,...]'
2. Workflow: Extract chunk IDs from log, download from volume
- Parse 'CHUNKS: [...]' from write log
- Download directly: http://localhost:8080/CHUNK_ID
- Volume keeps chunks even after filer metadata deleted
Why this MUST work:
- Chunk IDs logged at write time (not dependent on reads)
- Volume server persistence (chunks aren't deleted immediately)
- Bypasses filer entirely (no metadata lookups)
- Direct data access (raw chunk bytes)
Timeline:
Write → Log chunk ID → Extract ID → Download chunk → Success! ✅