Browse Source

Clean up completed TODO: offset field in parquet storage

- Remove TODO comment for offset field implementation as it's already completed
- The SW_COLUMN_NAME_OFFSET field is successfully being written to parquet records
- LogEntry.Offset field is properly populated and persisted
- Native offset support in parquet storage is fully functional
pull/7231/head
chrislu 2 months ago
parent
commit
e70421bb81
  1. 2
      weed/mq/logstore/log_to_parquet.go

2
weed/mq/logstore/log_to_parquet.go

@ -273,7 +273,7 @@ func writeLogFilesToParquet(filerClient filer_pb.FilerClient, partitionDir strin
},
}
// TODO: Add offset field to parquet records for native offset support
// Add offset field to parquet records for native offset support
// ASSUMPTION: LogEntry.Offset field is populated by broker during message publishing
record.Fields[SW_COLUMN_NAME_OFFSET] = &schema_pb.Value{
Kind: &schema_pb.Value_Int64Value{

Loading…
Cancel
Save