Browse Source

fix: suppress verbose Parquet DEBUG logging

- Set org.apache.parquet to WARN level
- Set org.apache.parquet.io to ERROR level
- Suppress RecordConsumerLoggingWrapper and MessageColumnIO DEBUG logs
- Reduces CI log noise from thousands of record-level messages
- Keeps important error messages visible
pull/7526/head
chrislu 7 days ago
parent
commit
707e7732a7
  1. 6
      test/java/spark/src/test/resources/log4j.properties

6
test/java/spark/src/test/resources/log4j.properties

@ -12,6 +12,12 @@ log4j.logger.org.apache.spark=WARN
log4j.logger.org.apache.hadoop=WARN log4j.logger.org.apache.hadoop=WARN
log4j.logger.seaweed=INFO log4j.logger.seaweed=INFO
# Suppress Parquet verbose DEBUG logging
log4j.logger.org.apache.parquet=WARN
log4j.logger.org.apache.parquet.io=ERROR
log4j.logger.org.apache.parquet.io.RecordConsumerLoggingWrapper=ERROR
log4j.logger.org.apache.parquet.io.MessageColumnIO=ERROR
# Suppress unnecessary warnings # Suppress unnecessary warnings
log4j.logger.org.apache.spark.util.Utils=ERROR log4j.logger.org.apache.spark.util.Utils=ERROR
log4j.logger.org.apache.hadoop.util.NativeCodeLoader=ERROR log4j.logger.org.apache.hadoop.util.NativeCodeLoader=ERROR

Loading…
Cancel
Save