Tree: 221252d34e

add-admin-and-worker-to-helm-charts

add-ec-vacuum

add_fasthttp_client

add_remote_storage

adding-message-queue-integration-tests

also-delete-parent-directory-if-empty

avoid_releasing_temp_file_on_write

changing-to-zap

collect-public-metrics

copilot/fix-helm-chart-installation

create-table-snapshot-api-design

data_query_pushdown

dependabot/maven/other/java/client/com.google.protobuf-protobuf-java-3.25.5

dependabot/maven/other/java/examples/org.apache.hadoop-hadoop-common-3.4.0

detect-and-plan-ec-tasks

do-not-retry-if-error-is-NotFound

enhance-erasure-coding

fasthttp

filer1_maintenance_branch

fix-GetObjectLockConfigurationHandler

fix-versioning-listing-only

ftp

gh-pages

improve-fuse-mount

improve-fuse-mount2

logrus

master

message_send

mount2

mq-subscribe

mq2

original_weed_mount

pr-7412

random_access_file

refactor-needle-read-operations

refactor-volume-write

remote_overlay

revert-5134-patch-1

revert-5819-patch-1

revert-6434-bugfix-missing-s3-audit

s3-select

sub

tcp_read

test-reverting-lock-table

test_udp

testing

testing-sdx-generation

tikv

track-mount-e2e

upgrade-versions-to-4.00

volume_buffered_writes

worker-execute-ec-tasks

0.72

0.72.release

0.73

0.74

0.75

0.76

0.77

0.90

0.91

0.92

0.93

0.94

0.95

0.96

0.97

0.98

0.99

1.00

1.01

1.02

1.03

1.04

1.05

1.06

1.07

1.08

1.09

1.10

1.11

1.12

1.14

1.15

1.16

1.17

1.18

1.19

1.20

1.21

1.22

1.23

1.24

1.25

1.26

1.27

1.28

1.29

1.30

1.31

1.32

1.33

1.34

1.35

1.36

1.37

1.38

1.40

1.41

1.42

1.43

1.44

1.45

1.46

1.47

1.48

1.49

1.50

1.51

1.52

1.53

1.54

1.55

1.56

1.57

1.58

1.59

1.60

1.61

1.61RC

1.62

1.63

1.64

1.65

1.66

1.67

1.68

1.69

1.70

1.71

1.72

1.73

1.74

1.75

1.76

1.77

1.78

1.79

1.80

1.81

1.82

1.83

1.84

1.85

1.86

1.87

1.88

1.90

1.91

1.92

1.93

1.94

1.95

1.96

1.97

1.98

1.99

1;70

2.00

2.01

2.02

2.03

2.04

2.05

2.06

2.07

2.08

2.09

2.10

2.11

2.12

2.13

2.14

2.15

2.16

2.17

2.18

2.19

2.20

2.21

2.22

2.23

2.24

2.25

2.26

2.27

2.28

2.29

2.30

2.31

2.32

2.33

2.34

2.35

2.36

2.37

2.38

2.39

2.40

2.41

2.42

2.43

2.47

2.48

2.49

2.50

2.51

2.52

2.53

2.54

2.55

2.56

2.57

2.58

2.59

2.60

2.61

2.62

2.63

2.64

2.65

2.66

2.67

2.68

2.69

2.70

2.71

2.72

2.73

2.74

2.75

2.76

2.77

2.78

2.79

2.80

2.81

2.82

2.83

2.84

2.85

2.86

2.87

2.88

2.89

2.90

2.91

2.92

2.93

2.94

2.95

2.96

2.97

2.98

2.99

3.00

3.01

3.02

3.03

3.04

3.05

3.06

3.07

3.08

3.09

3.10

3.11

3.12

3.13

3.14

3.15

3.16

3.18

3.19

3.20

3.21

3.22

3.23

3.24

3.25

3.26

3.27

3.28

3.29

3.30

3.31

3.32

3.33

3.34

3.35

3.36

3.37

3.38

3.39

3.40

3.41

3.42

3.43

3.44

3.45

3.46

3.47

3.48

3.50

3.51

3.52

3.53

3.54

3.55

3.56

3.57

3.58

3.59

3.60

3.61

3.62

3.63

3.64

3.65

3.66

3.67

3.68

3.69

3.71

3.72

3.73

3.74

3.75

3.76

3.77

3.78

3.79

3.80

3.81

3.82

3.83

3.84

3.85

3.86

3.87

3.88

3.89

3.90

3.91

3.92

3.93

3.94

3.95

3.96

3.97

3.98

3.99

4.00

4.01

dev

helm-3.65.1

v0.69

v0.70beta

v3.33

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from '221252d34e'

${ noResults }

Commit Graph

53 Commits (221252d34e724a1fee179d41572e5f3a59d4b0c1)

Author	SHA1	Message	Date
chrislu	a3cf4eb843	debug: track stream lifecycle and total bytes written Added comprehensive logging to identify why Parquet files fail with 'EOFException: Still have: 78 bytes left'. Key additions: 1. SeaweedHadoopOutputStream constructor logging with 🔧 marker - Shows when output streams are created - Logs path, position, bufferSize, replication 2. totalBytesWritten counter in SeaweedOutputStream - Tracks cumulative bytes written via write() calls - Helps identify if Parquet wrote 762 bytes but only 684 reached chunks 3. Enhanced close() logging with 🔒 and ✅ markers - Shows totalBytesWritten vs position vs buffer.position() - If totalBytesWritten=762 but position=684, write submission failed - If buffer.position()=78 at close, buffer wasn't flushed Expected scenarios in next run: A) Stream never created → No 🔧 log for .parquet files B) Write failed → totalBytesWritten=762 but position=684 C) Buffer not flushed → buffer.position()=78 at close D) All correct → totalBytesWritten=position=684, but Parquet expects 762 This will pinpoint whether the issue is in: - Stream creation/lifecycle - Write submission - Buffer flushing - Or Parquet's internal state	1 week ago
chrislu	c86177e063	add comments	1 week ago
chrislu	a7f786ac92	NPE	1 week ago
chrislu	c96448f3a5	more flexible replication configuration	1 week ago
dependabot[bot]	c14e513964	chore(deps): bump org.apache.hadoop:hadoop-common from 3.2.4 to 3.4.0 in /other/java/hdfs3 (#7512) * chore(deps): bump org.apache.hadoop:hadoop-common in /other/java/hdfs3 Bumps org.apache.hadoop:hadoop-common from 3.2.4 to 3.4.0. --- updated-dependencies: - dependency-name: org.apache.hadoop:hadoop-common dependency-version: 3.4.0 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * add java client unit tests * Update dependency-reduced-pom.xml * add java integration tests * fix * fix buffer --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: chrislu <chris.lu@gmail.com>	2 weeks ago
orthoxerox	d8cc269294	feature: added ssl support for HCFS (#6699) (#6775)	7 months ago
chrislu	d003bb0166	java 3.13	3 years ago
Chris Lu	e5fc35ed0c	change server address from string to a type	4 years ago
Chris Lu	ad36c7b0d7	refactoring: only expose FilerClient class	5 years ago
Chris Lu	9c1efdf11b	HCFS: 1.5.9	5 years ago
Chris Lu	8f3a51f2b8	Java: 1.5.8 additional fixes	5 years ago
Chris Lu	6f4aab51f9	refactoring SeaweedInputStream	5 years ago
Chris Lu	043c2d7960	refactoring SeaweedOutputStream	5 years ago
Chris Lu	4d2855476c	Hadoop: add BufferedByteBufferReadableInputStream fix https://github.com/chrislusf/seaweedfs/issues/1645	5 years ago
Chris Lu	3857f9c840	Hadoop: switch to ByteBuffer fix https://github.com/chrislusf/seaweedfs/issues/1645	5 years ago
Chris Lu	a9efaa6385	HDFS: implement ByteBufferReadable fix https://github.com/chrislusf/seaweedfs/issues/1645	5 years ago
Chris Lu	f4abd01adf	filer: cache small file to filer store	5 years ago
limd	4737df597d	HCFS: 1. add replication parameter 2. fix close sequence	5 years ago
Chris Lu	c709059b69	HCFS: add close() to SeaweedFileSystem.java	5 years ago
Chris Lu	f375b93aef	renaming	5 years ago
Chris Lu	596d476e3d	HCFS: 1.5.2	5 years ago
Chris Lu	459de70a77	Hadoop: more accurate block size	5 years ago
Chris Lu	912ef2bc53	Hadoop: remove unused variable bufferSize	5 years ago
limd	ac162fc857	hdfs: Hadoop on SeaweedFS: create empty file	5 years ago
Chris Lu	4929d0634e	Hadoop on SeaweedFS: create empty file fix https://github.com/chrislusf/seaweedfs/issues/1494	5 years ago
limd	95bfec4931	hadoop: filesystem cannot create file issues: https://github.com/chrislusf/seaweedfs/issues/1494	5 years ago
Chris Lu	5eee4983f3	1.4.7 hdfs configurable fs.seaweed.buffer.size	5 years ago
Chris Lu	13bfe5deef	same logic for reading random access files from Go	5 years ago
Chris Lu	15dc0a704d	Revert "add read ahead input stream" This reverts commit b3089dcc8e.	5 years ago
Chris Lu	b3089dcc8e	add read ahead input stream	5 years ago
Chris Lu	6b41c5250b	Hadoop file system: 1.4.3 added buffered fs input stream	5 years ago
Chris Lu	703057bff9	mirror changes from hdfs2	5 years ago
Chris Lu	6839f96c0c	simplify	5 years ago
Chris Lu	ae3e6d8244	remove changing buffer size	5 years ago
Chris Lu	1d724ab237	hdfs: support read write chunk manifest	5 years ago
Chris Lu	f90d2c93c9	1.3.9 remove logs	5 years ago
Chris Lu	3abd74b1d7	1.3.8	5 years ago
Chris Lu	2629da2cb9	simplify inputstream	5 years ago
李明达	74456b3d5e	1、Add SeaweedFS implementation of Hadoop AbstractFileSystem. The implementation delegates to the existing SeaweedFS FileSystem and is only necessary for use with Hadoop 2.x/3.x. Configuration example in Hadoop core-site.xml file: <property> <name>fs.AbstractFileSystem.seaweedfs.impl</name> <value>seaweed.hdfs.SeaweedAbstractFileSystem</value> </property> 2、Fix hiveserver2 startup NullPointerException	5 years ago
Chris Lu	7bca72deed	reuse bytebuffer	5 years ago
Chris Lu	86c8137546	1.3.4	5 years ago
Chris Lu	bc3be0bb37	Hadoop: 1.3.3 improve memory efficiency	5 years ago
Chris Lu	222f93e816	possibly fix concurrent access to entry object in SeaweedOutputStream	6 years ago
Chris Lu	8dfaaeabfd	HCFS: 1.2.8 fix hbase related bugs 1. SeaweedFileSystem.listStatus need to work with file also 2. SeaweedRead readChunkView has wrong len	6 years ago
Chris Lu	a999ed94d0	update hdfs client	6 years ago
Chris Lu	ae53f63680	filer: recursive deletion optionally ignoring any errors fix https://github.com/chrislusf/seaweedfs/issues/1062	6 years ago
Chris Lu	fd509c3844	HCFS: working with HBase	6 years ago
Chris Lu	cb299dfaa2	HCFS: use latest grpc versions, separate hadoop2 and hadoop3	6 years ago
Chris Lu	170ee6ef0f	tmp	6 years ago