Chris Lu
95261a712e
Improve lock ring ( #6921 )
...
* fix flaky lock ring test
* add more tests
2025-06-24 23:04:39 -07:00
Aleksey Kosov
4511c2cc1f
Changes logging function ( #6919 )
...
* updated logging methods for stores
* updated logging methods for stores
* updated logging methods for filer
* updated logging methods for uploader and http_util
* updated logging methods for weed server
---------
Co-authored-by: akosov <a.kosov@kryptonite.ru >
2025-06-24 08:44:06 -07:00
dependabot[bot]
5f1d2a9745
chore(deps): bump github.com/parquet-go/parquet-go from 0.24.0 to 0.25.1 ( #6851 )
...
* chore(deps): bump github.com/parquet-go/parquet-go from 0.24.0 to 0.25.1
Bumps [github.com/parquet-go/parquet-go](https://github.com/parquet-go/parquet-go ) from 0.24.0 to 0.25.1.
- [Release notes](https://github.com/parquet-go/parquet-go/releases )
- [Changelog](https://github.com/parquet-go/parquet-go/blob/main/CHANGELOG.md )
- [Commits](https://github.com/parquet-go/parquet-go/compare/v0.24.0...v0.25.1 )
---
updated-dependencies:
- dependency-name: github.com/parquet-go/parquet-go
dependency-version: 0.25.1
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
* adjust to updated API
Fixed Reader Construction: Updated to use parquet.OpenFile() instead of passing io.Reader directly to NewReader()
Fixed EOF Handling: Changed the order of operations to process rows before checking for EOF
Added Zero Row Count Check: Added explicit check for rowCount == 0 as an additional termination condition
---------
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com >
Co-authored-by: chrislu <chris.lu@gmail.com >
2025-06-23 10:25:51 -07:00
chrislu
7324cb7171
3.92
2025-06-22 21:17:06 -07:00
Aleksey Kosov
90c128e7a6
Context-based logging with request ID ( #6899 )
2025-06-20 06:23:53 -07:00
Chris Lu
a72c442945
Fix chunked data reading if iam not enabled ( #6898 )
...
* fix chunked data reading if iam not enabled
* add unit test
2025-06-19 22:58:10 -07:00
SmoothDenis
abd5102819
ydb filer improvements ( #6890 )
...
* fix(ydb): table creation with params
* fix(ydb): migrate to new query client & prevent creation table-bucket on get request
* fix(ydb): use new query client with kv req
* fix(ydb): use directory in every query
* fix(ydb): del unused import
* fix(ydb): tests & default const usage
2025-06-19 14:16:01 -07:00
chrislu
da728750be
follow grow volume option version
2025-06-19 13:54:54 -07:00
chrislu
2f1b3d68d7
pass volume version when creating a volume
2025-06-19 01:15:25 -07:00
chrislu
87927d068b
display volume version when listing
2025-06-19 00:33:01 -07:00
chrislu
9a115068af
adding cassandra2
...
fix https://github.com/seaweedfs/seaweedfs/issues/6888
2025-06-17 11:25:37 -07:00
chrislu
748bf5e4d3
add default value when reading needle version
2025-06-16 23:35:03 -07:00
chrislu
c602f53a6e
tail-volume-uses-the-source-volume-version
2025-06-16 22:46:13 -07:00
chrislu
d2be5822a1
refactoring
2025-06-16 22:25:22 -07:00
chrislu
96632a34b1
add version to volume proto
2025-06-16 22:05:06 -07:00
Chris Lu
5d8a391b95
filer store: fix nil for mongodb ( #6886 )
...
fix https://github.com/seaweedfs/seaweedfs/issues/6885
2025-06-16 14:21:05 -07:00
Alexey
29d1701c34
Fix url scheme using for forwarded request with changed proto ( #6884 )
2025-06-16 12:50:09 -07:00
chrislu
78069605a6
sort lifecycles
2025-06-16 11:48:29 -07:00
chrislu
f0e987dc9d
ensure consistent testing
2025-06-16 10:56:39 -07:00
Erik Jacobson
77397be070
allow distro mount command to use disableXAttr ( #6872 )
2025-06-16 08:45:05 -07:00
Konstantin Lebedev
958d88cb85
[shell] volume copy add param noLock ( #6871 )
2025-06-16 07:39:19 -07:00
chrislu
c26299b05a
3.91
2025-06-15 20:42:16 -07:00
NyaMisty
f894e7b7a5
Support filtering source disk type in volume.tier.upload ( #6868 )
2025-06-15 20:30:04 -07:00
NyaMisty
53e5c84523
Fix wrong error handling in volume.tier.upload when stream == nil but copyErr != nil ( #6867 )
2025-06-15 20:28:40 -07:00
NyaMisty
cdc543aa9e
Correctly sort in volume.list to ensure output consistency ( #6866 )
2025-06-15 20:27:48 -07:00
Gerry Hernandez
e653de54b4
FUSE Mount: Fix buffer allocation during copy ( #6863 )
...
Fix buffer allocation during FUSE copy
2025-06-13 12:27:39 -07:00
chrislu
c79e73aa2a
mount: complete fix for freebsd
...
fix https://github.com/seaweedfs/seaweedfs/issues/6645
2025-06-12 08:19:47 -07:00
chrislu
e71d681fee
refactor
2025-06-11 20:46:13 -07:00
chrislu
7c4d98446b
refactor
2025-06-11 20:13:06 -07:00
chrislu
f27e195354
refactoring
2025-06-11 20:13:06 -07:00
Bruce Zou
fa730abec7
fix rocksdb enumerate ( #6858 )
2025-06-11 17:55:58 -07:00
chrislu
33ecc8442e
refactor
go: build dev binaries / cleanup (push) Waiting to run
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Blocked by required conditions
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Blocked by required conditions
docker: build dev containers / build-dev-containers (push) Waiting to run
End to End / FUSE Mount (push) Waiting to run
go: build binary / Build (push) Waiting to run
Ceph S3 tests / Ceph S3 tests (push) Waiting to run
test s3 over https using aws-cli / awscli-tests (push) Waiting to run
helm: lint and test charts / lint-test (push) Has been cancelled
2025-06-08 22:11:09 -07:00
chrislu
81aeec74a4
3.90
2025-06-08 20:59:43 -07:00
chrislu
60f11f6510
add a readme file for volume needle data layout
go: build dev binaries / cleanup (push) Has been cancelled
docker: build dev containers / build-dev-containers (push) Has been cancelled
End to End / FUSE Mount (push) Has been cancelled
go: build binary / Build (push) Has been cancelled
Ceph S3 tests / Ceph S3 tests (push) Has been cancelled
test s3 over https using aws-cli / awscli-tests (push) Has been cancelled
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Has been cancelled
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Has been cancelled
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Has been cancelled
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Has been cancelled
2025-06-07 15:52:51 -07:00
chrislu
61c4f01e05
refactor
go: build dev binaries / cleanup (push) Has been cancelled
docker: build dev containers / build-dev-containers (push) Has been cancelled
End to End / FUSE Mount (push) Has been cancelled
go: build binary / Build (push) Has been cancelled
Ceph S3 tests / Ceph S3 tests (push) Has been cancelled
test s3 over https using aws-cli / awscli-tests (push) Has been cancelled
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Has been cancelled
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Has been cancelled
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Has been cancelled
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Has been cancelled
2025-06-06 08:55:32 -07:00
chrislu
a489d99333
fix tests
2025-06-06 08:25:04 -07:00
Lisandro Pin
00c621abb8
Fix dumb typo in 08556257 ( #6844 )
2025-06-06 05:59:11 -07:00
SmoothDenis
c99530ec66
fix(filer): add missing return after KvDelete in KvPut with empty value ( #6846 )
2025-06-06 05:58:03 -07:00
chrislu
7439af0eca
refactoring
2025-06-06 01:35:48 -07:00
chrislu
cc135c63f7
a bit refactoring
2025-06-06 01:26:54 -07:00
chrislu
c4695fc3b3
refactor needle write for different versions
2025-06-06 00:35:13 -07:00
Lisandro Pin
bed0a64693
New needle_map.CompactMap() implementation for reduced memory usage ( #6842 )
...
go: build dev binaries / cleanup (push) Waiting to run
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Blocked by required conditions
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Blocked by required conditions
docker: build dev containers / build-dev-containers (push) Waiting to run
End to End / FUSE Mount (push) Waiting to run
go: build binary / Build (push) Waiting to run
Ceph S3 tests / Ceph S3 tests (push) Waiting to run
test s3 over https using aws-cli / awscli-tests (push) Waiting to run
* Rework `needle_map.CompactMap()` to maximize memory efficiency.
* Use a memory-efficient structure for `CompactMap` needle value entries.
This slightly complicates the code, but makes a **massive** difference
in memory efficiency - preliminary results show a ~30% reduction in
heap usage, with no measurable performance impact otherwise.
* Clean up type for `CompactMap` chunk IDs.
* Add a small comment description for `CompactMap()`.
* Add the old version of `CompactMap()` for comparison purposes.
2025-06-05 14:03:29 -07:00
chrislu
35f0daa198
the isFsync parameter is essentially IsAsyncWrite and it needs to be turned off if s.isStopping
...
go: build dev binaries / cleanup (push) Waiting to run
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Blocked by required conditions
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Blocked by required conditions
docker: build dev containers / build-dev-containers (push) Waiting to run
End to End / FUSE Mount (push) Waiting to run
go: build binary / Build (push) Waiting to run
Ceph S3 tests / Ceph S3 tests (push) Waiting to run
test s3 over https using aws-cli / awscli-tests (push) Waiting to run
d8c574a5ef (r159132764)
2025-06-05 00:19:10 -07:00
chrislu
2f3de5e199
fix build
go: build dev binaries / cleanup (push) Waiting to run
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Blocked by required conditions
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Blocked by required conditions
docker: build dev containers / build-dev-containers (push) Waiting to run
End to End / FUSE Mount (push) Waiting to run
go: build binary / Build (push) Waiting to run
Ceph S3 tests / Ceph S3 tests (push) Waiting to run
test s3 over https using aws-cli / awscli-tests (push) Waiting to run
2025-06-03 22:50:45 -07:00
chrislu
bd4891a117
change version directory
2025-06-03 22:46:10 -07:00
Chris Lu
7151a54b28
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
go: build dev binaries / cleanup (push) Waiting to run
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Blocked by required conditions
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Blocked by required conditions
docker: build dev containers / build-dev-containers (push) Waiting to run
End to End / FUSE Mount (push) Waiting to run
go: build binary / Build (push) Waiting to run
Ceph S3 tests / Ceph S3 tests (push) Waiting to run
test s3 over https using aws-cli / awscli-tests (push) Waiting to run
helm: lint and test charts / lint-test (push) Has been cancelled
2025-06-02 23:57:54 -07:00
Chris Lu
b25561d0d7
3.89
2025-06-02 23:56:58 -07:00
Chris Lu
d40746f34e
fix insert beyond look back window ( #6838 )
2025-06-02 23:43:01 -07:00
Lisandro Pin
7204731749
Minor fix for the CompactMap() performance test. ( #6836 )
...
go: build dev binaries / cleanup (push) Waiting to run
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Blocked by required conditions
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Blocked by required conditions
docker: build dev containers / build-dev-containers (push) Waiting to run
End to End / FUSE Mount (push) Waiting to run
go: build binary / Build (push) Waiting to run
helm: lint and test charts / lint-test (push) Waiting to run
Ceph S3 tests / Ceph S3 tests (push) Waiting to run
test s3 over https using aws-cli / awscli-tests (push) Waiting to run
Per-entry memory usage is based on `TotalAllocs`, which is incorrect - that
value is a cummulative of heap usage, which doesn't decrease when objects
are freeed.
`Allocs` is instead an accurate represeentation of actual memory usage
at the time metrics are reported.
2025-06-02 17:09:01 -07:00
Luna Yao
5e354a18a3
Update filer upsert sqlstring for postgresql ( #6835 )
2025-06-02 10:46:50 -07:00
