chrislu
ed15357c7a
adds tls examples
...
go: build dev binaries / cleanup (push) Waiting to run
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Blocked by required conditions
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Blocked by required conditions
docker: build dev containers / build-dev-containers (push) Waiting to run
End to End / FUSE Mount (push) Waiting to run
go: build binary / Build (push) Waiting to run
Ceph S3 tests / Ceph S3 tests (push) Waiting to run
test s3 over https using aws-cli / awscli-tests (push) Waiting to run
related to https://github.com/seaweedfs/seaweedfs/pull/6738
2025-05-04 05:46:33 -07:00
ARibster
d424cbbcd5
fix: S3 Feature: please add s3.idleTimeout command line parameter #6746 ( #6747 )
...
ildeTimeout command line parameter for s3
2025-05-01 13:09:47 -07:00
ARibster
9f4be83e88
fix #6733 add s3.ip.bind command line parameter ( #6741 )
go: build dev binaries / cleanup (push) Has been cancelled
docker: build dev containers / build-dev-containers (push) Has been cancelled
End to End / FUSE Mount (push) Has been cancelled
go: build binary / Build (push) Has been cancelled
Ceph S3 tests / Ceph S3 tests (push) Has been cancelled
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Has been cancelled
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Has been cancelled
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Has been cancelled
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Has been cancelled
2025-04-28 04:49:01 -07:00
Konstantin Lebedev
aa9121aa9d
Revert "[filer] void panic if s3opt.tlsCACertificate is nill" ( #6694 )
...
Revert "[filer] void panic if s3opt.tlsCACertificate is nill (#6685 )"
This reverts commit 4dca59ed27
2025-04-07 11:09:40 -07:00
Konstantin Lebedev
4dca59ed27
[filer] void panic if s3opt.tlsCACertificate is nill ( #6685 )
...
* fix issues/6684
* add s3.cacert.file option for filer
2025-04-07 09:45:49 -07:00
MaratKarimov
ba3afd1803
Tarantool filer store ( #6669 )
...
Co-authored-by: Marat Karimov <m.karimov@digitalms.ru >
2025-03-29 21:12:06 -07:00
Chris Lu
669a3917af
add lua redis store to ensure atomicity ( #6671 )
2025-03-28 11:27:39 -07:00
chrislu
138b66231a
fix help message
go: build dev binaries / cleanup (push) Waiting to run
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Blocked by required conditions
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Blocked by required conditions
docker: build dev containers / build-dev-containers (push) Waiting to run
End to End / FUSE Mount (push) Waiting to run
go: build binary / Build (push) Waiting to run
Ceph S3 tests / Ceph S3 tests (push) Waiting to run
2025-03-25 09:30:56 -07:00
Karol Będkowski
95746f48e6
feat/fix: add s3.cacert.file/tlsVerifyClientCert to filer command ( #6659 )
...
This prevent crash filler with nil pointer dereference as s3 expect this
parameters.
New two parameters are added to filer command - copy of s3 parameters:
- s3.cacert.file - path to the TLS CA certificate file
- s3.tlsVerifyClientCert - whether to verify the client's certificate
2025-03-24 10:14:31 -07:00
Weihao Jiang
75ef324533
Allow standalone webdav server to bind specific address ( #6403 )
...
* Allow standalone webdav to bind specific address
* Rename bindIp to ipBind
* Bind embedded webdav IP to its parent
2025-03-17 23:01:26 -07:00
Chris Lu
02773a6107
Accumulated changes for message queue ( #6600 )
...
go: build dev binaries / cleanup (push) Waiting to run
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Blocked by required conditions
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Blocked by required conditions
docker: build dev containers / build-dev-containers (push) Waiting to run
End to End / FUSE Mount (push) Waiting to run
go: build binary / Build (push) Waiting to run
Ceph S3 tests / Ceph S3 tests (push) Waiting to run
* rename
* set agent address
* refactor
* add agent sub
* pub messages
* grpc new client
* can publish records via agent
* send init message with session id
* fmt
* check cancelled request while waiting
* use sessionId
* handle possible nil stream
* subscriber process messages
* separate debug port
* use atomic int64
* less logs
* minor
* skip io.EOF
* rename
* remove unused
* use saved offsets
* do not reuse session, since always session id is new after restart
remove last active ts from SessionEntry
* simplify printing
* purge unused
* just proxy the subscription, skipping the session step
* adjust offset types
* subscribe offset type and possible value
* start after the known tsns
* avoid wrongly set startPosition
* move
* remove
* refactor
* typo
* fix
* fix changed path
2025-03-09 23:49:42 -07:00
lizhengui007
61249d8dde
clear cache directory when mount exits ( #6605 )
...
go: build dev binaries / cleanup (push) Waiting to run
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Blocked by required conditions
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Blocked by required conditions
docker: build dev containers / build-dev-containers (push) Waiting to run
End to End / FUSE Mount (push) Waiting to run
go: build binary / Build (push) Waiting to run
Ceph S3 tests / Ceph S3 tests (push) Waiting to run
Signed-off-by: lizhengui <lizhengui@virtaitech.com >
Co-authored-by: lizhengui <lizhengui@virtaitech.com >
2025-03-06 08:14:17 -08:00
chrislu
314f211260
Update filer.toml
go: build dev binaries / cleanup (push) Has been cancelled
docker: build dev containers / build-dev-containers (push) Has been cancelled
End to End / FUSE Mount (push) Has been cancelled
go: build binary / Build (push) Has been cancelled
Ceph S3 tests / Ceph S3 tests (push) Has been cancelled
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Has been cancelled
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Has been cancelled
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Has been cancelled
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Has been cancelled
2025-02-26 17:52:45 -08:00
chrislu
9bd4c47299
update redis support status
2025-02-26 17:48:44 -08:00
chrislu
4613186e8a
not planning to redis3
2025-02-26 17:35:31 -08:00
Chris Lu
df436d342b
add cassandra2 ( #6582 )
2025-02-26 17:29:22 -08:00
Karol Będkowski
441614b386
fix: s3 command ignore -tlsVerifyClientCert and -cacert.file arguments ( #6547 )
...
go: build dev binaries / cleanup (push) Has been cancelled
docker: build dev containers / build-dev-containers (push) Has been cancelled
End to End / FUSE Mount (push) Has been cancelled
go: build binary / Build (push) Has been cancelled
helm: lint and test charts / lint-test (push) Has been cancelled
Ceph S3 tests / Ceph S3 tests (push) Has been cancelled
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Has been cancelled
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Has been cancelled
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Has been cancelled
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Has been cancelled
s3 command ignore tlsVerifyClientCert and cacert.file arguments from
command line. On startS3Server instead of use real values (in s3opt),
default values (from s3Options, always empty) are checked.
Now on right values are checked and if user provide this arguments
RequireAndVerifyClientCert is set and/or ca certificate is loaded.
2025-02-13 13:27:38 -08:00
Lisandro Pin
e8d8bfcccc
Nit: remove missing newlines on weed shell commands output. ( #6524 )
...
Nit: remove missing newlines on `weed` commands output.
2025-02-07 10:27:04 -08:00
Ethan Mosbaugh
9ebc132ffc
fix: bucket-hook fails with gnu wget ( #6521 )
go: build dev binaries / cleanup (push) Waiting to run
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Blocked by required conditions
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Blocked by required conditions
docker: build dev containers / build-dev-containers (push) Waiting to run
End to End / FUSE Mount (push) Waiting to run
go: build binary / Build (push) Waiting to run
Ceph S3 tests / Ceph S3 tests (push) Waiting to run
2025-02-06 23:11:17 -08:00
Chris Lu
cc05874d06
Add message queue agent ( #6463 )
...
* scaffold message queue agent
* adjust proto, add mq_agent
* add agent client implementation
* remove unused function
* agent publish server implementation
* adding agent
2025-01-20 22:19:27 -08:00
Tom Crasset
c5f21b2b01
fix S3 per-user-directory Policy ( #6443 )
...
go: build dev binaries / cleanup (push) Has been cancelled
docker: build dev containers / build-dev-containers (push) Has been cancelled
End to End / FUSE Mount (push) Has been cancelled
go: build binary / Build (push) Has been cancelled
Ceph S3 tests / Ceph S3 tests (push) Has been cancelled
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Has been cancelled
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Has been cancelled
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Has been cancelled
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Has been cancelled
* fix S3 per-user-directory Policy
* Delete docker/config.json
* add tests
* remove logs
* undo modifications of weed/shell/command_volume_balance.go
* remove modifications of docker-compose
* fix failing test
---------
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com >
2025-01-17 01:03:17 -08:00
chrislu
ec155022e7
"golang.org/x/exp/slices" => "slices" and go fmt
2024-12-19 19:25:06 -08:00
zemul
e77e50886e
mount metacache add ttl ( #6360 )
...
* fix:mount deadlock
* fix
* feat: metaCache ttl
* Update weed/command/mount.go
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com >
* fix InodeEntry
---------
Co-authored-by: zemul <zhouzemiao@ihuman.com >
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com >
2024-12-16 20:19:32 -08:00
vadimartynov
914ff0e718
Replaced https.client.enabled with false in scaffold/security ( #6320 )
2024-12-05 10:39:28 -08:00
Konstantin Lebedev
b65eb2ec45
[security] reload whiteList on http seerver ( #6302 )
...
* reload whiteList
* white_list add to scaffold
2024-12-02 10:38:10 -08:00
Numblgw
aebf3952b7
filer sync: source path and exclude path support dir suffix ( #6268 )
...
filer sync: source path and exclude paht support dir suffix
Co-authored-by: liguowei <liguowei@xinye.com >
2024-11-21 08:25:12 -08:00
zemul
6d3e38f439
Adjust threshold config ( #6246 )
...
* fix:mount deadlock
* fix
---------
Co-authored-by: zemul <zhouzemiao@ihuman.com >
2024-11-17 20:51:26 -08:00
Max Denushev
a5fe6e21bc
feat(filer.backup): add ignore errors option ( #6235 )
...
* feat(filer.backup): add ignore errors option
* feat(filer.backup): fix 404 error wrap
* feat(filer.backup): fix wrapping function
* feat(filer.backup): fix wrapping errors in genProcessFunction
* Update weed/command/filer_backup.go
* Update weed/command/filer_backup.go
* Update weed/command/filer_backup.go
---------
Co-authored-by: Max Denushev <denushev@tochka.com >
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com >
2024-11-14 08:40:55 -08:00
chrislu
113c9ce6a8
remove the direct_io flag, as it is not well-supported on macOS
2024-11-07 14:18:59 -08:00
Chris Lu
dc784bf217
merge current message queue code changes ( #6201 )
...
* listing files to convert to parquet
* write parquet files
* save logs into parquet files
* pass by value
* compact logs into parquet format
* can skip existing files
* refactor
* refactor
* fix compilation
* when no partition found
* refactor
* add untested parquet file read
* rename package
* refactor
* rename files
* remove unused
* add merged log read func
* parquet wants to know the file size
* rewind by time
* pass in stop ts
* add stop ts
* adjust log
* minor
* adjust log
* skip .parquet files when reading message logs
* skip non message files
* Update subscriber_record.go
* send messages
* skip message data with only ts
* skip non log files
* update parquet-go package
* ensure a valid record type
* add new field to a record type
* Update read_parquet_to_log.go
* fix parquet file name generation
* separating reading parquet and logs
* add key field
* add skipped logs
* use in memory cache
* refactor
* refactor
* refactor
* refactor, and change compact log
* refactor
* rename
* refactor
* fix format
* prefix v to version directory
2024-11-04 12:08:25 -08:00
chrislu
6c7824c813
consistent sorted tags elastic,gocdk,rclone,sqlite,tikv,ydb
2024-10-21 22:53:29 -07:00
chrislu
804e765397
remove unused
go: build dev binaries / cleanup (push) Waiting to run
go: build dev binaries / build_dev_linux_windows (amd64, linux) (push) Blocked by required conditions
go: build dev binaries / build_dev_linux_windows (amd64, windows) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (amd64, darwin) (push) Blocked by required conditions
go: build dev binaries / build_dev_darwin (arm64, darwin) (push) Blocked by required conditions
docker: build dev containers / build-dev-containers (push) Waiting to run
End to End / FUSE Mount (push) Waiting to run
go: build binary / Build (push) Waiting to run
Ceph S3 tests / Ceph S3 tests (push) Waiting to run
2024-10-13 23:12:10 -07:00
Guang Jiong Lou
6c986e9d70
improve worm support ( #5983 )
...
* improve worm support
Signed-off-by: lou <alex1988@outlook.com >
* worm mode in filer
Signed-off-by: lou <alex1988@outlook.com >
* update after review
Signed-off-by: lou <alex1988@outlook.com >
* update after review
Signed-off-by: lou <alex1988@outlook.com >
* move to fs configure
Signed-off-by: lou <alex1988@outlook.com >
* remove flag
Signed-off-by: lou <alex1988@outlook.com >
* update after review
Signed-off-by: lou <alex1988@outlook.com >
* support worm hardlink
Signed-off-by: lou <alex1988@outlook.com >
* update after review
Signed-off-by: lou <alex1988@outlook.com >
* typo
Signed-off-by: lou <alex1988@outlook.com >
* sync filer conf
Signed-off-by: lou <alex1988@outlook.com >
---------
Signed-off-by: lou <alex1988@outlook.com >
2024-09-16 21:02:21 -07:00
zouyixiong
881c9a009e
[master] master missing start LoopPushingMetric routine fixed. ( #6018 )
2024-09-13 20:01:34 -07:00
chrislu
d660d5c7d4
increasing default cache size
2024-09-10 10:30:19 -07:00
chrislu
eb02946c97
support write once read many
...
fix https://github.com/seaweedfs/seaweedfs/issues/5954
2024-09-04 02:25:07 -07:00
chrislu
18afdb15b6
Revert "weed mount, weed dav add option to force cache"
...
This reverts commit 7367b976b0
2024-09-04 01:38:29 -07:00
chrislu
7367b976b0
weed mount, weed dav add option to force cache
2024-09-04 01:19:14 -07:00
chrislu
66ac82bb8f
default cacheDirWrite to cacheDir
2024-09-04 00:05:58 -07:00
Shaun Alexander
0d435f9da4
filer.remote.gateway not filer.remote.sync for filer.remote.gateway help string. ( #5935 )
2024-08-23 20:42:59 -07:00
chrislu
4463296811
add parallel vacuuming
2024-08-21 22:53:54 -07:00
chrislu
2074e7db67
fix invalid toml
2024-08-08 00:03:42 -07:00
qinguoyi
bf2366ba3a
Fix KeyMaterial nil bug ( #5849 )
2024-08-02 11:06:48 -07:00
qinguoyi
e88da0be1b
Fix KeyMaterial nil bug ( #5848 )
2024-08-02 09:47:11 -07:00
qinguoyi
606d0cba64
Fix extractToFile gz file nil bug ( #5847 )
2024-08-02 09:46:37 -07:00
qinguoyi
b74b506e52
add command backup destory volume error log ( #5846 )
2024-08-02 00:04:57 -07:00
chrislu
d49ecde535
rename functions
2024-08-01 23:27:23 -07:00
zuzuviewer
5ee50d26d8
fix CVE-2016-2183 ( #5844 )
...
* fix CVE-2016-2183
* allow tls.min_version and tls.max_version not set
2024-08-01 20:00:22 -07:00
Konstantin Lebedev
e1f9336688
[filer] fix panic filer on webdav.maxMB ( #5822 )
...
fix panic filer on webdav.maxMB
2024-07-27 13:40:22 -07:00
vadimartynov
86d92a42b4
Added tls for http clients ( #5766 )
...
* Added global http client
* Added Do func for global http client
* Changed the code to use the global http client
* Fix http client in volume uploader
* Fixed pkg name
* Fixed http util funcs
* Fixed http client for bench_filer_upload
* Fixed http client for stress_filer_upload
* Fixed http client for filer_server_handlers_proxy
* Fixed http client for command_fs_merge_volumes
* Fixed http client for command_fs_merge_volumes and command_volume_fsck
* Fixed http client for s3api_server
* Added init global client for main funcs
* Rename global_client to client
* Changed:
- fixed NewHttpClient;
- added CheckIsHttpsClientEnabled func
- updated security.toml in scaffold
* Reduce the visibility of some functions in the util/http/client pkg
* Added the loadSecurityConfig function
* Use util.LoadSecurityConfiguration() in NewHttpClient func
2024-07-16 23:14:09 -07:00
