lsm/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2025-11-08 22:16:13 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
11,832 Commits 51 Branches 316 Tags
aee1e5dcf1842fa555977353154666c56400b39f
Commit Graph

11832 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Konstantin Lebedev
fd4154cfed fix: s3 return BadDigest (#6714) 
* fix: s3 return BadDigest

* adjust error message checking

---------

Co-authored-by: chrislu <chris.lu@gmail.com>
 2025-07-06 14:18:57 -07:00
chrislu
798f797158 use float for sleep seconds 
fix https://github.com/seaweedfs/seaweedfs/pull/6795
 2025-07-06 14:16:41 -07:00
Chris Lu
9b7f3b78b7 enhance remote.cache to sync meta only, delete local extra (#6941) 2025-07-06 13:58:25 -07:00
Chris Lu
aa66852304 Admin UI add maintenance menu (#6944) 
* add ui for maintenance

* valid config loading. fix workers page.

* refactor

* grpc between admin and workers

* add a long-running bidirectional grpc call between admin and worker
* use the grpc call to heartbeat
* use the grpc call to communicate
* worker can remove the http client
* admin uses http port + 10000 as its default grpc port

* one task one package

* handles connection failures gracefully with exponential backoff

* grpc with insecure tls

* grpc with optional tls

* fix detecting tls

* change time config from nano seconds to seconds

* add tasks with 3 interfaces

* compiles reducing hard coded

* remove a couple of tasks

* remove hard coded references

* reduce hard coded values

* remove hard coded values

* remove hard coded from templ

* refactor maintenance package

* fix import cycle

* simplify

* simplify

* auto register

* auto register factory

* auto register task types

* self register types

* refactor

* simplify

* remove one task

* register ui

* lazy init executor factories

* use registered task types

* DefaultWorkerConfig remove hard coded task types

* remove more hard coded

* implement get maintenance task

* dynamic task configuration

* "System Settings" should only have system level settings

* adjust menu for tasks

* ensure menu not collapsed

* render job configuration well

* use templ for ui of task configuration

* fix ordering

* fix bugs

* saving duration in seconds

* use value and unit for duration

* Delete WORKER_REFACTORING_PLAN.md

* Delete maintenance.json

* Delete custom_worker_example.go

* remove address from workers

* remove old code from ec task

* remove creating collection button

* reconnect with exponential backoff

* worker use security.toml

* start admin server with tls info from security.toml

* fix "weed admin" cli description
 2025-07-06 13:57:02 -07:00
chrislu
302e62d480 link to volume details 2025-07-04 14:45:13 -07:00
chrislu
df30737505 adjust enterprise link 2025-07-04 14:44:38 -07:00
chrislu
fc55d2d8e0 link to volume detail page 2025-07-04 13:55:43 -07:00
chrislu
d8da465cd3 fix link to volume server; display volume space usage 2025-07-04 13:52:28 -07:00
chrislu
e85fbd29a1 refactor 2025-07-04 13:33:58 -07:00
chrislu
a5f48de7d6 add vacuum operation 2025-07-04 13:11:43 -07:00
chrislu
0c1d4b2d08 tweak ui 2025-07-04 12:56:28 -07:00
chrislu
84d4ea0995 show volume details 2025-07-04 12:49:34 -07:00
chrislu
2cfe079a1f weed admin: remove system health status 2025-07-02 23:57:36 -07:00
chrislu
e89941f390 weed admin: minor 2025-07-02 23:46:26 -07:00
chrislu
645b6d2603 weed admin: disk types card can also show all disk type values, not just a count. 2025-07-02 23:31:17 -07:00
chrislu
5e6d94319b weed admin: add version to volumes page 2025-07-02 23:28:00 -07:00
chrislu
ebb16f474c remove status fields 2025-07-02 23:17:27 -07:00
chrislu
40e3eae21f admin ui: filter by collection 2025-07-02 22:48:21 -07:00
chrislu
2268d2f55e add back dynamic columns 2025-07-02 22:06:06 -07:00
chrislu
1cac3e73f9 show counts for rack and disk type 2025-07-02 21:53:06 -07:00
Chris Lu
080dce80eb weed admin UI dynamically show columns (#6939) 
* show counts for rack and disk type

* dynamically display columns if more than one value

* adjust ui
 2025-07-02 21:49:37 -07:00
chrislu
ac82dd7c07 Delete admin 2025-07-02 19:35:02 -07:00
Konstantin Lebedev
93007c1842 [volume] refactor and add metrics for flight upload and download data limit condition (#6920) 
* refactor concurrentDownloadLimit

* fix loop

* fix cmdServer

* fix: resolve conversation pr 6920

* Changes logging function (#6919)

* updated logging methods for stores

* updated logging methods for stores

* updated logging methods for filer

* updated logging methods for uploader and http_util

* updated logging methods for weed server

---------

Co-authored-by: akosov <a.kosov@kryptonite.ru>

* Improve lock ring (#6921)

* fix flaky lock ring test

* add more tests

* fix: build

* fix: rm import util/version

* fix: serverOptions

* refactoring

---------

Co-authored-by: Aleksey Kosov <rusyak777@list.ru>
Co-authored-by: akosov <a.kosov@kryptonite.ru>
Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
Co-authored-by: chrislu <chris.lu@gmail.com>
 2025-07-02 18:03:49 -07:00
Chris Lu
1db7c2b8aa Add credential storage (#6938) 
* add credential store interface

* load credential.toml

* lint

* create credentialManager with explicit store type

* add type name

* InitializeCredentialManager

* remove unused functions

* fix missing import

* fix import

* fix nil configuration
 2025-07-02 18:03:17 -07:00
chrislu
6b706f9ccd rename files 
*_server.go - main server files
*_management.go - business logic
*_data.go - data structures and types
*_middleware.go - middleware logic
 2025-07-02 00:04:46 -07:00
chrislu
f47c4aef5a object store users 2025-07-02 00:00:23 -07:00
chrislu
4aec3c3fb9 purge unused 2025-07-01 23:16:48 -07:00
chrislu
76d773bf88 viewer, download, properties 2025-07-01 21:27:38 -07:00
chrislu
d4f4c04361 remove ttl for collections 2025-07-01 21:11:31 -07:00
chrislu
2f9321086f add version, add alpha, add link to enterprise version 2025-07-01 21:02:12 -07:00
chrislu
471910736d remove ttl from collections 2025-07-01 21:01:49 -07:00
chrislu
757c436a82 collection has multiple disk types 2025-07-01 20:27:42 -07:00
chrislu
b2849ec435 set uid gid 2025-07-01 20:03:50 -07:00
chrislu
ae1d0a82ce add bucket quota 2025-07-01 19:59:45 -07:00
chrislu
5c2b2e5513 clean up s3 bucket references 2025-07-01 08:41:53 -07:00
Chris Lu
1defee3d68 Add admin component (#6928) 
* init version

* relocate

* add s3 bucket link

* refactor handlers into weed/admin folder

* fix login logout

* adding favicon

* remove fall back to http get topology

* grpc dial option, disk total capacity

* show filer count

* fix each volume disk usage

* add filers to dashboard

* adding hosts, volumes, collections

* refactor code and menu

* remove "refresh" button

* fix data for collections

* rename cluster hosts into volume servers

* add masters, filers

* reorder

* adding file browser

* create folder and upload files

* add filer version, created at time

* remove mock data

* remove fields

* fix submenu item highlighting

* fix bucket creation

* purge files

* delete multiple

* fix bucket creation

* remove region from buckets

* add object store with buckets and users

* rendering permission

* refactor

* get bucket objects and size

* link to file browser

* add file size and count for collections page

* paginate the volumes

* fix possible SSRF

https://github.com/seaweedfs/seaweedfs/pull/6928/checks?check_run_id=45108469801

* Update weed/command/admin.go

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update weed/command/admin.go

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix build

* import

* remove filer CLI option

* remove filer option

* remove CLI options

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-07-01 01:28:09 -07:00
chrislu
e5adc3872a ensure deleted entries are deleted 
fix https://github.com/seaweedfs/seaweedfs/issues/6936
 2025-07-01 00:45:13 -07:00
chrislu
7ab3b19e37 remove unused import 2025-07-01 00:24:42 -07:00
dependabot[bot]
190bc7f75f chore(deps): bump google.golang.org/api from 0.238.0 to 0.239.0 (#6935) 
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.238.0 to 0.239.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.238.0...v0.239.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-version: 0.239.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-06-30 16:55:42 -07:00
dependabot[bot]
06326ea148 chore(deps): bump gocloud.dev/pubsub/natspubsub from 0.41.0 to 0.42.0 (#6933) 
Bumps [gocloud.dev/pubsub/natspubsub](https://github.com/google/go-cloud) from 0.41.0 to 0.42.0.
- [Release notes](https://github.com/google/go-cloud/releases)
- [Commits](https://github.com/google/go-cloud/compare/v0.41.0...v0.42.0)

---
updated-dependencies:
- dependency-name: gocloud.dev/pubsub/natspubsub
  dependency-version: 0.42.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-06-30 14:57:23 -07:00
dependabot[bot]
1e4dab9c5c chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.81.0 to 1.82.0 (#6934) 
chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3

Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2) from 1.81.0 to 1.82.0.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/service/s3/v1.81.0...service/s3/v1.82.0)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/service/s3
  dependency-version: 1.82.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-06-30 14:57:17 -07:00
dependabot[bot]
ec4ef30483 chore(deps): bump actions/setup-go from 4 to 5 (#6931) 
Bumps [actions/setup-go](https://github.com/actions/setup-go) from 4 to 5.
- [Release notes](https://github.com/actions/setup-go/releases)
- [Commits](https://github.com/actions/setup-go/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/setup-go
  dependency-version: '5'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-06-30 14:56:54 -07:00
dependabot[bot]
73112191e2 chore(deps): bump github.com/rclone/rclone from 1.70.1 to 1.70.2 (#6930) 
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone) from 1.70.1 to 1.70.2.
- [Release notes](https://github.com/rclone/rclone/releases)
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md)
- [Commits](https://github.com/rclone/rclone/compare/v1.70.1...v1.70.2)

---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
  dependency-version: 1.70.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-06-30 14:56:45 -07:00
dependabot[bot]
f2033e39bc chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.111.0 to 3.111.3 (#6929) 
chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3

Bumps [github.com/ydb-platform/ydb-go-sdk/v3](https://github.com/ydb-platform/ydb-go-sdk) from 3.111.0 to 3.111.3.
- [Release notes](https://github.com/ydb-platform/ydb-go-sdk/releases)
- [Changelog](https://github.com/ydb-platform/ydb-go-sdk/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ydb-platform/ydb-go-sdk/compare/v3.111.0...v3.111.3)

---
updated-dependencies:
- dependency-name: github.com/ydb-platform/ydb-go-sdk/v3
  dependency-version: 3.111.3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-06-30 14:56:32 -07:00
chrislu
060ee1b9d5 fix tests 2025-06-30 13:57:28 -07:00
chrislu
2d0d429d2f fix disk space calculation 2025-06-30 10:11:30 -07:00
chrislu
3023a6f3a4 update doc 2025-06-28 20:27:26 -07:00
chrislu
a788d9ab53 remove unnecessary code 2025-06-28 20:26:46 -07:00
chrislu
3d519fa2a6 only leader master should send telemetry 2025-06-28 20:06:48 -07:00
chrislu
1733d0ce68 remove features and deployments fields 2025-06-28 20:03:06 -07:00