Chris Lu dc784bf217 merge current message queue code changes (#6201) ...

* listing files to convert to parquet

* write parquet files

* save logs into parquet files

* pass by value

* compact logs into parquet format

* can skip existing files

* refactor

* refactor

* fix compilation

* when no partition found

* refactor

* add untested parquet file read

* rename package

* refactor

* rename files

* remove unused

* add merged log read func

* parquet wants to know the file size

* rewind by time

* pass in stop ts

* add stop ts

* adjust log

* minor

* adjust log

* skip .parquet files when reading message logs

* skip non message files

* Update subscriber_record.go

* send messages

* skip message data with only ts

* skip non log files

* update parquet-go package

* ensure a valid record type

* add new field to a record type

* Update read_parquet_to_log.go

* fix parquet file name generation

* separating reading parquet and logs

* add key field

* add skipped logs

* use in memory cache

* refactor

* refactor

* refactor

* refactor, and change compact log

* refactor

* rename

* refactor

* fix format

* prefix v to version directory

2024-11-04 12:08:25 -08:00

..

abstract_sql

check bucket name in sql backend

2024-06-25 08:54:19 -07:00

arangodb

refactor filer_pb.Entry and filer.Entry to use GetChunks()

2022-11-15 06:33:36 -08:00

cassandra

changing FindEntry error handling in cassandra store (#6015)

2024-09-13 06:53:04 -07:00

elastic/v7

bug fixed to filer store elastic deleteEntry (#5988)

2024-09-09 02:15:25 -07:00

etcd

Move ListDirectoryEntries logic to ListDirectoryPrefixedEntries in etcd meta storage backend (#5416)

2024-03-24 14:08:54 -07:00

hbase

refactor filer_pb.Entry and filer.Entry to use GetChunks()

2022-11-15 06:33:36 -08:00

leveldb

adjust logging

2024-09-10 10:28:49 -07:00

leveldb2

optionally open the leveldb in readonly mode

2024-06-25 21:07:04 -07:00

leveldb3

optionally open the leveldb in readonly mode

2024-06-25 21:07:04 -07:00

mongodb

Feature/mongodb security (#5602)

2024-05-18 12:19:10 -07:00

mysql

chore: add dsn for connection to mysql (#5060)

2023-12-20 16:20:58 -08:00

mysql2

print only adapted url

2024-03-25 12:50:43 -07:00

postgres

print only adapted url

2024-03-25 12:50:43 -07:00

postgres2

print only adapted url

2024-03-25 12:50:43 -07:00

redis

upgrade to github.com/redis/go-redis/v9

2024-07-11 00:15:19 -07:00

redis2

upgrade to github.com/redis/go-redis/v9

2024-07-11 00:15:19 -07:00

redis3

fix test

2024-07-11 07:53:02 -07:00

redis_lua

upgrade to github.com/redis/go-redis/v9

2024-07-11 00:15:19 -07:00

rocksdb

fix: disallow file name too long when writing a file (#4881)

2023-10-12 14:29:55 -07:00

sqlite

serialize sqlite operations

2022-10-12 00:03:27 -07:00

store_test

move to https://github.com/seaweedfs/seaweedfs

2022-07-29 00:17:28 -07:00

tikv

Fix: issues #4950 (#4952)

2023-10-25 22:09:39 -07:00

ydb

chore(deps): bump github.com/ydb-platform/ydb-go-sdk-auth-environ from 0.2.0 to 0.4.2 (#5621)

2024-05-27 12:36:00 -07:00

configuration.go

add notes for full version

2023-01-04 09:52:25 -08:00

entry_codec.go

also migrate jsonpb

2022-08-17 12:42:03 -07:00

entry.go

refactor filer_pb.Entry and filer.Entry to use GetChunks()

2022-11-15 06:33:36 -08:00

filechunk_group_test.go

more solid weed mount (#4089)

2023-01-02 23:20:45 -08:00

filechunk_group.go

fix invalid file read (#6024)

2024-09-16 08:45:50 -07:00

filechunk_manifest_test.go

move to https://github.com/seaweedfs/seaweedfs

2022-07-29 00:17:28 -07:00

filechunk_manifest.go

Added tls for http clients (#5766)

2024-07-16 23:14:09 -07:00

filechunk_section_test.go

merge chunks during upload (#4130)

2023-01-12 23:07:36 -08:00

filechunk_section.go

Mount concurrent read (#4400)

2023-04-13 22:32:45 -07:00

filechunks2_test.go

Revert "Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs""

2023-09-25 09:35:16 -07:00

filechunks_read_test.go

more solid weed mount (#4089)

2023-01-02 23:20:45 -08:00

filechunks_read.go

fix when two consecutive chunks with the same modified_ts_ns

2024-02-04 09:22:24 -08:00

filechunks_test.go

fix when two consecutive chunks with the same modified_ts_ns

2024-02-04 09:22:24 -08:00

filechunks.go

refactor

2023-01-10 00:46:46 -08:00

filer_buckets.go

filer: remove replication, collection, disk_type info from entry metadata

2022-06-06 00:39:35 -07:00

filer_conf_test.go

move to https://github.com/seaweedfs/seaweedfs

2022-07-29 00:17:28 -07:00

filer_conf.go

improve worm support (#5983)

2024-09-16 21:02:21 -07:00

filer_delete_entry.go

conditional delete

2024-08-01 13:00:54 -07:00

filer_deletion.go

rename functions

2024-08-01 23:27:23 -07:00

filer_hardlink.go

move to https://github.com/seaweedfs/seaweedfs

2022-07-29 00:17:28 -07:00

filer_notify_append.go

Added tls for http clients (#5766)

2024-07-16 23:14:09 -07:00

filer_notify_read.go

Fix 6181/6182 (#6183)

2024-10-31 08:40:05 -07:00

filer_notify_test.go

refactor filer_pb.Entry and filer.Entry to use GetChunks()

2022-11-15 06:33:36 -08:00

filer_notify.go

Squashed commit of the following:

2024-07-11 00:04:24 -07:00

filer_on_meta_event.go

refactor filer_pb.Entry and filer.Entry to use GetChunks()

2022-11-15 06:33:36 -08:00

filer_rename.go

Fix: http rename move dir to subdir (#4432)

2023-04-26 20:54:36 -07:00

filer_search.go

move to https://github.com/seaweedfs/seaweedfs

2022-07-29 00:17:28 -07:00

filer.go

bootstrap filer from one peer

2024-06-28 14:57:20 -07:00

filerstore_hardlink.go

move to https://github.com/seaweedfs/seaweedfs

2022-07-29 00:17:28 -07:00

filerstore_translate_path.go

move to https://github.com/seaweedfs/seaweedfs

2022-07-29 00:17:28 -07:00

filerstore_wrapper.go

[filer] avoid 500 if table doesn't exist (#6075)

2024-09-27 07:15:54 -07:00

filerstore.go

move to https://github.com/seaweedfs/seaweedfs

2022-07-29 00:17:28 -07:00

interval_list_test.go

more solid weed mount (#4089)

2023-01-02 23:20:45 -08:00

interval_list.go

Mount concurrent read (#4400)

2023-04-13 22:32:45 -07:00

meta_aggregator.go

refactor

2024-04-02 16:25:43 -07:00

meta_replay.go

ParallelProcessDirectoryStructure

2024-06-28 15:02:46 -07:00

read_remote.go

refactor filer_pb.Entry and filer.Entry to use GetChunks()

2022-11-15 06:33:36 -08:00

read_write.go

refactor filer_pb.Entry and filer.Entry to use GetChunks()

2022-11-15 06:33:36 -08:00

reader_at_test.go

Feature limit caching to prescribed number of bytes per file (#6009)

2024-09-11 21:09:20 -07:00

reader_at.go

merge current message queue code changes (#6201)

2024-11-04 12:08:25 -08:00

reader_cache.go

fix file read crash (#6021)

2024-09-14 08:33:35 -07:00

reader_pattern.go

Fix a few data races when reading files in mount (#3527)

2022-08-26 16:41:37 -07:00

remote_mapping.go

Remote gateway Bug fix (#5100)

2023-12-12 07:46:45 -08:00

remote_storage_test.go

move to https://github.com/seaweedfs/seaweedfs

2022-07-29 00:17:28 -07:00

remote_storage.go

chore(deps): bump github.com/viant/ptrie from 0.3.1 to 1.0.1 (#5552)

2024-04-29 18:42:31 -07:00

s3iam_conf_test.go

s3: fix configuring IAM for the same user

2022-08-30 09:37:52 -07:00

s3iam_conf.go

associate Account and Identity by accountId (#3754)

2022-09-28 13:25:59 -07:00

stream.go

Added tls for http clients (#5766)

2024-07-16 23:14:09 -07:00

topics.go

merge current message queue code changes (#6201)

2024-11-04 12:08:25 -08:00