130 Commits

Author	SHA1	Message	Date
Chris Lu	b1daede91b	move volume vacuum to gRpc	2018-10-14 23:12:43 -07:00
Chris Lu	556382ff5f	adding basic grpc to volume server	2018-10-11 01:16:33 -07:00
Chris Lu	08266b7256	go fmt	2018-10-11 00:08:13 -07:00
Chris Lu	1d7e01b754	reformat	2018-10-11 00:05:54 -07:00
Chris Lu	da6154b29c	refactor volume server to startVolumeServer()	2018-10-11 00:04:31 -07:00
Chris Lu	60d2f1557d	refactor func name	2018-10-10 23:19:54 -07:00
Chris Lu	9f4c2f87d3	adding filer replication sink to Azure	2018-10-09 01:35:48 -07:00
Chris Lu	96a23591e7	remove comments	2018-10-07 22:21:00 -07:00
Chris Lu	a5b5887efc	add filer replication to aws s3	2018-10-06 17:10:15 -07:00
Chris Lu	84d4a2c8a0	add filer replication to google cloud storage	2018-10-06 13:08:38 -07:00
Chris Lu	14858f6224	add logging	2018-10-06 13:01:38 -07:00
Chris Lu	56c5c7b1b6	add google cloud storage	2018-10-04 01:14:44 -07:00
Chris Lu	e8ef501f02	add s3 replication sink	2018-10-03 23:36:52 -07:00
Chris Lu	98384b62fd	adjust description	2018-09-28 01:58:34 -07:00
Chris Lu	12ba8b9799	generate useable filer.toml	2018-09-23 09:26:25 -07:00
Chris Lu	b16d47030e	save and use last processed kafka offsets	2018-09-23 01:34:40 -07:00
Chris Lu	9fe24991d5	refactoring	2018-09-23 00:40:36 -07:00
Chris Lu	7d6b2a4740	add ETag to upload results and chunks	2018-09-22 22:12:21 -07:00
Chris Lu	420f068376	add more instructions	2018-09-22 22:12:06 -07:00
Chris Lu	01ceace18e	adjust sink options	2018-09-22 00:53:52 -07:00
Chris Lu	402ab598b6	go fmt	2018-09-22 00:12:10 -07:00
Chris Lu	7bb62b9f21	delay file creation without chunks from dir.Create to file.Flush	2018-09-22 00:11:46 -07:00
Chris Lu	db69ce89f0	go fmt	2018-09-21 01:56:43 -07:00
Chris Lu	a6cfaba018	able to sync the changes	2018-09-21 01:54:29 -07:00
Chris Lu	a8cd7df44a	let filer choose default replication	2018-09-20 09:00:15 -07:00
Chris Lu	d5149e592e	add logging on kafka reading	2018-09-19 22:31:45 -07:00
Chris Lu	25fb6f9a46	fix compilation	2018-09-17 02:23:21 -07:00
Chris Lu	779641e9d4	adjust replicated entry name	2018-09-17 01:37:24 -07:00
Chris Lu	b7a375f5aa	set large limit for "weed filer.export" directory listing	2018-09-17 00:42:36 -07:00
Chris Lu	4e1f1a0b92	set large limit for "weed mount" directory listing	2018-09-17 00:41:33 -07:00
Chris Lu	788acdf527	add WIP filer.replicate	2018-09-17 00:27:56 -07:00
Chris Lu	7ad5a90127	go fmt	2018-09-03 16:47:00 -07:00
Chris Lu	6e3f4d1079	add working filer.export command	2018-08-23 00:02:04 -07:00
Chris Lu	98b8f8649d	adding filer.export prototype	2018-08-22 23:54:22 -07:00
Chris Lu	ae4e654d2a	add example configuration for default redis create-cluster setup	2018-08-22 18:23:19 -07:00
Chris Lu	748870b03f	add "weed scaffold" command	2018-08-19 15:36:30 -07:00
Chris Lu	f827ada811	merge notification config with filer.toml	2018-08-19 15:17:55 -07:00
Chris Lu	f036ef8a3c	add filer notification	2018-08-13 01:20:49 -07:00
Chris Lu	75d63db60d	randomize raft server startup ... also some go fmt	2018-08-12 14:27:14 -07:00
Chris Lu	eca4b928d2	ensure master server count is odd	2018-08-12 14:25:31 -07:00
Chris Lu	2e427c66ac	small refactoring	2018-08-10 23:47:17 -07:00
Chris Lu	44d8e35988	add listener for volumd id location for benchmark tool	2018-07-31 19:12:36 -07:00
Chris Lu	d09606c65b	refactoring	2018-07-29 02:25:24 -07:00
Chris Lu	4f317c7e3d	working version3	2018-07-24 01:36:04 -07:00
Chris Lu	7f32eb1e25	s3 add https support	2018-07-22 21:28:54 -07:00
Chris Lu	056871242b	remove println	2018-07-22 01:17:49 -07:00
Chris Lu	0655151b8c	go fmt	2018-07-22 01:15:11 -07:00
Chris Lu	6319d84f42	s3 API add ListObjectsV1	2018-07-22 01:14:36 -07:00
Chris Lu	922c614bde	fix compilation problem	2018-07-21 20:42:14 -07:00
Chris Lu	16c66e097b	adjust default buckets folder	2018-07-21 20:29:33 -07:00