8470 Commits

Author	SHA1	Message	Date
Haojun Liao	a5c8eaacaa	fix(tsdb):clear the tsdb stt file reader flag when suspending the tsdbReader	2023-11-28 23:52:19 +08:00
shenglian zhou	5a75d74421	fix:mem table has data in the fileset duration	2023-11-28 15:58:33 +08:00
slzhou	4fb0f83f07	fix: core dump without resetTableListIndex	2023-11-28 14:50:50 +08:00
shenglian zhou	89cd2b6f17	enhance: tsdb output duration order	2023-11-28 14:39:08 +08:00
yihaoDeng	08eeee0794	Merge branch '3.0' into enh/refactorBackend	2023-11-28 11:52:49 +08:00
shenglian zhou	cdb7eb462d	Revert "Revert "fix: pass compilation"" ... This reverts commit 644dbad920.	2023-11-28 10:31:18 +08:00
shenglian zhou	df4f7d6956	Revert "Revert "enhance: duration notification"" ... This reverts commit 3331e25aaf.	2023-11-28 10:31:18 +08:00
shenglian zhou	3331e25aaf	Revert "enhance: duration notification" ... This reverts commit 9dd306e1ef.	2023-11-28 08:29:05 +08:00
shenglian zhou	644dbad920	Revert "fix: pass compilation" ... This reverts commit 1a7ee3643e.	2023-11-28 08:28:49 +08:00
yihaoDeng	a4d475b582	fix rsma	2023-11-27 20:27:53 +08:00
wangmm0220	06e2fbfb1c	fix:conflicts from 3.0	2023-11-27 17:53:53 +08:00
wangmm0220	70c5d36103	opti:extract common logic from snode & vnode to tqCommon	2023-11-27 17:49:09 +08:00
yihaoDeng	e9bec34c44	Merge branch '3.0' into enh/refactorBackend	2023-11-27 10:01:12 +08:00
dapan1121	d3ac79aeb7	Merge pull request #23808 from taosdata/fix/PI-23-3.0 ... fix: add check in mnode/vnode when alter table col/tag	2023-11-26 17:31:38 +08:00
Haojun Liao	9194c0c0cd	fix(stream): add logs.	2023-11-25 00:56:18 +08:00
Haojun Liao	30c776cc0a	fix(stream): reset the scheduler status.	2023-11-25 00:54:32 +08:00
Haojun Liao	d5e123db78	Merge pull request #23791 from taosdata/fix/3_liaohj ... refactor: do some internal refactor.	2023-11-24 14:42:43 +08:00
Hongze Cheng	24932d2d41	Merge pull request #23799 from taosdata/fix/TD-27423 ... fix(tsdb/skip-row): remove s3 size condition	2023-11-24 10:48:03 +08:00
Minglei Jin	b1841ee97b	tsdb/reader-writer: fix pgno iteration with cache setting	2023-11-24 09:06:43 +08:00
kailixu	ac47d3ea7d	enh: more check for column bytes	2023-11-24 06:51:57 +08:00
kailixu	c4f1babdcf	enh: naming optimize	2023-11-24 06:42:30 +08:00
kailixu	dc977ca200	fix: stash drop column	2023-11-23 23:09:49 +08:00
kailixu	9ce28483a0	fix: add check in mnode/vnode when alter table col/tag	2023-11-23 21:22:41 +08:00
wangmm0220	d249892b2a	fix:conflicts from 3.0	2023-11-23 20:29:46 +08:00
yihaoDeng	6129ebc294	Merge branch '3.0' into enh/refactorBackend	2023-11-23 17:41:37 +08:00
Minglei Jin	3c3763a774	tsdb/read-by-column: fix last column index	2023-11-23 17:30:49 +08:00
Minglei Jin	9334fbcb06	tsdb/read-by-column: zero hint size when i's nonzero	2023-11-23 17:14:26 +08:00
Benguang Zhao	f7f9546d1e	enh: trigger vnode commit at exit if meta changed, for dbs of single replica	2023-11-23 16:32:57 +08:00
Minglei Jin	3034ca2875	tsdb/open-file: log not exist file path	2023-11-23 16:25:39 +08:00
Minglei Jin	f076bfdfca	fix(tsdb/skip-row): remove s3 size condition	2023-11-23 16:19:26 +08:00
Minglei Jin	460638d294	enh(tsdb/open-file): new s3 failed to connect error code	2023-11-23 16:09:02 +08:00
Minglei Jin	c6721be112	fix stt read compilation	2023-11-23 15:49:42 +08:00
Haojun Liao	0a90c33b4d	fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting.	2023-11-23 15:49:07 +08:00
Minglei Jin	08e5525012	tsdb/read-file-page: new arg for hint size	2023-11-23 15:37:26 +08:00
Minglei Jin	023821a80b	enh(tsdb/read-by-column): calc hint size for preloading	2023-11-23 15:16:36 +08:00
yihaoDeng	6a0501967d	Merge branch '3.0' into fix/fixChkpRespMemleak	2023-11-23 14:06:04 +08:00
Haojun Liao	8ad071e69a	other: merge main.	2023-11-23 10:25:51 +08:00
Haojun Liao	f3355000a3	refactor: do some internal refactor.	2023-11-23 09:34:20 +08:00
Haojun Liao	3edb25a49e	fix(stream): add check for assert.	2023-11-23 09:33:40 +08:00
Haojun Liao	7b1f586d4f	Merge pull request #23762 from taosdata/fix/3_liaohj ... fix(stream): fix error in generating token in bucket.	2023-11-23 09:32:14 +08:00
wangmm0220	15d75a0497	fix:spelling errors	2023-11-23 09:17:54 +08:00
Hongze Cheng	44866b7b12	fix: possible race condition coredump	2023-11-22 20:35:18 +08:00
wangmm0220	cfab06239b	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060	2023-11-22 19:37:44 +08:00
wangmm0220	9a09e318ca	opti:common message process logic in vnode and snode	2023-11-22 16:53:33 +08:00
Haojun Liao	91e7000433	Merge branch 'enh/refactorBackend' of github.com:taosdata/tdengine into enh/refactorBackend	2023-11-22 15:29:31 +08:00
Haojun Liao	c96f7cf182	fix(stream): scheduler the checkpoint generating.	2023-11-22 15:17:21 +08:00
slzhou	1a7ee3643e	fix: pass compilation	2023-11-22 14:09:09 +08:00
shenglian zhou	9dd306e1ef	enhance: duration notification	2023-11-22 13:56:16 +08:00
dapan1121	1b6a3c2069	Merge pull request #23771 from taosdata/enh/xsren/TD-27022/windows ... Enh/xsren/td 27022/windows	2023-11-22 10:58:39 +08:00
yihaoDeng	0eba15b4a4	Merge branch '3.0' into enh/refactorBackend	2023-11-22 10:57:41 +08:00
yihaoDeng	0c0d9cdd2c	Merge branch '3.0' into fix/fixChkpRespMemleak	2023-11-22 10:42:30 +08:00
Haojun Liao	b712f5e7dc	refactor: do some internal refactor.	2023-11-22 08:41:17 +08:00
Haojun Liao	7a0dfdb0cc	fix(tsdb): fix invalid read.	2023-11-22 08:40:10 +08:00
yihaoDeng	947775155b	fix transfer crash	2023-11-21 20:51:11 +08:00
Haojun Liao	785d91c17b	Merge pull request #23661 from taosdata/feat/TD-26060 ... fix: errors in snode in conditions like fill history/checkpoint/restart	2023-11-21 19:02:38 +08:00
facetosea	845493294d	osfile	2023-11-21 16:31:31 +08:00
yihaoDeng	a92602b667	fix mem leak	2023-11-21 15:23:28 +08:00
Haojun Liao	2b099b11dd	refactor: do some internal refactor.	2023-11-21 10:09:59 +08:00
yihaoDeng	939aa7a3cc	Merge branch '3.0' into enh/refactorBackend	2023-11-20 17:33:30 +08:00
Minglei Jin	d12bc41236	tsdb/merge: clear file set before return 0	2023-11-20 14:30:25 +08:00
Haojun Liao	1b4f187ded	Merge pull request #23743 from taosdata/fix/pause_stream ... fix(stream): remove invalid assert	2023-11-17 23:48:47 +08:00
Haojun Liao	709502ba9e	fix(stream): record the check downstream failure.	2023-11-17 22:05:36 +08:00
wangmm0220	3241f9bda5	fix:memory leak	2023-11-17 17:26:52 +08:00
yihaoDeng	20de2f3cb5	Merge branch '3.0' into enh/refactorBackend	2023-11-17 17:15:14 +08:00
Haojun Liao	0fac706fa6	Merge pull request #23732 from taosdata/fix/pause_stream ... fix(stream): add check for assert.	2023-11-17 11:33:19 +08:00
Haojun Liao	2a1a7c82e2	Merge branch '3.0' into fix/3_liaohj	2023-11-17 10:17:14 +08:00
Haojun Liao	8fe79685a2	fix(stream): add check for assert.	2023-11-16 23:45:38 +08:00
Haojun Liao	c070e79d36	fix(stream): add check for assert.	2023-11-16 23:18:07 +08:00
wangmm0220	a5de1b032b	fix:snode upport stream task	2023-11-16 21:19:58 +08:00
Minglei Jin	65a27dd9c8	fix(tsdb/cos-merge): skip stt merging & not block commit	2023-11-16 18:58:58 +08:00
dapan1121	dc71252096	Merge remote-tracking branch 'origin/3.0' into merge/32m	2023-11-15 19:43:19 +08:00
wangmm0220	a16189d2a9	fix:confilct from 3.0	2023-11-15 19:14:27 +08:00
wangmm0220	45782f278b	fix:send update msg to vnodes if snode restart	2023-11-15 18:13:35 +08:00
Haojun Liao	9d2256ec9c	refactor: do some internal refactor.	2023-11-15 16:03:23 +08:00
Haojun Liao	2ca663ce66	Merge pull request #23593 from taosdata/feat/TD-21898 ... stream event window	2023-11-15 14:18:07 +08:00
dapan1121	9457cf0b46	Merge pull request #23702 from taosdata/merge/m23 ... merge: from main to 3.0	2023-11-15 13:54:21 +08:00
Hongze Cheng	082ddbddf6	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229	2023-11-15 13:41:28 +08:00
Hongze Cheng	8050d73202	first version	2023-11-15 13:41:00 +08:00
Haojun Liao	86f2673849	Merge pull request #23703 from taosdata/fix/drop_stream ... fix(tsdb): fix invalid read.	2023-11-15 13:35:46 +08:00
dapan1121	dfb3feb5dc	Merge remote-tracking branch 'origin/main' into merge/m23	2023-11-15 11:39:18 +08:00
Haojun Liao	f1b1b8911b	fix(tsdb): fix invalid read.	2023-11-15 11:26:43 +08:00
wade zhang	d800d59bf0	Merge pull request #23693 from taosdata/FIX/TD-27303-3.0 ... TD-27303	2023-11-15 11:22:47 +08:00
Haojun Liao	62c7877176	fix(tsdb): fix invalid read.	2023-11-15 11:13:06 +08:00
Hongze Cheng	ed6be3b8c5	Merge pull request #23695 from taosdata/fix/TD-27313 ... fix(cos/list): free object array in exception	2023-11-15 11:09:38 +08:00
Minglei Jin	7f65e92b81	tsdb/retention: not allow migrate backward	2023-11-14 19:27:18 +08:00
dmchen	d8277d5505	TD-27303	2023-11-14 19:18:06 +08:00
dmchen	056993b519	TD-27303	2023-11-14 11:10:22 +00:00
yihaoDeng	f4d6cf7c74	Merge branch '3.0' into enh/refactorBackend	2023-11-14 18:12:48 +08:00
Hongze Cheng	f7e63ad1ca	Merge pull request #23680 from taosdata/fix/TD-27273 ... fix(tsdb/merge): skip merge if data file cannot be written	2023-11-14 16:08:12 +08:00
Minglei Jin	cb3fe4d6de	fix(tsdb/merge): skip merge if data file cannot be written	2023-11-14 14:15:02 +08:00
Haojun Liao	436c7871a3	Merge pull request #23673 from taosdata/fix/3_liaohj ... fix(stream): fix deadlock and do some internal refactor.	2023-11-14 11:26:54 +08:00
Haojun Liao	f99e22b91f	fix(stream): fix deadlock.	2023-11-13 23:56:42 +08:00
Haojun Liao	cfa7c19dd5	Merge pull request #23667 from taosdata/fix/liaohj ... fix(stream): fix deadlock.	2023-11-13 22:15:06 +08:00
Haojun Liao	aad8a2eb87	fix(stream): fix deadlock.	2023-11-13 18:20:30 +08:00
Minglei Jin	acd816a364	fix(tsdb/retention): move fset destruction out of for loop	2023-11-13 16:59:26 +08:00
liuyao	37c102a115	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-11-13 16:06:17 +08:00
yihaoDeng	de7f2a2d1a	Merge branch '3.0' into enh/refactorBackend	2023-11-13 11:11:28 +08:00
wade zhang	8e5de50050	Merge pull request #23641 from taosdata/FIX/TS-4249-3.0 ... TS-4249	2023-11-13 10:03:03 +08:00
dapan1121	a51df86e43	Merge pull request #23636 from taosdata/enh/TD-25601-3.0 ... enh: support delete msg for rsma	2023-11-13 08:47:42 +08:00
Haojun Liao	9ee9174608	other: merge 3.0	2023-11-11 15:48:31 +08:00
Haojun Liao	8925c721e5	fix(stream): adjust critical section.	2023-11-11 15:40:16 +08:00
Haojun Liao	5937bdddf5	refactor:disable test.	2023-11-11 15:40:12 +08:00
Haojun Liao	cb0d244d5a	fix(stream): release lock.	2023-11-11 15:40:11 +08:00
Haojun Liao	af08a189c1	fix(stream): disable concurrently restart stream tasks.	2023-11-11 15:40:10 +08:00
Haojun Liao	4d9b422874	fix(stream): check for the repeatedly sent checkpoint-source msg.	2023-11-11 15:40:10 +08:00
Haojun Liao	45ab92a02d	fix(stream): remove invalid free.	2023-11-11 15:39:55 +08:00
Haojun Liao	77d6fd5394	refactor: do some internal refactor.	2023-11-11 15:39:09 +08:00
Haojun Liao	608c72e901	refactor(stream): create sim env for stream processing.	2023-11-11 15:39:08 +08:00
Cary Xu	1c2e9c18d5	Update tqSink.c	2023-11-10 22:01:28 +08:00
kailixu	3707857c12	chore: remove obsolete code	2023-11-10 18:43:23 +08:00
kailixu	42e4e2b7a4	fix: macro define	2023-11-10 18:27:42 +08:00
kailixu	9017e2ed68	chore: code optimization	2023-11-10 18:11:06 +08:00
kailixu	c04fb6d543	enh: logic optimization	2023-11-10 17:23:17 +08:00
kailixu	bc44659826	fix: buffer overflow	2023-11-10 17:14:57 +08:00
kailixu	11c0427b22	enh: test case to delete mutiple tables	2023-11-10 16:41:41 +08:00
dmchen	65870ae117	TS-4249	2023-11-10 16:29:59 +08:00
dmchen	22d6204fa9	TS-4249	2023-11-10 08:23:09 +00:00
kailixu	d5d8568bad	fix: skip delete msg affects 0 row	2023-11-10 15:30:49 +08:00
kailixu	b1bca4e1e2	fix: batch delete logic	2023-11-10 15:12:10 +08:00
kailixu	5fae10bc76	enh: error code when build delete req	2023-11-10 15:09:01 +08:00
kailixu	2a14a10d0d	Merge branch '3.0' into enh/TD-25601-3.0	2023-11-10 14:45:45 +08:00
kailixu	674e878ffa	enh: rsma support delete	2023-11-10 14:44:29 +08:00
Haojun Liao	5824caa8f5	Merge pull request #23631 from taosdata/fix/liaohj ... multiple fix	2023-11-10 13:09:40 +08:00
Minglei Jin	32528ab9cd	fix(tsdb/reader-writer): fix pgnoEnd calc	2023-11-10 12:44:09 +08:00
wade zhang	b5b15f36f2	Merge pull request #23627 from taosdata/FIX/TD-27243-3.0 ... fix/TD-27243	2023-11-10 11:05:33 +08:00
Haojun Liao	233777b6ac	fix(stream): adjust critical section.	2023-11-10 10:26:45 +08:00
Haojun Liao	d8ab8d2d03	refactor:disable test.	2023-11-10 09:46:20 +08:00
Haojun Liao	ed49294e9b	fix(stream): release lock.	2023-11-10 09:35:41 +08:00
Haojun Liao	9978667c48	fix(stream): disable concurrently restart stream tasks.	2023-11-10 09:24:08 +08:00
liuyao	6d2d5823dc	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-11-10 09:24:05 +08:00
yihaoDeng	3e2314b09b	Merge branch '3.0' into enh/refactorBackend	2023-11-10 09:22:16 +08:00
kailixu	ee6e68a71e	enh: rsma support delete	2023-11-10 07:02:46 +08:00
Haojun Liao	730434ed82	fix(stream): check for the repeatedly sent checkpoint-source msg.	2023-11-09 23:26:09 +08:00
kailixu	7288b0fc77	enh: rsma delete error code	2023-11-09 20:16:29 +08:00
kailixu	ff3621f382	enh: rsma delete logic	2023-11-09 20:09:39 +08:00
Hongze Cheng	ec3685db94	Merge pull request #23600 from taosdata/fix/TD-27206 ... fix(vnode/cos): fix error printing to avoid buffer overflow	2023-11-09 06:06:54 -06:00
kailixu	572eb691fb	enh: support delete msg for rsma	2023-11-09 19:51:01 +08:00
dapan1121	4f67629ea1	Merge pull request #23621 from taosdata/fix/TS-4122 ... correct colid in blockinfo	2023-11-09 18:09:09 +08:00
dmchen	2fbf0a532d	fix/TD-27243	2023-11-09 18:02:06 +08:00
yihaoDeng	757425bff8	Merge branch '3.0' into enh/refactorBackend	2023-11-09 17:58:49 +08:00
dmchen	65bebb0912	fix/TD-27243	2023-11-09 09:51:35 +00:00
Minglei Jin	d3cf6a4340	tsdb/file: new nlevel field for remove	2023-11-09 17:44:24 +08:00
Hongze Cheng	b1fbdfcdc9	Merge pull request #23617 from taosdata/fix/little_typo ... fix: code typo	2023-11-09 03:35:31 -06:00
wade zhang	c0c665d785	Merge pull request #23614 from taosdata/FIX/TD-27230-3.0 ... fix: close vnode in the failed mode properly in vmCloseVnode	2023-11-09 16:32:20 +08:00
wangjiaming0909	a6600ab23a	correct colid in blockinfo	2023-11-09 15:41:01 +08:00
Minglei Jin	386c25a99a	tsdb/retention: remove file when ref's clear	2023-11-09 15:24:19 +08:00
kailixu	9cf154543f	chore: merge 3.0	2023-11-09 15:09:30 +08:00
kailixu	aa3ba74f6e	chore: code optimization	2023-11-09 15:03:14 +08:00
dapan1121	8314cb6013	Merge pull request #23494 from taosdata/enh/TD-23769-3.0x ... enh: checkpoint for rsma	2023-11-09 14:51:37 +08:00
kailixu	74cddda24b	Merge branch '3.0' into enh/TD-25601-3.0	2023-11-09 14:37:13 +08:00
Hongze Cheng	e60f69a7ed	fix: code typo	2023-11-09 14:20:27 +08:00
yihaoDeng	f74edc7618	Merge branch '3.0' into enh/refactorBackend	2023-11-09 06:14:08 +00:00
Minglei Jin	398771da5b	Merge branch '3.0' into fix/TD-27206	2023-11-09 14:06:15 +08:00
liuyao	e56a3e8a1e	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-11-09 13:59:39 +08:00
Benguang Zhao	b80770dea8	fix: close vnode in the failed mode properly in vmCloseVnode	2023-11-09 13:05:52 +08:00
kailixu	1a950afdb8	enh: test case for rsma snapshot	2023-11-09 12:09:27 +08:00
Haojun Liao	257ab4f270	Merge pull request #23526 from taosdata/feat/TD-26060 ... feat:checkpoint backup function	2023-11-09 11:46:28 +08:00
kailixu	349e190120	enh: rsma result	2023-11-09 11:23:50 +08:00
kailixu	3495efaac7	enh: rsma exception process	2023-11-09 10:49:40 +08:00
Haojun Liao	62f34c757e	fix(stream): remove invalid free.	2023-11-09 10:10:37 +08:00
Minglei Jin	1bb10bb862	vnode/cos: check get object block size optionally	2023-11-09 09:32:13 +08:00
kailixu	501d5a7acc	Merge branch '3.0' into enh/TD-23769-3.0x	2023-11-08 20:47:15 +08:00
kailixu	72ecb0431c	enh: rsma checkpoint	2023-11-08 20:45:44 +08:00
Minglei Jin	5ccdde4495	vnode/cos: error on incomplete fetching	2023-11-08 20:43:52 +08:00
yihaoDeng	3abf0ae4b2	Merge branch 'feat/TD-26060' into enh/refactorBackend	2023-11-08 17:31:16 +08:00
liuyao	a8b415ed35	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-11-08 17:26:00 +08:00
Minglei Jin	128353a861	vnode/cos: fix get object handler mem	2023-11-08 16:04:24 +08:00
Minglei Jin	e5bbcf76f1	vnode/cos: fix get object block callback	2023-11-08 15:57:56 +08:00
Haojun Liao	99dbbe61d7	refactor(stream): do some internal refactor.	2023-11-08 15:20:47 +08:00
Minglei Jin	a1e692a796	fix(vnode/cos): fix error printing to avoid buffer overflow	2023-11-08 15:18:55 +08:00
wangjiaming0909	3e850df3c2	fix: last(ts2), ts2, ts caused data err	2023-11-08 14:43:11 +08:00
Minglei Jin	3f125bc6bf	vnode/cos: make err msg buffer big enough for detailed msg	2023-11-08 14:30:30 +08:00
liuyao	340fb3e727	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-11-08 14:16:59 +08:00
Haojun Liao	658fafd03c	refactor: do some internal refactor.	2023-11-08 14:02:08 +08:00
wangjiaming0909	fc6c4fba90	feat: cache scan for select last(c), ts/c	2023-11-08 13:39:28 +08:00
Haojun Liao	809dd064a7	refactor(stream): create sim env for stream processing.	2023-11-08 11:04:16 +08:00
Haojun Liao	17bd6badec	refactor(stream): do checkpoint for each task.	2023-11-08 10:47:54 +08:00
yihaoDeng	7ada7f34ac	fix:merge from 3.0	2023-11-08 10:45:15 +08:00
kailixu	d1106c51dc	enh: rsma code optimization	2023-11-08 09:54:03 +08:00
Minglei Jin	764f8d2e45	fix(vnode/s3): move init & cleanup to dnode	2023-11-08 09:03:19 +08:00
kailixu	b9f389a49f	Merge branch '3.0' into enh/TD-23769-3.0x	2023-11-08 08:36:35 +08:00
kailixu	f2d24306b1	enh: rsma tasks share one checkpoint and fix memory leak	2023-11-08 08:35:52 +08:00
Haojun Liao	666b8c531b	Merge pull request #23548 from taosdata/fix/liaohj ... refactor: do some internal refactor.	2023-11-08 08:08:36 +08:00
Haojun Liao	e052d3cd62	fix(stream): check null.	2023-11-08 00:10:08 +08:00
Haojun Liao	9ba854d49d	Merge branch '3.0' into fix/3_liaohj	2023-11-07 23:51:07 +08:00
Haojun Liao	7bfea5a82e	fix(stream): fix syntax error.	2023-11-07 22:31:35 +08:00
kailixu	6b738884a4	chore: rsma checkpoint	2023-11-07 19:59:05 +08:00
wangmm0220	c0068abc9a	fix:merge from 3.0	2023-11-07 18:55:46 +08:00
Haojun Liao	2674698b36	fix(stream): restart tasks in stream threads, instead of write thread.	2023-11-07 18:51:46 +08:00
yihaoDeng	95b14ee39b	merge 3.0	2023-11-07 17:15:49 +08:00
Haojun Liao	1301b92844	fix(stream): fix errors in scan-history, introduced by refactor	2023-11-07 16:41:15 +08:00
Haojun Liao	8c2f6bab0e	fix(stream): exec scan-history in timer.	2023-11-07 16:40:03 +08:00
Haojun Liao	7370daa6e0	fix(stream): record the start failure tasks.	2023-11-07 16:39:56 +08:00
Haojun Liao	e38e526dda	fix(stream):reset the starting flag for the followers.	2023-11-07 16:39:12 +08:00
Haojun Liao	207b53f3f6	fix(stream): fix errors in scan-history, introduced by refactor	2023-11-07 16:19:09 +08:00
kailixu	ac62714492	Merge branch '3.0' into enh/TD-23769-3.0x	2023-11-07 14:20:38 +08:00
Haojun Liao	4d8548e938	refactor: do some internal refactor.	2023-11-06 23:42:16 +08:00
kailixu	f5d796a081	chore: print stream state	2023-11-06 19:53:09 +08:00
Haojun Liao	d9474016fc	fix(stream): exec scan-history in timer.	2023-11-06 18:55:53 +08:00
kailixu	dc5284a19c	chore: add debug info	2023-11-06 17:27:36 +08:00
Haojun Liao	6b1889284b	fix(stream): record the start failure tasks.	2023-11-06 15:45:44 +08:00
Minglei Jin	ec908fa4d0	fix(cache/reader): use int64 max instead of uint	2023-11-06 15:34:28 +08:00
wangmm0220	dffaac55ea	fix:move cos from util to common	2023-11-06 14:57:32 +08:00
Minglei Jin	31ce6453c2	fix(cmake/s3): make cmake config portable	2023-11-06 14:17:27 +08:00
Haojun Liao	69863febe6	fix(stream):reset the starting flag for the followers.	2023-11-06 13:17:13 +08:00
Haojun Liao	bfd14076d7	fix(stream): fix dead-lock.	2023-11-06 12:05:47 +08:00
Haojun Liao	d41fd27189	fix(stream): restart tasks in stream threads, instead of write thread.	2023-11-06 11:57:21 +08:00
Haojun Liao	0e44950a37	enh(stream): execute scan history by using time slice 1s.	2023-11-06 09:21:33 +08:00
Haojun Liao	680eb5674e	refactor: do some internal refactor.	2023-11-06 09:15:49 +08:00
kailixu	7e8c123fca	chore: rsma code optimization	2023-11-06 08:46:04 +08:00
Haojun Liao	d440da0d8c	enh(stream): execute scan history by using time slice 1s.	2023-11-05 01:26:53 +08:00
Haojun Liao	e13f003b90	refactor: do some internal refactor.	2023-11-05 01:23:23 +08:00
kailixu	411151d671	fix: buffer overflow/buffer use after free/memory leak	2023-11-04 08:44:26 +08:00
yihaoDeng	f038f88c07	Merge branch 'feat/TD-26060' into enh/refactorBackend	2023-11-03 18:29:18 +08:00
Haojun Liao	3415ba5195	Merge pull request #23528 from taosdata/fix/liaohj ... enh(tsdb): on-demand open stt file reader.	2023-11-03 17:29:55 +08:00
kailixu	77eadc59dc	Merge branch '3.0' into enh/TD-23769-3.0x	2023-11-03 16:26:07 +08:00
Haojun Liao	d3ddaaa9f3	other(tsdb): adjust some log info.	2023-11-03 15:08:25 +08:00
Haojun Liao	de5c4d8d5d	other(tsdb): adjust some log info.	2023-11-03 15:07:40 +08:00
kailixu	c95fc014a8	enh: rsma checkpoint	2023-11-03 14:57:36 +08:00
kailixu	a48968e5e8	enh: rsma checkpoint	2023-11-03 14:33:45 +08:00
Haojun Liao	34403534ed	Merge branch '3.0' into fix/3_liaohj	2023-11-03 14:06:58 +08:00
liuyao	b1d1e2c778	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-11-03 14:02:59 +08:00
Haojun Liao	b4d14d3847	fix(tsdb): fix error during add on-demand opening stt file reader.	2023-11-03 13:51:18 +08:00
Haojun Liao	675c9ca613	enh(tsdb): on-demand open stt file reader.	2023-11-03 13:51:18 +08:00
wangmm0220	0a1f1085fc	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060	2023-11-03 11:33:50 +08:00
Haojun Liao	c980e2030c	fix(tsdb): fix error during add on-demand opening stt file reader.	2023-11-03 11:04:32 +08:00
Haojun Liao	0acf4f1795	enh(tsdb): on-demand open stt file reader.	2023-11-03 10:35:05 +08:00
Hongze Cheng	1ff3f96b08	Merge pull request #23465 from taosdata/fix/TD-26189-last-tier-write ... enh(tsdb/retention): enable last tier write	2023-11-02 21:21:38 -05:00
yihaoDeng	24e961976f	Merge branch 'enh/new3.0' into enh/refactorBackend	2023-11-03 09:31:57 +08:00
liuyao	31ad73f6d1	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-11-03 09:12:17 +08:00
Haojun Liao	ff5d69352f	Merge pull request #23493 from taosdata/fix/3_liaohj ... fix(stream): add unsupport trans.	2023-11-03 09:07:33 +08:00
Haojun Liao	70388bafd2	Merge pull request #23523 from taosdata/fix/liaohj ... fix(stream): fix deadlock in transfer state.	2023-11-03 09:07:23 +08:00
kailixu	d9ed63473c	Merge branch '3.0' into enh/TD-23769-3.0x	2023-11-03 08:37:41 +08:00
yihaoDeng	6ce878948f	Merge branch 'enh/new3.0' into enh/refactorBackend	2023-11-02 20:44:36 +08:00
kailixu	6c944bb192	enh: skip rsma_task during load stream tasks	2023-11-02 20:32:54 +08:00
wangmm0220	159873692c	feat:checkpoint bakeup using rsync	2023-11-02 20:13:29 +08:00
liuyao	389117b806	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-11-02 20:07:12 +08:00
Haojun Liao	b3d57e4a2d	fix(stream): not transfer state if state is not appropriate.	2023-11-02 19:31:35 +08:00
Haojun Liao	7a32b3a209	fix(stream): not transfer state if state is not appropriate.	2023-11-02 19:12:36 +08:00
kailixu	fa5d896787	enh: rsma checkpoint	2023-11-02 18:56:36 +08:00
Haojun Liao	c4079332ff	fix(stream):update the log level.	2023-11-02 18:18:04 +08:00
Haojun Liao	0a227e807f	refactor: set different tq level.	2023-11-02 18:18:04 +08:00
Haojun Liao	48aff868b6	fix(stream):update the log level.	2023-11-02 18:16:47 +08:00
Haojun Liao	3aed8c29ae	refactor: set different tq level.	2023-11-02 17:12:20 +08:00
Hongze Cheng	faea18c38f	fix: invalid read when file is deleted	2023-11-02 16:59:11 +08:00
kailixu	2d597659bc	enh: rsma checkpoint	2023-11-02 15:20:54 +08:00
liuyao	330b04a8bc	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-11-02 14:36:13 +08:00
Haojun Liao	f5fa3edeba	Merge pull request #23503 from taosdata/fix/liaohj ... fix(stream): fix dead lock.	2023-11-02 13:52:50 +08:00
kailixu	722777f8c9	enh: rsma checkpoint	2023-11-02 13:15:31 +08:00
kailixu	96b5024347	enh: rsma checkpoint	2023-11-02 13:05:36 +08:00
kailixu	698fb804f9	enh: disable update tbUidList during reboot	2023-11-02 12:54:23 +08:00
kailixu	76536e1c82	enh: rsma logic	2023-11-02 11:03:18 +08:00
Haojun Liao	95efa07e92	fix(stream): add full unsupported event filtering.	2023-11-02 11:02:39 +08:00
Minglei Jin	46d3be1f08	config/page-cache-size: new parameter for pcache size	2023-11-02 10:10:03 +08:00
kailixu	9649e87cab	fix: rsma checkpoint	2023-11-02 09:44:43 +08:00
Haojun Liao	351a31302f	fix(stream): add full unsupported event filtering.	2023-11-02 09:43:48 +08:00
Minglei Jin	d0327e07b8	tsdb/pg-cache: use pgno for cache key instead of blkno	2023-11-02 09:42:19 +08:00
Hongze Cheng	a6ee7c4685	fix: possible coredump	2023-11-01 20:34:47 +08:00
kailixu	3803f952f9	chore: rsma checkpoint verify	2023-11-01 20:05:00 +08:00
Haojun Liao	7cf90dde5c	refactor: do some internal refactor.	2023-11-01 19:38:13 +08:00
Haojun Liao	00f029e44f	refactor: add some logs.	2023-11-01 19:38:12 +08:00
Haojun Liao	9a9c1d689d	fix(stream): add lock log.	2023-11-01 19:38:12 +08:00
Haojun Liao	246ed4e022	refactor: do some internal refactor.	2023-11-01 17:19:21 +08:00
liuyao	505c44d9aa	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-11-01 16:50:46 +08:00
kailixu	c32e60d199	chore: more code for rsma checkpoint	2023-11-01 16:27:41 +08:00
Haojun Liao	12bc4f32cf	refactor: add some logs.	2023-11-01 16:12:15 +08:00
yihaoDeng	4c8edb5545	Merge branch 'enh/new3.0' into enh/refactorBackend	2023-11-01 16:07:49 +08:00
kailixu	59be62c96e	chore: set stream input checkpoint	2023-11-01 15:34:17 +08:00
Minglei Jin	6f0fa5d47e	tsdb/retention: remove incorrect right brace	2023-11-01 14:56:57 +08:00
Haojun Liao	5ff89bc098	fix(stream): add lock log.	2023-11-01 13:19:53 +08:00
kailixu	ab266c712f	chore: checkpoint for rsma stream state	2023-11-01 12:29:54 +08:00
Haojun Liao	0cf0ff3bbf	Merge pull request #23455 from taosdata/fix/liaohj ... refactor: do some internal refactor.	2023-11-01 12:01:54 +08:00
Haojun Liao	3e6c89d8eb	fix(stream): add unsupport trans.	2023-11-01 11:43:02 +08:00
Minglei Jin	221afff9ee	vnode/write: remove keep modify code block	2023-11-01 11:00:47 +08:00
Minglei Jin	64644d673b	Merge branch '3.0' into fix/TD-26189-last-tier-write	2023-11-01 10:53:55 +08:00
Minglei Jin	a61502411d	tsdb/pg-cache: new page cache for tsdb s3 read file page	2023-11-01 10:49:05 +08:00
kailixu	1530fe0c49	Merge branch '3.0' into enh/TD-23769-3.0x	2023-11-01 09:52:16 +08:00
kailixu	ad1e6accd4	chore: build checkpoint for rsma	2023-11-01 09:45:58 +08:00
Haojun Liao	7359f98eca	Merge pull request #23428 from taosdata/fix/3_liaohj ... other: merge refactor into 3.0	2023-11-01 09:44:31 +08:00
Haojun Liao	639d5cde47	fix(stream): add unsupport trans.	2023-10-31 23:14:02 +08:00
yihaoDeng	bb8252df16	fix mem leak	2023-10-31 20:59:24 +08:00
kailixu	e6684fa5de	enh: rsma retetion and stream state	2023-10-31 20:26:42 +08:00
dapan1121	d40cc27abc	Merge pull request #23464 from taosdata/enh/TD-26638-3.0 ... enh: use placeholder '-' for interval of 1st retention level	2023-10-31 18:36:43 +08:00
Haojun Liao	a1aa2380ae	other: merge 3.0	2023-10-31 16:42:51 +08:00
Haojun Liao	0b18192b23	fix(stream): fix error in finishing event handling.	2023-10-31 16:40:16 +08:00
Haojun Liao	4c0242a58d	fix(stream): fix error in finishing event handling.	2023-10-31 16:39:14 +08:00
liuyao	696294c208	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-10-31 15:41:04 +08:00
wade zhang	76c9b9afc5	Merge pull request #23377 from taosdata/FIX/TD-26596-3.0 ... feat: support pipelining of snap replication	2023-10-31 15:19:07 +08:00
wade zhang	25b09b467f	Merge pull request #23439 from taosdata/feat/TD-26971-3.0 ... TD-26971	2023-10-31 13:53:49 +08:00
kailixu	28cd8f4915	enh: file duration for rsma	2023-10-31 11:38:33 +08:00
Hongze Cheng	ac3df85d8a	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26684	2023-10-31 11:23:23 +08:00
Haojun Liao	fc70fa053c	fix(tsdb): fix syntax error.	2023-10-31 10:45:14 +08:00
Haojun Liao	6a7ba0f5f5	fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1.	2023-10-31 10:45:14 +08:00
Haojun Liao	00626de6e4	fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files.	2023-10-31 10:45:13 +08:00
Haojun Liao	cb43299faa	fix(tsdb): avoid to read duplicated rows in buf.	2023-10-31 10:45:13 +08:00
Haojun Liao	635243f01a	refactor: do some internal refactor.	2023-10-31 10:45:12 +08:00
Haojun Liao	6e2240a3d1	fix(stream): fix the deadlock.	2023-10-31 10:45:12 +08:00
Haojun Liao	0c982093cd	fix(stream): enable the set of fill-history task to be un-init.	2023-10-31 10:45:12 +08:00
Haojun Liao	8b9bc988f1	fix(tsdb): fix syntax error.	2023-10-31 10:42:34 +08:00
Haojun Liao	eaf76854f6	fix(tsdb): handle the case where stt not exists, possibly exists while the stt-trigger is 1.	2023-10-31 09:29:24 +08:00
kailixu	b03baaed2c	chore: revert the code change	2023-10-30 19:49:50 +08:00
kailixu	89651626e3	chore: reopen rsma stream commit	2023-10-30 19:45:18 +08:00
dmchen	fe044051c8	memory leak	2023-10-30 19:36:27 +08:00
dmchen	5120d25297	memory leak	2023-10-30 11:34:34 +00:00
Minglei Jin	867ce92dcc	tsdb/file-rw: fix log msg	2023-10-30 19:28:18 +08:00
Minglei Jin	800cbfbb05	tsdb/file: new s3flag in mem	2023-10-30 17:36:49 +08:00
Haojun Liao	6e118c7963	fix(stream): fix memory leak.	2023-10-30 17:28:57 +08:00
dmchen	0f40e1dbb9	memory leak	2023-10-30 16:59:12 +08:00
dmchen	40c9622df5	memory leak	2023-10-30 08:57:07 +00:00
Haojun Liao	ed07486405	fix(tsdb): fix error in decide if data buffer overlaps with stt files/block-files.	2023-10-30 16:40:09 +08:00
Haojun Liao	bc1c2a879a	fix(tsdb): avoid to read duplicated rows in buf.	2023-10-30 16:12:08 +08:00
dmchen	be0a85a0ff	memory leak	2023-10-30 15:22:54 +08:00
Minglei Jin	84d2f9c379	tsdb/upload: delay data file uploading	2023-10-30 15:22:34 +08:00
dmchen	6172b820ac	memory leak	2023-10-30 07:19:08 +00:00
Haojun Liao	fdf3f210ac	refactor: do some internal refactor.	2023-10-30 14:39:24 +08:00
Haojun Liao	3275452bce	fix(stream): fix the deadlock.	2023-10-30 14:38:51 +08:00
kailixu	c77153cb81	enh: use placeholder '-' for interval of 1st retention level	2023-10-30 14:02:31 +08:00
Haojun Liao	15d217fc3e	fix(stream): fix memory leak.	2023-10-30 13:29:35 +08:00
Haojun Liao	b0700d6095	Merge branch '3.0' into fix/3_liaohj	2023-10-30 11:57:54 +08:00
Haojun Liao	93232a0e14	fix(stream): enable the set of fill-history task to be un-init.	2023-10-30 11:48:51 +08:00
liuyao	1a37f19c82	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-21898	2023-10-30 11:43:23 +08:00
dapan1121	1b7a6bccdf	Merge pull request #23430 from taosdata/enh/TD-26641-3.0 ... enh: only float/double allowed for sum/avg of rsma	2023-10-30 10:08:55 +08:00
Minglei Jin	4fede02da4	tsdb/retention: remove s3 evict cache hook	2023-10-30 10:06:42 +08:00
Haojun Liao	c7285c0ede	fix(stream): add expired epset node list for stream tasks in hb to mnode.	2023-10-27 23:41:57 +08:00
Haojun Liao	4c267b538f	fix(stream): add expired epset node list for stream tasks in hb to mnode.	2023-10-27 23:05:41 +08:00
Hongze Cheng	a7f3041ff3	more fix	2023-10-27 17:59:27 +08:00
Benguang Zhao	4163a3be7c	feat: resend snap replication of data on timeout	2023-10-27 17:58:26 +08:00
Hongze Cheng	cdb1d8296d	feat: concurrency on fileset	2023-10-27 17:48:19 +08:00
dmchen	43e6dec6c2	TD-26971	2023-10-27 17:39:50 +08:00
dmchen	34c4ffde26	TD-26971	2023-10-27 09:30:30 +00:00
Minglei Jin	8c6f452f09	tsdb/write: make last tier writable to mem	2023-10-27 15:51:52 +08:00
Haojun Liao	dcca6b0868	other: merge 3.0.	2023-10-27 11:41:28 +08:00
Haojun Liao	9c9d02b181	fix(stream): disable follower nodes exec reset.	2023-10-27 09:59:52 +08:00
Haojun Liao	454624516c	fix(stream): handle the repeatly issued nodeUpdate msg from dnode.	2023-10-27 09:59:51 +08:00
Haojun Liao	33dc51cc86	fix(stream): add some logs.	2023-10-27 09:59:44 +08:00
Haojun Liao	1ccbb77981	fix(stream): fix dead lock when shutdown all tasks.	2023-10-27 09:59:37 +08:00
Haojun Liao	2493c21ed3	fix(stream): fix the invalid write in sma	2023-10-27 09:58:52 +08:00
Haojun Liao	7cce53f7e5	fix(stream): ignore the check status when is ready.	2023-10-27 09:58:52 +08:00
Haojun Liao	c99f434706	fix(stream): set checkpoint failure when in pause status.	2023-10-27 09:58:52 +08:00
Haojun Liao	2c1af8dad8	refactor: do some internal refactor.	2023-10-27 09:58:52 +08:00
Haojun Liao	1ad2c3029a	refactor(stream): do some internal refactor.	2023-10-27 09:58:52 +08:00
Haojun Liao	7311f9d2fe	fix(sma): fix bugs in sma and do some internal refactor.	2023-10-27 09:58:51 +08:00
Haojun Liao	3bcffcf1da	other: merge stream refactor from main.	2023-10-27 09:56:02 +08:00
Haojun Liao	226b6596d6	fix(stream): fix bugs caused by refactor.	2023-10-27 09:54:58 +08:00
Haojun Liao	091238e7be	fix(stream): fix bugs caused by refactor sm.	2023-10-27 09:54:58 +08:00
Haojun Liao	e1f6043eed	fix(stream): fix bugs caused by refactor sm.	2023-10-27 09:54:57 +08:00
Haojun Liao	8729bdac1e	fix(stream): fix bugs caused by refactor.	2023-10-27 09:54:57 +08:00
Haojun Liao	1eac7f44c0	fix(stream): fix error in stream.	2023-10-27 09:54:56 +08:00
Haojun Liao	579dd8e6b2	refactor(stream): do some internal refactor.	2023-10-27 09:54:56 +08:00
Haojun Liao	6f3c0d17cc	refactor(stream): add state machine to manage the state of stream tasks.	2023-10-27 09:54:49 +08:00