9588 Commits

Author	SHA1	Message	Date
Haojun Liao	0100bb51b9	other: merge 3.0	2024-07-17 17:36:49 +08:00
Haojun Liao	30186f466b	refactor: check return value for each function.	2024-07-17 16:47:56 +08:00
wangmm0220	f078be357d	opti:[TS-4593] transform offset from file to tdb in tmq	2024-07-17 16:25:51 +08:00
Hongze Cheng	cb055eca80	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-30987-4	2024-07-17 16:16:15 +08:00
Hongze Cheng	931749dca6	refactor tsdb code	2024-07-17 16:15:19 +08:00
wangmm0220	646731b5dd	opti:[TS-4593] transform offset from file to tdb in tmq	2024-07-17 15:58:37 +08:00
Haojun Liao	552e59f42b	refactor: check return value for each function.	2024-07-17 15:40:00 +08:00
Shungang Li	394da5d8bf	fix: (pk) load last cache from tsdb	2024-07-17 14:27:06 +08:00
Hongze Cheng	fdd866737d	fix more	2024-07-17 13:17:40 +08:00
Hongze Cheng	35606a5658	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TD-30987-3	2024-07-17 13:07:07 +08:00
Haojun Liao	14f149cdd3	refactor: check return value for each function.	2024-07-17 11:47:05 +08:00
wangmm0220	a61d5fa827	opti:[TS-4593] transform offset from file to tdb in tmq	2024-07-17 11:26:22 +08:00
Haojun Liao	53ed030967	Merge branch '3.0' into fix/3_liaohj	2024-07-17 11:25:19 +08:00
Haojun Liao	1ed620e702	fix(stream): return after get value.	2024-07-17 11:17:27 +08:00
Haojun Liao	395b437fec	Merge branch '3.0' into fix/create_tb	2024-07-17 10:24:20 +08:00
Haojun Liao	103e9194b0	Merge pull request #26592 from taosdata/fix/syntax ... fix(tsdb): check return value.	2024-07-17 09:08:22 +08:00
Hongze Cheng	d8e3279ca6	fix: little fix	2024-07-17 08:58:59 +08:00
Haojun Liao	872cae1386	refactor: do some refactor.	2024-07-17 01:08:39 +08:00
Haojun Liao	749e7d6cf7	fix(stream): return after get value.	2024-07-17 00:49:53 +08:00
Haojun Liao	f3cfd297b8	fix(stream): return after get value.	2024-07-16 19:42:29 +08:00
Haojun Liao	b29e1c2b0d	fix(stream):fix syntax error.	2024-07-16 19:13:14 +08:00
wangmm0220	0704dcf45d	fix:[TS-4593] check info error	2024-07-16 18:56:20 +08:00
Haojun Liao	94f596c4ce	refactor: remove the invalid return value.	2024-07-16 18:52:01 +08:00
Hongze Cheng	64363627fe	enh: refact tqueue code	2024-07-16 17:30:32 +08:00
Haojun Liao	38ee5dc472	fix(stream):fix syntax error.	2024-07-16 16:04:51 +08:00
Haojun Liao	19ba5af5e7	refactor: remove the invalid return value.	2024-07-16 15:59:16 +08:00
Haojun Liao	d2cb53ab3d	refactor: remove the invalid return value.	2024-07-16 15:49:08 +08:00
Haojun Liao	691c1dfa7d	fix(stream): check dst stable schema before generating auto create table.	2024-07-16 14:45:09 +08:00
Haojun Liao	8dde576c6f	fix(stream): add explicit create table into sink cache.	2024-07-16 09:32:13 +08:00
Haojun Liao	dd590f36e2	refactor: do some refactor.	2024-07-15 23:53:12 +08:00
Haojun Liao	25f5c9dc5e	other: merge 3.0	2024-07-15 19:41:54 +08:00
Haojun Liao	51e9723d66	refactor: do some refactor.	2024-07-15 19:37:52 +08:00
Haojun Liao	14a7cebc56	fix(stream): add explicit create table into sink cache.	2024-07-15 18:51:58 +08:00
Haojun Liao	019a1eb76b	fix(tsdb): check return value.	2024-07-15 15:28:32 +08:00
wangmm0220	1e1612a5fa	opti:[TS-4593] transform offset from file to tdb in tmq	2024-07-15 10:19:03 +08:00
wangmm0220	e78a75d183	opti:[TS-4593] transform offset from file to tdb in tmq	2024-07-15 09:48:04 +08:00
Yihao Deng	142f9132a5	fix failed to load task	2024-07-12 12:08:57 +00:00
dapan1121	e527f2fd0b	fix: validate function return value	2024-07-12 15:22:39 +08:00
Shungang Li	3cc926d597	fix: tsdbCacheUpdate incorrect filling cache	2024-07-10 17:52:13 +08:00
Hongze Cheng	0fcc57b52a	Merge pull request #26439 from taosdata/enh/TD-30442 ... Enh/TD-30442	2024-07-09 18:04:34 +08:00
Haojun Liao	c71413c2aa	fix(stream): discard the repeat send consensus-checkpointId msg.	2024-07-09 14:52:15 +08:00
Haojun Liao	acde36a25b	Merge branch '3.0' into fix/3_liaohj	2024-07-09 14:43:35 +08:00
Hongze Cheng	b3be47fdbb	cancel bg tasks when alter stt_trigger	2024-07-08 15:39:25 +08:00
Haojun Liao	6e15c16cf7	fix(stream): check the set consensus-checkpointId ts.	2024-07-08 14:33:28 +08:00
Haojun Liao	647f9f47ef	refactor: do some internal refactor.	2024-07-08 10:32:23 +08:00
Haojun Liao	ce4153b6fc	fix(stream): use hb to send the consens-checkpointid req.	2024-07-08 09:05:33 +08:00
Haojun Liao	8e6bb176c2	fix(stream): use trans to set the consensus-checkpoint id	2024-07-05 16:17:20 +08:00
Haojun Liao	db4a00c74e	fix(stream): not restart for reset task status.	2024-07-05 08:55:40 +08:00
Yihao Deng	94a480292f	Merge remote-tracking branch 'origin/3.0' into enh/TD-30442	2024-07-05 00:48:41 +00:00
Yihao Deng	0cdfae3a2c	refactor backend	2024-07-04 12:13:17 +00:00
Haojun Liao	4cfecfcf28	other: fix coverity issue.	2024-07-04 19:23:58 +08:00
Yihao Deng	8428a5be37	refactor backend	2024-07-04 10:25:37 +00:00
Haojun Liao	47b0a0464e	fix(stream): send checkpoint-source-rsp to mnode before reset task status.	2024-07-04 15:21:16 +08:00
Yihao Deng	0bd51f2133	fix comment	2024-07-04 06:36:36 +00:00
Haojun Liao	653f7a1a43	fix(stream): refactor the checkpoint consensus policy.	2024-07-04 13:55:50 +08:00
Minglei Jin	0fa44fe8cf	fix(tsdb/commit): make commit failing core in release buildings	2024-07-03 16:40:54 +08:00
dapan1121	56689cf97a	Merge pull request #26360 from taosdata/fix/3.0/TD-30305 ... fix coverity issues	2024-07-03 08:50:11 +08:00
Hongze Cheng	991d43b610	Merge pull request #26314 from taosdata/fix/TS-2518-3.0 ... fix/TS-2518	2024-07-02 18:52:02 +08:00
Haojun Liao	0a9bcc0870	Merge pull request #26370 from taosdata/fix/3_liaohj ... fix(stream): remove invalid assert.	2024-07-02 18:41:45 +08:00
Yihao Deng	471580ec5e	Merge remote-tracking branch 'origin/3.0' into enh/TD-30442	2024-07-02 08:26:10 +00:00
Haojun Liao	c7d4f45b7f	fix(stream): remove invalid assert.	2024-07-02 15:33:25 +08:00
Haojun Liao	279bfb4de0	Merge pull request #26364 from taosdata/fix/3_liaohj ... fix(stream): fix error in pause/resume procedure.	2024-07-02 15:32:43 +08:00
Haojun Liao	4e56b6f9eb	fix(stream): fix error in pause/resume procedure.	2024-07-02 13:33:31 +08:00
wangjiaming0909	024422bfd7	fix coverity issues	2024-07-02 09:27:14 +08:00
Haojun Liao	420b59fea5	Merge pull request #26344 from taosdata/fix/3_liaohj ... fix(stream): validate the stream hb msg, and discard the invalid hb msg.	2024-07-02 09:07:31 +08:00
dapan1121	6d0b8eeed4	Merge pull request #26302 from taosdata/TD-26483 ... feat(query):add thread pool	2024-07-01 19:04:52 +08:00
Hongze Cheng	88a24c5457	Merge pull request #26345 from taosdata/fix/TD-30843 ... fix(tsdb/retention): fix null pointer crash (uaf)	2024-07-01 15:50:27 +08:00
Minglei Jin	299cf3a00b	fix(tsdb/retention): fix null pointer crash (uaf)	2024-07-01 14:20:48 +08:00
Haojun Liao	f09be802ea	other: merge 3.0	2024-07-01 13:32:30 +08:00
wangjiaming0909	5040ff5bd9	mnode/qnode support QueryAutoQWorkerPool	2024-07-01 11:08:40 +08:00
wangjiaming0909	11a98ffab2	QueryAutoQWorker	2024-07-01 11:08:39 +08:00
Yihao Deng	6c6bff611a	add self check	2024-06-29 12:56:36 +00:00
Yihao Deng	7290920c6f	add self check	2024-06-29 04:35:54 +00:00
Haojun Liao	79085015d6	fix(stream): set correct msg start position.	2024-06-29 00:49:37 +08:00
Haojun Liao	707fe02885	fix(stream):set the initial transId	2024-06-28 16:30:12 +08:00
Haojun Liao	f6e32529fc	fix(stream): set initial update ep transId.	2024-06-28 14:13:16 +08:00
Haojun Liao	025437df0c	fix(stream): fix error in checkpoint consensus.	2024-06-27 19:25:18 +08:00
Haojun Liao	48bf5eb4d8	other: merge 3.0	2024-06-27 19:23:06 +08:00
Haojun Liao	b5661752aa	fix(tsdb):check the result of the binary search for the end position in data file block.	2024-06-27 14:32:18 +08:00
Haojun Liao	dc78cf32cb	fix(tsdb):check the result of the binary search for the end position in data file block.	2024-06-27 14:29:29 +08:00
dmchen	5001cab278	fix/TS-2518	2024-06-27 04:38:17 +00:00
Haojun Liao	a44e17d5ea	fix(stream): enable to re-send hbmsg if mnode failed to recv this hbmsg.	2024-06-26 15:21:14 +08:00
Hongze Cheng	b761bd2e38	enh: port main change to 3.0	2024-06-26 10:32:15 +08:00
Haojun Liao	1818edcb2b	fix(stream): consensus the start checkpoint id, and extract the streamhb related functions into a new file.	2024-06-26 10:18:32 +08:00
Haojun Liao	bd8c7d8c93	fix(stream): pause not stop the start procedure of stream tasks.	2024-06-24 13:25:48 +08:00
Haojun Liao	119001e30b	fix(stream): update the retrieve checkpoint-trigger msg.	2024-06-21 15:11:48 +08:00
Haojun Liao	e7105edaa4	fix(stream): disable pause if task is un-init.	2024-06-21 14:14:44 +08:00
Haojun Liao	aea4254d40	fix(stream): async start task.	2024-06-21 10:37:06 +08:00
Haojun Liao	2cb9644471	fix(stream): update the checkpoint info only when the status is normal.	2024-06-21 09:23:29 +08:00
Haojun Liao	ece139d921	fix(stream): initialize the sink stream task.	2024-06-21 09:22:09 +08:00
Hongze Cheng	70851f6bed	Merge pull request #26160 from taosdata/enh/TD-30554-3.0 ... tfs: support disable create new file	2024-06-20 16:46:00 +08:00
kailixu	cefff2bfee	Merge branch '3.0' into enh/TD-30554-3.0	2024-12-31 08:35:03 +08:00
Yihao Deng	639df3dfad	update case	2024-06-20 00:14:26 +00:00
Yihao Deng	01ee8b36a4	update case	2024-06-19 12:36:13 +00:00
Haojun Liao	da63a40796	Merge pull request #26188 from taosdata/fix/3_liaohj ... fix(stream): fix a typo.	2024-06-19 14:58:21 +08:00
Haojun Liao	2534ce5071	fix(stream): fix a typo.	2024-06-19 10:29:01 +08:00
kailixu	809c691b22	Merge branch '3.0' into enh/TD-30554-3.0	2024-06-18 16:47:51 +08:00
Minglei Jin	356f6645ad	Merge branch '3.0' into fix/TD-30545	2024-06-18 11:28:29 +08:00
kailixu	d87a7d2809	Merge branch '3.0' into enh/TD-30554-3.0	2024-06-18 08:51:53 +08:00
Haojun Liao	c3ae66c95c	Merge pull request #26169 from taosdata/fix/3_liaohj ... fix(stream): not revise the stream id for fill-history task.	2024-06-18 08:38:29 +08:00
Haojun Liao	c4a2756907	fix(stream): not revise the stream id for fill-history task.	2024-06-17 23:13:54 +08:00
Haojun Liao	60fac80345	fix(stream): add some logs.	2024-06-17 19:34:09 +08:00
Haojun Liao	3aa6e00bee	fix(stream): fix some typo.	2024-06-17 15:58:59 +08:00
Haojun Liao	848b1e19b5	fix(stream): fix some typo.	2024-06-17 14:39:46 +08:00
Hongze Cheng	3645bce918	Merge pull request #26127 from taosdata/fix/TD-30567 ... add compress to child table	2024-06-17 13:18:51 +08:00
kailixu	e1f5e6d533	Merge branch '3.0' into enh/TD-30554-3.0	2024-06-17 10:44:11 +08:00
dapan1121	e34a8b48df	Merge pull request #26008 from taosdata/fix/TS-4833/dataloaded ... partition interval and limimt, dataload error	2024-06-17 08:32:19 +08:00
kailixu	4ed3b30352	tfs: support disable create new file	2024-06-17 06:14:49 +08:00
kailixu	e3645def98	Merge branch '3.0' into enh/TD-30554-3.0	2024-06-17 05:52:15 +08:00
factosea	19f6766c9a	fix: blockAgg	2024-06-15 18:08:25 +08:00
Haojun Liao	62b69932b2	Merge pull request #26150 from taosdata/fix/3_liaohj ... fix(stream): move the expansion of the stream task related task to right place.	2024-06-15 17:37:39 +08:00
Haojun Liao	42e0dff589	fix(stream): move the expansion of the stream task related fill-history task to the place where the fill-history task must have been deoployed already.	2024-06-14 17:03:04 +08:00
Haojun Liao	85baf2b3e1	Merge pull request #26147 from taosdata/fix/3_liaohj ... fix(test): wait for a little bit more time.	2024-06-14 16:34:40 +08:00
Haojun Liao	b25e6d3250	fix(stream): always return 0 for enqueuing retrieve block.	2024-06-14 14:43:27 +08:00
Haojun Liao	5f4b506777	Merge pull request #26131 from taosdata/fix/3_liaohj ... fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen.	2024-06-13 17:38:28 +08:00
Haojun Liao	0f8c0fa8cb	fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen.	2024-06-13 14:56:20 +08:00
Haojun Liao	6f32a617f7	fix(tsdb): check for malloc failure.	2024-06-13 13:45:42 +08:00
Haojun Liao	5d2d5c3eee	fix(tsdb): check for null ptr for block load info when retrieving block distribution.	2024-06-13 13:43:57 +08:00
Haojun Liao	849f64d557	fix(tsdb): check null for tsdb block load info	2024-06-13 13:25:29 +08:00
kailixu	50d163f10d	Merge branch '3.0' into enh/TD-30554-3.0	2024-06-13 11:11:29 +08:00
kailixu	cdc7083b09	Merge branch '3.0' into enh/TD-30554-3.0	2024-06-13 11:11:01 +08:00
Yihao Deng	b7ef054b38	add compress to child table	2024-06-13 02:11:41 +00:00
Hongze Cheng	470b0e6730	Merge pull request #26119 from taosdata/feat/TS-4724-3.0 ... feat: data migration speed limit	2024-06-13 09:59:53 +08:00
dapan1121	d21e2f52de	Merge pull request #26054 from taosdata/fix/TD-30365 ... fix:[TD-30365] ci case error & drop topic error if vnode is splitted	2024-06-13 09:55:34 +08:00
Haojun Liao	9c42c90209	Merge pull request #26118 from taosdata/fix/3_liaohj ... fix(stream): add fill-history task id in msg.	2024-06-12 18:03:43 +08:00
Hongze Cheng	e060535c13	feat: data migration speed limit	2024-06-12 17:23:57 +08:00
kailixu	e7754a0b3e	Merge branch '3.0' into enh/TD-30554-3.0	2024-06-12 15:40:01 +08:00
Haojun Liao	d06e1549f1	fix(stream): add fill-history task id in msg.	2024-06-12 15:27:19 +08:00
Minglei Jin	568799a6a3	fix(wal/level): enable alter replica from fake walLevel 1	2024-06-12 15:16:58 +08:00
kailixu	f2401f32a2	enh: support enable/disable tfs config entries	2024-06-12 15:14:38 +08:00
Haojun Liao	623a73f57b	Merge pull request #26089 from taosdata/fix/3_liaohj ... fix(stream): init the node list and task list when starting mnode.	2024-06-12 11:34:10 +08:00
Haojun Liao	9406be9aa6	fix(stream): remove invalid reset.	2024-06-11 18:58:16 +08:00
Haojun Liao	a41a04dc37	fix(stream): remove the related history task correctly.	2024-06-11 18:35:59 +08:00
wangmm0220	70db803aec	fix:[TD-30365] ci case error & drop topic error if vnode is splitted	2024-06-11 17:24:29 +08:00
Haojun Liao	539543b011	Merge pull request #25846 from taosdata/enh/opt_prj ... enh(query): optimize the project query performance	2024-06-11 14:35:27 +08:00
Hongze Cheng	5c1c65751a	Merge pull request #26083 from taosdata/fix/TD-30200-3.0 ... fix: last cache rebuild from multi brinBlk	2024-06-11 13:46:55 +08:00
Haojun Liao	20bade24c3	Merge branch '3.0' into fix/3_liaohj	2024-06-10 01:34:55 +08:00
Haojun Liao	cbf8b363fc	fix(stream): update checkpoint info by using trans.	2024-06-10 00:46:01 +08:00
Haojun Liao	895ee30cf3	Merge branch '3.0' into enh/opt_prj	2024-06-09 23:51:38 +08:00
Shungang Li	f9950d5fa3	fix: last cache rebuild from multi brinBlk	2024-06-07 14:47:02 +08:00
Minglei Jin	01e5e124fb	fix(last_row): fix empty table condition	2024-06-07 13:47:04 +08:00
Haojun Liao	6ef3c02717	fix(tsdb): remove invalid assert.	2024-06-06 19:09:54 +08:00
wangmm0220	0e337d3418	fix:[TD-30365] ci case error & drop topic error if vnode is splitted	2024-06-06 17:26:20 +08:00
wangmm0220	697b81aa8a	fix:[TD-30365] ci case error & drop topic error if vnode is splitted	2024-06-06 11:15:23 +08:00
wangmm0220	48ecba95da	fix:[TD-30365] ci case error & drop topic error if vnode is splitted	2024-06-05 18:02:57 +08:00
Haojun Liao	29d34200b5	other: fix coverity issues.	2024-06-05 13:39:46 +08:00
Haojun Liao	c529ecc7d2	Merge pull request #25734 from taosdata/fix/3_liaohj ... fix(stream): update the checkpoint info for followers, and some internal refactor.	2024-06-05 13:38:51 +08:00
Hongze Cheng	4490cd7db3	Merge pull request #26040 from taosdata/enh/lsg-restore-3.0 ... enh: add more log for restore	2024-06-05 09:11:42 +08:00
Shungang Li	1f73bb106e	enh: add more log for restore	2024-06-04 17:14:59 +08:00
factosea	c42e627a41	test	2024-06-04 11:39:47 +08:00
Haojun Liao	3b3ed1c30c	fix(stream): add monitor for checkpoint-ready msg recv status.	2024-06-03 16:45:37 +08:00
Haojun Liao	927e2237de	Merge branch '3.0' into fix/3_liaohj	2024-06-03 15:56:02 +08:00
Hongze Cheng	6f72fd4170	Merge pull request #25996 from taosdata/feat/TD-30006-3 ... Feat/TD-30006-3	2024-06-03 15:41:47 +08:00
dapan1121	affdeed944	Merge pull request #25909 from taosdata/feat/ly_tmq_batch_meta ... optimize tmq snapshot meta	2024-06-03 10:19:57 +08:00
Hongze Cheng	c8f13874a7	Merge pull request #25984 from taosdata/fix/TD-30309-3.0 ... fix: coverity scan problem	2024-06-03 08:58:48 +08:00
Haojun Liao	2a8270f9c8	fix(stream): track the checkpoint-ready msg on the upstream tasks.	2024-06-01 18:26:45 +08:00
54liuyao	e0167511c1	use tDeleteSVCreateTbBatchReq free mem	2024-05-31 17:18:25 +08:00
Haojun Liao	76b43dc072	fix(stream): 1. check the checkpoint-trigger rsp, 2. set the error code in the message body, 3. follower nodes not handle the checkpoint-trigger retrieve request.	2024-05-31 14:32:55 +08:00
Yihao Deng	5293c4a1dd	Merge branch '3.0' into feat/TD-30006	2024-05-31 02:49:58 +00:00
Yihao Deng	a1ccf91298	support add column compress	2024-05-31 02:47:57 +00:00
Yihao Deng	b364379671	add compress	2024-05-31 02:31:29 +00:00
Haojun Liao	ee4e4c0e6d	refactor: do some internal refactor.	2024-05-31 09:17:20 +08:00
Yihao Deng	c6407277dc	support add column compress	2024-05-30 11:41:22 +00:00
Haojun Liao	815a9e953b	fix(stream): desc the ref for checkpoint-trigger timer.	2024-05-30 18:41:56 +08:00
Haojun Liao	e66283d99c	fix(stream): remove table meta in table-meta cache.	2024-05-30 18:41:17 +08:00
Hongze Cheng	d28abdf837	fix coverity scan problem	2024-05-30 16:11:53 +08:00
Haojun Liao	b4956392d9	fix(stream): return in_progress code if not send retrieve rsp to downstream.	2024-05-30 15:54:08 +08:00
Haojun Liao	5768cc94a1	Merge branch '3.0' into fix/3_liaohj	2024-05-30 15:35:00 +08:00
Haojun Liao	cff5e753ef	fix(stream): discard the result data block if the primary timestamp of results is expired.	2024-05-30 14:16:49 +08:00
Hongze Cheng	91394f2e6d	fix more	2024-05-30 11:01:44 +08:00
Hongze Cheng	88a2c373b3	more fix	2024-05-30 10:22:26 +08:00
54liuyao	129d04a449	adj tmq param	2024-05-29 16:29:04 +08:00
Hongze Cheng	e75ab5b298	fix more	2024-05-29 14:10:34 +08:00
Hongze Cheng	bb83ed2469	fix: compact and commit concurrency problem	2024-05-29 11:33:17 +08:00
Haojun Liao	d1d868f239	refactor: do some internal refactor and set the pActiveInfo for rsma.	2024-05-29 00:08:29 +08:00
54liuyao	a2255ca355	add tmq param	2024-05-28 18:34:37 +08:00
Haojun Liao	8d54d45054	fix(stream): fix error found by CI.	2024-05-28 17:30:14 +08:00
Haojun Liao	c3c6b680fb	Merge branch '3.0' into fix/3_liaohj	2024-05-28 17:29:22 +08:00
Hongze Cheng	242b836eca	compile error	2024-05-28 14:35:58 +08:00
Hongze Cheng	913612e4a6	Merge pull request #25913 from taosdata/enh/TS-4723-3.0 ... enh: reduce compact block write time	2024-05-28 13:18:57 +08:00
Haojun Liao	cc318d7e2d	enh(stream): sink task does not initialize the backend.	2024-05-28 11:34:04 +08:00
Haojun Liao	bd514fe4d3	other: merge rows.	2024-05-28 11:13:09 +08:00
54liuyao	57bf9d1048	adj log	2024-05-28 10:56:43 +08:00
54liuyao	7fc2e8cc26	batch meta	2024-05-28 10:17:20 +08:00
Haojun Liao	be107b204c	enh(stream): support retrieve checkpoint data remotely when start stream tasks in vnodes.	2024-05-28 09:54:22 +08:00
Shungang Li	9947d8ec42	fix: last cache memory leak	2024-05-24 12:57:49 +08:00
Haojun Liao	89fb56e77d	other: merge 3.0	2024-05-24 11:41:51 +08:00
Hongze Cheng	21ea1e3735	fix memory leak	2024-05-23 19:05:11 +08:00
Hongze Cheng	9531cba834	Merge branch '3.0' of https://github.com/taosdata/TDengine into enh/TS-4723-3.0	2024-05-23 18:02:26 +08:00
Hongze Cheng	f729072044	enh: reduce compact block write time	2024-05-23 17:57:07 +08:00
54liuyao	441a150d66	optimize tmq snapshot meta	2024-05-23 17:35:54 +08:00
Shungang Li	0e76ba4034	fix: last cache update ts for col format	2024-05-22 15:15:41 +08:00
wangmm0220	f21eeae56c	fix:[TD-30180]error in judging if groupId already added to the end of table name	2024-05-21 16:57:00 +08:00
Haojun Liao	f6af165d9a	refactor(stream): add more info in info-meta	2024-05-21 10:09:55 +08:00
Haojun Liao	3baa4169e6	Merge branch '3.0' into fix/3_liaohj	2024-05-20 10:31:53 +08:00
dapan1121	68640f52be	Merge pull request #25833 from taosdata/fix/TS-4716-3.0 ... fix:[TS-4716]wait too long if change system time	2024-05-20 09:47:06 +08:00
Haojun Liao	93292d8149	other: merge 3.0	2024-05-18 09:58:36 +08:00
Haojun Liao	27c4e3634c	refactor: do some internal refactor.	2024-05-17 17:04:05 +08:00
Shungang Li	bf40585f6c	fix: cache update for last key	2024-05-17 16:41:26 +08:00
wangmm0220	3c0dbacf37	fix:[TS-4716]wait too long if change system time	2024-05-17 16:37:40 +08:00
Minglei Jin	7292d7a0ff	fix(tsdb/cache): update array reference to fix missing tables/groupby	2024-05-17 14:59:20 +08:00
wangmm0220	b0cdf887b4	fix:[TS-4716]wait too long if change system time	2024-05-17 14:27:09 +08:00
Shungang Li	b79dda6689	enh: adjust order for row format cache update	2024-05-17 11:31:09 +08:00
Minglei Jin	3b8c27764d	Merge branch '3.0' into fix/TD-29995-3.0	2024-05-17 10:17:33 +08:00
Haojun Liao	15181eb14b	enh(tsdb): increase the capacity for return data.	2024-05-17 09:51:56 +08:00
Shungang Li	5c952fc922	enh: cleanup	2024-05-17 09:10:35 +08:00
Haojun Liao	5307f15766	refactor: do some internal refactor.	2024-05-16 19:54:29 +08:00
Haojun Liao	41b55cf4d6	Merge pull request #25792 from taosdata/fix/TD-29745-1 ... adj code	2024-05-16 13:56:31 +08:00
Shungang Li	fc047ddafc	fix: last cache update rule	2024-05-16 09:30:27 +08:00
Hongze Cheng	9dd3f326ea	Merge pull request #25731 from taosdata/enh/TD-29968-3.0 ... enh: grant support s3/active-active/dual-replica/db_encryption	2024-05-15 15:52:28 +08:00
Haojun Liao	abd90c733a	fix(stream): remove backend files only after the in-memory task is dropped.	2024-05-15 14:24:35 +08:00
54liuyao	2a67b83a27	adj code	2024-05-15 14:11:55 +08:00
Haojun Liao	43e018e210	Merge pull request #25733 from taosdata/fix/TD-29745 ... optimize scan data	2024-05-15 13:41:08 +08:00
54liuyao	167cdc79c5	format code	2024-05-15 10:54:53 +08:00
54liuyao	4c603fee55	format code	2024-05-15 10:54:24 +08:00
54liuyao	3c56f623ed	adj inline func	2024-05-15 10:46:19 +08:00
54liuyao	ab3ba3f2e4	optimize scan tsdb	2024-05-15 09:09:20 +08:00
Haojun Liao	a3bd3a4c76	Merge pull request #25769 from taosdata/fix/TS-4791 ... fix(tsdb): fix the length of column type overflow.	2024-05-15 00:44:59 +08:00
Haojun Liao	610aa80e65	fix(stream): init backend for fill-history task.	2024-05-15 00:08:38 +08:00
Haojun Liao	9300b7a401	fix(tsdb): fix the length of column type overflow.	2024-05-14 16:22:11 +08:00
Haojun Liao	6898eba6ed	fix(stream): expand stream tasks are divided into two phase, the first is to build stream task and then expand stream task before start stream tasks.	2024-05-14 14:34:31 +08:00
Minglei Jin	b6eec20dfb	fix(s3/grant): checking grant when doing migrate	2024-05-14 11:01:06 +08:00
Shungang Li	694680600e	fix: tsdbCache vartype of zero size	2024-05-14 09:23:32 +08:00
Haojun Liao	b7e7de0354	fix(stream): set the stream task load flag.	2024-05-13 16:45:38 +08:00
Haojun Liao	3dfffe9113	fix(stream): async load and start stream tasks.	2024-05-13 15:31:26 +08:00
t_max	f030af3aab	fix: build fails on macOS and Windows	2024-05-11 14:59:05 +08:00
Haojun Liao	d7e1f37cd4	Merge branch '3.0' into fix/3_liaohj	2024-05-11 10:28:12 +08:00
Haojun Liao	7f93ec2c53	fix(stream): update the checkpoint info for followers, and some internal refactor.	2024-05-11 09:37:02 +08:00
Hongze Cheng	4d4fa9ea94	Merge pull request #25703 from taosdata/fix/TD-29912 ... fix: handle memleak in vnodeSnapWriterOpen, add log for abort_edit	2024-05-10 15:29:44 +08:00
Hongze Cheng	db68b9a1f0	Merge pull request #25707 from taosdata/fix/TD-29981 ... fix: refactor lastcache ser/des for compatibility	2024-05-10 09:15:29 +08:00
Shungang Li	0ac5d393e6	fix: tsdbcache last disk data format change	2024-05-09 23:37:28 +08:00
Shungang Li	544999c01b	fix: tsdbCacheSerialize copy from null ptr	2024-05-09 22:55:29 +08:00
Shungang Li	457b98fee8	fix: adjust SValueV0 data order	2024-05-09 21:52:43 +08:00
Shungang Li	7ae4415890	fix: refactor lastcache ser/des for compatibility	2024-05-09 19:04:11 +08:00
Shungang Li	6895bb121f	fix: handle memleak in vnodeSnapWriterOpen, add log for abort_edit	2024-05-09 14:55:48 +08:00
dmchen	454b4047cb	fix/audit-memory-leak	2024-05-09 10:19:14 +08:00
Hongze Cheng	e76d15e33f	Merge pull request #25690 from taosdata/fix/TD-29962 ... enh: refactor tsdbCache ser/des	2024-05-09 09:04:09 +08:00
Shungang Li	70598a3038	enh: refactor tsdbCache ser/des	2024-05-09 00:13:19 +08:00
Hongze Cheng	9e21eacf26	Merge pull request #25687 from taosdata/fix/TD-29934-3.0 ... fix(tsdb/cache-update): compare when rocks's colVal not null	2024-05-08 21:48:01 +08:00
Minglei Jin	3d1612e44b	fix(tsdb/cache-update): compare when rocks's colVal not null	2024-05-08 19:27:43 +08:00
Hongze Cheng	431c3c0066	Merge pull request #25675 from taosdata/fix/TD-29934-3.0 ... fix(tsdb/cache-update): discard none colVals for same timestamp	2024-05-08 18:54:17 +08:00
Minglei Jin	bb227a9798	fix(tsdb/cache-update): discard none colVals for same timestamp	2024-05-08 17:29:07 +08:00
Shungang Li	733c8f8f9a	fix: (compatibility) SLastCol field change cause 'last' crash	2024-05-08 16:12:43 +08:00
Haojun Liao	b26656fd1c	Merge pull request #25661 from taosdata/fix/3_liaohj ... refactor: do some internal refactor.	2024-05-08 13:03:13 +08:00
Haojun Liao	cdeb4462fb	refactor: do some internal refactor.	2024-05-07 23:43:21 +08:00
Haojun Liao	55a630911d	Merge pull request #25653 from taosdata/fix/3_liaohj ... refactor: do some internal refactor.	2024-05-07 23:12:30 +08:00
Haojun Liao	b6debd985b	fix(stream): always return success if repeatly recv checkpoint source msg.	2024-05-07 16:33:08 +08:00
Hongze Cheng	c4b2f5681c	Merge pull request #25654 from taosdata/fix/TD-29845 ... fix: fix last col version when updating rocks	2024-05-07 11:33:51 +08:00
Haojun Liao	0e0f98eb8d	refactor: do some internal refactor.	2024-05-07 10:50:44 +08:00
Minglei Jin	562bf0fe1e	tsdb/cache: fix last col version when updating rocks	2024-05-07 10:24:07 +08:00
Shungang Li	b979c584fb	fix: tsdbCacheGetBatch ref of tmp memory	2024-05-07 10:22:58 +08:00
Haojun Liao	18c66a5491	refactor: do some internal refactor.	2024-05-06 18:17:38 +08:00
Haojun Liao	7ad7ef7cfc	refactor: do some internal refactor.	2024-05-06 17:03:41 +08:00
Haojun Liao	cdc7b03ac6	fix(stream): fix syntax error.	2024-04-30 22:44:32 +08:00
Haojun Liao	732e52d64d	refactor: do some internal refactor, and add some logs.	2024-04-30 19:11:58 +08:00
Haojun Liao	94a0f9ab8f	other: merge 3.0	2024-04-30 17:12:46 +08:00
Haojun Liao	629502e12e	refactor: do some internal refactor.	2024-04-30 17:00:51 +08:00
Haojun Liao	f2bc93b78d	Merge pull request #25598 from taosdata/fix/3_liaohj ... refactor(stream): opt stream sink perf.	2024-04-30 16:59:22 +08:00
dapan1121	f54dd2b818	Merge pull request #25602 from taosdata/fix/TS-4728-3.0 ... fix:use path of SStreamMeta	2024-04-30 16:12:50 +08:00
Haojun Liao	cb5a0563e6	fix(stream): fix error caused by merge.	2024-04-30 15:43:12 +08:00
wangmm0220	35003cbb34	fix:use path of SStreamMeta	2024-04-30 14:36:16 +08:00
Haojun Liao	4c27af9b13	refactor: do some internal refactor.	2024-04-30 13:25:39 +08:00
wangmm0220	3a1c210601	fix:use path of SStreamMeta	2024-04-30 11:06:03 +08:00
Haojun Liao	54e9522c62	refactor(stream): opt stream sink perf.	2024-04-30 09:41:29 +08:00
dapan1121	6187bf4e06	Merge pull request #25584 from taosdata/fix/TS-4728-3.0 ... fix:[TS-4728]transform store data if data is too big	2024-04-30 09:02:40 +08:00
wangmm0220	cd3f3046f7	fix:memory leak	2024-04-29 19:36:41 +08:00
wangmm0220	1f85cb42e6	fix:[TS-4728]transform strore data if data is too big	2024-04-29 17:22:40 +08:00
Haojun Liao	b0ef022e87	fix(tsdb): set the correct start pos for binary search.	2024-04-29 15:13:52 +08:00
Haojun Liao	7a5cdb81d5	fix(tsdb): set the correct start pos for binary search.	2024-04-29 14:40:49 +08:00
Haojun Liao	bf5d523116	fix(stream): disable the exec of complete check status in timer thread.	2024-04-28 17:57:34 +08:00
Haojun Liao	324072fed8	Merge pull request #25525 from taosdata/fix/3_liaohj ... fix(stream): update stream task meta info.	2024-04-26 18:15:09 +08:00
Haojun Liao	6d06188b9f	fix(stream): fix memory leak.	2024-04-26 17:06:15 +08:00
Haojun Liao	b1b3246066	fix(stream): update the checkpoint executed transId range.	2024-04-26 17:03:01 +08:00
Haojun Liao	5f5595a6ab	Merge pull request #25517 from taosdata/fix/3_liaohj ... fix(stream): add task node into update list if it is timeout for more than 100sec.	2024-04-26 17:00:23 +08:00
Haojun Liao	8b53f76691	fix(stream): discard the repeatly recv checkpoint-source msg.	2024-04-26 15:56:34 +08:00
Hongze Cheng	efdc943a3d	Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0	2024-04-26 14:57:58 +08:00
Haojun Liao	c565e31638	Merge pull request #25510 from taosdata/fix/3_liaohj ... fix(stream): handle disorder node Update trans Id.	2024-04-26 12:44:00 +08:00
Haojun Liao	815489d20a	fix(tsdb): set the pk info when converting fileblockinfo to binrecord.	2024-04-26 11:10:20 +08:00
Haojun Liao	77961ea791	fix(stream): handle disorder node Update trans Id.	2024-04-26 09:45:42 +08:00
Haojun Liao	feb176149e	Merge pull request #25507 from taosdata/fix/3_liaohj ... fix(tsdb): overlap check take pk into consideration.	2024-04-26 09:06:38 +08:00
Hongze Cheng	f500762af7	Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0	2024-04-26 09:00:09 +08:00
Haojun Liao	59a3e8ca40	fix(tsdb): overlap check take pk into consideration.	2024-04-25 23:25:24 +08:00
Haojun Liao	b3d2ccec83	Merge pull request #25483 from taosdata/fix/3_liaohj ... fix(query): add ts in cache_scan_operator if pk exists and only retri…	2024-04-25 22:32:26 +08:00
Haojun Liao	eef5e6e409	fix(stream): fix syntax error.	2024-04-25 18:30:33 +08:00
Haojun Liao	3b932599ab	fix(stream): fix syntax error.	2024-04-25 17:47:03 +08:00
Minglei Jin	eaa1e7a775	tsdb/writer: use latest version of data for writing	2024-04-25 16:40:58 +08:00
Haojun Liao	cd8baa7ba0	fix(stream): add log for update task epset, set correct update flag if epset updated.	2024-04-25 16:39:11 +08:00
Minglei Jin	a9094d7602	fix(cos/multi-writing): use lasted version of data	2024-04-25 16:37:24 +08:00
Hongze Cheng	10d82a3acf	Merge pull request #25476 from taosdata/enh/TS-4710-3.0 ... enh: recover file	2024-04-25 11:15:02 +08:00
Hongze Cheng	ca9aebc5ff	Merge pull request #25473 from taosdata/fix/TD-29773 ... Fix/TD-29773	2024-04-25 09:45:47 +08:00
Haojun Liao	ac860f7fe8	fix(query): add ts in cache_scan_operator if pk exists and only retrieve ts column.	2024-04-25 09:29:42 +08:00
Haojun Liao	3b08ee3d16	Merge pull request #25458 from taosdata/fix/3_liaohj ... fix(stream): add task update trans conflict level.	2024-04-24 18:54:06 +08:00
Hongze Cheng	2cac0d5691	enh: recover file	2024-04-24 18:04:10 +08:00
dapan1121	ab2c9aaf5b	Merge pull request #25466 from taosdata/enh/TD-29758 ... enh:[TD-29758]optimize log in tmq	2024-04-24 17:47:28 +08:00
Yihao Deng	1181f9de28	Fix metaGetColCmpr function and remove commented code	2024-04-24 08:22:54 +00:00
Hongze Cheng	b1fb14e49e	Merge pull request #25465 from taosdata/fix/TD-29759 ... fix(s3migrate/datas3): init fd of from & to early	2024-04-24 11:29:47 +08:00
Hongze Cheng	c3275dc61c	Merge pull request #25459 from taosdata/fix/TD-29750-3.0 ... fix: if not exists logic for topic/stream/table	2024-04-24 10:52:53 +08:00
Hongze Cheng	0eae851257	Merge pull request #25425 from taosdata/fix/ci_monitor_memory ... fix ci monitor memory	2024-04-24 10:35:04 +08:00
wangmm0220	20cedc3339	enh:[TD-29758]optimize log in tmq	2024-04-24 10:02:58 +08:00
Minglei Jin	c76f886c91	fix(s3migrate/datas3): init fd of from & to early	2024-04-24 09:36:44 +08:00
kailixu	c173be667c	Merge branch '3.0' into fix/TD-29750-3.0	2024-04-24 08:44:43 +08:00
Haojun Liao	ace5e12e65	fix(tsdb): set the correct lflag when creating tsdbCache reader.	2024-04-23 19:25:51 +08:00
Cary Xu	44b4580bd5	Update metaTable.c	2024-04-23 18:37:40 +08:00
kailixu	89ee62ac09	fix: if not exists logic for topic/stream/table	2024-04-23 18:19:16 +08:00
Haojun Liao	0f8ff48c6b	fix(stream): fix double free	2024-04-23 18:18:01 +08:00
Haojun Liao	0c7373509e	fix(stream): add task update trans conflict level.	2024-04-23 18:07:00 +08:00
Hongze Cheng	328f95f7cb	fix: possible write block when error occurs	2024-04-23 16:48:49 +08:00
Haojun Liao	7fda9d9fcb	Merge branch '3.0' into fix/3_liaohj	2024-04-23 15:08:43 +08:00
Haojun Liao	b0f68a9147	refactor: do some internal refactor.	2024-04-23 14:58:51 +08:00
Haojun Liao	1adf59e7d8	fix(stream): do check when task is paused, and do some internal refactor.	2024-04-23 13:53:23 +08:00
Haojun Liao	d7a08909dd	Merge pull request #25442 from taosdata/fix/3_liaohj ... fix(stream): save the epset if task epset updated.	2024-04-23 09:10:45 +08:00
Haojun Liao	315b86cf66	fix(stream): save the epset if task epset updated.	2024-04-22 23:52:45 +08:00
Haojun Liao	ada1c6d4c0	Merge pull request #25434 from taosdata/fix/3_liaohj ... fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.	2024-04-22 22:13:19 +08:00
Haojun Liao	a8fac441be	fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.	2024-04-22 14:02:31 +08:00
Yihao Deng	541b070765	Remove commented out code in metaCreateSTable function	2024-04-20 07:45:39 +00:00
Yihao Deng	ba30339d4e	Refactor meteDecodeColCmprEntry function to return -1 on error	2024-04-20 03:07:12 +00:00
Yihao Deng	517365467d	Merge branch '3.0' into fix/compatibleWithVeryOldMeta	2024-04-20 01:54:02 +00:00
Haojun Liao	e5dddc4abf	Merge branch '3.0' into fix/3_liaohj	2024-04-19 19:13:28 +08:00
Haojun Liao	ea527b19b8	fix(stream): set correct start version if no checkpoint exist.	2024-04-19 19:12:23 +08:00
dmchen	62bc1074c0	fix monitor memory	2024-04-19 10:44:08 +00:00
dapan1121	a46b7cca3d	Merge pull request #25413 from taosdata/feat/TS-4243-tmq ... opti:raw data from tmq	2024-04-19 18:22:21 +08:00
Yihao Deng	18cdeaf960	compatible with older meta	2024-04-19 07:37:43 +00:00
Hongze Cheng	69222543a2	Merge pull request #25401 from taosdata/fix/TD-29562 ... Fix/td 29562	2024-04-19 13:57:19 +08:00
wangmm0220	1695824c73	fix:merge from 3.0	2024-04-19 13:52:57 +08:00
wangmm0220	42467c0e00	opti:raw data from tmq	2024-04-19 13:48:17 +08:00
Hongze Cheng	fc5c84422e	Merge pull request #25256 from taosdata/feat/TD-24834 ... Feat/td 24834	2024-04-19 13:34:37 +08:00
Haojun Liao	62260bff79	Merge pull request #25389 from taosdata/fix/3_liaohj ... fix(stream): reset checkpoint info after receiving task-reset info.	2024-04-19 11:23:55 +08:00
Hongze Cheng	e4e00c8953	Merge pull request #25403 from taosdata/fix/TD-29621 ... fix: geometry crash in stream & tmq	2024-04-19 11:15:26 +08:00
Yihao Deng	2314771209	fix TD-29562	2024-04-19 02:09:40 +00:00
Yihao Deng	ee8a96fb42	fix TD-29562	2024-04-19 02:04:32 +00:00
Haojun Liao	34f7dc4782	Merge pull request #25404 from taosdata/feat/TS-4243-3.0 ... fix(tsdb): set correct compare func for merge tree.	2024-04-19 09:10:03 +08:00
Haojun Liao	eb1fed177f	fix(tsdb): set correct compare func for merge tree.	2024-04-19 00:32:41 +08:00
Haojun Liao	525b574c85	Merge pull request #25402 from taosdata/feat/TS-4243-3.0 ... fix(tsdb): update the initial value of pk for varchar type.	2024-04-18 19:49:05 +08:00
Shungang Li	f3438ce04e	fix: geometry crash in stream & tmq	2024-04-18 19:27:02 +08:00
Haojun Liao	815d12fd77	fix(stream): set check downstream completed for sink task.	2024-04-18 18:36:02 +08:00
Haojun Liao	4802cd1ddf	Merge branch '3.0' into fix/3_liaohj	2024-04-18 17:53:30 +08:00
Hongze Cheng	05d853bd9e	Merge pull request #25383 from taosdata/fix/dropStreamData ... Fix/drop stream data	2024-04-18 17:10:57 +08:00
Hongze Cheng	874b4b1911	Merge pull request #25400 from taosdata/enh/TD-28945-pk ... fix(vnode): encode the missing tsdbPageSize	2024-04-18 17:04:29 +08:00
Haojun Liao	8962010caf	other: merge 3.0	2024-04-18 16:31:15 +08:00
Haojun Liao	c94c9a900c	fix(tsdb): update the initial value of pk for varchar type.	2024-04-18 16:17:29 +08:00
Yihao Deng	d21341c943	fix TD-29562	2024-04-18 08:16:40 +00:00
kailixu	20c4385d27	Merge branch '3.0' into feat/TD-24834	2024-04-18 15:54:01 +08:00
Yihao Deng	3f4fa8b74e	fix TD-29562	2024-04-18 07:03:18 +00:00
Minglei Jin	eb51a7c5b5	vnode: encode the missing tsdbPageSize	2024-04-18 14:48:05 +08:00
Hongze Cheng	a4edab720c	Merge pull request #25391 from taosdata/enh/TD-28945-pk ... cos/multi-writing: init fid & cid for s3 page cache	2024-04-18 14:05:28 +08:00
Haojun Liao	deee0c3793	refactor: do some internal refactor.	2024-04-18 13:05:45 +08:00
Haojun Liao	d5d23b0434	fix(tsdb): set reader status normal once successful taking snapshot.	2024-04-18 13:05:44 +08:00
Minglei Jin	8ca2b08d5c	cos/multi-writing: fix remove_file with -1 lcn	2024-04-18 08:48:44 +08:00
Haojun Liao	9056a48efd	refactor: do some internal refactor.	2024-04-17 21:58:02 +08:00
Haojun Liao	ac84a5f82b	refactor: do some internal refactor.	2024-04-17 21:57:09 +08:00