1678 Commits

Author	SHA1	Message	Date
yihaoDeng	8883d66227	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-08-24 17:20:12 +08:00
yihaoDeng	090515c684	refactor code	2023-08-24 17:20:04 +08:00
Ganlin Zhao	13d2d72bb6	add seperate function for createLogs	2023-08-24 14:56:14 +08:00
Haojun Liao	a750eb9699	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-08-24 11:43:32 +08:00
Haojun Liao	957c7f872b	fix(stream): update the agg task status check, when transferring state.	2023-08-24 11:43:18 +08:00
liuyao	1e108c4178	mem leak	2023-08-24 11:34:43 +08:00
liuyao	7ebce2814f	mem leak	2023-08-24 11:19:59 +08:00
yihaoDeng	3afea998ac	refactor log	2023-08-24 10:15:15 +08:00
Ganlin Zhao	962a0cd403	fix	2023-08-23 23:34:02 +08:00
yihaoDeng	0959758bd5	fix transfer error	2023-08-23 21:43:10 +08:00
Haojun Liao	8e07703dd2	fix(stream): reset the timerActive value.	2023-08-23 18:26:07 +08:00
Haojun Liao	809d3087ff	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 ... # Conflicts: # source/dnode/mnode/impl/src/mndStream.c	2023-08-23 17:53:50 +08:00
Haojun Liao	230d8c2d80	fix(stream): fix error in stream computing after vnode is transferred to other dnodes.	2023-08-23 17:50:44 +08:00
yihaoDeng	1ffc13d391	fix mem leak	2023-08-23 17:02:12 +08:00
Haojun Liao	f8a3cdb987	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-08-23 14:10:56 +08:00
Haojun Liao	b0c5fa8290	fix(stream): reset the task status.	2023-08-23 14:10:41 +08:00
yihaoDeng	ab407c58b6	add log	2023-08-23 10:54:50 +08:00
yihaoDeng	12b10dfc76	fix mem leak	2023-08-23 09:08:37 +08:00
yihaoDeng	5fe7563a13	fix mem leak	2023-08-22 21:13:02 +08:00
yihaoDeng	ba5c3648db	fix mem leak	2023-08-22 21:12:54 +08:00
Haojun Liao	57ef43ba18	fix(stream): set sink task status to enable the checkpoint.	2023-08-22 18:16:46 +08:00
yihaoDeng	ab9490101f	Merge branch 'enh/3.0' into enh/triggerCheckPoint2	2023-08-22 18:04:04 +08:00
Haojun Liao	af80d94a88	refactor: do some internal refactor.	2023-08-22 15:43:50 +08:00
Haojun Liao	e6b49b45d9	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-08-22 13:37:50 +08:00
Haojun Liao	cc8b2263cb	fix(stream): fix error in heartbeat from vnode.	2023-08-22 13:37:38 +08:00
yihaoDeng	2c1ca6d325	Merge branch 'enh/3.0' into enh/triggerCheckPoint2	2023-08-22 10:51:39 +08:00
yihaoDeng	d106b5a87e	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-08-22 10:48:30 +08:00
yihaoDeng	a0fd56c84f	fix invalid cmp	2023-08-22 10:48:15 +08:00
Haojun Liao	64556c9f1d	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-08-22 10:47:02 +08:00
Haojun Liao	def0877980	fix(stream): add timer to check stream task status.	2023-08-22 10:46:49 +08:00
yihaoDeng	0304ad88ff	fix invalid cmp	2023-08-22 09:49:04 +08:00
yihaoDeng	fdd62e53d8	fix invalid cmp	2023-08-22 09:11:56 +08:00
yihaoDeng	2268114c4a	fix invalid cmp	2023-08-22 09:10:48 +08:00
yihaoDeng	55f1d464ab	fix invalid cmp	2023-08-22 09:06:42 +08:00
yihaoDeng	3e944d228b	refactor checkpoint	2023-08-21 21:48:06 +08:00
Haojun Liao	082882b71e	fix(stream): reset the upstream stage info.	2023-08-21 19:29:03 +08:00
Haojun Liao	8b27f98ee4	refactor: do some internal refactor.	2023-08-21 19:08:27 +08:00
yihaoDeng	387b4d365e	refactor checkpoint	2023-08-21 19:07:15 +08:00
yihaoDeng	bf3c401a68	refactor checkpoint	2023-08-21 12:52:00 +08:00
Haojun Liao	99024e9d78	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-08-21 11:49:08 +08:00
Haojun Liao	29bb5854cc	fix(stream): fix error in check stream state.	2023-08-21 11:48:55 +08:00
yihaoDeng	9ef69dd455	refactor checkpoint	2023-08-21 10:27:47 +08:00
yihaoDeng	1c5346b13c	refactor checkpoint	2023-08-19 16:10:03 +08:00
yihaoDeng	52788aca1c	fix checkpoint error	2023-08-19 12:25:22 +08:00
yihaoDeng	fbdea723b0	fix checkpoint error	2023-08-19 11:58:12 +08:00
Haojun Liao	718bb4a881	fix(stream): fix the invalid free.	2023-08-18 22:40:04 +08:00
yihaoDeng	8e4411c144	fix checkpoint error	2023-08-18 21:42:35 +08:00
Haojun Liao	4b10393c81	fix(stream): fix memory leak and do some internal refactor.	2023-08-18 18:02:08 +08:00
yihaoDeng	3a3385bb84	fix mem leak	2023-08-18 17:01:57 +08:00
yihaoDeng	0537323bac	fix get error	2023-08-18 16:54:33 +08:00
Haojun Liao	c26d625152	Merge branch '3.0' into enh/triggerCheckPoint2	2023-08-18 15:51:07 +08:00
liuyao	9afd5155ed	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-08-18 15:33:37 +08:00
liuyao	87c65f3b68	Merge remote-tracking branch 'origin/3.0' into enh/triggerCheckPoint2	2023-08-18 15:27:02 +08:00
Haojun Liao	10872240ae	Merge pull request #22476 from taosdata/fix/3_liaohj ... fix(stream): pause when outputQ is blocked.	2023-08-18 15:12:54 +08:00
Haojun Liao	3ec28ca5e1	Merge branch 'enh/triggerCheckPoint2' of github.com:taosdata/tdengine into enh/triggerCheckPoint2	2023-08-18 15:11:19 +08:00
Haojun Liao	edbad45772	other: add logs.	2023-08-18 13:45:08 +08:00
yihaoDeng	ac10f0f9b4	add trace log	2023-08-18 12:06:41 +08:00
Haojun Liao	a8b53c2e69	other: add logs.	2023-08-18 10:51:59 +08:00
Haojun Liao	2a9668da67	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 ... # Conflicts: # source/dnode/mnode/impl/src/mndStream.c	2023-08-18 10:30:30 +08:00
Haojun Liao	87785b1d9c	refactor: add some logs.	2023-08-18 10:30:00 +08:00
yihaoDeng	002d5979c1	add trace log	2023-08-17 21:13:03 +08:00
yihaoDeng	ebd4cac36b	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-08-17 18:58:18 +08:00
yihaoDeng	46574c385f	fix mem leak	2023-08-17 18:52:33 +08:00
Haojun Liao	a18989df88	fix(stream): add lost codes caused by merge 3.0.	2023-08-17 18:51:39 +08:00
Haojun Liao	9e9d83d4a1	refactor: do some internal refactor	2023-08-17 11:57:04 +08:00
Haojun Liao	bb4f8515bd	fix(stream): pause when outputQ is blocked.	2023-08-17 11:53:17 +08:00
Haojun Liao	58c0a3d8ef	fix(stream): fix syntax error.	2023-08-17 09:13:37 +08:00
Haojun Liao	eb76b6f175	fix(stream): fix syntax error.	2023-08-17 09:11:32 +08:00
liuyao	5ce7688a93	Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/ly_refactor	2023-08-17 09:06:46 +08:00
Haojun Liao	6746339609	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 ... # Conflicts: # source/libs/stream/src/streamSnapshot.c	2023-08-17 00:08:44 +08:00
Haojun Liao	ea6574b3c7	other: merge 3.0	2023-08-17 00:07:55 +08:00
yihaoDeng	114df7c349	fix transfer error	2023-08-16 11:37:15 +00:00
Haojun Liao	59d5858b95	fix(stream): fix a typo	2023-08-16 19:22:45 +08:00
Haojun Liao	9a76ae72d6	fix(stream): add the back pressure for sink node.	2023-08-16 19:11:43 +08:00
Haojun Liao	ec84d7fd81	fix(stream): add the back pressure for sink node.	2023-08-16 19:00:35 +08:00
yihaoDeng	ab7e2b3122	Merge branch 'enh/chkpTransfer' into enh/triggerCheckPoint2	2023-08-16 09:00:30 +00:00
Haojun Liao	d63758a1c5	fix(stream): fix error in execute task on a tranferred node.	2023-08-16 15:24:24 +08:00
yihaoDeng	993ae84398	close backend	2023-08-16 07:17:15 +00:00
yihaoDeng	7815e44655	fix invalid free	2023-08-16 09:48:11 +08:00
Haojun Liao	ad9f3cbc43	other: merge main.	2023-08-16 09:14:10 +08:00
Haojun Liao	7628be236d	other: merge main.	2023-08-16 09:03:54 +08:00
yihaoDeng	7fd918962f	fix invalid free	2023-08-16 00:53:10 +00:00
Haojun Liao	9551fcf7bb	fix(tsdb): check the	2023-08-15 20:57:12 +08:00
Haojun Liao	13640f5f53	other	2023-08-15 20:46:06 +08:00
Haojun Liao	6d7b6fbb74	other: add some logs.	2023-08-15 20:01:53 +08:00
liuyao	19dfcf3a59	refactor stream scan log	2023-08-15 16:29:48 +08:00
Haojun Liao	39079ab64a	fix(stream): load term from sync model to decide if the node is restart or not	2023-08-15 15:52:06 +08:00
Haojun Liao	71c3c710e6	fix(stream): continue process when met with trans-state msg.	2023-08-15 14:23:20 +08:00
Haojun Liao	0acb00c516	fix(stream): add log.	2023-08-15 11:48:56 +08:00
Haojun Liao	c9f3e0b0e1	fix(stream): fix an syntax error.	2023-08-15 09:34:19 +08:00
Haojun Liao	fe5e48b87d	fix(stream): remove redundant include.	2023-08-15 09:26:35 +08:00
Haojun Liao	b1d35f43ba	enh(stream): using term from sync module to denote the upstream node is restarted/replica-modified/vnode-transferred or not.	2023-08-15 09:25:05 +08:00
Haojun Liao	a334547726	fix(stream): fix an syntax error.	2023-08-14 19:28:36 +08:00
Haojun Liao	1a08ffc79f	fix(stream): check error.	2023-08-14 19:27:09 +08:00
Haojun Liao	5d3232d275	fix(stream): fix an syntax error.	2023-08-14 18:14:32 +08:00
Haojun Liao	2e6263b43f	fix(stream): fix memory leak.	2023-08-14 17:16:11 +08:00
Haojun Liao	a1e554fbf3	refactor: exec directly not asynchnoized.	2023-08-14 15:05:13 +08:00
Haojun Liao	91710b0c0f	fix(stream):	2023-08-14 14:56:17 +08:00
Haojun Liao	e8c9a019a4	fix(stream): remove the invalid set of scheduler status.	2023-08-14 11:41:24 +08:00
Haojun Liao	2806fe1c56	fix(stream): ignore the related stream task destory msg in transfer state.	2023-08-14 10:58:24 +08:00
Haojun Liao	98f40325e9	fix(stream): fix memory leak.	2023-08-13 20:02:15 +08:00
Haojun Liao	a81cc9aebf	fix(stream): fix the error when no agg tasks exist.	2023-08-13 17:31:09 +08:00
Haojun Liao	0d38f389ab	refactor: do some internal refactor.	2023-08-13 16:25:35 +08:00
Haojun Liao	0e189f70a1	refactor	2023-08-12 19:44:44 +08:00
Haojun Liao	03c26a9d6d	refactor	2023-08-12 19:16:20 +08:00
Haojun Liao	afe9b848a5	fix(tsdb): check the	2023-08-12 18:54:39 +08:00
Haojun Liao	09da6c6840	refactor: do some internal refactor.	2023-08-12 18:51:20 +08:00
Haojun Liao	75e6fb0f16	refactor: do some internal refactor.	2023-08-12 18:47:01 +08:00
Haojun Liao	075b5e9481	refactor: do some internal refactor.	2023-08-12 18:41:54 +08:00
Haojun Liao	a0534ee715	refactor: do some internal refactor.	2023-08-12 18:40:09 +08:00
Haojun Liao	8f9de93cf0	refactor: do some internal refactor.	2023-08-12 18:37:36 +08:00
Haojun Liao	30c2a9c619	refactor: do some internal refactor.	2023-08-12 18:27:51 +08:00
Haojun Liao	0d0e30b764	fix(stream): fix the error.	2023-08-12 17:20:10 +08:00
Haojun Liao	ce721a0146	fix(stream): fix error.	2023-08-12 16:32:05 +08:00
Haojun Liao	a89ce1a20b	fix(stream): transfer state by using data block.	2023-08-12 01:24:07 +08:00
Haojun Liao	f24b22000f	enh(stream): stop stream task before redistribute vnodes.	2023-08-11 23:46:53 +08:00
Haojun Liao	87c7e4c0fe	fix(stream): not launch stream tasks when restarting the stream tasks.	2023-08-11 16:19:46 +08:00
yihaoDeng	6e6eb05d5c	Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer	2023-08-11 08:03:02 +00:00
Haojun Liao	e984affe90	fix(stream): disable the stream in the followers nodes.	2023-08-11 15:58:15 +08:00
Haojun Liao	4afe603c6e	fix(stream): fix error.	2023-08-11 14:17:09 +08:00
yihaoDeng	99be2836b2	Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer	2023-08-11 02:50:12 +00:00
Haojun Liao	1e636a2ef9	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-08-11 10:37:40 +08:00
Haojun Liao	6a9826cf6e	enh(stream): update the stream task epset.	2023-08-11 10:37:25 +08:00
yihaoDeng	ba4ce9db02	Merge branch 'enh/triggerCheckPoint2' into enh/chkpTransfer	2023-08-11 02:15:07 +00:00
yihaoDeng	32983a11e1	add log and fix crash	2023-08-10 20:34:00 +08:00
Haojun Liao	8890fa5781	fix(stream): execute the stream task directly, instead of executing it in a asynchronized way.	2023-08-10 15:13:49 +08:00
yihaoDeng	b2fb94d7f8	Merge branch 'enh/chkpTransfer' of https://github.com/taosdata/TDengine into enh/chkpTransfer	2023-08-10 14:57:25 +08:00
yihaoDeng	ea00f676fc	Merge branch 'enh/chkpTransfer' of https://github.com/taosdata/TDengine into enh/chkpTransfer	2023-08-10 14:57:12 +08:00
yihaoDeng	100d2240c3	support reopen stream state	2023-08-10 06:35:25 +00:00
Haojun Liao	a713b37f35	fix(stream): add more logs.	2023-08-10 14:07:29 +08:00
Haojun Liao	f633c7fe2b	other: merge 3.0.	2023-08-10 11:56:30 +08:00
Haojun Liao	b658608541	Merge pull request #22388 from taosdata/fix/3_liaohj ... other: merge main.	2023-08-10 11:43:02 +08:00
yihaoDeng	ef247cdb1d	support reopen stream state	2023-08-10 01:49:26 +00:00
Haojun Liao	c10b323188	other: merge main.	2023-08-10 09:26:33 +08:00
Haojun Liao	4393375e47	fix(stream): set correct task id.	2023-08-10 02:16:04 +08:00
Haojun Liao	0cf8144952	fix(stream): fix the invalid key used by remove data in stream meta hash table.	2023-08-09 22:28:23 +08:00
yihaoDeng	a20b299f9b	support reopen stream state	2023-08-09 13:06:10 +00:00
yihaoDeng	19ac9054d0	support reopen stream state	2023-08-09 12:47:49 +00:00
Haojun Liao	d34b9af054	enh(stream): create update stream trans.	2023-08-09 19:38:13 +08:00
yihaoDeng	1db15da4e1	support reopen stream state	2023-08-09 09:50:49 +00:00
yihaoDeng	6fdcd82a33	support reopen stream state	2023-08-09 09:19:03 +00:00
yihaoDeng	f3cf907d5a	support reopen stream state	2023-08-09 09:07:13 +00:00
yihaoDeng	a336a7b1a4	support reopen stream state	2023-08-09 09:06:22 +00:00
yihaoDeng	a619b8f5be	rm duplicate para	2023-08-09 08:58:49 +00:00
Haojun Liao	1e8579e8c5	fix(stream): fix other cases.	2023-08-09 16:04:48 +08:00
Haojun Liao	4c92997328	fix(stream): use streamId&taskId to identify the stream task in the stream meta.	2023-08-09 15:52:23 +08:00
yihaoDeng	92b247aae8	support reopen stream state	2023-08-09 07:36:00 +00:00
yihaoDeng	bbcfa9ab03	support reopen stream state	2023-08-09 06:10:40 +00:00
Haojun Liao	3cdb16352c	fix(stream): avoid launching check downstream when failed to add stream task into stream meta.	2023-08-09 12:03:14 +08:00
Haojun Liao	f3c5f20ee2	enh(stream): add timer to check the node changing.	2023-08-09 10:25:16 +08:00
yihaoDeng	c43a6b272c	support reopen stream state	2023-08-09 02:09:50 +00:00
yihaoDeng	ac11537fc8	support reopen stream state	2023-08-08 07:21:47 +00:00
Haojun Liao	17c6143471	fix(stream): check more status when handling the state transfer.	2023-08-08 15:08:11 +08:00
Haojun Liao	a0dcec5890	enh(stream): add function handler for hb message.	2023-08-08 11:23:19 +08:00
Haojun Liao	db8ce3de3b	other: merge main.	2023-08-08 10:17:51 +08:00
Haojun Liao	327e13c3f7	fix(stream): fix the syntax error.	2023-08-08 10:07:28 +08:00
Haojun Liao	d6d63ec54c	fix(stream): add more check.	2023-08-08 09:54:49 +08:00
Haojun Liao	e89d3c18d6	fix(stream): remove invalid check.	2023-08-08 09:54:46 +08:00
Haojun Liao	ac00e1d520	fix(stream): fetch all data before paused and dump to sink node.	2023-08-08 09:54:43 +08:00
Haojun Liao	0e3fd5277d	fix(stream): dump results to sink node before paused.	2023-08-08 09:54:39 +08:00
Haojun Liao	1e680d4df1	fix(stream): ignore the sink task transfer state.	2023-08-08 09:52:19 +08:00
Haojun Liao	3bcc7ed83e	fix(stream): transfer the state for agg tasks.	2023-08-08 09:52:04 +08:00
Haojun Liao	d43cb3fcdf	fix(stream): kill task when pause the stream execution.	2023-08-08 09:51:21 +08:00
Haojun Liao	ca2183acfd	refactor: do some internal refactor.	2023-08-08 09:50:40 +08:00
Haojun Liao	82ab81810b	refactor: do some internal refactor.	2023-08-08 09:40:21 +08:00
Haojun Liao	51e0b903b0	refactor: do some internal refactor.	2023-08-08 09:36:42 +08:00
Haojun Liao	af3a87560a	refactor: do some refactor.	2023-08-08 09:11:41 +08:00
Haojun Liao	f8ee055641	other: merge 3.0	2023-08-08 00:19:08 +08:00
Haojun Liao	ad3e231b2f	Merge pull request #22350 from taosdata/fix/3_liaohj ... other: merge main and fix bugs in stop stream tasks.	2023-08-07 22:57:13 +08:00
Haojun Liao	85756e4404	Merge pull request #22353 from taosdata/fix/liaohj ... fix(stream): commit the update to make sure the new state of tasks will be persistent to disk.	2023-08-07 22:57:08 +08:00
yihaoDeng	6b73fc9c06	support reopen stream state	2023-08-07 13:56:53 +00:00
yihaoDeng	80e78e054d	support reopen stream state	2023-08-07 11:39:32 +00:00
Haojun Liao	2da67392c6	fix(stream): commit the update to make sure the new state of tasks will be persistent to disk.	2023-08-07 19:30:23 +08:00
yihaoDeng	6a69c56b32	support reopen stream state	2023-08-07 10:55:42 +00:00
yihaoDeng	6c8c575549	support reopen stream state	2023-08-07 10:48:04 +00:00
Haojun Liao	aea1690cd1	fix(stream): fix the stream task after checking if it is in the timer activities.	2023-08-07 17:49:36 +08:00
yihaoDeng	b6c991f896	support reopen stream state	2023-08-07 08:59:04 +00:00
yihaoDeng	eeb97351e8	support reopen stream state	2023-08-07 08:51:01 +00:00
Haojun Liao	225c0e61dc	hen(stream): support the rollback and checkdown stream tasks.	2023-08-07 16:13:39 +08:00
yihaoDeng	7ef4df8752	support reopen stream state	2023-08-07 07:20:05 +00:00
Haojun Liao	7924d7e0af	Merge pull request #22337 from taosdata/fix/fixInvalidFree ... fix invalid free	2023-08-07 11:45:29 +08:00
Haojun Liao	a8006d3d0d	Merge pull request #22278 from taosdata/fix/fixStateMemleak ... fix state mem leak	2023-08-07 11:45:16 +08:00
yihaoDeng	4ca39d0f3c	support reopen stream state	2023-08-07 01:45:16 +00:00
Haojun Liao	8a11a0418f	other: merge 3.0	2023-08-07 09:19:26 +08:00
yihaoDeng	7396799d90	fix invalid free	2023-08-04 19:06:16 +08:00
yihaoDeng	36e841b6d0	fix invalid free	2023-08-04 18:59:17 +08:00
Hui Li	f19826fa9d	Merge pull request #22313 from taosdata/fix/addStreamVer ... add stream verion	2023-08-04 17:36:21 +08:00
yihaoDeng	a4da6e9a88	fix mem leak	2023-08-04 15:59:34 +08:00
yihaoDeng	81908be32f	add stream ver	2023-08-04 14:02:03 +08:00
yihaoDeng	6dc93a8dec	add stream ver	2023-08-04 13:52:20 +08:00
liuyao	9cb481dd6e	use stream task	2023-08-04 11:01:36 +08:00
yihaoDeng	f9d0874e45	support reopen stream state	2023-08-03 08:24:50 +00:00
liuyao	3464979489	set dummy delete data request	2023-08-03 09:03:48 +08:00
yihaoDeng	918eca4d22	fix state mem leak	2023-08-02 03:31:11 +00:00
yihaoDeng	6cdf94fec0	fix state mem leak	2023-08-02 03:29:13 +00:00
yihaoDeng	d9fd95777a	fix state mem leak	2023-08-02 03:21:39 +00:00
yihaoDeng	83468a7710	fix state mem leak	2023-08-02 03:18:59 +00:00
Haojun Liao	13543f7daa	feature(stream): handle task update in tq module.	2023-08-02 10:33:41 +08:00
liuyao	71b000f08c	reload state window state	2023-08-01 18:22:40 +08:00
Haojun Liao	ad4c5916e7	enh(stream): update the stream task.	2023-08-01 18:14:58 +08:00
Haojun Liao	164bfd5408	enh(stream): prepare update trans.	2023-08-01 16:12:35 +08:00
yihaoDeng	111481cef9	fix state mem leak	2023-08-01 08:09:10 +00:00
Haojun Liao	6365d5000b	Merge pull request #22271 from taosdata/fix/3_liaohj ... fix(stream): dump results to sink node before paused.	2023-08-01 15:50:17 +08:00
Haojun Liao	f1e0e64918	fix(stream): add more check.	2023-08-01 14:31:41 +08:00
Haojun Liao	75b1520be0	enh(stream): create task update info	2023-08-01 14:04:07 +08:00
Haojun Liao	e11cda17c0	fix(stream): remove invalid check.	2023-08-01 10:30:24 +08:00
Haojun Liao	f6ae9cf9bb	fix(stream): fetch all data before paused and dump to sink node.	2023-08-01 10:16:14 +08:00
Haojun Liao	b83860372c	fix(stream): dump results to sink node before paused.	2023-08-01 00:50:30 +08:00
Haojun Liao	36ef9a537f	Merge pull request #22256 from taosdata/fix/TD-25457 ... check update data	2023-07-31 22:56:05 +08:00
Haojun Liao	8c1c17e31e	fix(stream): ignore the sink task transfer state.	2023-07-31 19:23:53 +08:00
Haojun Liao	d72580dad7	fix(stream): transfer the state for agg tasks.	2023-07-31 19:12:23 +08:00
Haojun Liao	d45596bb33	fix(stream): kill task when pause the stream execution.	2023-07-31 18:07:37 +08:00
liuyao	32b59af4b1	check update data	2023-07-31 17:32:24 +08:00
Haojun Liao	9981cecbed	refactor: do some internal refactor.	2023-07-31 15:24:35 +08:00
Haojun Liao	e61aa83594	enh(stream): handle the stream hb.	2023-07-31 14:07:18 +08:00
Haojun Liao	cc5ff44604	enh(stream): handle the stream hb.	2023-07-30 19:25:00 +08:00
Haojun Liao	8dfef8768a	other: merge 3.0	2023-07-29 22:54:16 +08:00
Haojun Liao	0bd2548937	fix(stream): initialize the filter window initial range.	2023-07-29 16:41:01 +08:00
Haojun Liao	f6e07d1fdb	other: merge 3.0	2023-07-29 01:32:02 +08:00
Haojun Liao	92d1dbd9ad	fix(stream): set the time window filter before generating create table result.	2023-07-29 01:23:06 +08:00
Haojun Liao	6c9fa4d7c8	fix(stream): check for pause when handling the fill history data.	2023-07-28 19:58:52 +08:00
Haojun Liao	936afeb5ac	refactor: do internal refactor to simple the pause/resume in case of fill history exists.	2023-07-28 19:13:03 +08:00
Haojun Liao	d5974a8f25	refactor(stream): refactor the pause/resume for fill history execution.	2023-07-28 18:05:32 +08:00
Haojun Liao	9f943213ed	enh(stream): update the hb info.	2023-07-28 14:23:53 +08:00
Haojun Liao	74834aea11	enh(stream): prepare hb to mnode from stream meta.	2023-07-28 13:07:16 +08:00
Haojun Liao	2a78cd2d23	Merge pull request #22215 from taosdata/fix/liaohj ... other: merge main.	2023-07-28 13:06:17 +08:00
Haojun Liao	ccc0f13649	Merge pull request #22214 from taosdata/fix/3_liaohj ... fix(stream): scan wal in step2	2023-07-28 00:42:15 +08:00
Haojun Liao	22a5a18fff	fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store.	2023-07-27 18:57:36 +08:00
liuyao	5d21f50340	adjust history task trigger mode	2023-07-27 17:45:28 +08:00
Haojun Liao	6319cb8dd4	fix: fix syntax error.	2023-07-27 17:16:45 +08:00
Haojun Liao	b145771a1b	other: merge 3.0	2023-07-27 16:38:57 +08:00
Haojun Liao	3d403dca5a	other: merge main.	2023-07-27 16:23:41 +08:00
Haojun Liao	6ff50d4eaf	fix(stream): update the step2 scan wal files.	2023-07-27 16:10:55 +08:00
Haojun Liao	40fe3ef4f6	fix(stream): refactor the step2 wal scan.	2023-07-27 14:49:20 +08:00
Haojun Liao	e89f530db2	fix(stream): scan wal in step2	2023-07-27 10:55:59 +08:00
yihaoDeng	287088ae3f	fix stream state transfer	2023-07-26 10:16:06 +00:00
liuyao	c368db30c3	stream fill operator mem leak	2023-07-26 17:38:37 +08:00
Haojun Liao	cdffabcdad	fix(stream): fix memory leak.	2023-07-26 14:37:04 +08:00
Haojun Liao	728112ed89	fix(stream): set correct upstream epinfo.	2023-07-26 10:26:59 +08:00
Haojun Liao	12986ff594	fix(stream): fix memory leaks.	2023-07-26 09:25:30 +08:00
yihaoDeng	22c85fcbad	fix stream state transfer	2023-07-25 13:07:49 +00:00
yihaoDeng	0c2e86f416	fix stream state transfer	2023-07-25 10:17:30 +00:00
Haojun Liao	1c1bf63e1f	other: merge 3.0	2023-07-25 18:17:11 +08:00
Haojun Liao	063673726a	fix(stream): fix syntax error	2023-07-25 18:08:22 +08:00
Haojun Liao	2cc4e0a727	fix(stream): fix syntax error	2023-07-25 17:56:40 +08:00
Haojun Liao	0bdccd2681	refactor: do some internal refactor.	2023-07-25 17:31:54 +08:00
Haojun Liao	d29f835a63	fix(stream): set the correct step2 scan time window range.	2023-07-25 15:09:22 +08:00
Haojun Liao	f3f1fade43	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-25 09:25:32 +08:00
Haojun Liao	c116b69941	fix(stream): fix memory leak.	2023-07-25 09:25:18 +08:00
Haojun Liao	a2694b9ce9	fix(stream): fix the invalid check of step2 .	2023-07-24 19:44:28 +08:00
yihaoDeng	fe262d308e	del wal	2023-07-24 11:10:15 +00:00
Haojun Liao	1e34f84f78	other: merge 3.0	2023-07-24 15:23:03 +08:00
Haojun Liao	9bae91bcba	fix(stream): add some logs, and remove the invalid loop.	2023-07-24 13:37:44 +08:00
yihaoDeng	6a27e81964	fix stream state transfer	2023-07-24 02:05:14 +00:00
Haojun Liao	1367552f38	fix(stream): refactor the halt status to check more status.	2023-07-24 10:04:15 +08:00
Haojun Liao	0b6e1a12bb	refactor: do some internal refactor.	2023-07-23 19:09:43 +08:00
Haojun Liao	e387b2f932	refactor: do some internal refactor.	2023-07-23 18:59:34 +08:00
Haojun Liao	4e0f7ffbf8	fix(stream): set the correct flag of pause/resume.	2023-07-23 18:49:56 +08:00
Haojun Liao	9679cc4527	fix(stream): fix race condition.	2023-07-22 10:19:51 +08:00
Haojun Liao	f4864b8713	fix(stream): fix memory leak.	2023-07-22 01:02:58 +08:00
Haojun Liao	bfc4a07207	fix(stream): fix memory leak.	2023-07-22 00:20:02 +08:00
Haojun Liao	1b2636028a	fix(stream): fix memory leak.	2023-07-21 23:05:42 +08:00
Haojun Liao	16d7707b90	fix(stream): align the scan real time data for stream task.	2023-07-21 19:33:43 +08:00
Haojun Liao	39ca9b537f	fix(stream): fix syntax error	2023-07-21 09:43:08 +08:00
Haojun Liao	bd8b811b9d	refactor: do some internal refactor.	2023-07-21 09:14:25 +08:00
Haojun Liao	0d1c4f9ee2	fix(stream): fix syntax error	2023-07-21 09:13:06 +08:00
Haojun Liao	db46d31ca5	fix(stream): refactor the halt function.	2023-07-21 01:32:42 +08:00
yihaoDeng	82df77eba8	fix stream state transfer	2023-07-20 11:52:31 +00:00
yihaoDeng	fc2d6744e2	fix stream state transfer	2023-07-20 10:52:34 +00:00
yihaoDeng	519d3b74d1	fix stream state transfer	2023-07-20 09:51:18 +00:00
Haojun Liao	c9fa170e65	refactor: do some internal refactor.	2023-07-20 16:31:46 +08:00
Haojun Liao	45cb478b31	refactor: do some internal refactor.	2023-07-20 15:36:46 +08:00
Haojun Liao	87fa8f0c4c	Merge branch '3.0' into fix/3_liaohj	2023-07-20 12:15:23 +08:00
Haojun Liao	aed99da6c1	refactor: refactor the stream task starting order.	2023-07-20 12:14:53 +08:00
yihaoDeng	6e5be0d30e	fix stream state transfer	2023-07-20 03:49:32 +00:00
yihaoDeng	733db123ad	refactor code	2023-07-19 13:24:59 +00:00
Haojun Liao	97c44e7c18	refactor: do some internal refactor.	2023-07-19 18:42:02 +08:00
liuyao	8481725517	remove redundant results	2023-07-19 14:58:28 +08:00
Haojun Liao	a32c650248	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-19 10:05:48 +08:00
Haojun Liao	2ae95217bd	fix(stream): open inputQ by default for task deployed on snode.	2023-07-19 10:05:35 +08:00
liuyao	fd02b9a71e	Merge branch '3.0' into enh/triggerCheckPoint2	2023-07-19 10:02:06 +08:00
Haojun Liao	9513f76172	fix(stream): set downstream task ready state.	2023-07-18 19:02:24 +08:00
Haojun Liao	5b29a5ec97	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-18 18:30:10 +08:00
Haojun Liao	902f9d1f94	fix(stream): set not-ready initial value.	2023-07-18 18:29:35 +08:00
yihaoDeng	039befa3d6	Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2	2023-07-18 10:15:20 +00:00
yihaoDeng	790101ced2	fix mem leak	2023-07-18 10:14:04 +00:00
Haojun Liao	d2c875e774	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-18 15:19:09 +08:00
Haojun Liao	901b7d8ecc	fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore.	2023-07-18 15:18:57 +08:00
yihaoDeng	95b8754dab	Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2	2023-07-18 04:03:56 +00:00
yihaoDeng	40d59990d8	fix mem leak	2023-07-18 04:01:20 +00:00
Haojun Liao	92106312d2	fix(stream): not dispatch checkpoint block result to downstream.	2023-07-18 09:43:38 +08:00
Haojun Liao	2f24f776fb	fix(stream): fix error in generating checkpoint for state_window.	2023-07-18 09:04:28 +08:00
yihaoDeng	40eb50676d	add checkpoint	2023-07-17 11:04:19 +00:00
Haojun Liao	14b9d920ba	fix(stream): fix memory leak.	2023-07-17 16:02:41 +08:00
Haojun Liao	08f43b9d00	fix(stream): fix checkpoint block not fetched bug.	2023-07-17 15:31:54 +08:00
yihaoDeng	394cc771e5	add checkpoint	2023-07-17 06:47:23 +00:00
yihaoDeng	f0f2215f49	add checkpoint	2023-07-17 06:21:45 +00:00
yihaoDeng	3168096e40	add checkpoint	2023-07-17 06:06:21 +00:00
yihaoDeng	e0bb3c8f94	Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2	2023-07-17 05:26:57 +00:00
yihaoDeng	f7732ddd18	recoverSnapshot	2023-07-17 05:26:30 +00:00
Haojun Liao	d7f7a7d6cf	fix(stream): fix syntax error	2023-07-17 12:53:36 +08:00
Haojun Liao	b2a905bd91	Merge branch '3.0' into enh/triggerCheckPoint2	2023-07-17 11:50:12 +08:00
yihaoDeng	5adf580764	add checkpoint	2023-07-17 03:44:06 +00:00
Haojun Liao	8c8b1a6d79	fix(stream): handle block before checkpoint msg in the inputQ.	2023-07-17 10:47:05 +08:00
yihaoDeng	dea2e73d2e	add checkpoint	2023-07-17 02:22:21 +00:00
Haojun Liao	a9757637d9	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-16 12:47:24 +08:00
Haojun Liao	c6a322e0ef	refactor(stream): back pressure is active, which is trigger by dispatch rsp.	2023-07-16 12:47:08 +08:00
yihaoDeng	b4de0892e6	add checkpoint	2023-07-15 09:35:33 +00:00
yihaoDeng	7b4185dc56	Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2	2023-07-15 04:27:39 +00:00
yihaoDeng	e18c9ea672	add checkpoint	2023-07-15 04:26:34 +00:00
yihaoDeng	aad669e33c	add checkpoint	2023-07-14 14:46:13 +00:00
Haojun Liao	725db16af9	fix(stream): set save checkpoint ver.	2023-07-14 19:47:19 +08:00
Haojun Liao	035b199497	refactor(stream): do some internal refactor.	2023-07-14 18:46:38 +08:00
Haojun Liao	6798e31bb5	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-14 18:35:53 +08:00
Haojun Liao	8c79157822	fix(stream): close the inputQ if checkpoint msg received.	2023-07-14 18:35:41 +08:00
yihaoDeng	3020e27114	fix mem leak	2023-07-14 10:20:37 +00:00
yihaoDeng	3c4631ef1f	add checkpoint	2023-07-14 10:06:24 +00:00
Haojun Liao	b16432280e	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-14 17:21:37 +08:00
Haojun Liao	eb7e6152ae	refactor(stream): do some internal refactor.	2023-07-14 17:21:20 +08:00
yihaoDeng	be050e12ea	fix recover error	2023-07-14 15:46:00 +08:00
yihaoDeng	d0ccbd48d2	fix coverity scan problem	2023-07-14 14:54:20 +08:00
yihaoDeng	49b21b3ccb	fix coverity scan problem	2023-07-14 14:53:11 +08:00
yihaoDeng	2279706357	fix coverity scan problem	2023-07-14 14:49:02 +08:00
yihaoDeng	15f5fd19eb	fix recover error	2023-07-14 14:47:06 +08:00
yihaoDeng	e16a3935a5	fix coverity scan problem	2023-07-14 14:40:32 +08:00
liuyao	c3375dd744	mem leak	2023-07-13 19:24:11 +08:00
Haojun Liao	e0ea0f2df4	Merge pull request #22020 from taosdata/fix/liaohj ... other: merge main	2023-07-13 17:55:28 +08:00
Haojun Liao	2fd72500e2	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-13 16:32:37 +08:00
Haojun Liao	813f4cb363	refactor: do some internal refactor.	2023-07-13 16:32:25 +08:00
liuyao	ec2134f758	op ci	2023-07-13 16:24:38 +08:00
yihaoDeng	9e128b92f8	fix recover error	2023-07-13 16:17:18 +08:00
yihaoDeng	1307776786	fix recover error	2023-07-13 16:09:34 +08:00
yihaoDeng	9434b4eaac	fix recover error	2023-07-13 16:07:58 +08:00
yihaoDeng	18f9882834	fix recover error	2023-07-13 16:06:23 +08:00
Haojun Liao	66d577d134	fix(stream): abort exec when task is dropped.	2023-07-13 15:04:39 +08:00
yihaoDeng	b7403cd171	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-07-13 10:38:34 +08:00
yihaoDeng	0e1a91d134	fix compile error	2023-07-13 10:38:21 +08:00
Haojun Liao	af7f78ada2	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-13 10:17:10 +08:00
Haojun Liao	2f90a53548	fix(stream): set checkpoint id when expanding task.	2023-07-13 10:16:57 +08:00
yihaoDeng	f3f3893872	fix compile error	2023-07-13 10:05:29 +08:00
yihaoDeng	2ec67bcc08	rm expire checkpoint	2023-07-13 10:00:16 +08:00
Haojun Liao	773ae39d33	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 ... # Conflicts: # source/libs/stream/src/streamCheckpoint.c	2023-07-13 09:17:51 +08:00
Haojun Liao	08a4fb06ae	fix(stream): dispatch checkpoint msg to downstream by puting message into input queue.	2023-07-13 09:17:20 +08:00
yihaoDeng	82468f162a	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-07-12 16:43:56 +08:00
yihaoDeng	e1de4984a6	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-07-12 16:39:19 +08:00
yihaoDeng	bb72f07a94	rm expire checkpoint	2023-07-12 16:38:46 +08:00
Haojun Liao	3ce54423a5	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-12 11:38:27 +08:00
Haojun Liao	d392bb60ba	refactor(stream): set the initial version from the checkpoint.	2023-07-12 11:38:13 +08:00
liuyao	7d4bb1b932	add checkpoint id for recover	2023-07-12 10:48:58 +08:00
Haojun Liao	9484f3da94	Merge branch '3.0' into enh/triggerCheckPoint2	2023-07-12 10:20:18 +08:00
Haojun Liao	a049e310f6	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-12 10:16:26 +08:00
Haojun Liao	6f2fc4fab3	fix(stream): commit task meta after do vnode-wide checkpoint.	2023-07-12 10:16:14 +08:00
Haojun Liao	fed3803739	fix(stream): fix memory leak.	2023-07-11 19:29:52 +08:00
liuyao	6298f17c45	delete invalid code	2023-07-11 19:21:27 +08:00
yihaoDeng	503d7540f7	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-07-11 16:31:07 +08:00
yihaoDeng	e547ed3699	rm expire checkpoint	2023-07-11 16:30:14 +08:00
Haojun Liao	da6a4de021	fix(stream): disable invalid set normal task status.	2023-07-11 15:12:34 +08:00
Haojun Liao	09b764494d	fix(stream): set correct checkpoint version when starting stream tasks.	2023-07-11 14:03:43 +08:00
Haojun Liao	571cccd737	refactor: do some internal refactor.	2023-07-11 11:41:37 +08:00
Haojun Liao	62a763ead3	fix(stream): fix invalid assert.	2023-07-11 11:22:48 +08:00
Haojun Liao	a803eaee3e	fix(stream): fix concurrent bug in save task meta.	2023-07-11 10:01:43 +08:00
Haojun Liao	a571663a5d	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 ... # Conflicts: # source/libs/stream/src/streamExec.c	2023-07-11 09:53:41 +08:00
Haojun Liao	cbda61c7f9	fix(stream): fix error in checkpointing.	2023-07-11 09:53:08 +08:00
yihaoDeng	c056e34534	fix compile error	2023-07-11 09:39:58 +08:00
Haojun Liao	3ffdbe923d	other: merge 3.0	2023-07-11 09:12:57 +08:00
Haojun Liao	a6cd702676	fix(stream): supress the warning	2023-07-11 08:54:11 +08:00
Haojun Liao	8a6a876f67	fix(stream): fix error in generating checkpoint.	2023-07-10 22:53:15 +08:00
Haojun Liao	87bedef2cd	fix(stream): fix error in checkpointing.	2023-07-10 19:20:05 +08:00
Haojun Liao	ab5b2fe0a8	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-10 18:21:02 +08:00
Haojun Liao	385a5c9651	fix(stream): fix error in generating checkpoint.	2023-07-10 18:20:50 +08:00
yihaoDeng	e263d5f55f	add checkpoint	2023-07-10 17:33:48 +08:00
Haojun Liao	d6e7e6e174	fix(stream): fix typo.	2023-07-10 14:57:28 +08:00
Haojun Liao	16ee72ab06	fix(stream): free msg after send checkpoint rsp.	2023-07-10 13:57:51 +08:00
Haojun Liao	f6515e2a2c	fix(stream): fix error in checkpointing.	2023-07-10 11:43:37 +08:00
Haojun Liao	5940bbfb33	fix(stream): set correct datablock.	2023-07-10 10:42:38 +08:00
Haojun Liao	9ad5e05751	fix(stream): fix error in checking status.	2023-07-10 10:24:04 +08:00
Haojun Liao	e8eba3175a	fix(stream): fix error in checking status.	2023-07-10 10:23:05 +08:00
Haojun Liao	dd15ca6103	fix(stream): add missing status check.	2023-07-10 10:06:21 +08:00
Haojun Liao	ed1181a1d1	fix(stream): fix invalid read bug.	2023-07-10 09:55:29 +08:00
Haojun Liao	4f534ce6e9	fix(stream): fix error in generating checkpoint.	2023-07-08 10:29:09 +08:00
Haojun Liao	a5c19427e7	fix(stream): send correct rsp to mnode.	2023-07-08 09:39:44 +08:00
Haojun Liao	ab4e2ebc3a	fix(stream): fix bug that causes the endless loop.	2023-07-07 21:45:22 +08:00
Haojun Liao	9c30abf95b	fix(stream): fix error in generating checkpoint.	2023-07-07 21:38:53 +08:00
Haojun Liao	b03ca31a7f	fix(stream): fix error in generating checkpoint.	2023-07-07 17:21:46 +08:00
Haojun Liao	8298f30e56	fix(stream): fix bug in checkpoint.	2023-07-07 17:16:08 +08:00
Haojun Liao	47877898d0	enh(stream): generate the checkpoint framework.	2023-07-07 16:07:52 +08:00
Haojun Liao	4f814db5d5	fix(stream): fix error during transferring executor state, while a task is not in normal status.	2023-07-06 18:34:01 +08:00
Haojun Liao	61f3585714	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-06 18:26:44 +08:00
Haojun Liao	d7101f7109	enh(stream): support dispatch checkpoint msg.	2023-07-06 18:26:22 +08:00
yihaoDeng	8e9ef2a384	fix mem leak	2023-07-06 09:01:34 +00:00
liuyao	0e914a19c6	stream operartor checkpoint	2023-07-06 14:28:34 +08:00
Haojun Liao	5a9461a69a	other: merge 3.0	2023-07-06 11:52:21 +08:00
yihaoDeng	483f9ab896	add other	2023-07-06 03:39:28 +00:00
Haojun Liao	f4a3567935	other: merge 3.0	2023-07-06 11:24:30 +08:00
Haojun Liao	7a417a33b0	Merge pull request #21960 from taosdata/fix/3_liaohj ... fix(stream): fix error for extract msg from inputQ	2023-07-05 17:47:18 +08:00
Haojun Liao	1855a16981	other: merge 3.0	2023-07-05 16:12:32 +08:00
Haojun Liao	03dbcbf055	refactor: do some internal refactor.	2023-07-05 15:55:55 +08:00
Haojun Liao	ff2bf35603	fix(stream): fix error in set the version range for secondary scan.	2023-07-04 15:08:39 +08:00
Haojun Liao	77530e1956	refactor: record the downstream input Queue blocking time.	2023-07-04 10:58:11 +08:00
yihaoDeng	e7b37486bb	vnode snapshot read	2023-07-04 00:46:39 +00:00
Haojun Liao	393b36d83d	Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory	2023-07-03 17:53:18 +08:00
Haojun Liao	2dbccc1573	refactor: do some internal refactor.	2023-07-03 17:52:17 +08:00
Haojun Liao	42e1cd741a	Merge pull request #21935 from taosdata/fix/3_liaohj ... fix(stream): fix message lost bug during pause stream.	2023-07-03 17:37:56 +08:00
Haojun Liao	9e62b9d0d2	fix(stream): fix error in extract data from inputQ.	2023-07-03 15:33:08 +08:00
Haojun Liao	200575647c	Merge branch '3.0' into refact/fillhistory	2023-07-03 15:16:18 +08:00
Haojun Liao	20d099dfa6	Merge pull request #21901 from taosdata/fix/liaohj ... fix: fix coverity issue.	2023-07-03 15:15:21 +08:00
Haojun Liao	ceb06635fe	fix(stream): fix error in pause stream.	2023-07-03 15:12:35 +08:00
Haojun Liao	f84bfc96fb	fix(stream): fix error in pause in stream.	2023-07-03 14:30:11 +08:00
Haojun Liao	5d4efe1198	fix(stream): fix error in pause.	2023-07-03 11:46:05 +08:00
Haojun Liao	317a7c83c7	fix(stream): fix message lost bug during pause stream.	2023-07-03 10:55:45 +08:00
yihaoDeng	247d3ac7ee	vnode snapshot read	2023-06-30 12:05:05 +00:00
yihaoDeng	7d30a6e27a	vnode snapshot read	2023-06-30 11:48:46 +00:00
yihaoDeng	9eb6d8cf1e	vnode snapshot read	2023-06-29 09:35:09 +00:00
Haojun Liao	622e1cb608	fix: fix coverity issue.	2023-06-29 15:54:09 +08:00
dapan1121	3519e9170e	Merge remote-tracking branch 'origin/main' into 3.0	2023-06-29 11:13:45 +08:00
yihaoDeng	bb520b56e7	add checkpoint	2023-06-28 09:58:07 +00:00
yihaoDeng	6b6e237079	add checkpoint	2023-06-28 09:57:08 +00:00
Haojun Liao	78739e4bdb	fix(stream): fix syntax error.	2023-06-28 14:21:11 +08:00
Haojun Liao	57fcd553f8	refactor: do some internal refactor.	2023-06-28 13:13:13 +08:00
Haojun Liao	3710ea4aca	refactor: do some internal refactor.	2023-06-28 09:41:08 +08:00
Haojun Liao	a19e63fd23	fix(stream): fix error in handling fill history.	2023-06-27 23:00:14 +08:00
Yihao Deng	4de7db06f9	Merge branch '3.0' into enh/triggerCheckPoint2	2023-06-27 17:57:14 +08:00
Haojun Liao	32fddeff18	fix(stream): fix error retrieve data from source task.And optimize the test cases.	2023-06-27 16:24:47 +08:00
Haojun Liao	3289ad62be	other: merge 3.0	2023-06-27 11:33:40 +08:00
liuyao	71f4226e15	fix coverity san issues	2023-06-27 10:39:38 +08:00
Haojun Liao	b73444b291	fix(stream): start stream task in case of scan history completing.	2023-06-27 09:44:51 +08:00
yihaoDeng	2c1fc501ff	add checkpoint	2023-06-26 12:28:42 +00:00
Haojun Liao	437eb93a4d	fix(stream): fix error while fill history exists.	2023-06-26 18:44:59 +08:00
Haojun Liao	daafe240ed	fix(stream): fix memory leak.	2023-06-26 14:18:47 +08:00
liuyao	6b8549dea5	set table name	2023-06-26 14:14:46 +08:00
yihaoDeng	9b451bc56a	add checkpoint	2023-06-25 20:14:07 +08:00
yihaoDeng	52f588955b	add checkpoint	2023-06-25 20:05:42 +08:00
Haojun Liao	402c091df0	fix(stream): fix sma error.	2023-06-25 19:41:44 +08:00
yihaoDeng	74a4a89d70	add checkpoint	2023-06-25 17:59:36 +08:00
liuyao	e236bf818c	set fill history info	2023-06-25 17:47:10 +08:00
yihaoDeng	832aed5e98	add checkpoint	2023-06-25 17:10:59 +08:00
yihaoDeng	0330f3b2db	add checkpoint	2023-06-25 17:03:01 +08:00
yihaoDeng	e36de5edf7	add checkpoint	2023-06-25 14:35:20 +08:00
Haojun Liao	0322fdc1fc	fix(stream): fix memory leak.	2023-06-24 23:43:43 +08:00
yihaoDeng	2f656f3854	add checkpoint	2023-06-21 18:04:10 +08:00
yihaoDeng	d9e24566c0	add checkpoint	2023-06-20 18:32:56 +08:00
liuyao	aafbdcb492	set task status	2023-06-20 15:20:04 +08:00
yihaoDeng	b6d4e98e68	fix restart crash	2023-06-20 13:47:46 +08:00
yihaoDeng	f1fcc1d2f1	add checkpoint	2023-06-20 11:44:51 +08:00
liuyao	870d75bf82	fill history pause&resume	2023-06-20 11:34:09 +08:00
yihaoDeng	548e439aa2	add checkpoint	2023-06-19 20:48:49 +08:00
liuyao	41c193945f	fill history pause&resume	2023-06-19 17:28:19 +08:00
yihaoDeng	0eeaab9cd3	Merge branch 'refact/fillhistory1' into refact/fillhistory	2023-06-19 13:53:37 +08:00
yihaoDeng	fd85a8495a	Merge branch 'dev30' into enh/triggerCheckPoint2	2023-06-17 14:17:21 +08:00
yihaoDeng	b6fe5d917b	refactor checkpoint	2023-06-17 14:05:49 +08:00
Haojun Liao	64365666b7	fix(stream): update the info, and do some internal refactor.	2023-06-16 16:04:43 +08:00
yihaoDeng	1e05f5c693	support fill history	2023-06-16 10:00:16 +08:00
yihaoDeng	f4b9d630c0	support fill history	2023-06-16 09:36:44 +08:00
yihaoDeng	0ef8afbdaa	support fill history	2023-06-16 09:32:38 +08:00
yihaoDeng	8cb8c05428	support fill history	2023-06-15 21:55:46 +08:00
yihaoDeng	9f9171719a	support fill history	2023-06-15 21:29:52 +08:00
Haojun Liao	74e0138f72	Merge branch '3.0' into refact/fillhistory	2023-06-15 15:25:00 +08:00
liuyao	693942b821	trans state	2023-06-15 14:13:17 +08:00
Haojun Liao	1b9eca5ce0	other: merge main.	2023-06-15 13:03:17 +08:00
Haojun Liao	13028744df	refactor: do some internal refactor.	2023-06-15 10:24:21 +08:00
Haojun Liao	53377c2c1f	fix(stream): wait for stream task completed.	2023-06-15 01:14:41 +08:00
Yihao Deng	7ded6fc7a2	Merge branch '3.0' into enh/triggerCheckPoint2	2023-06-14 16:30:38 +08:00
yihaoDeng	52ca94ea6d	trigger checkpoint	2023-06-14 16:20:14 +08:00
liuyao	9a3708e17b	pause&resume fill history	2023-06-14 15:54:07 +08:00
Haojun Liao	7c6fbd7772	enh(stream): do some internal refactor and support secondary scan for history data.	2023-06-14 14:10:09 +08:00
Haojun Liao	11f0c3b336	refactor: do some internal refactor.	2023-06-14 10:46:46 +08:00
Haojun Liao	5282492663	refactor: do some internal refactor.	2023-06-14 10:35:03 +08:00
Haojun Liao	b44447e6f3	enh(stream): support restore from disk.	2023-06-14 10:19:03 +08:00
Haojun Liao	97da2a8fac	fix(stream): set the fill history status.	2023-06-13 16:10:55 +08:00
Haojun Liao	fb24ed161d	enh(stream): set correct task status.	2023-06-12 22:48:23 +08:00
yihaoDeng	83dde6a212	add trigger checkpoint	2023-06-12 14:33:08 +00:00
Haojun Liao	78a240be8f	enh(stream): add dispatch msg.	2023-06-12 13:12:45 +08:00
yihaoDeng	ae7d5c79e5	fix invald read/write	2023-06-12 02:24:49 +00:00
yihaoDeng	a2030dc378	add trigger checkpoint	2023-06-09 12:12:51 +00:00
yihaoDeng	a0c2897124	add trigger checkpoint	2023-06-09 10:46:03 +00:00
yihaoDeng	d38e3835c0	opt batch write	2023-06-09 08:12:39 +00:00
yihaoDeng	06b65ce5c1	opt batch write	2023-06-09 07:49:43 +00:00
Haojun Liao	69c9eda7af	fix(stream): fix race condition.	2023-06-09 11:37:38 +08:00
Haojun Liao	53246ed6bb	other: merge other branch.	2023-06-09 09:41:10 +08:00
yihaoDeng	a67ef8ce91	opt batch write	2023-06-09 01:27:08 +00:00
yihaoDeng	d5c0ca3163	opt batch write	2023-06-08 13:36:52 +00:00
Haojun Liao	0fd11aaefe	other: add some logs.	2023-06-08 19:14:36 +08:00
Haojun Liao	c9aa59cbb9	refactor: do some internal refactor.	2023-06-08 18:59:25 +08:00
Haojun Liao	6726edae0c	fix(stream): add more logs.	2023-06-08 17:54:22 +08:00
yihaoDeng	9828ca9d7f	add trigger checkpoint	2023-06-08 09:28:34 +00:00
Haojun Liao	6c13491428	refactor: do some internal refactor.	2023-06-08 16:55:41 +08:00
Haojun Liao	2b6ace653a	refactor: do some internal refactor.	2023-06-08 16:14:27 +08:00
yihaoDeng	8b91617145	Merge branch 'enh/dv3' into enh/triggerCheckpoint	2023-06-08 07:20:41 +00:00
Haojun Liao	30eba472c3	Merge pull request #21602 from taosdata/fix/TD-24600-dv3 ... fix/td-24600-dv3	2023-06-08 13:42:02 +08:00
Haojun Liao	cb26dd9fa2	refactor(stream): do some internal refactor.	2023-06-08 10:17:21 +08:00
yihaoDeng	79b628101c	add trigger checkpoint	2023-06-07 14:32:22 +00:00
Haojun Liao	06cf3588da	refactor: do some internal refactor.	2023-06-07 15:03:04 +08:00
liuyao	1e9c4d5fac	opt stream block dispatch	2023-06-07 10:45:27 +08:00
Haojun Liao	6a3c935b4a	fix(stream): fix error in fill history scan.	2023-06-07 09:15:55 +08:00
yihaoDeng	66f483e51a	fix invalid free	2023-06-06 02:32:06 +00:00
yihaoDeng	c6242fee01	fix invalid free	2023-06-05 10:54:02 +00:00
yihaoDeng	cb024ca069	fix invalid free	2023-06-05 10:52:07 +00:00
Haojun Liao	0dd933013c	enh(stream): make history task for stream running.	2023-06-05 17:58:00 +08:00
yihaoDeng	63c4929089	fix invalid free	2023-06-05 08:42:00 +00:00
Haojun Liao	e8549ce511	refactor: do some internal refactor.	2023-06-05 16:19:37 +08:00
Haojun Liao	fcc706c45c	enh(stream): refactor the fill history task.	2023-06-05 15:59:01 +08:00
yihaoDeng	c77f7f65d2	fix invalid free	2023-06-05 07:32:28 +00:00
yihaoDeng	3108ecf84b	fix invalid free	2023-06-05 06:38:17 +00:00
yihaoDeng	74d5f02969	fix invalid free	2023-06-05 04:56:07 +00:00
Haojun Liao	077e1a1ed4	Merge branch '3.0' into refact/fillhistory	2023-06-05 11:41:13 +08:00
Haojun Liao	044e56fc97	Merge branch '3.0' into fix/resume_mem	2023-06-03 12:19:17 +08:00
Haojun Liao	cb7bb954b5	Merge pull request #21577 from taosdata/fix/TD-24515 ... reset unclosed window info	2023-06-03 11:21:06 +08:00
yihaoDeng	9e0392ff59	fix mem leak	2023-06-03 09:17:05 +08:00
yihaoDeng	7244ab1f6b	fix mem leak	2023-06-03 08:28:21 +08:00
yihaoDeng	81fe174aa2	fix mem leak	2023-06-03 08:19:59 +08:00
yihaoDeng	5063c175f4	fix mem problem	2023-06-02 23:47:14 +08:00
yihaoDeng	3ec700e0f7	fix mem problem	2023-06-02 22:25:38 +08:00
yihaoDeng	e48e485b6c	update default buffer	2023-06-02 11:56:24 +00:00
yihaoDeng	6ee68331b3	update DEFAULT_BUFF	2023-06-02 11:54:36 +00:00
Haojun Liao	cca69f3038	Merge branch '3.0' into fix/resume_mem	2023-06-02 18:40:48 +08:00
liuyao	17f2c3f882	reset wind info	2023-06-02 18:27:22 +08:00
yihaoDeng	449051cda6	avoid mem leak	2023-06-02 10:05:32 +00:00
wangmm0220	56f7a137ee	fix:conflict	2023-06-02 15:47:53 +08:00
wangmm0220	b2f0d88639	fix:conflict	2023-06-02 15:43:35 +08:00
Haojun Liao	6a9c03309e	Merge pull request #21553 from taosdata/enh/changeRocksParam ... change log level	2023-06-02 14:23:50 +08:00
Haojun Liao	cce87a036f	other: merge 3.0.	2023-06-02 13:34:20 +08:00
Haojun Liao	f1bd829977	refactor: do some internal refactor.	2023-06-02 13:10:54 +08:00
yihaoDeng	63d9a5dcf3	avoid mem leak	2023-06-02 04:08:08 +00:00
Haojun Liao	27b7d1ec88	refactor: do some internal refactor.	2023-06-02 11:17:44 +08:00
yihaoDeng	becc5c51a4	fix compatibility	2023-06-02 02:35:15 +00:00
yihaoDeng	420ae73728	Avoid creating the same ID task multiple times	2023-06-02 00:35:45 +00:00
yihaoDeng	1571ea844a	Avoid creating the same ID task multiple times	2023-06-01 11:25:55 +00:00
yihaoDeng	0315e89591	Avoid creating the same ID task multiple times	2023-06-01 11:13:01 +00:00
yihaoDeng	64edab6302	refactor code	2023-06-01 07:51:52 +00:00
Haojun Liao	91de00597d	refactor: do some internal refactor.	2023-05-31 22:12:14 +08:00
Haojun Liao	46f731e4d9	Merge pull request #21551 from taosdata/fix/resume_mem ... fix(query): check the version range when dump partial rows. #TD-24504	2023-05-31 21:51:07 +08:00
Haojun Liao	ccc86f9916	refactor: do some internal refactor.	2023-05-31 19:36:34 +08:00
Haojun Liao	87deb36f8a	refactor: do some internal refactor.	2023-05-31 19:36:02 +08:00
yihaoDeng	04f3784696	change log level	2023-05-31 11:05:03 +00:00
Haojun Liao	a3abe25539	refactor: do some internal refactor.	2023-05-31 19:03:37 +08:00
Haojun Liao	65b81a803f	refactor: do some internal refactor and add some logs.	2023-05-31 18:05:53 +08:00
Haojun Liao	8c240cede9	Merge pull request #21545 from taosdata/enh/changeRocksParam ... Enh/change rocks param	2023-05-31 13:51:32 +08:00
Haojun Liao	dd9f810f81	Merge pull request #21530 from taosdata/fix/TD-24365 ... fix sliding window issue	2023-05-31 13:51:14 +08:00
yihaoDeng	3b0a6d7f0b	change db param	2023-05-31 03:15:25 +00:00
yihaoDeng	67becbd4d1	change db param	2023-05-31 01:10:36 +00:00
Haojun Liao	fc20ca8423	fix(stream): set the correct rps flag as the dispatch rsp.	2023-05-30 18:42:23 +08:00
Haojun Liao	d9cc9f2157	fix(stream): remove invalid free.	2023-05-30 18:03:21 +08:00
Haojun Liao	937f67f07b	fix(stream): fix invalid free.	2023-05-30 18:02:42 +08:00
Haojun Liao	e96ed81ec0	fix(stream): add input queue capacity check.	2023-05-30 17:29:01 +08:00
Haojun Liao	eda06081ff	enh(stream): refactor and serialize the attributes of history tasks.	2023-05-30 16:55:37 +08:00
Haojun Liao	d9c364d663	Merge branch '3.0' into refact/fillhistory	2023-05-30 15:51:12 +08:00
Haojun Liao	de7231e59e	fix(stream): fix memory leak in handling dispatch msg when output buffer is full.	2023-05-30 15:35:59 +08:00
liuyao	7d699ae579	fix sliding window issue	2023-05-30 15:16:11 +08:00
Haojun Liao	2977a4d07f	refactor: do some internal refactor.	2023-05-30 09:41:19 +08:00
Haojun Liao	20a0054c4a	Merge pull request #21472 from taosdata/enh/addCompileError ... change parameter	2023-05-30 09:36:36 +08:00