1333 Commits

Author	SHA1	Message	Date
Haojun Liao	b658608541	Merge pull request #22388 from taosdata/fix/3_liaohj ... other: merge main.	2023-08-10 11:43:02 +08:00
yihaoDeng	ef247cdb1d	support reopen stream state	2023-08-10 01:49:26 +00:00
Haojun Liao	c10b323188	other: merge main.	2023-08-10 09:26:33 +08:00
Haojun Liao	4393375e47	fix(stream): set correct task id.	2023-08-10 02:16:04 +08:00
Haojun Liao	0cf8144952	fix(stream): fix the invalid key used by remove data in stream meta hash table.	2023-08-09 22:28:23 +08:00
yihaoDeng	a20b299f9b	support reopen stream state	2023-08-09 13:06:10 +00:00
yihaoDeng	19ac9054d0	support reopen stream state	2023-08-09 12:47:49 +00:00
Haojun Liao	d34b9af054	enh(stream): create update stream trans.	2023-08-09 19:38:13 +08:00
yihaoDeng	1db15da4e1	support reopen stream state	2023-08-09 09:50:49 +00:00
yihaoDeng	6fdcd82a33	support reopen stream state	2023-08-09 09:19:03 +00:00
yihaoDeng	f3cf907d5a	support reopen stream state	2023-08-09 09:07:13 +00:00
yihaoDeng	a336a7b1a4	support reopen stream state	2023-08-09 09:06:22 +00:00
yihaoDeng	a619b8f5be	rm duplicate para	2023-08-09 08:58:49 +00:00
Haojun Liao	1e8579e8c5	fix(stream): fix other cases.	2023-08-09 16:04:48 +08:00
Haojun Liao	4c92997328	fix(stream): use streamId&taskId to identify the stream task in the stream meta.	2023-08-09 15:52:23 +08:00
yihaoDeng	92b247aae8	support reopen stream state	2023-08-09 07:36:00 +00:00
yihaoDeng	bbcfa9ab03	support reopen stream state	2023-08-09 06:10:40 +00:00
Haojun Liao	3cdb16352c	fix(stream): avoid launching check downstream when failed to add stream task into stream meta.	2023-08-09 12:03:14 +08:00
Haojun Liao	f3c5f20ee2	enh(stream): add timer to check the node changing.	2023-08-09 10:25:16 +08:00
yihaoDeng	c43a6b272c	support reopen stream state	2023-08-09 02:09:50 +00:00
yihaoDeng	ac11537fc8	support reopen stream state	2023-08-08 07:21:47 +00:00
Haojun Liao	17c6143471	fix(stream): check more status when handling the state transfer.	2023-08-08 15:08:11 +08:00
Haojun Liao	a0dcec5890	enh(stream): add function handler for hb message.	2023-08-08 11:23:19 +08:00
Haojun Liao	db8ce3de3b	other: merge main.	2023-08-08 10:17:51 +08:00
Haojun Liao	327e13c3f7	fix(stream): fix the syntax error.	2023-08-08 10:07:28 +08:00
Haojun Liao	d6d63ec54c	fix(stream): add more check.	2023-08-08 09:54:49 +08:00
Haojun Liao	e89d3c18d6	fix(stream): remove invalid check.	2023-08-08 09:54:46 +08:00
Haojun Liao	ac00e1d520	fix(stream): fetch all data before paused and dump to sink node.	2023-08-08 09:54:43 +08:00
Haojun Liao	0e3fd5277d	fix(stream): dump results to sink node before paused.	2023-08-08 09:54:39 +08:00
Haojun Liao	1e680d4df1	fix(stream): ignore the sink task transfer state.	2023-08-08 09:52:19 +08:00
Haojun Liao	3bcc7ed83e	fix(stream): transfer the state for agg tasks.	2023-08-08 09:52:04 +08:00
Haojun Liao	d43cb3fcdf	fix(stream): kill task when pause the stream execution.	2023-08-08 09:51:21 +08:00
Haojun Liao	ca2183acfd	refactor: do some internal refactor.	2023-08-08 09:50:40 +08:00
Haojun Liao	82ab81810b	refactor: do some internal refactor.	2023-08-08 09:40:21 +08:00
Haojun Liao	51e0b903b0	refactor: do some internal refactor.	2023-08-08 09:36:42 +08:00
Haojun Liao	af3a87560a	refactor: do some refactor.	2023-08-08 09:11:41 +08:00
Haojun Liao	f8ee055641	other: merge 3.0	2023-08-08 00:19:08 +08:00
Haojun Liao	ad3e231b2f	Merge pull request #22350 from taosdata/fix/3_liaohj ... other: merge main and fix bugs in stop stream tasks.	2023-08-07 22:57:13 +08:00
Haojun Liao	85756e4404	Merge pull request #22353 from taosdata/fix/liaohj ... fix(stream): commit the update to make sure the new state of tasks will be persistent to disk.	2023-08-07 22:57:08 +08:00
yihaoDeng	6b73fc9c06	support reopen stream state	2023-08-07 13:56:53 +00:00
yihaoDeng	80e78e054d	support reopen stream state	2023-08-07 11:39:32 +00:00
Haojun Liao	2da67392c6	fix(stream): commit the update to make sure the new state of tasks will be persistent to disk.	2023-08-07 19:30:23 +08:00
yihaoDeng	6a69c56b32	support reopen stream state	2023-08-07 10:55:42 +00:00
yihaoDeng	6c8c575549	support reopen stream state	2023-08-07 10:48:04 +00:00
Haojun Liao	aea1690cd1	fix(stream): fix the stream task after checking if it is in the timer activities.	2023-08-07 17:49:36 +08:00
yihaoDeng	b6c991f896	support reopen stream state	2023-08-07 08:59:04 +00:00
yihaoDeng	eeb97351e8	support reopen stream state	2023-08-07 08:51:01 +00:00
Haojun Liao	225c0e61dc	hen(stream): support the rollback and checkdown stream tasks.	2023-08-07 16:13:39 +08:00
yihaoDeng	7ef4df8752	support reopen stream state	2023-08-07 07:20:05 +00:00
Haojun Liao	7924d7e0af	Merge pull request #22337 from taosdata/fix/fixInvalidFree ... fix invalid free	2023-08-07 11:45:29 +08:00
Haojun Liao	a8006d3d0d	Merge pull request #22278 from taosdata/fix/fixStateMemleak ... fix state mem leak	2023-08-07 11:45:16 +08:00
yihaoDeng	4ca39d0f3c	support reopen stream state	2023-08-07 01:45:16 +00:00
Haojun Liao	8a11a0418f	other: merge 3.0	2023-08-07 09:19:26 +08:00
yihaoDeng	7396799d90	fix invalid free	2023-08-04 19:06:16 +08:00
yihaoDeng	36e841b6d0	fix invalid free	2023-08-04 18:59:17 +08:00
Hui Li	f19826fa9d	Merge pull request #22313 from taosdata/fix/addStreamVer ... add stream verion	2023-08-04 17:36:21 +08:00
yihaoDeng	a4da6e9a88	fix mem leak	2023-08-04 15:59:34 +08:00
yihaoDeng	81908be32f	add stream ver	2023-08-04 14:02:03 +08:00
yihaoDeng	6dc93a8dec	add stream ver	2023-08-04 13:52:20 +08:00
liuyao	9cb481dd6e	use stream task	2023-08-04 11:01:36 +08:00
yihaoDeng	f9d0874e45	support reopen stream state	2023-08-03 08:24:50 +00:00
liuyao	3464979489	set dummy delete data request	2023-08-03 09:03:48 +08:00
yihaoDeng	918eca4d22	fix state mem leak	2023-08-02 03:31:11 +00:00
yihaoDeng	6cdf94fec0	fix state mem leak	2023-08-02 03:29:13 +00:00
yihaoDeng	d9fd95777a	fix state mem leak	2023-08-02 03:21:39 +00:00
yihaoDeng	83468a7710	fix state mem leak	2023-08-02 03:18:59 +00:00
Haojun Liao	13543f7daa	feature(stream): handle task update in tq module.	2023-08-02 10:33:41 +08:00
liuyao	71b000f08c	reload state window state	2023-08-01 18:22:40 +08:00
Haojun Liao	ad4c5916e7	enh(stream): update the stream task.	2023-08-01 18:14:58 +08:00
Haojun Liao	164bfd5408	enh(stream): prepare update trans.	2023-08-01 16:12:35 +08:00
yihaoDeng	111481cef9	fix state mem leak	2023-08-01 08:09:10 +00:00
Haojun Liao	6365d5000b	Merge pull request #22271 from taosdata/fix/3_liaohj ... fix(stream): dump results to sink node before paused.	2023-08-01 15:50:17 +08:00
Haojun Liao	f1e0e64918	fix(stream): add more check.	2023-08-01 14:31:41 +08:00
Haojun Liao	75b1520be0	enh(stream): create task update info	2023-08-01 14:04:07 +08:00
Haojun Liao	e11cda17c0	fix(stream): remove invalid check.	2023-08-01 10:30:24 +08:00
Haojun Liao	f6ae9cf9bb	fix(stream): fetch all data before paused and dump to sink node.	2023-08-01 10:16:14 +08:00
Haojun Liao	b83860372c	fix(stream): dump results to sink node before paused.	2023-08-01 00:50:30 +08:00
Haojun Liao	36ef9a537f	Merge pull request #22256 from taosdata/fix/TD-25457 ... check update data	2023-07-31 22:56:05 +08:00
Haojun Liao	8c1c17e31e	fix(stream): ignore the sink task transfer state.	2023-07-31 19:23:53 +08:00
Haojun Liao	d72580dad7	fix(stream): transfer the state for agg tasks.	2023-07-31 19:12:23 +08:00
Haojun Liao	d45596bb33	fix(stream): kill task when pause the stream execution.	2023-07-31 18:07:37 +08:00
liuyao	32b59af4b1	check update data	2023-07-31 17:32:24 +08:00
Haojun Liao	9981cecbed	refactor: do some internal refactor.	2023-07-31 15:24:35 +08:00
Haojun Liao	e61aa83594	enh(stream): handle the stream hb.	2023-07-31 14:07:18 +08:00
Haojun Liao	cc5ff44604	enh(stream): handle the stream hb.	2023-07-30 19:25:00 +08:00
Haojun Liao	8dfef8768a	other: merge 3.0	2023-07-29 22:54:16 +08:00
Haojun Liao	0bd2548937	fix(stream): initialize the filter window initial range.	2023-07-29 16:41:01 +08:00
Haojun Liao	f6e07d1fdb	other: merge 3.0	2023-07-29 01:32:02 +08:00
Haojun Liao	92d1dbd9ad	fix(stream): set the time window filter before generating create table result.	2023-07-29 01:23:06 +08:00
Haojun Liao	6c9fa4d7c8	fix(stream): check for pause when handling the fill history data.	2023-07-28 19:58:52 +08:00
Haojun Liao	936afeb5ac	refactor: do internal refactor to simple the pause/resume in case of fill history exists.	2023-07-28 19:13:03 +08:00
Haojun Liao	d5974a8f25	refactor(stream): refactor the pause/resume for fill history execution.	2023-07-28 18:05:32 +08:00
Haojun Liao	9f943213ed	enh(stream): update the hb info.	2023-07-28 14:23:53 +08:00
Haojun Liao	74834aea11	enh(stream): prepare hb to mnode from stream meta.	2023-07-28 13:07:16 +08:00
Haojun Liao	2a78cd2d23	Merge pull request #22215 from taosdata/fix/liaohj ... other: merge main.	2023-07-28 13:06:17 +08:00
Haojun Liao	ccc0f13649	Merge pull request #22214 from taosdata/fix/3_liaohj ... fix(stream): scan wal in step2	2023-07-28 00:42:15 +08:00
Haojun Liao	22a5a18fff	fix(stream): 1. set correct timewindow after step2. 2. handle the case when the task is failed to be added into the meta store.	2023-07-27 18:57:36 +08:00
liuyao	5d21f50340	adjust history task trigger mode	2023-07-27 17:45:28 +08:00
Haojun Liao	6319cb8dd4	fix: fix syntax error.	2023-07-27 17:16:45 +08:00
Haojun Liao	b145771a1b	other: merge 3.0	2023-07-27 16:38:57 +08:00
Haojun Liao	3d403dca5a	other: merge main.	2023-07-27 16:23:41 +08:00
Haojun Liao	6ff50d4eaf	fix(stream): update the step2 scan wal files.	2023-07-27 16:10:55 +08:00
Haojun Liao	40fe3ef4f6	fix(stream): refactor the step2 wal scan.	2023-07-27 14:49:20 +08:00
Haojun Liao	e89f530db2	fix(stream): scan wal in step2	2023-07-27 10:55:59 +08:00
yihaoDeng	287088ae3f	fix stream state transfer	2023-07-26 10:16:06 +00:00
liuyao	c368db30c3	stream fill operator mem leak	2023-07-26 17:38:37 +08:00
Haojun Liao	cdffabcdad	fix(stream): fix memory leak.	2023-07-26 14:37:04 +08:00
Haojun Liao	728112ed89	fix(stream): set correct upstream epinfo.	2023-07-26 10:26:59 +08:00
Haojun Liao	12986ff594	fix(stream): fix memory leaks.	2023-07-26 09:25:30 +08:00
yihaoDeng	22c85fcbad	fix stream state transfer	2023-07-25 13:07:49 +00:00
yihaoDeng	0c2e86f416	fix stream state transfer	2023-07-25 10:17:30 +00:00
Haojun Liao	1c1bf63e1f	other: merge 3.0	2023-07-25 18:17:11 +08:00
Haojun Liao	063673726a	fix(stream): fix syntax error	2023-07-25 18:08:22 +08:00
Haojun Liao	2cc4e0a727	fix(stream): fix syntax error	2023-07-25 17:56:40 +08:00
Haojun Liao	0bdccd2681	refactor: do some internal refactor.	2023-07-25 17:31:54 +08:00
Haojun Liao	d29f835a63	fix(stream): set the correct step2 scan time window range.	2023-07-25 15:09:22 +08:00
Haojun Liao	f3f1fade43	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-25 09:25:32 +08:00
Haojun Liao	c116b69941	fix(stream): fix memory leak.	2023-07-25 09:25:18 +08:00
Haojun Liao	a2694b9ce9	fix(stream): fix the invalid check of step2 .	2023-07-24 19:44:28 +08:00
yihaoDeng	fe262d308e	del wal	2023-07-24 11:10:15 +00:00
Haojun Liao	1e34f84f78	other: merge 3.0	2023-07-24 15:23:03 +08:00
Haojun Liao	9bae91bcba	fix(stream): add some logs, and remove the invalid loop.	2023-07-24 13:37:44 +08:00
yihaoDeng	6a27e81964	fix stream state transfer	2023-07-24 02:05:14 +00:00
Haojun Liao	1367552f38	fix(stream): refactor the halt status to check more status.	2023-07-24 10:04:15 +08:00
Haojun Liao	0b6e1a12bb	refactor: do some internal refactor.	2023-07-23 19:09:43 +08:00
Haojun Liao	e387b2f932	refactor: do some internal refactor.	2023-07-23 18:59:34 +08:00
Haojun Liao	4e0f7ffbf8	fix(stream): set the correct flag of pause/resume.	2023-07-23 18:49:56 +08:00
Haojun Liao	9679cc4527	fix(stream): fix race condition.	2023-07-22 10:19:51 +08:00
Haojun Liao	f4864b8713	fix(stream): fix memory leak.	2023-07-22 01:02:58 +08:00
Haojun Liao	bfc4a07207	fix(stream): fix memory leak.	2023-07-22 00:20:02 +08:00
Haojun Liao	1b2636028a	fix(stream): fix memory leak.	2023-07-21 23:05:42 +08:00
Haojun Liao	16d7707b90	fix(stream): align the scan real time data for stream task.	2023-07-21 19:33:43 +08:00
Haojun Liao	39ca9b537f	fix(stream): fix syntax error	2023-07-21 09:43:08 +08:00
Haojun Liao	bd8b811b9d	refactor: do some internal refactor.	2023-07-21 09:14:25 +08:00
Haojun Liao	0d1c4f9ee2	fix(stream): fix syntax error	2023-07-21 09:13:06 +08:00
Haojun Liao	db46d31ca5	fix(stream): refactor the halt function.	2023-07-21 01:32:42 +08:00
yihaoDeng	82df77eba8	fix stream state transfer	2023-07-20 11:52:31 +00:00
yihaoDeng	fc2d6744e2	fix stream state transfer	2023-07-20 10:52:34 +00:00
yihaoDeng	519d3b74d1	fix stream state transfer	2023-07-20 09:51:18 +00:00
Haojun Liao	c9fa170e65	refactor: do some internal refactor.	2023-07-20 16:31:46 +08:00
Haojun Liao	45cb478b31	refactor: do some internal refactor.	2023-07-20 15:36:46 +08:00
Haojun Liao	87fa8f0c4c	Merge branch '3.0' into fix/3_liaohj	2023-07-20 12:15:23 +08:00
Haojun Liao	aed99da6c1	refactor: refactor the stream task starting order.	2023-07-20 12:14:53 +08:00
yihaoDeng	6e5be0d30e	fix stream state transfer	2023-07-20 03:49:32 +00:00
yihaoDeng	733db123ad	refactor code	2023-07-19 13:24:59 +00:00
Haojun Liao	97c44e7c18	refactor: do some internal refactor.	2023-07-19 18:42:02 +08:00
liuyao	8481725517	remove redundant results	2023-07-19 14:58:28 +08:00
Haojun Liao	a32c650248	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-19 10:05:48 +08:00
Haojun Liao	2ae95217bd	fix(stream): open inputQ by default for task deployed on snode.	2023-07-19 10:05:35 +08:00
liuyao	fd02b9a71e	Merge branch '3.0' into enh/triggerCheckPoint2	2023-07-19 10:02:06 +08:00
Haojun Liao	9513f76172	fix(stream): set downstream task ready state.	2023-07-18 19:02:24 +08:00
Haojun Liao	5b29a5ec97	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-18 18:30:10 +08:00
Haojun Liao	902f9d1f94	fix(stream): set not-ready initial value.	2023-07-18 18:29:35 +08:00
yihaoDeng	039befa3d6	Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2	2023-07-18 10:15:20 +00:00
yihaoDeng	790101ced2	fix mem leak	2023-07-18 10:14:04 +00:00
Haojun Liao	d2c875e774	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-18 15:19:09 +08:00
Haojun Liao	901b7d8ecc	fix(stream): if a source task is set to be non-normal, no data should be put into inputQ anymore.	2023-07-18 15:18:57 +08:00
yihaoDeng	95b8754dab	Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2	2023-07-18 04:03:56 +00:00
yihaoDeng	40d59990d8	fix mem leak	2023-07-18 04:01:20 +00:00
Haojun Liao	92106312d2	fix(stream): not dispatch checkpoint block result to downstream.	2023-07-18 09:43:38 +08:00
Haojun Liao	2f24f776fb	fix(stream): fix error in generating checkpoint for state_window.	2023-07-18 09:04:28 +08:00
yihaoDeng	40eb50676d	add checkpoint	2023-07-17 11:04:19 +00:00
Haojun Liao	14b9d920ba	fix(stream): fix memory leak.	2023-07-17 16:02:41 +08:00
Haojun Liao	08f43b9d00	fix(stream): fix checkpoint block not fetched bug.	2023-07-17 15:31:54 +08:00
yihaoDeng	394cc771e5	add checkpoint	2023-07-17 06:47:23 +00:00
yihaoDeng	f0f2215f49	add checkpoint	2023-07-17 06:21:45 +00:00
yihaoDeng	3168096e40	add checkpoint	2023-07-17 06:06:21 +00:00
yihaoDeng	e0bb3c8f94	Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2	2023-07-17 05:26:57 +00:00
yihaoDeng	f7732ddd18	recoverSnapshot	2023-07-17 05:26:30 +00:00
Haojun Liao	4dd93494d1	fix(stream): fix syntax error	2023-07-17 13:23:06 +08:00
Haojun Liao	d7f7a7d6cf	fix(stream): fix syntax error	2023-07-17 12:53:36 +08:00
Haojun Liao	b2a905bd91	Merge branch '3.0' into enh/triggerCheckPoint2	2023-07-17 11:50:12 +08:00
yihaoDeng	5adf580764	add checkpoint	2023-07-17 03:44:06 +00:00
Haojun Liao	8c8b1a6d79	fix(stream): handle block before checkpoint msg in the inputQ.	2023-07-17 10:47:05 +08:00
yihaoDeng	dea2e73d2e	add checkpoint	2023-07-17 02:22:21 +00:00
Haojun Liao	a9757637d9	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-16 12:47:24 +08:00
Haojun Liao	c6a322e0ef	refactor(stream): back pressure is active, which is trigger by dispatch rsp.	2023-07-16 12:47:08 +08:00
yihaoDeng	b4de0892e6	add checkpoint	2023-07-15 09:35:33 +00:00
yihaoDeng	7b4185dc56	Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2	2023-07-15 04:27:39 +00:00
yihaoDeng	e18c9ea672	add checkpoint	2023-07-15 04:26:34 +00:00
yihaoDeng	aad669e33c	add checkpoint	2023-07-14 14:46:13 +00:00
Haojun Liao	725db16af9	fix(stream): set save checkpoint ver.	2023-07-14 19:47:19 +08:00
Haojun Liao	035b199497	refactor(stream): do some internal refactor.	2023-07-14 18:46:38 +08:00
Haojun Liao	6798e31bb5	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-14 18:35:53 +08:00
Haojun Liao	8c79157822	fix(stream): close the inputQ if checkpoint msg received.	2023-07-14 18:35:41 +08:00
yihaoDeng	3020e27114	fix mem leak	2023-07-14 10:20:37 +00:00
yihaoDeng	ed931c1100	Merge branch 'fix/newCheckpoint' into enh/triggerCheckPoint2	2023-07-14 10:11:20 +00:00
yihaoDeng	3c4631ef1f	add checkpoint	2023-07-14 10:06:24 +00:00
Haojun Liao	2b85ea62aa	refactor: do some internal refactor.	2023-07-14 17:48:47 +08:00
Haojun Liao	b16432280e	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-14 17:21:37 +08:00
Haojun Liao	eb7e6152ae	refactor(stream): do some internal refactor.	2023-07-14 17:21:20 +08:00
yihaoDeng	be050e12ea	fix recover error	2023-07-14 15:46:00 +08:00
yihaoDeng	d0ccbd48d2	fix coverity scan problem	2023-07-14 14:54:20 +08:00
yihaoDeng	49b21b3ccb	fix coverity scan problem	2023-07-14 14:53:11 +08:00
yihaoDeng	2279706357	fix coverity scan problem	2023-07-14 14:49:02 +08:00
yihaoDeng	15f5fd19eb	fix recover error	2023-07-14 14:47:06 +08:00
yihaoDeng	e16a3935a5	fix coverity scan problem	2023-07-14 14:40:32 +08:00
liuyao	c3375dd744	mem leak	2023-07-13 19:24:11 +08:00
Haojun Liao	e0ea0f2df4	Merge pull request #22020 from taosdata/fix/liaohj ... other: merge main	2023-07-13 17:55:28 +08:00
Haojun Liao	2fd72500e2	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-13 16:32:37 +08:00
Haojun Liao	813f4cb363	refactor: do some internal refactor.	2023-07-13 16:32:25 +08:00
liuyao	ec2134f758	op ci	2023-07-13 16:24:38 +08:00
yihaoDeng	9e128b92f8	fix recover error	2023-07-13 16:17:18 +08:00
yihaoDeng	1307776786	fix recover error	2023-07-13 16:09:34 +08:00
yihaoDeng	9434b4eaac	fix recover error	2023-07-13 16:07:58 +08:00
yihaoDeng	18f9882834	fix recover error	2023-07-13 16:06:23 +08:00
Haojun Liao	66d577d134	fix(stream): abort exec when task is dropped.	2023-07-13 15:04:39 +08:00
yihaoDeng	b7403cd171	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-07-13 10:38:34 +08:00
yihaoDeng	0e1a91d134	fix compile error	2023-07-13 10:38:21 +08:00
Haojun Liao	af7f78ada2	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-13 10:17:10 +08:00
Haojun Liao	2f90a53548	fix(stream): set checkpoint id when expanding task.	2023-07-13 10:16:57 +08:00
yihaoDeng	f3f3893872	fix compile error	2023-07-13 10:05:29 +08:00
yihaoDeng	2ec67bcc08	rm expire checkpoint	2023-07-13 10:00:16 +08:00
Haojun Liao	773ae39d33	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 ... # Conflicts: # source/libs/stream/src/streamCheckpoint.c	2023-07-13 09:17:51 +08:00
Haojun Liao	08a4fb06ae	fix(stream): dispatch checkpoint msg to downstream by puting message into input queue.	2023-07-13 09:17:20 +08:00
yihaoDeng	82468f162a	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-07-12 16:43:56 +08:00
yihaoDeng	e1de4984a6	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-07-12 16:39:19 +08:00
yihaoDeng	bb72f07a94	rm expire checkpoint	2023-07-12 16:38:46 +08:00
Haojun Liao	3ce54423a5	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-12 11:38:27 +08:00
Haojun Liao	d392bb60ba	refactor(stream): set the initial version from the checkpoint.	2023-07-12 11:38:13 +08:00
liuyao	7d4bb1b932	add checkpoint id for recover	2023-07-12 10:48:58 +08:00
Haojun Liao	9484f3da94	Merge branch '3.0' into enh/triggerCheckPoint2	2023-07-12 10:20:18 +08:00
Haojun Liao	a049e310f6	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-12 10:16:26 +08:00
Haojun Liao	6f2fc4fab3	fix(stream): commit task meta after do vnode-wide checkpoint.	2023-07-12 10:16:14 +08:00
Haojun Liao	fed3803739	fix(stream): fix memory leak.	2023-07-11 19:29:52 +08:00
liuyao	6298f17c45	delete invalid code	2023-07-11 19:21:27 +08:00
yihaoDeng	503d7540f7	Merge branch 'enh/triggerCheckPoint2' of https://github.com/taosdata/TDengine into enh/triggerCheckPoint2	2023-07-11 16:31:07 +08:00
yihaoDeng	e547ed3699	rm expire checkpoint	2023-07-11 16:30:14 +08:00
Haojun Liao	da6a4de021	fix(stream): disable invalid set normal task status.	2023-07-11 15:12:34 +08:00
Haojun Liao	09b764494d	fix(stream): set correct checkpoint version when starting stream tasks.	2023-07-11 14:03:43 +08:00
Haojun Liao	571cccd737	refactor: do some internal refactor.	2023-07-11 11:41:37 +08:00
Haojun Liao	62a763ead3	fix(stream): fix invalid assert.	2023-07-11 11:22:48 +08:00
Haojun Liao	a803eaee3e	fix(stream): fix concurrent bug in save task meta.	2023-07-11 10:01:43 +08:00
Haojun Liao	a571663a5d	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2 ... # Conflicts: # source/libs/stream/src/streamExec.c	2023-07-11 09:53:41 +08:00
Haojun Liao	cbda61c7f9	fix(stream): fix error in checkpointing.	2023-07-11 09:53:08 +08:00
yihaoDeng	c056e34534	fix compile error	2023-07-11 09:39:58 +08:00
Haojun Liao	3ffdbe923d	other: merge 3.0	2023-07-11 09:12:57 +08:00
Haojun Liao	a6cd702676	fix(stream): supress the warning	2023-07-11 08:54:11 +08:00
Haojun Liao	8a6a876f67	fix(stream): fix error in generating checkpoint.	2023-07-10 22:53:15 +08:00
Haojun Liao	87bedef2cd	fix(stream): fix error in checkpointing.	2023-07-10 19:20:05 +08:00
Haojun Liao	ab5b2fe0a8	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-10 18:21:02 +08:00
Haojun Liao	385a5c9651	fix(stream): fix error in generating checkpoint.	2023-07-10 18:20:50 +08:00
yihaoDeng	e263d5f55f	add checkpoint	2023-07-10 17:33:48 +08:00
Haojun Liao	d6e7e6e174	fix(stream): fix typo.	2023-07-10 14:57:28 +08:00
Haojun Liao	16ee72ab06	fix(stream): free msg after send checkpoint rsp.	2023-07-10 13:57:51 +08:00
Haojun Liao	f6515e2a2c	fix(stream): fix error in checkpointing.	2023-07-10 11:43:37 +08:00
Haojun Liao	5940bbfb33	fix(stream): set correct datablock.	2023-07-10 10:42:38 +08:00
Haojun Liao	9ad5e05751	fix(stream): fix error in checking status.	2023-07-10 10:24:04 +08:00
Haojun Liao	e8eba3175a	fix(stream): fix error in checking status.	2023-07-10 10:23:05 +08:00
Haojun Liao	dd15ca6103	fix(stream): add missing status check.	2023-07-10 10:06:21 +08:00
Haojun Liao	ed1181a1d1	fix(stream): fix invalid read bug.	2023-07-10 09:55:29 +08:00
Haojun Liao	4f534ce6e9	fix(stream): fix error in generating checkpoint.	2023-07-08 10:29:09 +08:00
Haojun Liao	a5c19427e7	fix(stream): send correct rsp to mnode.	2023-07-08 09:39:44 +08:00
Haojun Liao	ab4e2ebc3a	fix(stream): fix bug that causes the endless loop.	2023-07-07 21:45:22 +08:00
Haojun Liao	9c30abf95b	fix(stream): fix error in generating checkpoint.	2023-07-07 21:38:53 +08:00
Haojun Liao	b03ca31a7f	fix(stream): fix error in generating checkpoint.	2023-07-07 17:21:46 +08:00
Haojun Liao	8298f30e56	fix(stream): fix bug in checkpoint.	2023-07-07 17:16:08 +08:00
Haojun Liao	47877898d0	enh(stream): generate the checkpoint framework.	2023-07-07 16:07:52 +08:00
Haojun Liao	4f814db5d5	fix(stream): fix error during transferring executor state, while a task is not in normal status.	2023-07-06 18:34:01 +08:00
Haojun Liao	61f3585714	Merge remote-tracking branch 'origin/enh/triggerCheckPoint2' into enh/triggerCheckPoint2	2023-07-06 18:26:44 +08:00
Haojun Liao	d7101f7109	enh(stream): support dispatch checkpoint msg.	2023-07-06 18:26:22 +08:00
yihaoDeng	8e9ef2a384	fix mem leak	2023-07-06 09:01:34 +00:00
liuyao	0e914a19c6	stream operartor checkpoint	2023-07-06 14:28:34 +08:00
Haojun Liao	5a9461a69a	other: merge 3.0	2023-07-06 11:52:21 +08:00
yihaoDeng	483f9ab896	add other	2023-07-06 03:39:28 +00:00
Haojun Liao	f4a3567935	other: merge 3.0	2023-07-06 11:24:30 +08:00
Haojun Liao	7a417a33b0	Merge pull request #21960 from taosdata/fix/3_liaohj ... fix(stream): fix error for extract msg from inputQ	2023-07-05 17:47:18 +08:00
Haojun Liao	1855a16981	other: merge 3.0	2023-07-05 16:12:32 +08:00
Haojun Liao	03dbcbf055	refactor: do some internal refactor.	2023-07-05 15:55:55 +08:00
Haojun Liao	ff2bf35603	fix(stream): fix error in set the version range for secondary scan.	2023-07-04 15:08:39 +08:00
Haojun Liao	77530e1956	refactor: record the downstream input Queue blocking time.	2023-07-04 10:58:11 +08:00
yihaoDeng	e7b37486bb	vnode snapshot read	2023-07-04 00:46:39 +00:00
Haojun Liao	393b36d83d	Merge branch 'refact/fillhistory' of github.com:taosdata/tdengine into refact/fillhistory	2023-07-03 17:53:18 +08:00
Haojun Liao	2dbccc1573	refactor: do some internal refactor.	2023-07-03 17:52:17 +08:00
Haojun Liao	42e1cd741a	Merge pull request #21935 from taosdata/fix/3_liaohj ... fix(stream): fix message lost bug during pause stream.	2023-07-03 17:37:56 +08:00
Haojun Liao	9e62b9d0d2	fix(stream): fix error in extract data from inputQ.	2023-07-03 15:33:08 +08:00
Haojun Liao	200575647c	Merge branch '3.0' into refact/fillhistory	2023-07-03 15:16:18 +08:00
Haojun Liao	20d099dfa6	Merge pull request #21901 from taosdata/fix/liaohj ... fix: fix coverity issue.	2023-07-03 15:15:21 +08:00
Haojun Liao	ceb06635fe	fix(stream): fix error in pause stream.	2023-07-03 15:12:35 +08:00
Haojun Liao	f84bfc96fb	fix(stream): fix error in pause in stream.	2023-07-03 14:30:11 +08:00
Haojun Liao	5d4efe1198	fix(stream): fix error in pause.	2023-07-03 11:46:05 +08:00
Haojun Liao	317a7c83c7	fix(stream): fix message lost bug during pause stream.	2023-07-03 10:55:45 +08:00
yihaoDeng	247d3ac7ee	vnode snapshot read	2023-06-30 12:05:05 +00:00
yihaoDeng	7d30a6e27a	vnode snapshot read	2023-06-30 11:48:46 +00:00
yihaoDeng	9eb6d8cf1e	vnode snapshot read	2023-06-29 09:35:09 +00:00
Haojun Liao	622e1cb608	fix: fix coverity issue.	2023-06-29 15:54:09 +08:00
dapan1121	3519e9170e	Merge remote-tracking branch 'origin/main' into 3.0	2023-06-29 11:13:45 +08:00
yihaoDeng	bb520b56e7	add checkpoint	2023-06-28 09:58:07 +00:00
yihaoDeng	6b6e237079	add checkpoint	2023-06-28 09:57:08 +00:00
Haojun Liao	78739e4bdb	fix(stream): fix syntax error.	2023-06-28 14:21:11 +08:00
Haojun Liao	57fcd553f8	refactor: do some internal refactor.	2023-06-28 13:13:13 +08:00
Haojun Liao	3710ea4aca	refactor: do some internal refactor.	2023-06-28 09:41:08 +08:00
Haojun Liao	a19e63fd23	fix(stream): fix error in handling fill history.	2023-06-27 23:00:14 +08:00
Yihao Deng	4de7db06f9	Merge branch '3.0' into enh/triggerCheckPoint2	2023-06-27 17:57:14 +08:00
Haojun Liao	32fddeff18	fix(stream): fix error retrieve data from source task.And optimize the test cases.	2023-06-27 16:24:47 +08:00
Haojun Liao	3289ad62be	other: merge 3.0	2023-06-27 11:33:40 +08:00
liuyao	71f4226e15	fix coverity san issues	2023-06-27 10:39:38 +08:00
Haojun Liao	b73444b291	fix(stream): start stream task in case of scan history completing.	2023-06-27 09:44:51 +08:00
yihaoDeng	2c1fc501ff	add checkpoint	2023-06-26 12:28:42 +00:00
Haojun Liao	437eb93a4d	fix(stream): fix error while fill history exists.	2023-06-26 18:44:59 +08:00