Commit Graph

8637 Commits

Author SHA1 Message Date
Haojun Liao b6debd985b fix(stream): always return success if repeatly recv checkpoint source msg. 2024-05-07 16:33:08 +08:00
Hongze Cheng c4b2f5681c
Merge pull request #25654 from taosdata/fix/TD-29845
fix: fix last col version when updating rocks
2024-05-07 11:33:51 +08:00
Haojun Liao 0e0f98eb8d refactor: do some internal refactor. 2024-05-07 10:50:44 +08:00
Minglei Jin 562bf0fe1e tsdb/cache: fix last col version when updating rocks 2024-05-07 10:24:07 +08:00
Shungang Li b979c584fb fix: tsdbCacheGetBatch ref of tmp memory 2024-05-07 10:22:58 +08:00
Haojun Liao 18c66a5491 refactor: do some internal refactor. 2024-05-06 18:17:38 +08:00
Haojun Liao 7ad7ef7cfc refactor: do some internal refactor. 2024-05-06 17:03:41 +08:00
Haojun Liao cdc7b03ac6 fix(stream): fix syntax error. 2024-04-30 22:44:32 +08:00
Haojun Liao 732e52d64d refactor: do some internal refactor, and add some logs. 2024-04-30 19:11:58 +08:00
Haojun Liao 94a0f9ab8f other: merge 3.0 2024-04-30 17:12:46 +08:00
Haojun Liao 629502e12e refactor: do some internal refactor. 2024-04-30 17:00:51 +08:00
Haojun Liao f2bc93b78d
Merge pull request #25598 from taosdata/fix/3_liaohj
refactor(stream): opt stream sink perf.
2024-04-30 16:59:22 +08:00
dapan1121 f54dd2b818
Merge pull request #25602 from taosdata/fix/TS-4728-3.0
fix:use path of SStreamMeta
2024-04-30 16:12:50 +08:00
Haojun Liao cb5a0563e6 fix(stream): fix error caused by merge. 2024-04-30 15:43:12 +08:00
wangmm0220 35003cbb34 fix:use path of SStreamMeta 2024-04-30 14:36:16 +08:00
Haojun Liao 4c27af9b13 refactor: do some internal refactor. 2024-04-30 13:25:39 +08:00
wangmm0220 3a1c210601 fix:use path of SStreamMeta 2024-04-30 11:06:03 +08:00
Haojun Liao 54e9522c62 refactor(stream): opt stream sink perf. 2024-04-30 09:41:29 +08:00
dapan1121 6187bf4e06
Merge pull request #25584 from taosdata/fix/TS-4728-3.0
fix:[TS-4728]transform store data if data is too big
2024-04-30 09:02:40 +08:00
wangmm0220 cd3f3046f7 fix:memory leak 2024-04-29 19:36:41 +08:00
wangmm0220 1f85cb42e6 fix:[TS-4728]transform strore data if data is too big 2024-04-29 17:22:40 +08:00
Haojun Liao b0ef022e87 fix(tsdb): set the correct start pos for binary search. 2024-04-29 15:13:52 +08:00
Haojun Liao 7a5cdb81d5 fix(tsdb): set the correct start pos for binary search. 2024-04-29 14:40:49 +08:00
Haojun Liao bf5d523116 fix(stream): disable the exec of complete check status in timer thread. 2024-04-28 17:57:34 +08:00
Haojun Liao 324072fed8
Merge pull request #25525 from taosdata/fix/3_liaohj
fix(stream): update stream task meta info.
2024-04-26 18:15:09 +08:00
Haojun Liao 6d06188b9f fix(stream): fix memory leak. 2024-04-26 17:06:15 +08:00
Haojun Liao b1b3246066 fix(stream): update the checkpoint executed transId range. 2024-04-26 17:03:01 +08:00
Haojun Liao 5f5595a6ab
Merge pull request #25517 from taosdata/fix/3_liaohj
fix(stream): add task node into update list if it is timeout for more than 100sec.
2024-04-26 17:00:23 +08:00
Haojun Liao 8b53f76691 fix(stream): discard the repeatly recv checkpoint-source msg. 2024-04-26 15:56:34 +08:00
Hongze Cheng efdc943a3d Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0 2024-04-26 14:57:58 +08:00
Haojun Liao c565e31638
Merge pull request #25510 from taosdata/fix/3_liaohj
fix(stream): handle disorder node Update trans Id.
2024-04-26 12:44:00 +08:00
Haojun Liao 815489d20a fix(tsdb): set the pk info when converting fileblockinfo to binrecord. 2024-04-26 11:10:20 +08:00
Haojun Liao 77961ea791 fix(stream): handle disorder node Update trans Id. 2024-04-26 09:45:42 +08:00
Haojun Liao feb176149e
Merge pull request #25507 from taosdata/fix/3_liaohj
fix(tsdb): overlap check take pk into consideration.
2024-04-26 09:06:38 +08:00
Hongze Cheng f500762af7 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TS-4706-3.0 2024-04-26 09:00:09 +08:00
Haojun Liao 59a3e8ca40 fix(tsdb): overlap check take pk into consideration. 2024-04-25 23:25:24 +08:00
Haojun Liao b3d2ccec83
Merge pull request #25483 from taosdata/fix/3_liaohj
fix(query): add ts in cache_scan_operator if pk exists and only retri…
2024-04-25 22:32:26 +08:00
Haojun Liao eef5e6e409 fix(stream): fix syntax error. 2024-04-25 18:30:33 +08:00
Haojun Liao 3b932599ab fix(stream): fix syntax error. 2024-04-25 17:47:03 +08:00
Minglei Jin eaa1e7a775 tsdb/writer: use latest version of data for writing 2024-04-25 16:40:58 +08:00
Haojun Liao cd8baa7ba0 fix(stream): add log for update task epset, set correct update flag if epset updated. 2024-04-25 16:39:11 +08:00
Minglei Jin a9094d7602 fix(cos/multi-writing): use lasted version of data 2024-04-25 16:37:24 +08:00
Hongze Cheng 10d82a3acf
Merge pull request #25476 from taosdata/enh/TS-4710-3.0
enh: recover file
2024-04-25 11:15:02 +08:00
Hongze Cheng ca9aebc5ff
Merge pull request #25473 from taosdata/fix/TD-29773
Fix/TD-29773
2024-04-25 09:45:47 +08:00
Haojun Liao ac860f7fe8 fix(query): add ts in cache_scan_operator if pk exists and only retrieve ts column. 2024-04-25 09:29:42 +08:00
Haojun Liao 3b08ee3d16
Merge pull request #25458 from taosdata/fix/3_liaohj
fix(stream): add task update trans conflict level.
2024-04-24 18:54:06 +08:00
Hongze Cheng 2cac0d5691 enh: recover file 2024-04-24 18:04:10 +08:00
dapan1121 ab2c9aaf5b
Merge pull request #25466 from taosdata/enh/TD-29758
enh:[TD-29758]optimize log in tmq
2024-04-24 17:47:28 +08:00
Yihao Deng 1181f9de28 Fix metaGetColCmpr function and remove commented code 2024-04-24 08:22:54 +00:00
Hongze Cheng b1fb14e49e
Merge pull request #25465 from taosdata/fix/TD-29759
fix(s3migrate/datas3): init fd of from & to early
2024-04-24 11:29:47 +08:00
Hongze Cheng c3275dc61c
Merge pull request #25459 from taosdata/fix/TD-29750-3.0
fix: if not exists logic for topic/stream/table
2024-04-24 10:52:53 +08:00
Hongze Cheng 0eae851257
Merge pull request #25425 from taosdata/fix/ci_monitor_memory
fix ci monitor memory
2024-04-24 10:35:04 +08:00
wangmm0220 20cedc3339 enh:[TD-29758]optimize log in tmq 2024-04-24 10:02:58 +08:00
Minglei Jin c76f886c91 fix(s3migrate/datas3): init fd of from & to early 2024-04-24 09:36:44 +08:00
kailixu c173be667c Merge branch '3.0' into fix/TD-29750-3.0 2024-04-24 08:44:43 +08:00
Haojun Liao ace5e12e65 fix(tsdb): set the correct lflag when creating tsdbCache reader. 2024-04-23 19:25:51 +08:00
Cary Xu 44b4580bd5
Update metaTable.c 2024-04-23 18:37:40 +08:00
kailixu 89ee62ac09 fix: if not exists logic for topic/stream/table 2024-04-23 18:19:16 +08:00
Haojun Liao 0f8ff48c6b fix(stream): fix double free 2024-04-23 18:18:01 +08:00
Haojun Liao 0c7373509e fix(stream): add task update trans conflict level. 2024-04-23 18:07:00 +08:00
Hongze Cheng 328f95f7cb fix: possible write block when error occurs 2024-04-23 16:48:49 +08:00
Haojun Liao 7fda9d9fcb Merge branch '3.0' into fix/3_liaohj 2024-04-23 15:08:43 +08:00
Haojun Liao b0f68a9147 refactor: do some internal refactor. 2024-04-23 14:58:51 +08:00
Haojun Liao 1adf59e7d8 fix(stream): do check when task is paused, and do some internal refactor. 2024-04-23 13:53:23 +08:00
Haojun Liao d7a08909dd
Merge pull request #25442 from taosdata/fix/3_liaohj
fix(stream): save the epset if task epset updated.
2024-04-23 09:10:45 +08:00
Haojun Liao 315b86cf66 fix(stream): save the epset if task epset updated. 2024-04-22 23:52:45 +08:00
Haojun Liao ada1c6d4c0
Merge pull request #25434 from taosdata/fix/3_liaohj
fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.
2024-04-22 22:13:19 +08:00
Haojun Liao a8fac441be fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure. 2024-04-22 14:02:31 +08:00
Yihao Deng 541b070765 Remove commented out code in metaCreateSTable function 2024-04-20 07:45:39 +00:00
Yihao Deng ba30339d4e Refactor meteDecodeColCmprEntry function to return -1 on error 2024-04-20 03:07:12 +00:00
Yihao Deng 517365467d Merge branch '3.0' into fix/compatibleWithVeryOldMeta 2024-04-20 01:54:02 +00:00
Haojun Liao e5dddc4abf Merge branch '3.0' into fix/3_liaohj 2024-04-19 19:13:28 +08:00
Haojun Liao ea527b19b8 fix(stream): set correct start version if no checkpoint exist. 2024-04-19 19:12:23 +08:00
dmchen 62bc1074c0 fix monitor memory 2024-04-19 10:44:08 +00:00
dapan1121 a46b7cca3d
Merge pull request #25413 from taosdata/feat/TS-4243-tmq
opti:raw data from tmq
2024-04-19 18:22:21 +08:00
Yihao Deng 18cdeaf960 compatible with older meta 2024-04-19 07:37:43 +00:00
Hongze Cheng 69222543a2
Merge pull request #25401 from taosdata/fix/TD-29562
Fix/td 29562
2024-04-19 13:57:19 +08:00
wangmm0220 1695824c73 fix:merge from 3.0 2024-04-19 13:52:57 +08:00
wangmm0220 42467c0e00 opti:raw data from tmq 2024-04-19 13:48:17 +08:00
Hongze Cheng fc5c84422e
Merge pull request #25256 from taosdata/feat/TD-24834
Feat/td 24834
2024-04-19 13:34:37 +08:00
Haojun Liao 62260bff79
Merge pull request #25389 from taosdata/fix/3_liaohj
fix(stream): reset checkpoint info after receiving task-reset info.
2024-04-19 11:23:55 +08:00
Hongze Cheng e4e00c8953
Merge pull request #25403 from taosdata/fix/TD-29621
fix: geometry crash in stream & tmq
2024-04-19 11:15:26 +08:00
Yihao Deng 2314771209 fix TD-29562 2024-04-19 02:09:40 +00:00
Yihao Deng ee8a96fb42 fix TD-29562 2024-04-19 02:04:32 +00:00
Haojun Liao 34f7dc4782
Merge pull request #25404 from taosdata/feat/TS-4243-3.0
fix(tsdb): set correct compare func for merge tree.
2024-04-19 09:10:03 +08:00
Haojun Liao eb1fed177f fix(tsdb): set correct compare func for merge tree. 2024-04-19 00:32:41 +08:00
Haojun Liao 525b574c85
Merge pull request #25402 from taosdata/feat/TS-4243-3.0
fix(tsdb): update the initial value of pk for varchar type.
2024-04-18 19:49:05 +08:00
Shungang Li f3438ce04e fix: geometry crash in stream & tmq 2024-04-18 19:27:02 +08:00
Haojun Liao 815d12fd77 fix(stream): set check downstream completed for sink task. 2024-04-18 18:36:02 +08:00
Haojun Liao 4802cd1ddf Merge branch '3.0' into fix/3_liaohj 2024-04-18 17:53:30 +08:00
Hongze Cheng 05d853bd9e
Merge pull request #25383 from taosdata/fix/dropStreamData
Fix/drop stream data
2024-04-18 17:10:57 +08:00
Hongze Cheng 874b4b1911
Merge pull request #25400 from taosdata/enh/TD-28945-pk
fix(vnode): encode the missing tsdbPageSize
2024-04-18 17:04:29 +08:00
Haojun Liao 8962010caf other: merge 3.0 2024-04-18 16:31:15 +08:00
Haojun Liao c94c9a900c fix(tsdb): update the initial value of pk for varchar type. 2024-04-18 16:17:29 +08:00
Yihao Deng d21341c943 fix TD-29562 2024-04-18 08:16:40 +00:00
kailixu 20c4385d27 Merge branch '3.0' into feat/TD-24834 2024-04-18 15:54:01 +08:00
Yihao Deng 3f4fa8b74e fix TD-29562 2024-04-18 07:03:18 +00:00
Minglei Jin eb51a7c5b5 vnode: encode the missing tsdbPageSize 2024-04-18 14:48:05 +08:00
Hongze Cheng a4edab720c
Merge pull request #25391 from taosdata/enh/TD-28945-pk
cos/multi-writing: init fid & cid for s3 page cache
2024-04-18 14:05:28 +08:00
Haojun Liao deee0c3793 refactor: do some internal refactor. 2024-04-18 13:05:45 +08:00