Commit Graph

9090 Commits

Author SHA1 Message Date
wangmm0220 20cedc3339 enh:[TD-29758]optimize log in tmq 2024-04-24 10:02:58 +08:00
Minglei Jin c76f886c91 fix(s3migrate/datas3): init fd of from & to early 2024-04-24 09:36:44 +08:00
kailixu c173be667c Merge branch '3.0' into fix/TD-29750-3.0 2024-04-24 08:44:43 +08:00
Haojun Liao ace5e12e65 fix(tsdb): set the correct lflag when creating tsdbCache reader. 2024-04-23 19:25:51 +08:00
Cary Xu 44b4580bd5
Update metaTable.c 2024-04-23 18:37:40 +08:00
kailixu 89ee62ac09 fix: if not exists logic for topic/stream/table 2024-04-23 18:19:16 +08:00
Haojun Liao 0f8ff48c6b fix(stream): fix double free 2024-04-23 18:18:01 +08:00
Haojun Liao 0c7373509e fix(stream): add task update trans conflict level. 2024-04-23 18:07:00 +08:00
Hongze Cheng 328f95f7cb fix: possible write block when error occurs 2024-04-23 16:48:49 +08:00
Haojun Liao 7fda9d9fcb Merge branch '3.0' into fix/3_liaohj 2024-04-23 15:08:43 +08:00
Haojun Liao b0f68a9147 refactor: do some internal refactor. 2024-04-23 14:58:51 +08:00
Haojun Liao 1adf59e7d8 fix(stream): do check when task is paused, and do some internal refactor. 2024-04-23 13:53:23 +08:00
Haojun Liao d7a08909dd
Merge pull request #25442 from taosdata/fix/3_liaohj
fix(stream): save the epset if task epset updated.
2024-04-23 09:10:45 +08:00
Haojun Liao 315b86cf66 fix(stream): save the epset if task epset updated. 2024-04-22 23:52:45 +08:00
Haojun Liao ada1c6d4c0
Merge pull request #25434 from taosdata/fix/3_liaohj
fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure.
2024-04-22 22:13:19 +08:00
Haojun Liao a8fac441be fix(stream):update the check-rsp prcedure, to avoid repeatly start check-rsp procedure. 2024-04-22 14:02:31 +08:00
Yihao Deng 541b070765 Remove commented out code in metaCreateSTable function 2024-04-20 07:45:39 +00:00
Yihao Deng ba30339d4e Refactor meteDecodeColCmprEntry function to return -1 on error 2024-04-20 03:07:12 +00:00
Yihao Deng 517365467d Merge branch '3.0' into fix/compatibleWithVeryOldMeta 2024-04-20 01:54:02 +00:00
Haojun Liao e5dddc4abf Merge branch '3.0' into fix/3_liaohj 2024-04-19 19:13:28 +08:00
Haojun Liao ea527b19b8 fix(stream): set correct start version if no checkpoint exist. 2024-04-19 19:12:23 +08:00
dmchen 62bc1074c0 fix monitor memory 2024-04-19 10:44:08 +00:00
dapan1121 a46b7cca3d
Merge pull request #25413 from taosdata/feat/TS-4243-tmq
opti:raw data from tmq
2024-04-19 18:22:21 +08:00
Yihao Deng 18cdeaf960 compatible with older meta 2024-04-19 07:37:43 +00:00
Hongze Cheng 69222543a2
Merge pull request #25401 from taosdata/fix/TD-29562
Fix/td 29562
2024-04-19 13:57:19 +08:00
wangmm0220 1695824c73 fix:merge from 3.0 2024-04-19 13:52:57 +08:00
wangmm0220 42467c0e00 opti:raw data from tmq 2024-04-19 13:48:17 +08:00
Hongze Cheng fc5c84422e
Merge pull request #25256 from taosdata/feat/TD-24834
Feat/td 24834
2024-04-19 13:34:37 +08:00
Haojun Liao 62260bff79
Merge pull request #25389 from taosdata/fix/3_liaohj
fix(stream): reset checkpoint info after receiving task-reset info.
2024-04-19 11:23:55 +08:00
Hongze Cheng e4e00c8953
Merge pull request #25403 from taosdata/fix/TD-29621
fix: geometry crash in stream & tmq
2024-04-19 11:15:26 +08:00
Yihao Deng 2314771209 fix TD-29562 2024-04-19 02:09:40 +00:00
Yihao Deng ee8a96fb42 fix TD-29562 2024-04-19 02:04:32 +00:00
Haojun Liao 34f7dc4782
Merge pull request #25404 from taosdata/feat/TS-4243-3.0
fix(tsdb): set correct compare func for merge tree.
2024-04-19 09:10:03 +08:00
Haojun Liao eb1fed177f fix(tsdb): set correct compare func for merge tree. 2024-04-19 00:32:41 +08:00
Haojun Liao 525b574c85
Merge pull request #25402 from taosdata/feat/TS-4243-3.0
fix(tsdb): update the initial value of pk for varchar type.
2024-04-18 19:49:05 +08:00
Shungang Li f3438ce04e fix: geometry crash in stream & tmq 2024-04-18 19:27:02 +08:00
Haojun Liao 815d12fd77 fix(stream): set check downstream completed for sink task. 2024-04-18 18:36:02 +08:00
Haojun Liao 4802cd1ddf Merge branch '3.0' into fix/3_liaohj 2024-04-18 17:53:30 +08:00
Hongze Cheng 05d853bd9e
Merge pull request #25383 from taosdata/fix/dropStreamData
Fix/drop stream data
2024-04-18 17:10:57 +08:00
Hongze Cheng 874b4b1911
Merge pull request #25400 from taosdata/enh/TD-28945-pk
fix(vnode): encode the missing tsdbPageSize
2024-04-18 17:04:29 +08:00
Haojun Liao 8962010caf other: merge 3.0 2024-04-18 16:31:15 +08:00
Haojun Liao c94c9a900c fix(tsdb): update the initial value of pk for varchar type. 2024-04-18 16:17:29 +08:00
Yihao Deng d21341c943 fix TD-29562 2024-04-18 08:16:40 +00:00
kailixu 20c4385d27 Merge branch '3.0' into feat/TD-24834 2024-04-18 15:54:01 +08:00
Yihao Deng 3f4fa8b74e fix TD-29562 2024-04-18 07:03:18 +00:00
Minglei Jin eb51a7c5b5 vnode: encode the missing tsdbPageSize 2024-04-18 14:48:05 +08:00
Hongze Cheng a4edab720c
Merge pull request #25391 from taosdata/enh/TD-28945-pk
cos/multi-writing: init fid & cid for s3 page cache
2024-04-18 14:05:28 +08:00
Haojun Liao deee0c3793 refactor: do some internal refactor. 2024-04-18 13:05:45 +08:00
Haojun Liao d5d23b0434 fix(tsdb): set reader status normal once successful taking snapshot. 2024-04-18 13:05:44 +08:00
Minglei Jin 8ca2b08d5c cos/multi-writing: fix remove_file with -1 lcn 2024-04-18 08:48:44 +08:00
Haojun Liao 9056a48efd refactor: do some internal refactor. 2024-04-17 21:58:02 +08:00
Haojun Liao ac84a5f82b refactor: do some internal refactor. 2024-04-17 21:57:09 +08:00
Minglei Jin 7034cbee22 cos/multi-writing: init fid & cid for s3 page cache 2024-04-17 19:48:50 +08:00
Haojun Liao ddf98ae0c2 refactor: do some internal refactor. 2024-04-17 18:04:02 +08:00
Haojun Liao 289ec6cf66 fix(stream): reset checkpoint info after receiving task-reset info. 2024-04-17 17:57:12 +08:00
dm chen 1196ea72da
Merge branch '3.0' into feat/TD-24834 2024-04-17 17:13:29 +08:00
Hongze Cheng a34b644640
Merge pull request #25366 from taosdata/feat/compress_3.0
Feat/compress 3.0
2024-04-17 16:15:26 +08:00
Yihao Deng 354f33fa88 drop stream data 2024-04-17 05:38:45 +00:00
Yihao Deng 74b7bf6bbc drop stream data 2024-04-17 05:37:35 +00:00
Haojun Liao 2ce7d18e94 refactor: do some internal refactor. 2024-04-17 11:35:03 +08:00
Haojun Liao 69cb630e7f fix(tsdb): update the compare func. 2024-04-17 11:32:48 +08:00
Yihao Deng 04e78d0ce7 Merge branch 'feat/3.0' into feat/compress_3.0 2024-04-17 03:23:02 +00:00
kailixu 74afb8deae chore: solve conflicts 2024-04-17 10:52:34 +08:00
dapan1121 5936d3a1b0
Merge pull request #25300 from taosdata/draft/tsma_before_ci
feat: support tsma
2024-04-17 10:00:17 +08:00
Haojun Liao a439f61708
Merge pull request #25375 from taosdata/fix/3_liaohj
fix(stream): generate the checkpoint id
2024-04-16 19:41:07 +08:00
wangjiaming0909 fb72e29fe1 fix stream progress delay 2024-04-16 18:17:33 +08:00
Yihao Deng 6f9de676f0 Merge branch 'fix/compress_3.0' into feat/compress_3.0 2024-04-16 09:27:26 +00:00
Haojun Liao 8bdd43c305 fix(stream): wait for 50ms when no token in bucket for sink task. 2024-04-16 14:42:21 +08:00
wangjiaming0909 1978a06e6e merge with 3.0 2024-04-16 14:27:06 +08:00
wangjiaming0909 6ce0616ffd fix ci and TODOs 2024-04-16 14:25:34 +08:00
wangjiaming0909 a2cbbba24d find TODO 2024-04-16 14:23:26 +08:00
wangjiaming0909 a8e00f7410 drop tb in transaction 2024-04-16 14:23:26 +08:00
wangjiaming0909 3d77e8432d support rm ttl tb 2024-04-16 14:23:26 +08:00
wangjiaming0909 c3e73d9168 fix recursive tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909 d8200b2f63 fetch lastts vnode version before create tsma 2024-04-16 14:18:10 +08:00
wangjiaming0909 8e56d9a359 fix tsmas 2024-04-16 14:18:10 +08:00
wangjiaming0909 e947a2fb0d catalog cache get stream progress 2024-04-16 14:18:10 +08:00
wangjiaming0909 a4d2dfed67 stream supported api 2024-04-16 14:18:10 +08:00
Haojun Liao e0cb17211b
Merge pull request #25358 from taosdata/feat/TS-4243-3.0
fix: extracted data block shall initialize pks of datablock info
2024-04-16 13:30:48 +08:00
dm chen aedec5ead7
Merge branch '3.0' into feat/TD-24834 2024-04-16 11:35:49 +08:00
Hongze Cheng ace8f30bdf
Merge pull request #25361 from taosdata/fix/TD-29560-3.0
fix: drop table after commit
2024-04-16 11:15:29 +08:00
Haojun Liao 51dfa20cf4 fix(tsdb): set correct initial value for compare. 2024-04-16 10:13:15 +08:00
Haojun Liao ee62b66b07 Merge branch 'enh/TD-28945-pk' into fix/3_liaohj 2024-04-15 19:15:39 +08:00
Haojun Liao 13bd296d58 Merge branch '3.0' into fix/3_liaohj 2024-04-15 18:53:48 +08:00
Haojun Liao d92f0706e7 fix(tsdb): check the boundary value when reseting range. 2024-04-15 18:43:58 +08:00
Haojun Liao 1ac192c069 fix(stream): keep the original tsdb scan version range. 2024-04-15 18:41:38 +08:00
Yihao Deng ce137d3084 Merge branch 'enh/TD-28945-pk' into feat/compress_3.0 2024-04-15 10:36:13 +00:00
Minglei Jin 9cce9c221d cos/multi-write: empty impl for tsdb async compact 2024-04-15 18:32:06 +08:00
Hongze Cheng 29194df1ec Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-29560-3.0 2024-04-15 18:26:21 +08:00
Hongze Cheng b936969a01 more fix 2024-04-15 18:25:23 +08:00
Yihao Deng a7722fbf3c Merge branch '3.0' into feat/compress_3.0 2024-04-15 09:33:15 +00:00
Yihao Deng ea9385912f Merge branch '3.0' into feat/compress_3.0 2024-04-15 09:06:30 +00:00
dmchen 9a99b8526d resolve conflict 2024-04-15 08:24:40 +00:00
kailixu 123090e18a fix: solve conflicts 2024-04-15 16:12:15 +08:00
Hongze Cheng ac2853f28c fix: drop table after commit 2024-04-15 15:36:54 +08:00
dmchen a6c36a6cf3 resolve conflict 2024-04-15 07:36:41 +00:00
dm chen 4d660d89c0
Merge branch '3.0' into feat/TD-24834 2024-04-15 15:12:32 +08:00
Haojun Liao 665107ad3a enh(stream): add more info in meta table. 2024-04-15 14:23:37 +08:00
dmchen 0526618fe5 resolve conflict 2024-04-15 03:45:37 +00:00
yihaoDeng 4948bd690d 3.0 merge compress 2024-04-15 11:38:44 +08:00
Minglei Jin 4b3e3f9091 Merge branch '3.0' into enh/TD-28945-pk 2024-04-15 09:31:56 +08:00
Minglei Jin e14d4e172d cos/multi-writing: fix remove with different version 2024-04-15 09:30:24 +08:00
Haojun Liao 15c18af221 fix(stream): fix init error. 2024-04-13 18:27:38 +08:00
Haojun Liao 46fd0cb0b5 fix(tsdb): set correct initial value 2024-04-12 23:32:47 +08:00
Haojun Liao 27af9de628 fix(tsdb):add placeholder if no rowkeys exist. 2024-04-12 22:16:48 +08:00
Haojun Liao 528497944c fix(tsdb): update log. 2024-04-12 19:03:03 +08:00
Haojun Liao df4dd2ec93 fix(tsdb): update log. 2024-04-12 18:57:27 +08:00
Haojun Liao ffe5bb4024 fix(tsdb): update log. 2024-04-12 18:46:39 +08:00
Haojun Liao 6d1c07e3a5 fix(tsdb): fix syntax error. 2024-04-12 18:39:29 +08:00
Haojun Liao 2b6f02f894 fix(tsdb): add some logs. 2024-04-12 18:37:03 +08:00
Haojun Liao 04227904ea fix(tsdb): adjust assert. 2024-04-12 18:30:02 +08:00
Haojun Liao 0656ba1bf2 fix(tsdb):add assert 2024-04-12 18:16:59 +08:00
Haojun Liao f398e5b5e5 fix(tsdb): update code. 2024-04-12 18:05:21 +08:00
Haojun Liao cf30db8795 fix(tsdb): fix invalid empty time window check. 2024-04-12 17:52:52 +08:00
Haojun Liao 6127185e3b fix(tsdb): set correct initial value for compare. 2024-04-12 14:10:43 +08:00
Haojun Liao 2b953735bc Merge remote-tracking branch 'origin/feat/TS-4243-3.0' into feat/TS-4243-3.0 2024-04-12 13:51:43 +08:00
Haojun Liao 1e89b86827 refactor: do some internal refactor. 2024-04-12 13:51:29 +08:00
yihaoDeng e3acb10acd Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-12 11:10:00 +08:00
Minglei Jin 16b65b7311 Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-12 10:32:25 +08:00
Haojun Liao d799212fb2 refactor: do some internal refactor. 2024-04-12 10:02:18 +08:00
wangmm0220 ca8153fb98 fix:filter data error & add test case 2024-04-12 09:49:08 +08:00
Haojun Liao efdd0c8a2a refactor: do some internal refactor. 2024-04-11 22:34:47 +08:00
Haojun Liao 5ee40fb5c9 fix(tsdb): fix invalid free 2024-04-11 18:38:17 +08:00
wangmm0220 035b61218c fix:filter data error & add test case 2024-04-11 18:01:27 +08:00
Haojun Liao 14242331b9 fix(tsdb): fix error in decode key. 2024-04-11 17:25:58 +08:00
wangmm0220 2478519c5d Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-11 17:16:16 +08:00
Haojun Liao b4ea80b637 fix(tsdb): prepare the pk buf for blocks generated by reader. 2024-04-11 17:09:07 +08:00
wangmm0220 f609a45dd2 Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-11 16:21:14 +08:00
Minglei Jin 6515d74fa2 Merge branch '3.0' into enh/TD-28945-pk 2024-04-11 16:02:01 +08:00
54liuyao 1d42e927c6 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-3.0 2024-04-11 15:35:42 +08:00
Haojun Liao a3bbf3ba0e fix(tsdb): check numOfPks before load pk 2024-04-11 15:16:21 +08:00
Haojun Liao 1751b84188 Merge remote-tracking branch 'origin/feat/TS-4243-3.0' into feat/TS-4243-3.0 2024-04-11 14:32:18 +08:00
Haojun Liao 312f7864c8 refactor: do some internal refactor. 2024-04-11 14:32:17 +08:00
kailixu e0f7b14ffa fix: eliminate double free 2024-04-11 11:41:05 +08:00
Haojun Liao 563efeb560 fix(tsdb): fix memory leak. 2024-04-11 11:09:57 +08:00
kailixu 3738ce9e10 chore: solve conflicts of sql.c 2024-04-11 11:05:58 +08:00
Haojun Liao 1f85a47cab fix(tsdb): fix memory leak. 2024-04-11 10:47:05 +08:00
Haojun Liao 9f95360ecc fix(tsdb): fix error in read rowkey with null. 2024-04-11 10:14:15 +08:00
Haojun Liao 79be7eea8c fix(tsdb): fix invalid read, and do some internal refactor. 2024-04-11 10:06:07 +08:00
Haojun Liao e261023ee6 fix(stream): add lock, and fix race condition. 2024-04-10 18:42:44 +08:00
Haojun Liao f0beceb5eb fix(tsdb): check for the duplicated ts in delete-skyline. 2024-04-10 18:32:08 +08:00
Haojun Liao 9811a9e216 fix(tsdb): deep copy the pk for varchar type. 2024-04-10 18:06:58 +08:00
dmchen 8875311f23 remove log output 2024-04-10 09:04:53 +00:00
yihaoDeng a02426fd2f Merge branch '3.0' into feature/compressData 2024-04-10 09:03:50 +00:00
Haojun Liao ded66fc4e5 Merge branch 'feat/TS-4243-3.0' of github.com:taosdata/tdengine into feat/TS-4243-3.0 2024-04-10 16:43:54 +08:00
Haojun Liao f23a8a37bc refactor: do some internal refactor. 2024-04-10 16:43:02 +08:00
wangmm0220 539d1f441f Merge branch 'feat/TS-4243-3.0' of https://github.com/taosdata/TDengine into feat/TS-4243-tmq 2024-04-10 16:41:15 +08:00
wangmm0220 d3fa85b7bd fix:make log different to locate the cause 2024-04-10 16:40:12 +08:00
Minglei Jin 0761692b14 Merge branch 'feat/TS-4243-3.0' into enh/TD-28945-pk 2024-04-10 16:30:06 +08:00
Hongze Cheng 1bcf693f07 more code 2024-04-10 15:06:43 +08:00