Commit Graph

8266 Commits

Author SHA1 Message Date
slzhou 2743228217 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4229 2023-12-11 14:15:17 +08:00
wade zhang 0082c071b7
Merge pull request #23968 from taosdata/fix/TS-4251-main
fix/TS-4251
2023-12-11 11:19:41 +08:00
Haojun Liao 39ea7d7567
Merge pull request #23980 from taosdata/fix/3_liaohj
fix(tsdb): opt read stt file
2023-12-09 21:28:52 +08:00
Haojun Liao f020c34c62
Merge pull request #23954 from taosdata/enh/validMsgMain
refactor code
2023-12-08 17:29:07 +08:00
Haojun Liao a4399d761c
Merge pull request #23955 from taosdata/enh/validMsg
refactor code
2023-12-08 17:28:44 +08:00
Minglei Jin 2dbb718101 Merge branch '3.0' into enh/TD-27119 2023-12-08 14:48:17 +08:00
wade zhang 638e4c1f00
Merge pull request #23568 from taosdata/FEAT/TD-27125-3.0
feat: support tsdb snap replication of raw data mode
2023-12-08 14:36:16 +08:00
Haojun Liao 4ffaff4d50 other: merge 3.0 2023-12-08 10:14:42 +08:00
Haojun Liao 446c14da72 fix(tsdb): opt read stt file 2023-12-08 10:03:36 +08:00
dapan1121 a2ee41233e
Merge pull request #23835 from taosdata/szhou/tms-duration
feat: tsdb output in duration order
2023-12-08 09:07:41 +08:00
Haojun Liao 7c17d6f313 fix(tsdb): opt read performance by check clean stt block if only row number required. 2023-12-07 23:12:54 +08:00
dapan1121 4d993e8f9a
Merge pull request #23912 from taosdata/enh/3.0/TD-27276
enh : accept float data as int field input
2023-12-07 19:14:59 +08:00
Hongze Cheng aee070918b more dev 2023-12-07 17:37:47 +08:00
Benguang Zhao ebd3b69745 enh: control playload size of tsdb snap replication with TSDB_SNAP_DATA_PAYLOAD_SIZE 2023-12-07 15:29:42 +08:00
Benguang Zhao 1a9b08fa08 refact: relocate func syncSnapInfoDataRealloc 2023-12-07 15:28:14 +08:00
Hongze Cheng 04e84ba152 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TS-4229 2023-12-06 16:43:00 +08:00
dmchen dc9408ed5f fix/TS-4251 2023-12-06 07:48:40 +00:00
yihaoDeng f48c37039c refactor code 2023-12-06 14:39:50 +08:00
yihaoDeng 5b796cd749 refactor code 2023-12-06 13:33:18 +08:00
yihaoDeng 1bb4d1b34d refactor code 2023-12-06 11:51:23 +08:00
yihaoDeng 88e88a1ac8 refactor code 2023-12-06 11:50:55 +08:00
yihaoDeng f48045d9c0 refactor code 2023-12-06 11:47:08 +08:00
yihaoDeng 203580a8e1 refactor code 2023-12-06 11:45:59 +08:00
Haojun Liao 8e1970be49
Merge pull request #23950 from taosdata/enh/validMsgMain
Enh/valid msg main
2023-12-06 11:21:40 +08:00
shenglian zhou ac531c6d7f enhance: add fileset delimited front end 2023-12-06 10:45:12 +08:00
yihaoDeng b1e8c21903 valid msg 2023-12-06 10:10:49 +08:00
shenglian zhou a2e7c78d27 refactor: rename variables 2023-12-06 09:39:38 +08:00
Bob Liu d2b2dee256 opt & add test case 2023-12-05 22:00:33 +08:00
yihaoDeng 4cfcbf71ad valid msg 2023-12-05 21:04:29 +08:00
yihaoDeng a82856dff7 fix mem leak 2023-12-05 20:28:12 +08:00
Shungang Li b642f0fc83 enh: adjust ENodeType for show statements nodes 2023-12-05 18:02:29 +08:00
yihaoDeng 87c78919a9 add stream backend copy 2023-12-05 17:09:03 +08:00
Minglei Jin e9cc54d87b cos_cp/load: load checkpoint from json 2023-12-05 16:37:28 +08:00
slzhou e690076331 Merge branch '3.0' of github.com:taosdata/TDengine into szhou/tms-duration 2023-12-05 09:53:29 +08:00
Haojun Liao 4e68fbd744
Merge pull request #23904 from taosdata/enh/validMsg
valid msg
2023-12-05 09:40:33 +08:00
Haojun Liao cc5890d56a
Merge pull request #23924 from taosdata/fix/3_liaohj
enh(tsdb): extract rows for the given tables in all stt files.
2023-12-04 19:21:19 +08:00
Haojun Liao 24d9337632 enh(tsdb): extract rows for the given tables in all stt files. 2023-12-04 15:38:24 +08:00
yihaoDeng d4f237d2fe rm invalid code 2023-12-04 10:19:19 +08:00
54liuyao 38900d672e Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-12-04 09:12:53 +08:00
Haojun Liao 48af3a9559
Merge pull request #23909 from taosdata/fix/TD-27455
fix:[TD-27644]heartbeat closed before snode close leading to snode is…
2023-12-04 09:10:00 +08:00
Bob Liu 7e8f3579de accept float data as int data input 2023-12-01 18:33:01 +08:00
wangmm0220 f06117dbc9 fix:[TD-27644]heartbeat closed before snode close leading to snode is hanged 2023-12-01 17:32:29 +08:00
yihaoDeng c5d9a2b24d add valid msg 2023-12-01 17:19:34 +08:00
yihaoDeng 0aa9db4fd5 valid msg 2023-12-01 17:16:12 +08:00
Haojun Liao 3194ff41aa
Merge pull request #23900 from taosdata/fix/3_liaohj
fix(stream): merge fix from main to 3.0
2023-12-01 16:39:38 +08:00
shenglian zhou bff88e0639 fix: set duration order api 2023-12-01 16:27:36 +08:00
yihaoDeng f029995142 valid msg 2023-12-01 16:22:55 +08:00
yihaoDeng 50bda0b719 add valid msg 2023-12-01 15:15:12 +08:00
yihaoDeng 5a05f1019f valid msg 2023-12-01 14:52:37 +08:00
Haojun Liao d7a19a9179 fix(stream): fix invalid decode hbmsg and memory leaks caused by invalid hb msg. 2023-12-01 14:45:18 +08:00
yihaoDeng 3ae0e2d74f valid msg 2023-12-01 14:20:16 +08:00
wade zhang 041add545c
Merge pull request #23844 from taosdata/FIX/TS-4306-3.0
enh: limit size of snap replication msg by data length
2023-12-01 14:06:36 +08:00
slzhou 4d755562af fix: resolve conflicts 2023-12-01 13:02:14 +08:00
Haojun Liao eac3cbf564 fix(stream): merge 3.0 2023-12-01 11:12:57 +08:00
Haojun Liao e753d631af fix(stream): make sure open operator only once for scan-history task. 2023-12-01 10:21:07 +08:00
Haojun Liao e6a024bcb1 refactor: do some internal refactor. 2023-12-01 10:19:58 +08:00
Haojun Liao 0131fbe62d fix(tsdb): add simd for decompress timestamp. 2023-12-01 10:19:54 +08:00
Haojun Liao 8515a2f9b6 fix(stream): fix status check for stream-scan-history status when drop stream task msg is missing. 2023-12-01 10:19:18 +08:00
Haojun Liao eb2f5ad074 fix(stream): fix error. 2023-12-01 10:18:22 +08:00
Haojun Liao 2b03d64850 fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-12-01 10:18:15 +08:00
Haojun Liao fee9d751d4 fix(stream): fix the race condition in dispatching data. 2023-12-01 10:17:14 +08:00
Haojun Liao e24ab38072
Merge pull request #23890 from taosdata/fix/3_liaohj
fix(stream): make sure open operator only once for scan-history task.
2023-12-01 09:14:18 +08:00
dapan1121 32030ca130
Merge pull request #23886 from taosdata/revert-23730-enh/TD-26976-3.0
Revert "enh:  grant and active codes"
2023-11-30 19:04:50 +08:00
Minglei Jin 49ecb1093f cos/put: new arg withcp to control resumable uploading 2023-11-30 17:20:21 +08:00
Minglei Jin 3deaea9abf enh(cos/put): put object with cp 2023-11-30 16:19:15 +08:00
Haojun Liao 30d78c6be1 fix(stream): make sure open operator only once for scan-history task. 2023-11-30 16:10:09 +08:00
54liuyao 271311a770 Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-27419 2023-11-30 14:33:48 +08:00
dapan1121 215dbeaa3d
Merge pull request #23882 from taosdata/revert/TD-27277
revert nodes func
2023-11-30 14:10:44 +08:00
Cary Xu f96044e09f
Revert "enh: grant and active codes" 2023-11-30 13:39:54 +08:00
Bob Liu d5989b0f74 revert nodes func 2023-11-30 11:56:33 +08:00
yihaoDeng 5c32680cd8 Merge branch '3.0' into enh/refactorBackend 2023-11-30 10:31:27 +08:00
dapan1121 0d04dc296e
Merge pull request #23843 from taosdata/fix3.0/TS-4272
fix crash when insert big csv
2023-11-30 10:01:09 +08:00
Haojun Liao 130614c938
Merge pull request #23831 from taosdata/fix/3_liaohj
enh(stream/tsdb): do multiple optimization and fix some bugs.
2023-11-30 09:20:15 +08:00
Benguang Zhao 9e8944d17c enh: adjust buffer size of sync snap replication 2023-11-29 16:01:11 +08:00
Bob Liu 084a0b1a65 Merge branch '3.0' into fix3.0/TS-4272 2023-11-29 15:46:20 +08:00
dapan1121 72e04d4f6c
Merge pull request #23670 from taosdata/style/3.0/TD-27277
rewrite nodesNodeName
2023-11-29 13:29:19 +08:00
54liuyao ae386c6e34 opt expired data 2023-11-29 11:16:56 +08:00
Bob Liu 5c5efa34eb fix crash when insert big csv 2023-11-29 01:53:13 +08:00
slzhou 4fb0f83f07 fix: core dump without resetTableListIndex 2023-11-28 14:50:50 +08:00
yihaoDeng 08eeee0794 Merge branch '3.0' into enh/refactorBackend 2023-11-28 11:52:49 +08:00
shenglian zhou df4f7d6956 Revert "Revert "enhance: duration notification""
This reverts commit 3331e25aaf.
2023-11-28 10:31:18 +08:00
shenglian zhou 3331e25aaf Revert "enhance: duration notification"
This reverts commit 9dd306e1ef.
2023-11-28 08:29:05 +08:00
yihaoDeng a4d475b582 fix rsma 2023-11-27 20:27:53 +08:00
wangmm0220 06e2fbfb1c fix:conflicts from 3.0 2023-11-27 17:53:53 +08:00
wangmm0220 70c5d36103 opti:extract common logic from snode & vnode to tqCommon 2023-11-27 17:49:09 +08:00
Haojun Liao f9d717d0f2 refactor: do some internal refactor. 2023-11-27 14:42:13 +08:00
yihaoDeng 630f4f9d80 Merge branch '3.0' into enh/refactorBackend 2023-11-27 13:53:33 +08:00
yihaoDeng e9bec34c44 Merge branch '3.0' into enh/refactorBackend 2023-11-27 10:01:12 +08:00
Haojun Liao 1dd5cd17a0 fix(tsdb): add simd for decompress timestamp. 2023-11-26 23:53:05 +08:00
wangmm0220 ff0828fcc2 fix:add O_CLOSEXEC for .running & process snode when drop stream 2023-11-24 18:30:58 +08:00
Haojun Liao f28cf740b0 fix(stream): fix status check for stream-scan-history status when drop stream task msg is missing. 2023-11-24 14:44:00 +08:00
Haojun Liao d5e123db78
Merge pull request #23791 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-11-24 14:42:43 +08:00
Hongze Cheng 24932d2d41
Merge pull request #23799 from taosdata/fix/TD-27423
fix(tsdb/skip-row): remove s3 size condition
2023-11-24 10:48:03 +08:00
wangmm0220 d249892b2a fix:conflicts from 3.0 2023-11-23 20:29:46 +08:00
wangmm0220 55a4181e5e fix:add O_CLOEXEC for .running lock file to prevent inherited by child processes(rsync) 2023-11-23 20:16:54 +08:00
dmchen 75810bbdbb audit 2023-11-23 11:26:14 +00:00
yihaoDeng 6129ebc294 Merge branch '3.0' into enh/refactorBackend 2023-11-23 17:41:37 +08:00
Minglei Jin 460638d294 enh(tsdb/open-file): new s3 failed to connect error code 2023-11-23 16:09:02 +08:00
Haojun Liao de4cc2009d fix(stream): fix error. 2023-11-23 16:04:06 +08:00
Haojun Liao 0a90c33b4d fix(stream): drop the related fill-history task & set the task to be ready, if the drop fill-history task msg is missing due to the vnode restarting. 2023-11-23 15:49:07 +08:00
slzhou c53bd04894 feat: after select compacts 2023-11-23 15:26:21 +08:00
yihaoDeng 6a0501967d Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-23 14:06:04 +08:00
dmchen d4d55ab395 msg 2023-11-23 04:54:28 +00:00
dmchen 4e1a355052 mnode for compact 2023-11-23 04:43:28 +00:00
Haojun Liao 8ad071e69a other: merge main. 2023-11-23 10:25:51 +08:00
Haojun Liao ff9c0c0df4 fix(stream): fix error in check trans conflict. 2023-11-23 09:38:11 +08:00
Haojun Liao 7b1f586d4f
Merge pull request #23762 from taosdata/fix/3_liaohj
fix(stream): fix error in generating token in bucket.
2023-11-23 09:32:14 +08:00
wangmm0220 15d75a0497 fix:spelling errors 2023-11-23 09:17:54 +08:00
Haojun Liao 4ea49fe285 fix(stream): fix the race condition in dispatching data. 2023-11-22 23:49:16 +08:00
wangmm0220 6dc91d12d5 fix:add msg type 2023-11-22 20:23:58 +08:00
wangmm0220 cfab06239b Merge branch '3.0' of https://github.com/taosdata/TDengine into feat/TD-26060 2023-11-22 19:37:44 +08:00
Haojun Liao b35c971278 fix(stream):remove unused function. 2023-11-22 17:29:19 +08:00
wangmm0220 9a09e318ca opti:common message process logic in vnode and snode 2023-11-22 16:53:33 +08:00
Haojun Liao 9988720a1e fix(stream): fix the invalid check of trans conflict. 2023-11-22 16:39:29 +08:00
Haojun Liao ebb1993900 fix(stream): fix error in check trans conflict. 2023-11-22 16:20:59 +08:00
Haojun Liao 91e7000433 Merge branch 'enh/refactorBackend' of github.com:taosdata/tdengine into enh/refactorBackend 2023-11-22 15:29:31 +08:00
Haojun Liao c96f7cf182 fix(stream): scheduler the checkpoint generating. 2023-11-22 15:17:21 +08:00
shenglian zhou 9dd306e1ef enhance: duration notification 2023-11-22 13:56:16 +08:00
dapan1121 1b6a3c2069
Merge pull request #23771 from taosdata/enh/xsren/TD-27022/windows
Enh/xsren/td 27022/windows
2023-11-22 10:58:39 +08:00
yihaoDeng 0eba15b4a4 Merge branch '3.0' into enh/refactorBackend 2023-11-22 10:57:41 +08:00
yihaoDeng 0c0d9cdd2c Merge branch '3.0' into fix/fixChkpRespMemleak 2023-11-22 10:42:30 +08:00
Haojun Liao b712f5e7dc refactor: do some internal refactor. 2023-11-22 08:41:17 +08:00
Haojun Liao 785d91c17b
Merge pull request #23661 from taosdata/feat/TD-26060
fix: errors in snode in conditions like fill history/checkpoint/restart
2023-11-21 19:02:38 +08:00
shenglian zhou cc932b5ac9 fix: change compact id to 32-bit int 2023-11-21 17:01:24 +08:00
facetosea 845493294d osfile 2023-11-21 16:31:31 +08:00
yihaoDeng a92602b667 fix mem leak 2023-11-21 15:23:28 +08:00
wade zhang d8b324e960
Merge pull request #23760 from taosdata/enh/TD-27424-3.0
enh: adjust timeout threshold of snapshot replication
2023-11-21 11:53:43 +08:00
dapan1121 415d162358
Merge pull request #23730 from taosdata/enh/TD-26976-3.0
enh:  grant and active codes
2023-11-21 10:04:20 +08:00
Benguang Zhao 42fa8e818b enh: adjust timeout threshold of snapshot replication 2023-11-20 20:28:34 +08:00
Bob Liu 6e1e4702a5 adjust 2023-11-20 11:13:09 +08:00
Bob Liu e453962271 rewrite nodes function 2023-11-19 16:31:47 +08:00
Haojun Liao 1b4f187ded
Merge pull request #23743 from taosdata/fix/pause_stream
fix(stream): remove invalid assert
2023-11-17 23:48:47 +08:00
Haojun Liao 709502ba9e fix(stream): record the check downstream failure. 2023-11-17 22:05:36 +08:00
yihaoDeng 20de2f3cb5 Merge branch '3.0' into enh/refactorBackend 2023-11-17 17:15:14 +08:00
kailixu 3b62d555ab enh: code optimization for active code 2023-11-17 15:50:08 +08:00
wangmm0220 a5de1b032b fix:snode upport stream task 2023-11-16 21:19:58 +08:00
kailixu 50126e4425 enh: support spread active codes 2023-11-16 19:52:05 +08:00
slzhou 88819ea608 fix: tranform SCompactRsp to a datablock 2023-11-16 14:40:54 +08:00
slzhou 9ad86d7753 commit: add create show stmt support 2023-11-16 11:41:02 +08:00
yihaoDeng 77261068e0 fix stream backend convert 2023-11-16 11:06:55 +08:00
shenglian zhou b51e4b18ce feat: compact return id and kill compact id 2023-11-16 11:03:56 +08:00
Haojun Liao f45c3277c3
Merge pull request #23710 from taosdata/fix/3_liaohj
fix(stream): check the status before pause
2023-11-15 22:06:56 +08:00
dapan1121 dc71252096 Merge remote-tracking branch 'origin/3.0' into merge/32m 2023-11-15 19:43:19 +08:00
wangmm0220 a16189d2a9 fix:confilct from 3.0 2023-11-15 19:14:27 +08:00
wangmm0220 45782f278b fix:send update msg to vnodes if snode restart 2023-11-15 18:13:35 +08:00
Haojun Liao 6529e56020 fix(stream): check the status before pause 2023-11-15 18:06:16 +08:00
Haojun Liao 115246c877 fix(stream): check the status before pause 2023-11-15 16:46:09 +08:00
kailixu 188a4ce6a5 enh: the latest active code take effect 2023-11-15 16:33:05 +08:00
Haojun Liao 9d2256ec9c refactor: do some internal refactor. 2023-11-15 16:03:23 +08:00
Haojun Liao 1b1ad3068d fix(stream): check node status before start pause trans. 2023-11-15 16:02:56 +08:00