Commit Graph

29585 Commits

Author SHA1 Message Date
Minglei Jin 2ba586513f fix(tsdb/cache): erase entry from lru if deleted 2023-12-26 16:41:33 +08:00
Yihao Deng 40aa5f697f fix tag index double free 2023-12-26 07:21:02 +00:00
dapan1121 b9ae472ad1
Merge pull request #24212 from taosdata/szhou/fix/TD-28019
fix: change compact rsp first column name
2023-12-26 15:06:17 +08:00
Yihao Deng dc01625ea1 fix tag index double free 2023-12-26 06:52:33 +00:00
factosea 1aae0e52e3 fix: like wildcard match 2023-12-26 14:48:05 +08:00
Haojun Liao b74e98b25c fix(stream): set the correct split timestamp for session/state window. 2023-12-26 14:17:46 +08:00
Benguang Zhao 0e6ea7af71 enh: check snapshot begin index for unexpected change in syncNodeOnSnapshotBegin 2023-12-26 10:54:40 +08:00
Bob Liu 2c9fa56e9c calcNeedCountEmpty 2023-12-26 10:24:50 +08:00
54liuyao 68be2dc534 Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-12-26 09:03:28 +08:00
Haojun Liao 62cfcefbb0 refactor: remove stream-scan-history event for stream task. 2023-12-26 00:34:04 +08:00
Haojun Liao 68795ecf35
Merge pull request #24225 from taosdata/fix/3_liaohj
fix(stream): handle the remaining event when restore from halt.
2023-12-25 22:52:25 +08:00
Benguang Zhao 7b967ffdc6 enh: retry on fsm commit when rpc out of memory in syncFsmExecute 2023-12-25 20:34:38 +08:00
54liuyao ac3c76f608 init dummy function 2023-12-25 19:38:20 +08:00
Haojun Liao f14c3b93c1 refactor: do some internal refactor. 2023-12-25 18:22:36 +08:00
Hongze Cheng a7c8563c06 fix: remove useless code 2023-12-25 16:13:30 +08:00
dapan1121 7da93155aa
Merge pull request #24185 from taosdata/szhou/fix/TD-27899
fix: BI support is moved to open source version
2023-12-25 15:27:37 +08:00
Haojun Liao bcc57e0644
Merge pull request #24207 from taosdata/fix/3_liaohj
fix(stream): add async call restart, instead of sync wait, and fix several deadlock.
2023-12-25 13:56:42 +08:00
Haojun Liao 60977d56bd refactor: set attribute only on Linux 2023-12-25 12:47:16 +08:00
Bob Liu 15694df001 adjust 2023-12-25 11:54:10 +08:00
wade zhang a4f7ee6fb5
Merge pull request #24158 from taosdata/fix/TD-27977
fix: dynamic cfg resetlog
2023-12-25 11:29:56 +08:00
Haojun Liao e5087f6e23 fix(tsdb): fix invalid delete check. 2023-12-25 10:40:36 +08:00
slzhou 1beb3347fa fix: change compact rsp first column name 2023-12-25 10:18:19 +08:00
wade zhang 40994c3fbd
Merge pull request #24174 from taosdata/FIX/TD-28001-3.0
enh: protect syncNodeRestore with log buffer mutex
2023-12-25 10:08:43 +08:00
wade zhang 1fc7a1a72e
Merge pull request #24128 from taosdata/FEAT/TD-27125-3.0
enh: protect processing of snap preparation rsp with sender buf mutex
2023-12-25 10:08:25 +08:00
Haojun Liao 00fac852e8 fix(tsdb): fix invalid delete check. 2023-12-25 09:55:24 +08:00
Benguang Zhao 7edfbf8023 fix: set commit log for mndAddCompactDetailToTran 2023-12-25 09:47:17 +08:00
Benguang Zhao 4f29500f74 fix: set commit log for mndDropSubByTopic 2023-12-25 09:46:55 +08:00
Haojun Liao 0877e0bfad other: merge 3.0 2023-12-25 09:13:31 +08:00
Bob Liu da0ecc18b9 test 2023-12-25 02:51:52 +08:00
Bob Liu 52c244d9ec adjust 2023-12-24 23:48:37 +08:00
Haojun Liao cd85dae3fd fix(stream): fix the dead lock. 2023-12-24 23:30:00 +08:00
Haojun Liao bf895fadcb fix(stream): fix invalid read. 2023-12-24 03:05:29 +08:00
Haojun Liao 30498a4028 refactor: do some internal refactor. 2023-12-24 02:24:46 +08:00
Bob Liu c9b69316c1 calcNeedCountEmpty 2023-12-24 01:19:16 +08:00
Haojun Liao 25f798e42f fix(stream): record the start failure tasks 2023-12-23 23:29:30 +08:00
Alex Duan 659acfd5f3
Merge pull request #24196 from taosdata/coverage/alex
coverage: remove tfunctionInt.c
2023-12-23 16:39:49 +08:00
Haojun Liao c61203b55a fix: fix deadlock. 2023-12-23 16:37:21 +08:00
Haojun Liao 8a714db17d fix: fix deadlock. 2023-12-23 15:33:50 +08:00
Haojun Liao 5c1ff76082 fix(stream): set rwlock attr. 2023-12-23 00:58:52 +08:00
Haojun Liao 66bdace9eb fix(stream): check rsp. 2023-12-23 00:09:55 +08:00
Haojun Liao 80604ec8e2 fix(stream): init rwlock. 2023-12-22 23:31:51 +08:00
Bob Liu ef5b5786b3 adjust 2023-12-22 18:14:26 +08:00
Bob Liu e3098accc4 support count empty table 2023-12-22 18:14:26 +08:00
Haojun Liao b175a4b7b3 refactor(stream): async stop tasks, and do some internal refactor. 2023-12-22 17:56:16 +08:00
fullhonest e13b3b9ceb Fix TD-27989: percentile crash 2023-12-22 17:51:16 +08:00
Alex Duan a71fabb24f coverage: remove tfunctionInt.c 2023-12-22 17:50:55 +08:00
dapan1121 709b7f4683
Merge pull request #24181 from taosdata/fix/TD-27967_TD-28004
fix: cache scan heap overflow and forbid DDD for to_char in windows
2023-12-22 16:54:46 +08:00
Shungang Li 212c1ebb3c udpate test case test_hot_refresh_configurations 2023-12-22 16:15:47 +08:00
Haojun Liao 7ce545bcd4 refactor: refactor the lock type. 2023-12-22 16:14:49 +08:00
Benguang Zhao 2de6d6c81d enh: add TSDB_CODE_MND_TRANS_CTX_SWITCH 2023-12-22 16:06:59 +08:00
Haojun Liao dce0a6c74a fix(stream): remove invalid assert 2023-12-22 15:24:37 +08:00
Haojun Liao e91afa7df2 fix(stream): fix deadlock. 2023-12-22 14:51:04 +08:00
Haojun Liao 67edc29a65
Merge pull request #24179 from taosdata/fix/TD-27957-30
fix snode crash
2023-12-22 14:41:41 +08:00
Haojun Liao 90898a16e0 refactor: do some internal refactor. 2023-12-22 13:57:15 +08:00
Hongze Cheng 02bb9e90d2
Merge pull request #24189 from taosdata/fix/TD-27974
fix(tsdb/cache): prepend ts col to load stt
2023-12-22 13:53:15 +08:00
slzhou 7dd6cb4227 fix: move bi to community version 2023-12-22 13:17:25 +08:00
dapan1121 ceedd5b051
Merge pull request #24170 from taosdata/szhou/fix/TS-4382
fix: the pre-allocated column has no data to copy
2023-12-22 12:31:07 +08:00
Minglei Jin 16ad59fb18 fix(tsdb/cache): prepend ts col to load stt 2023-12-22 12:14:27 +08:00
Yihao Deng f557d86609
Merge branch '3.0' into fix/initBackendHashmutex 2023-12-22 10:51:54 +08:00
Hongze Cheng 46211258b3
Merge pull request #24173 from taosdata/fix/TD-27974
fix(tsdb/cache): plus 1 to nCols to load stt data
2023-12-22 09:43:20 +08:00
Haojun Liao c9475060de fix(stream): fix race condition. 2023-12-22 09:34:49 +08:00
Haojun Liao 0fab9a1827 other: fix syntax error. 2023-12-22 00:29:49 +08:00
wangjiaming0909 153221e1d6 fix: cache scan heap overflow and forbid DDD for to_char in windows 2023-12-21 19:46:33 +08:00
Haojun Liao 84583580e2 fix(stream): transfer the checkpoint trans id. 2023-12-21 19:12:49 +08:00
yihaoDeng 913fda4a36 fix snode crash 2023-12-21 18:52:25 +08:00
Haojun Liao 949ff6b18c
Merge pull request #24168 from taosdata/fix/TD-27979
fix:[TD-27979] init mutux
2023-12-21 18:38:02 +08:00
Minglei Jin 9d3eb02f3c fix(tsdb/cache): plus 1 to nCols to load stt data 2023-12-21 17:53:44 +08:00
Benguang Zhao 4137a44fd0 enh: protect syncNodeRestore with log buffer mutex 2023-12-21 17:49:20 +08:00
slzhou 094c6cdfb4 fix: the pre-allocated column has no data to copy 2023-12-21 16:31:35 +08:00
Haojun Liao 2acc8423c5 fix(stream): send msg to mnode before closing all tasks. 2023-12-21 16:00:50 +08:00
wangmm0220 13851a60a4 fix:[TD-27979] init mutux 2023-12-21 15:26:41 +08:00
Alex Duan 1fa6cb8f69 coverage: isRowEntryCompleted had been called 5200w hits 2023-12-21 15:10:21 +08:00
Alex Duan 9d4a75b0be coverage: vnodeSrv.c tmsg.c trow.c 2023-12-21 14:22:22 +08:00
Alex Duan b0247f649b coverage : comment trow.c 2023-12-21 13:41:49 +08:00
Haojun Liao 71f6d9f06f fix(stream): handle the case that recvs drop msg twice. 2023-12-21 11:52:45 +08:00
Haojun Liao 8a8ddf5699 fix(stream): record the checkpoint failure when nodeEp changed. 2023-12-21 10:30:44 +08:00
Benguang Zhao 572368703d enh: ensure mndTransProcessRsp invoked in mnode-write thread 2023-12-21 09:33:56 +08:00
Haojun Liao 32ce4b6a4c fix(stream): fix race condition. 2023-12-20 23:12:59 +08:00
Haojun Liao ad5d78a6ca fix(stream): fix deadlock. 2023-12-20 19:12:47 +08:00
Haojun Liao 64eee4bbd2 fix(stream): add conflict check for nodeUpdate 2023-12-20 19:06:32 +08:00
Shungang Li 4906243115 fix: dynamic cfg resetlog 2023-12-20 18:32:23 +08:00
Haojun Liao 849aaf8d4f fix(stream): avoid dead lock. 2023-12-20 18:07:53 +08:00
yihaoDeng d6297e26ce init backend mutex 2023-12-20 16:56:12 +08:00
dapan1121 cd044137a0
Merge pull request #24130 from taosdata/fix/3.0/TD-27945
fix: session window block row index overflow
2023-12-20 16:13:47 +08:00
dapan1121 e90fe43f93
Merge pull request #24083 from taosdata/enh/xsren/TD-27847
enh: call fetch_rows in taos_query_a callback
2023-12-20 16:12:31 +08:00
Haojun Liao 43fb7cf14a other: add log info. 2023-12-20 16:04:20 +08:00
Haojun Liao 1a8583887f fix(stream): remove clear backendcache. 2023-12-20 15:35:43 +08:00
Haojun Liao a0d1933134
Merge pull request #24113 from taosdata/mark/3.0
opti:logic in parse raw line & make log more specific
2023-12-20 15:25:26 +08:00
Haojun Liao d25a323a4c fix(stream): record the launch failure. 2023-12-20 13:55:12 +08:00
wangmm0220 1f70f51ac8 fix:sdb maxId should use int64* instead of int32* 2023-12-20 11:20:41 +08:00
Haojun Liao 94b260a1f9 refactor: do some internal refactor. 2023-12-20 10:29:04 +08:00
Haojun Liao 81d8b2434f refactor: do some internal refactor. 2023-12-20 10:25:31 +08:00
Haojun Liao 541967e99e refactor: do some internal refactor. 2023-12-20 10:24:03 +08:00
Benguang Zhao e06f355143 enh: improve logging msg of mndPostMgmtCode 2023-12-19 20:16:33 +08:00
Benguang Zhao f7ab8e99b5 enh: demarcate top and bottom halves of task trans execution to ensure a consistent order 2023-12-19 19:52:11 +08:00
Haojun Liao 2de0f6e971 test(stream): lock the update procedure. 2023-12-19 18:56:15 +08:00
Haojun Liao 92045f5485 fix(stream): add snode check, and handle the task status reset from checkpoint when it is in the snode. 2023-12-19 18:34:30 +08:00
wade zhang 8bbf03a695
Merge pull request #24116 from taosdata/fix/release-mem-check-3.0
release mem check
2023-12-19 18:13:53 +08:00
Haojun Liao 17e9e84aa9 Merge branch '3.0' into fix/3_liaohj 2023-12-19 16:43:08 +08:00
Haojun Liao fee198f9ad refactor: do some internal refactor. 2023-12-19 16:21:11 +08:00
wangjiaming0909 ad24c03538 fix: session window block row index overflow 2023-12-19 14:31:13 +08:00
Benguang Zhao 4c13dee721 enh: protect processing of snap preparation rsp with sender buf mutex 2023-12-19 12:49:48 +08:00
wangmm0220 84d18005f2 fix:add control for raw data in schemaless 2023-12-19 11:34:15 +08:00
Haojun Liao ec3183b6a8 other: merge 3.0 2023-12-18 23:16:37 +08:00
Haojun Liao 612b50c4cd
Merge pull request #24097 from taosdata/fix/TD-27834
fix stream backend crash when transfer
2023-12-18 23:13:08 +08:00
Haojun Liao 579366ec00
Merge pull request #24121 from taosdata/fix/liaohj
other: merge main into 3.0
2023-12-18 23:11:36 +08:00
wangmm0220 ef621a06a7 opti:logic in parse raw line & make log more specific 2023-12-18 19:21:02 +08:00
Haojun Liao e734569de0 fix(stream): fix dead lock. 2023-12-18 18:42:57 +08:00
Haojun Liao bba5a4f08b other: merge main into 3.0 2023-12-18 18:26:42 +08:00
Minglei Jin 64378be7f4 fix(tsdb/cache): fix buffer-overflow with column adding 2023-12-18 18:06:40 +08:00
dmchen 19637fd148 release mem check 2023-12-18 09:32:31 +00:00
Haojun Liao ea6e78cbaa fix(stream): add async call restart, instead of sync wait. 2023-12-18 16:33:44 +08:00
wade zhang 4cac96d2df
Merge pull request #24111 from taosdata/fix/TD-27845
fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange
2023-12-18 16:27:18 +08:00
Haojun Liao 79672f8e5f
Merge pull request #24107 from taosdata/fix/3_liaohj
fix(stream): add check for null ptr and leader .
2023-12-18 16:24:07 +08:00
Haojun Liao 01f4912584
Merge pull request #24108 from taosdata/fix/resetHttp30
change fast failure time
2023-12-18 16:23:41 +08:00
Haojun Liao dad26d645a
Merge pull request #24110 from taosdata/fix/TD-27903
reset update info
2023-12-18 16:03:22 +08:00
yihaoDeng 1dea66d4f5 fix stream backend crash when transfer 2023-12-18 15:48:01 +08:00
wangmm0220 7f8479f953 opti:logic in parse raw line & make log more specific 2023-12-18 15:16:33 +08:00
Minglei Jin 5dd9ce8ceb fix(tsdb/cache): use int64_t instead of uint64_t for stt verRange 2023-12-18 15:02:34 +08:00
54liuyao 70a8281ef2 reset update info 2023-12-18 14:59:48 +08:00
yihaoDeng e0210ad513 change fast failure time 2023-12-18 14:08:37 +08:00
Benguang Zhao 25ab03e5d3 refact: improve info logging msg in mmProcessWriteMsg 2023-12-18 13:35:21 +08:00
yihaoDeng ba1b6d7c64 change fast failure time 2023-12-18 11:55:51 +08:00
Haojun Liao b4a1907fb7 fix(stream): add check for null ptr and leader . 2023-12-18 11:52:59 +08:00
yihaoDeng 0840e6a0d8 fix stream backend crash when transfer 2023-12-18 11:19:15 +08:00
Haojun Liao 93f3a3135f
Merge pull request #24104 from taosdata/fix/3_liaohj
fix(stream): avoid invalid read.
2023-12-18 11:03:37 +08:00
Haojun Liao edc3841a2c fix(stream): avoid invalid read. 2023-12-18 09:26:56 +08:00
dapan1121 bf151eafdc
Merge pull request #24073 from taosdata/enh/xsren/TD-27724/utest
enh: osSystemTest
2023-12-18 09:12:03 +08:00
dmchen dd317d6738 add more log 2023-12-17 11:03:25 +00:00
dmchen 6347792a93 TD-27906 2023-12-17 08:47:51 +00:00
wade zhang 967a259219
Merge pull request #24092 from taosdata/fix/TD-27902
fix/TD-27902
2023-12-17 12:31:15 +08:00
Haojun Liao ef0cab18cb
Merge pull request #24098 from taosdata/fix/3_liaohj
fix(stream): send checkpoint complete msg to mnode when dropping it.
2023-12-17 11:03:04 +08:00
factosea 74793e6528 fix: inCallback 2023-12-17 10:05:58 +08:00
Haojun Liao 4f852704f5 fix(stream): send checkpoint complete msg to mnode when dropping it. 2023-12-17 02:06:01 +08:00
Haojun Liao 0526e619ad
Merge pull request #24095 from taosdata/fix/3_liaohj
fix(tsdb): add desc check for clean file block.
2023-12-16 18:10:15 +08:00
Haojun Liao 9bd80cf0f8
Merge pull request #24094 from taosdata/fix/TD-27905
Fix/td 27905
2023-12-16 18:07:17 +08:00
yihaoDeng 5aa575acfa fix stream backend crash when transfer 2023-12-16 18:03:32 +08:00
yihaoDeng 6f4fb506a0 fix stream backend crash when transfer 2023-12-16 17:43:41 +08:00
Haojun Liao 4cc0f5be59 fix(tsdb): add desc check for clean file block. 2023-12-16 15:37:17 +08:00
yihaoDeng 8045d2bda7 fix stream backend crash when transfer 2023-12-16 15:20:38 +08:00
yihaoDeng 547d797a26 fix stream backend crash when transfer 2023-12-16 15:05:27 +08:00
Haojun Liao 9978d8cbfd
Merge pull request #24089 from taosdata/fix/TD-27880
Fix/td 27880
2023-12-16 13:13:48 +08:00
Haojun Liao 1a9701d401
Merge pull request #23946 from taosdata/fix/snodeBackendCrash
Fix/snode backend crash
2023-12-16 13:13:28 +08:00
Haojun Liao f9a5485d52 fix(stream): refactor the stream trans conflict detection strategy. 2023-12-16 01:46:29 +08:00
slzhou 8a6317b76a Merge branch '3.0' of github.com:taosdata/TDengine into szhou/fix-tms-duration 2023-12-15 22:09:43 +08:00
slzhou b2ee43540b enhance: add log and clean up 2023-12-15 21:55:25 +08:00
dmchen 62672b84a2 fix/TD-27902 2023-12-15 11:39:45 +00:00
Haojun Liao a847bf468a
Merge pull request #24088 from taosdata/fix/3_liaohj
fix(query): add rows info if blocks exist.
2023-12-15 18:24:45 +08:00
yihaoDeng bb5f0d9112 Merge branch 'fix/snodeBackendCrash' of https://github.com/taosdata/TDengine into fix/snodeBackendCrash 2023-12-15 18:16:38 +08:00
yihaoDeng 7ab7a64eb3 Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 18:16:14 +08:00
yihaoDeng 73c7e17033 fix error case 2023-12-15 18:02:14 +08:00
Hongze Cheng 94811d6cbc
Merge pull request #24080 from taosdata/fix/TD-27891-3.0
fix/TD-27891
2023-12-15 17:56:00 +08:00
dapan1121 50d6f0ed41
Merge pull request #24067 from taosdata/fix/TD-27839-3.0
fix: update dmodule lib
2023-12-15 17:44:31 +08:00
dapan1121 5bbec0108a
Merge pull request #24081 from taosdata/szhou/add-experimental-flag
fix: add experimental flag
2023-12-15 17:31:35 +08:00
Haojun Liao aedc5e6b05 fix(stream): set the correct dst stable name. 2023-12-15 17:16:25 +08:00
slzhou ce48598f0d fix: pass first round test 2023-12-15 17:16:20 +08:00
Hongze Cheng 4ae13f411e
Merge pull request #24010 from taosdata/feat/TS-4229
feat: compact monitor and kill
2023-12-15 16:20:13 +08:00
dmchen 98966a58aa delete detail 2023-12-15 15:34:13 +08:00
dmchen 65f69b5fe4 delete detail 2023-12-15 07:31:47 +00:00
Haojun Liao e2fa4cba8c refactor: do some internal refactor. 2023-12-15 15:28:01 +08:00
Haojun Liao bc11b76904 fix(query): set correct y-axis annotation. 2023-12-15 15:26:44 +08:00
Haojun Liao 4758f95708 fix(query): add rows info if blocks exist. 2023-12-15 15:04:55 +08:00
shenglian zhou cc4a6c6d55 fix: add new duration block event 2023-12-15 15:04:47 +08:00
Haojun Liao 556eaa22ac
Merge pull request #24074 from taosdata/mark/3.0
fix:core dump if tqOpen error in vnodeOpen
2023-12-15 13:55:10 +08:00
yihaoDeng d8093d9f21 not do chkp when pbackend not inited 2023-12-15 11:47:44 +08:00
factosea f2d89b7086 fix: use req after release 2023-12-15 11:29:25 +08:00
dmchen 4f5dd57b65 fix/TD-27891 2023-12-15 10:50:03 +08:00
dmchen 181642e6a1 fix/TD-27891 2023-12-15 02:43:55 +00:00
shenglian zhou 617d4bfb95 fix: add experimental flag 2023-12-15 10:40:54 +08:00
wangmm0220 812f0f97a7 fix:rollback size to old logic 2023-12-15 10:09:18 +08:00
slzhou d3146a5bec fix: when no file block, no proc mem before fileset 2023-12-15 09:51:06 +08:00
dmchen 5e7aead4d8 keep killed compact 2023-12-15 01:43:24 +00:00
Yihao Deng 5f2d93d62c
Merge branch '3.0' into fix/snodeBackendCrash 2023-12-15 09:22:33 +08:00
yihaoDeng 5189f3d15b not do chkp when pbackend not inited 2023-12-15 09:18:37 +08:00
wangmm0220 740228a653 fix:core dump if tqOpen error in vnodeOpen 2023-12-15 09:07:35 +08:00
dmchen 7183fd66a1 keep killed compact 2023-12-15 00:59:56 +00:00
slzhou 5bf364cc0a enhance: refactor code 2023-12-15 08:23:25 +08:00
kailixu b7bfbdd2b3 Merge branch '3.0' into fix/TD-27839-3.0 2023-12-14 19:48:13 +08:00
wade zhang c5c6414a61
Merge pull request #24050 from taosdata/fix/TS-4251-main
auditinterval default
2023-12-14 19:26:13 +08:00
wade zhang bf3bfa4d66
Merge pull request #24063 from taosdata/fix/TS-4251-3.0
auditinterval default
2023-12-14 19:25:56 +08:00
dmchen 85827dbcd3 fix compile error 2023-12-14 11:22:29 +00:00
dmchen 7bb3d43f4e kill compact 2023-12-14 11:22:07 +00:00
dmchen d7ac3558f8 fix wrong merge 2023-12-14 11:21:41 +00:00
kailixu 7d18bd9811 chore: reduce the dependencies 2023-12-14 18:49:32 +08:00
factosea 75757fffb6 enh: osSystemTest 2023-12-14 17:19:16 +08:00
dm chen 81767dfa32
Merge branch '3.0' into feat/TS-4229 2023-12-14 17:02:51 +08:00
slzhou 4dc39e74c5 fix: the block return from buildBlockFromFiles should be of new fileset 2023-12-14 16:57:04 +08:00
Haojun Liao 0449b5f1bd other: add some logs. 2023-12-14 15:43:59 +08:00
factosea d17d51194f taos_fetch_row cannot be called before the query callback ends. 2023-12-14 15:43:43 +08:00
slzhou c3ab6940cd Merge branch 'feat/TS-4229' of github.com:taosdata/TDengine into feat/TS-4229 2023-12-14 15:26:46 +08:00
slzhou f379abe55c fix: message compatibility 2023-12-14 15:25:57 +08:00
dmchen 1ca0858a97 compact detail log 2023-12-14 07:11:00 +00:00
dmchen 6b9ba26f37 auditinterval default 2023-12-14 14:40:25 +08:00
wade zhang c95c567376
Merge pull request #24046 from taosdata/fix/TS-4251-3.0
revert dependency
2023-12-14 14:03:04 +08:00
Haojun Liao 05ca8f1784
Merge pull request #24056 from taosdata/fix/3_liaohj
refactor: do some internal refactor.
2023-12-14 13:52:04 +08:00
Haojun Liao 7cf0add513 fix(stream): fix error caused by refactor. 2023-12-14 11:28:03 +08:00
dmchen 606a6fe891 field encode 2023-12-14 03:24:53 +00:00
Haojun Liao 38d7ae3cd7 fix(query): add one more row for table rows distributed 2023-12-14 10:36:15 +08:00
dapan1121 2e35b42a16
Merge pull request #24048 from taosdata/fix/xsren/TD-27776/wildcard
fix: % wildcard match
2023-12-14 10:20:44 +08:00
dapan1121 7803a717c2
Merge pull request #24051 from taosdata/fix/TD-27839-3.0
enh: add check and reduce offset dependencies in lib
2023-12-14 10:19:02 +08:00
Haojun Liao f0d63a977a refactor: do some internal refactor. 2023-12-14 10:01:57 +08:00
Haojun Liao 8e042e34cb refactor: do some internal refactor. 2023-12-14 09:48:14 +08:00
Haojun Liao 81f96603b0 refactor: do some internal refactor. 2023-12-14 09:33:51 +08:00
wade zhang 661624cbc6
Merge pull request #24026 from taosdata/FEAT/TD-27125-3.0
enh: clear info data of snap sender and receiver at stop
2023-12-14 09:29:53 +08:00
slzhou 803e9d3ffb fix: db previlege check 2023-12-14 08:11:27 +08:00
Cary Xu 46f27a77f1
Update dmMgmt.h 2023-12-13 23:05:46 +08:00
Haojun Liao 26af397431
Merge pull request #24052 from taosdata/fix/3_liaohj
fix(tsdb): fix error in tsdb read.
2023-12-13 22:35:08 +08:00
Benguang Zhao 41ef6075e2 enh: check result of FpGetSnapshotInfo for exchange snap info 2023-12-13 18:38:47 +08:00
Benguang Zhao 926c28f62f enh: clear info data of snap sender and receiver at stop 2023-12-13 18:38:44 +08:00
wade zhang 484614da47
Merge pull request #24040 from taosdata/ENH/TD-27833-3.0
enh: clean wal logs based on size if one follower is offline.
2023-12-13 18:19:57 +08:00
dmchen da46b3ced8 auditinterval default 2023-12-13 10:11:15 +00:00
Haojun Liao 105542bb21 fix(stream):handle the case of delete orphaned tasks. 2023-12-13 17:44:00 +08:00
Haojun Liao 88a8e4e9f0 fix(tsdb): fix syntax error. 2023-12-13 17:01:55 +08:00
Haojun Liao 840b457308 fix(tsdb): fix error in tsdb read. 2023-12-13 17:00:39 +08:00
kailixu f685b6c34a enh: reduce offset dependencies in lib 2023-12-13 16:56:45 +08:00
Hongze Cheng 31d61415c8
Merge pull request #24044 from taosdata/fix/TD-27849
fix(cos/put): seek to part offset
2023-12-13 16:12:53 +08:00
factosea e2d2ffc00e fix: % wildcard 2023-12-13 16:07:10 +08:00
dmchen 04366f2e68 revert dependency 2023-12-13 15:29:32 +08:00
Minglei Jin 7cb32da336 fix(cos/put): seek to part offset 2023-12-13 15:14:49 +08:00
Benguang Zhao 0a7ef098ba enh: reduce wait time to start a new snap replication 2023-12-13 14:01:52 +08:00
Benguang Zhao 6eb64fcd9b fix: set start of snap replication incremental properly 2023-12-13 13:48:45 +08:00
wade zhang fe0248afbc
Merge pull request #24029 from taosdata/fix/TS-4251-3.0
Fix/ts 4251 3.0
2023-12-13 11:05:51 +08:00
Benguang Zhao c74c4fe208 enh: clean WAL logs based on size if one follower is offline. 2023-12-13 10:10:02 +08:00
wade zhang 3be9af9765
Merge pull request #24039 from taosdata/FIX/TD-27843-3.0
enh: resend new snap replication msg on all acked if not finished yet
2023-12-13 09:51:31 +08:00
dmchen e9cf639adb db is null 2023-12-13 01:04:34 +00:00
dmchen 71020e4812 show command db field is null 2023-12-13 00:53:33 +00:00
dapan1121 8528fb7a15
Merge pull request #23963 from taosdata/enh/xsren/TD-22212/taosQueryParam3.0
enh: td-22212 taos query param3.0
2023-12-13 08:24:39 +08:00
dmchen 4c9763d2c1 mem leak 2023-12-12 13:12:04 +00:00
Benguang Zhao af8a5c0ada enh: protect stop of snap sender and receiver with the mutex of its buffer 2023-12-12 19:22:34 +08:00
Benguang Zhao c5cde7ffe8 enh: resend new snap replication msg on all acked if not finished yet 2023-12-12 18:35:11 +08:00
Benguang Zhao b1dd76b924 fix: assert on offset leq file.size in tsdbDataFileRAWWriterCloseCommit 2023-12-12 18:33:42 +08:00
54liuyao 0c284c4398 reset stream trigger 2023-12-12 16:04:58 +08:00
dmchen 7e2ce6381f ci case 2023-12-12 07:24:13 +00:00
Hongze Cheng 613ca2c370
Merge pull request #23982 from taosdata/fix/PI-30-3.0
fix(tsdb/cache): remove malloc zero bytes
2023-12-12 15:22:38 +08:00
Hongze Cheng 6f6b3bbbd9
Merge pull request #24030 from taosdata/fix/TD-27836
fix(cos/put): null fd after close to fix double closing
2023-12-12 15:07:25 +08:00
factosea d25275713e ctest 2023-12-12 13:59:56 +08:00
Minglei Jin b860e3827c fix(cos/put): null fd after close to fix double closing 2023-12-12 13:59:20 +08:00
dmchen ea9eba5621 fix ci case 2023-12-12 05:34:41 +00:00
Alex Duan 7c6f4cbe6e
Merge pull request #23994 from taosdata/case/army
feat: new  army frame create
2023-12-12 12:41:45 +08:00
dmchen dad76804e8 mem leak 2023-12-12 12:19:43 +08:00
dmchen 1547d95742 break dependency 2023-12-12 12:19:12 +08:00
dmchen 67e9f695c9 debug info and default setting 2023-12-12 12:18:35 +08:00
dmchen daa2c2238a fix/TS-4251 2023-12-12 12:17:49 +08:00
wade zhang 81d06cc4d5
Merge pull request #24024 from taosdata/fix/TS-4251-main
revert dependency
2023-12-12 11:06:30 +08:00
facetosea 33897447cb ctest on linux exclude 2023-12-12 10:37:39 +08:00
dapan1121 2ff36490c4
Merge pull request #24022 from taosdata/fix/xsren/tstrdup
fix: tstrdup
2023-12-12 10:07:28 +08:00
dapan1121 96c481d537
Merge pull request #24002 from taosdata/fix/xsren/TD-27792
int32->int16 error
2023-12-12 09:54:16 +08:00
Haojun Liao 5ab1b47cef
Merge pull request #24023 from taosdata/fix/TD-27807
ignore invalid event window
2023-12-12 09:37:23 +08:00
dapan1121 394dc6c725
Merge pull request #24025 from taosdata/fix/case-when-heap-overflow
fix:heap overflow if print json value node
2023-12-12 09:20:12 +08:00
Hongze Cheng 7e9d4ff824 fix compile issue 2023-12-12 09:11:29 +08:00
Alex Duan 15fec76033 Merge branch '3.0' into case/army 2023-12-11 20:35:10 +08:00
wangmm0220 b99b9986b8 fix:heap overflow if print json value node 2023-12-11 19:46:51 +08:00
Minglei Jin c4bf9a92bc Merge branch '3.0' into enh/TD-27119 2023-12-11 19:38:04 +08:00
Minglei Jin fe824c51e2 tsdb/cos: not remove cp files 2023-12-11 19:36:06 +08:00
dmchen a861e55764 revert dependency 2023-12-11 11:24:31 +00:00
54liuyao 5e0ad7638d ignore invalid event window 2023-12-11 19:13:22 +08:00
Haojun Liao 1bf3f2d1bd
Merge pull request #24013 from taosdata/fix/TD-27795
set event window rows
2023-12-11 18:40:02 +08:00
xsren 87a536d583 fix: tstrdup 2023-12-11 18:19:34 +08:00
54liuyao 7e21030dfd set event window rows 2023-12-11 15:16:01 +08:00
slzhou 2743228217 Merge branch '3.0' of github.com:taosdata/TDengine into feat/TS-4229 2023-12-11 14:15:17 +08:00
factosea f6d70daef8 int32->int16 error 2023-12-11 11:46:15 +08:00
54liuyao 06c0a090c2 opt ignore expried rule 2023-12-11 11:32:14 +08:00
wade zhang 0082c071b7
Merge pull request #23968 from taosdata/fix/TS-4251-main
fix/TS-4251
2023-12-11 11:19:41 +08:00
54liuyao 76a5560e1d Merge branch '3.0' of https://github.com/taosdata/TDengine into 3.0 2023-12-11 08:55:10 +08:00
Alex Duan 400f466f62 case: tarray.c unit case add 2023-12-10 17:25:13 +08:00
Alex Duan 00c9218b32 case: add arrayRemoveDumplicate case 2023-12-10 14:40:38 +08:00
Haojun Liao 39ea7d7567
Merge pull request #23980 from taosdata/fix/3_liaohj
fix(tsdb): opt read stt file
2023-12-09 21:28:52 +08:00
Haojun Liao 9acd4af1f9 fix(tsdb):fix capacity rows value. 2023-12-09 01:49:55 +08:00
Haojun Liao 5528c2bf67 fix(tsdb): do some internal refactor. 2023-12-08 23:47:49 +08:00
Haojun Liao f2592f7399 fix(tsdb): prepare the memory buffer. 2023-12-08 23:44:05 +08:00
Haojun Liao da636ab527 fix(tsdb): add null check. 2023-12-08 18:55:20 +08:00
Haojun Liao 67d967e22f fix(tsdb): check the overlap between stt blocks and data file blocks. 2023-12-08 18:48:00 +08:00
Alex Duan 7adad817c9 case: add arrayTest unit case 2023-12-08 18:27:38 +08:00
dmchen e8617812ae update progress rsp 2023-12-08 10:17:04 +00:00
54liuyao ccce9d5085 init delete mark 2023-12-08 18:12:05 +08:00
Hongze Cheng 853fb6f119
Merge pull request #23987 from taosdata/fix/little_fix_3.0
fix: little fix
2023-12-08 17:29:24 +08:00
Haojun Liao 0bfbc359ed
Merge pull request #23956 from taosdata/fix/fixHttpFastQuit
Fix/fix http fast quit
2023-12-08 17:28:32 +08:00
Hongze Cheng f830fc2f4c more dev 2023-12-08 17:26:44 +08:00
54liuyao 7570fa758b init delete mark 2023-12-08 16:28:18 +08:00
Haojun Liao 63b34c7acf fix(tsdb): add check for not load stt file blocks. 2023-12-08 16:09:58 +08:00
Haojun Liao 82e9e26e07
Merge pull request #23988 from taosdata/fix/TD-27777
delete invalid event window
2023-12-08 15:47:55 +08:00
dmchen 0be39ebe77 mem leak 2023-12-08 07:26:20 +00:00
Minglei Jin 2dbb718101 Merge branch '3.0' into enh/TD-27119 2023-12-08 14:48:17 +08:00
Hongze Cheng a0487529d0 more fix 2023-12-08 14:37:21 +08:00
wade zhang 638e4c1f00
Merge pull request #23568 from taosdata/FEAT/TD-27125-3.0
feat: support tsdb snap replication of raw data mode
2023-12-08 14:36:16 +08:00
54liuyao 13193e29b7 delete invalid event window 2023-12-08 14:28:40 +08:00
Haojun Liao 9c72ce846e fix(tsdb): add more condition for not load data. 2023-12-08 14:23:37 +08:00
Hongze Cheng 16068bab41
Merge pull request #23964 from taosdata/fix/TD-27707
fix(tsdb/cache): del from mem with time range
2023-12-08 14:22:08 +08:00
Hongze Cheng b9d056c6a8 fix: little fix 2023-12-08 14:11:36 +08:00
dmchen 18dbc47949 break dependency 2023-12-08 04:24:33 +00:00
Haojun Liao da1207ef74 fix(tsdb): add return flag for stt files. 2023-12-08 11:07:45 +08:00
Minglei Jin d4dbb55669 fix(tsdb/cache): remove malloc zero bytes 2023-12-08 11:04:04 +08:00
54liuyao 2528fff8a8 rebuild stream event window 2023-12-08 10:52:52 +08:00
Haojun Liao 2e13b0b97d refactor: do some internal refactor. 2023-12-08 10:43:17 +08:00
Haojun Liao 9477146b30 fix(tsdb): fix syntax error. 2023-12-08 10:29:38 +08:00
Haojun Liao 4ffaff4d50 other: merge 3.0 2023-12-08 10:14:42 +08:00
Haojun Liao 446c14da72 fix(tsdb): opt read stt file 2023-12-08 10:03:36 +08:00
wade zhang c26d5fa6bd
Merge pull request #23973 from taosdata/fix/TD-27757
fix: memory access out of bounds in doGeomFromTextFunc
2023-12-08 09:09:02 +08:00
dapan1121 a2ee41233e
Merge pull request #23835 from taosdata/szhou/tms-duration
feat: tsdb output in duration order
2023-12-08 09:07:41 +08:00
Haojun Liao 7c17d6f313 fix(tsdb): opt read performance by check clean stt block if only row number required. 2023-12-07 23:12:54 +08:00
dmchen 348bef49ec message handle 2023-12-07 11:42:32 +00:00
dapan1121 4d993e8f9a
Merge pull request #23912 from taosdata/enh/3.0/TD-27276
enh : accept float data as int field input
2023-12-07 19:14:59 +08:00
Hongze Cheng aee070918b more dev 2023-12-07 17:37:47 +08:00
wangmm0220 ff23e9afae fix:inline error 2023-12-07 17:03:48 +08:00
wangmm0220 865906eaae Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/TD-27676 2023-12-07 16:33:10 +08:00
Benguang Zhao 1255b46469 fix: destroy dataReaderArr properly in tsdbSnapRAWReaderClose 2023-12-07 15:29:42 +08:00
Benguang Zhao ebd3b69745 enh: control playload size of tsdb snap replication with TSDB_SNAP_DATA_PAYLOAD_SIZE 2023-12-07 15:29:42 +08:00
Benguang Zhao 5cdf2b0b04 fixup: remove call to obsolete funcs of BgTask in tsdbSnapRAWWriter open and close 2023-12-07 15:29:42 +08:00
Benguang Zhao 28e1d83662 fix: adjust tsdbReadFile call in tsdbDataFileRAWReadBlockData 2023-12-07 15:29:42 +08:00
Benguang Zhao 52672657c1 feat: toggle tsdb snap replication mode by snap info handshake ahead of time 2023-12-07 15:29:42 +08:00
Benguang Zhao ef34176e37 fix: close data file readers in tsbSnapRAWReaderClose 2023-12-07 15:29:42 +08:00
Benguang Zhao 6c4c0242fd refact: adjust logging format in tsdbSnapRAWReaderOpen 2023-12-07 15:29:42 +08:00
Benguang Zhao f136266972 feat: support snap replication by file blocks 2023-12-07 15:29:42 +08:00
Benguang Zhao 1dc9019baa feat: add tsdbSnapRAWRead into vnodeSnapRead 2023-12-07 15:29:42 +08:00
Benguang Zhao ae60e1f810 refact: add tsdbSnapRAWReaderIterNext 2023-12-07 15:29:42 +08:00
Benguang Zhao a504007ade refact: alloc just enough memory for snap data in tsdbSnapRAWReadData 2023-12-07 15:29:42 +08:00
Benguang Zhao 6c419423de feat: impl tsdb snapshot reader and writer for raw files 2023-12-07 15:29:42 +08:00
Benguang Zhao a4c504169d feat: add file tsdbFSetRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao da646b5a5b feat: add file tsdbDataFileRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao e05914119e feat: add file tsdbSnapshotRAW.c 2023-12-07 15:29:42 +08:00
Benguang Zhao fe258e226d feat: add data type of SNAP_DATA_RAW for snap replication 2023-12-07 15:29:42 +08:00
Benguang Zhao 081c83710e enh: save a copy of snapshot info in syncNodeOnSnapshotPrepRsp 2023-12-07 15:29:37 +08:00
Benguang Zhao 030f3db4d6 refact: improve code of syncNodeOnSnapshotBegin with syncSnapSendRsp 2023-12-07 15:28:14 +08:00
Benguang Zhao 41fe39de3e refact: improve code with syncNodeExchangeSnapInfo 2023-12-07 15:28:14 +08:00
Benguang Zhao d4add073cc refact: improve code with syncSnapSendRsp 2023-12-07 15:28:14 +08:00
Benguang Zhao de9c9d4f20 refact: improve code of tsdbPartitionInfoSerialize 2023-12-07 15:28:14 +08:00
Benguang Zhao 1a9b08fa08 refact: relocate func syncSnapInfoDataRealloc 2023-12-07 15:28:14 +08:00
Benguang Zhao f68804322c refact: improve code of tsdbSnapGetDetails as tsdbSnapPrepDescription 2023-12-07 15:28:14 +08:00
Benguang Zhao ed39c9a572 refact: rename snap range to fset range in tsdbSnapInfo.c 2023-12-07 15:28:14 +08:00
Benguang Zhao 3550347f0c refact: use tsdbFSDestroyCopyRangedSnapshot and tsdbFSDestroyRefRangedSnapshot 2023-12-07 15:28:14 +08:00
Benguang Zhao 962febef02 refact: rename tsdb snap range to tsdb fset range 2023-12-07 15:28:14 +08:00
Benguang Zhao ed916b1a80 refact: rename tsdb snap partition to fset partition 2023-12-07 15:28:14 +08:00
Benguang Zhao 20b5cf8d49 refact: remove redundent includes from tsdbSnapInfo.c 2023-12-07 15:28:14 +08:00
Benguang Zhao 4487eeacb5 refact: improve funcs dealing with SnapInfo for vnode snap reader and writer 2023-12-07 15:28:14 +08:00
Benguang Zhao b8b53a4b0e refact: put source code of snap info into tsdbSnapInfo.c 2023-12-07 15:28:06 +08:00
Benguang Zhao 3ad68bdfea enh: add tsdbSnapInfo.c 2023-12-07 15:20:55 +08:00
Benguang Zhao ddcabcfa4a refact: remove unused fn tSerializeSnapRangeArray 2023-12-07 15:20:55 +08:00
Benguang Zhao e429526789 refact: rename STSnapRange to STFileSetRange 2023-12-07 15:20:55 +08:00
wangmm0220 60500f4a81 fix:error 2023-12-07 15:17:15 +08:00
wangmm0220 26855848f6 opti:schemaless logic 2023-12-07 14:07:09 +08:00
Bob Liu 4737b00879 cancel rm tail space 2023-12-07 14:00:50 +08:00
dapan1121 a4242e829a
Merge pull request #23960 from taosdata/enh/xsren/TD-26882
Enh/xsren/td 26882
2023-12-07 13:23:28 +08:00
Bob Liu 07af4e9a08 adjust 2023-12-07 12:02:04 +08:00
Shungang Li d3f3ebfe0d fix:memory access out of bounds in doGeomFromTextFunc 2023-12-07 12:01:59 +08:00
dmchen 27a86a6faa debug info and default setting 2023-12-07 03:13:23 +00:00
slzhou 1ba1fbfabc fix: remove allow_forbid_func define 2023-12-07 10:45:26 +08:00
Bob Liu 8f5df0b6a3 opt double -> int 2023-12-07 01:51:23 +08:00
Bob Liu bfc12f03cb optimize & perf test 2023-12-06 21:26:29 +08:00
dapan1121 30eb035447
Merge pull request #23940 from taosdata/fix/TS-4327
fix: last/last_row crash with dropped column
2023-12-06 17:57:24 +08:00
Minglei Jin a9309cb295 fix(tsdb/cache): del from mem with time range 2023-12-06 17:52:15 +08:00