Commit Graph

711 Commits

Author SHA1 Message Date
Minglei Jin f5f385486d fix(tdb/pcache): typo pCache->nPages as pCache->nPage 2022-11-24 21:42:09 +08:00
Minglei Jin 1a2983c067 fix(tdb): zero pOlds[i]'s nOverflow and assert it's zero when committing 2022-11-24 18:07:06 +08:00
Minglei Jin 78335f83d2 tdb/api: migrate txn related api changes of meta, sma, tq, and stream meta/state 2022-11-17 20:02:13 +08:00
Benguang Zhao 051b73c1ed Merge branch 3.0 to FIX/TD-19334-3.0 2022-11-17 17:28:11 +08:00
Minglei Jin 1441684c03 cleanup: remove unused pager open 2022-11-17 09:29:27 +08:00
stephenkgu 420be42269 fix: flush pages to get buffer ready for fetching 2022-11-14 10:37:56 +08:00
Minglei Jin 1a4cf6964b fix: add post commit to tq & stream 2022-11-07 20:34:23 +08:00
Minglei Jin c17f8244be enh(tdb): new interface of meta prep async commit 2022-11-07 16:45:29 +08:00
Benguang Zhao 5878c9a31a fix: impl ring log buffer 2022-11-07 14:27:22 +08:00
Minglei Jin 451b6a451d fix: set output value to null if zero-length 2022-11-02 11:47:58 +08:00
Minglei Jin 4dc0eaf0be fix: zero new dest pages to avoid double free ovfl cell 2022-10-25 17:48:06 +08:00
Minglei Jin 16275caa8d fix(tdb): typo casues large page crash 2022-10-20 15:39:37 +08:00
Minglei Jin 894d13ac18 fix: cleanup tdbExOVFL test cases 2022-10-20 13:58:13 +08:00
Minglei Jin 716c3f8a59 fix: coverity issues 2022-10-20 09:47:04 +08:00
Shengliang Guan 985e6f53e4 Merge branch '3.0' into FIX/TD-19593-3.0 2022-10-19 19:06:03 +08:00
Minglei Jin 1fc3e07abd fix: use PRId64 instead of ld to format string 2022-10-19 16:34:25 +08:00
Benguang Zhao 2aa7afe7fa Merge branch '3.0' into FIX/TD-19593-3.0 2022-10-19 16:31:13 +08:00
Minglei Jin 1e4601d8f6 fix: coverity issues 2022-10-19 16:30:50 +08:00
Benguang Zhao 3b0968d7f9 enh: enable the -Wformat=2 compiler option 2022-10-19 09:24:15 +08:00
Hongze Cheng 74d025c783 Merge branch '3.0' of https://github.com/taosdata/TDengine into fix/commit_txn 2022-10-18 22:47:12 +08:00
Minglei Jin 82132cdfdd meta: new metaFinishCommit api & rollback parameter with metaOpen 2022-10-18 18:34:39 +08:00
Minglei Jin 029abe7396 fix: coverity issues 2022-10-18 14:32:18 +08:00
Minglei Jin 5c66712b91 fix: coverity issues 2022-10-17 15:28:10 +08:00
Benguang Zhao 616eb5f903 Merge branch '3.0' into FIX/TD-19239-3.0 2022-10-16 00:29:01 +08:00
Benguang Zhao 6f39a36344 fix: replace asserts on failure of tdbPagerWrite with tdbError msg 2022-10-15 23:57:37 +08:00
Benguang Zhao a4cc3f76d4 fix: ignore file not exist error of tdbOsRemove 2022-10-15 23:57:37 +08:00
Benguang Zhao 76865258cf enh: protect WAL meta by flushing to a tmpfile at first and then renaming 2022-10-14 22:32:15 +08:00
Benguang Zhao 36bf800e15 fix: improve fault tolerance on disk space full with error handling enhanced 2022-10-14 22:02:27 +08:00
Minglei Jin 3f46bd64b9 fix: dismiss some coverity scan issues 2022-10-14 17:47:21 +08:00
Hongze Cheng 2268a1e94e fix some converity scan problem 2022-10-14 13:34:25 +08:00
Minglei Jin ccdd3ff8c2 fix: unit test case for tdb ovfl pages 2022-10-11 15:32:07 +08:00
Minglei Jin 47f286869c fix(tdb): add cell header size while decoding left bytes 2022-10-11 14:25:30 +08:00
Shengliang Guan e99b8a5f57
Merge pull request #17240 from taosdata/fix/TD-19261
fix(tdb): subtract payload size with cell header size
2022-10-09 19:30:57 +08:00
Minglei Jin 4a64803278 fix(tdb): subtract payload size with cell header size 2022-10-09 18:40:24 +08:00
Minglei Jin de3e886188 fix(test): ovfl page case with border condition checking 2022-10-09 16:38:58 +08:00
Hongze Cheng 18e31f8e26 more fix 2022-10-09 15:50:22 +08:00
Hongze Cheng a27677d285 more fix 2022-10-09 15:44:01 +08:00
Hongze Cheng 2015db5756 alter pages 2022-10-09 15:01:20 +08:00
Zhiqiang Wang d05b134a48
os: Mac package (#17201)
* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package

* os: Mac package
2022-10-08 10:12:17 +08:00
Minglei Jin 47b7aeabbc enh(tdb): more debug output for page's overflow cells 2022-09-21 15:21:56 +08:00
Minglei Jin 5a5b9f4f70 fix: update dbOrigSize before releasing dirty pages 2022-09-19 21:29:32 +08:00
Minglei Jin 5dddf1812b fix: copy rpgno with non-leaf pages 2022-09-19 16:53:18 +08:00
Minglei Jin 66bcf1fad6 fix: deep copy ovfl cells to avoid double free 2022-09-14 19:22:26 +08:00
Minglei Jin 3922ea4922 fix: drop page from rbtree before releasing 2022-09-13 19:16:25 +08:00
Minglei Jin 508c7abb68 fix(tdb): use rbtree with dirty pages' list 2022-09-13 10:51:15 +08:00
Minglei Jin bdb7f20d3d fix: force pageSize as i64 to fix u32 overflow 2022-09-06 16:29:59 +08:00
Minglei Jin 95e591efed fix: release pages with drop case 2022-08-29 15:30:05 +08:00
Minglei Jin e05169ccc6 fix: free ofp large value's memory 2022-08-25 18:16:34 +08:00
Minglei Jin 45775a9e83 fix: release ofp when encoding and decoding 2022-08-25 15:56:27 +08:00
Minglei Jin 437d4947f6 fix: tdb page cache hash page removing fix 2022-08-24 20:13:18 +08:00
Minglei Jin 0338530544 fix: wait pPageH to complete initialization 2022-08-19 19:40:21 +08:00
Minglei Jin 938c6e4c05 fix: zero cell coder 2022-08-04 20:06:55 +08:00
Minglei Jin d5c36c6536 fix: free cell decoder's pVal when resetting 2022-08-04 19:03:53 +08:00
Minglei Jin 8dbbd8362e fix: free btc cell coder's pval memory when closing btc 2022-08-04 15:47:31 +08:00
Minglei Jin a6c67f44c5 commit tdbInfo to fix crash 2022-08-02 19:32:21 +08:00
Minglei Jin 95a2212cef fix: tdbAbort API in tdb.h 2022-08-02 16:39:52 +08:00
Minglei Jin ad466ec7a9 fix: new API tdbAbort for tdb txn aborting 2022-08-02 15:40:06 +08:00
Minglei Jin 1584dd0ac0 fix: free ovfl cells when destroying page 2022-07-27 16:42:09 +08:00
Minglei Jin 1d3648fc9b fix(tdb): make txn write when insert subdb into main db 2022-07-18 17:31:11 +08:00
Minglei Jin 73e91f6491 fix wal kill case 2022-07-17 14:27:13 +08:00
Minglei Jin 24e40fcc39 fix memory issue 2022-07-17 00:14:36 +08:00
Minglei Jin c6b2b2f98a fix: return 0 if page's already dirty 2022-07-16 19:37:17 +08:00
Minglei Jin c816f795cd fix/tdb: first round multi-db implementation 2022-07-16 17:27:29 +08:00
Shengliang Guan e4a855e591 Merge remote-tracking branch 'origin/3.0' into fix/valgrind 2022-07-08 19:54:26 +08:00
Minglei Jin 5ae5ad14c4 fix: use uint32_t instead of int to avoid negative hash result 2022-07-08 18:56:48 +08:00
Shengliang Guan dca93b18cc refactor: adjust logs 2022-07-08 16:57:54 +08:00
wangmm0220 2c6f3e6971 feat: tmq get meta with json format 2022-07-06 16:02:55 +08:00
wangmm0220 78cdc64615 fix:rollback meta change 2022-07-06 10:36:56 +08:00
wangmm0220 f47c3595a2 Merge branch '3.0' into feature/TD-13041 2022-07-06 10:07:19 +08:00
Minglei Jin 06af04675a fix: dirty new allocated non-dirty page (root leaf without writings) 2022-07-05 14:28:10 +08:00
wangmm0220 a558672622 fix:merge from 3.0 2022-07-04 16:36:18 +08:00
wangmm0220 36b49b5028 fix:<TD-16840> meta ttl index core if insert with benchmark 2022-07-04 16:33:54 +08:00
afwerar b9a1c6744c os: add Mac compile support 2022-07-02 17:40:23 +08:00
Minglei Jin 6f5de8192e fix/ofp: use btree's pager instead of page's which may be null 2022-06-23 11:34:29 +08:00
Zhiqiang Wang 04771a6d82
Merge pull request #14079 from taosdata/fix/ZhiqiangWang/TD-16357-fix-sim-test-error
test: fix sim test error
2022-06-21 21:50:01 +08:00
afwerar 9dff7b93c6 test: fix sim test error 2022-06-21 20:04:55 +08:00
Minglei Jin 7a87a43b0a fix: fd return by open is a pointer 2022-06-21 19:49:49 +08:00
Minglei Jin 25fdcac305 fix/journal: restore interrupted(abort, power failure, etc.) tdb txn 2022-06-21 17:18:57 +08:00
Minglei Jin 9ef9209a5c tdb: fix windows compiling issues 2022-06-20 18:21:50 +08:00
Minglei Jin 55d2e28f70 Merge branch 'v3.0' into fix/tdb-maxLocal 2022-06-20 17:40:21 +08:00
Minglei Jin 2872a50edc tdb/ofp: support overflow pages for big data 2022-06-20 17:16:29 +08:00
WANG MINGMING b3d2daeb72
Merge branch '3.0' into feature/TD-16524 2022-06-17 14:51:33 +08:00
Minglei Jin c1de4df95b fix: fix page capacity calculation 2022-06-16 18:33:45 +08:00
wangmm0220 f2a19c98ef feat:add test for operator encode/decode 2022-06-15 20:35:45 +08:00
yihaoDeng 64ffbc1eea enh: support tag filter 2022-05-31 18:34:17 +08:00
Hongze Cheng 54d41127ee fix: tdb large page 2022-05-24 12:46:03 +00:00
Hongze Cheng b563902bb4 make it compile 2022-05-20 07:40:21 +00:00
Hongze Cheng 3b4551cc26 fix: tdb concurrency 2022-05-20 07:07:51 +00:00
Hongze Cheng 366832378e make compile 2022-05-20 05:28:24 +00:00
Hongze Cheng 0ab2b6dd4d more TDB test 2022-05-19 11:14:14 +00:00
Hongze Cheng c49b3f39d9 make windows compile pass 2022-05-19 08:16:06 +00:00
Hongze Cheng f30e6be9e0 fix windows compile error 2022-05-19 07:46:36 +00:00
Hongze Cheng 3c4b91a796 fix: tdb concurrent w/r 2022-05-19 07:15:00 +00:00
Hongze Cheng cda6fa50a9 refact: tdb 2022-05-18 12:19:32 +00:00
Hongze Cheng bad77f8e84 refact TDB 2022-05-18 12:05:39 +00:00
Hongze Cheng ef684076c4 refact: tdb api 2022-05-18 07:57:29 +00:00
Hongze Cheng f8b2bdecf1 refact: TDB 2022-05-18 05:46:16 +00:00
Hongze Cheng ed25681fc8 fix coredump 2022-05-17 13:11:39 +00:00
Hongze Cheng 83487bc3ae tdb Debug 2022-05-17 13:06:34 +00:00
Hongze Cheng f3fa9e4dd8 tdb debug 2022-05-17 12:47:00 +00:00
Hongze Cheng 442f016529 tdb debug 2022-05-17 12:11:03 +00:00
afwerar b7ca4f7710 fix(os): win str to int64 error 2022-05-17 13:50:16 +08:00
afwerar cc021699a8 fix(os): make tdb lib to static 2022-05-14 20:34:59 +08:00
afwerar 81e48a9e23 fix(os): 3.0 TDengine package error 2022-05-14 12:25:29 +08:00
Hongze Cheng c32a340055 fix memory leak 2022-05-12 06:13:59 +00:00
Hongze Cheng 72f9a1c4a4 fix 2022-05-12 03:34:38 +00:00
Hongze Cheng 6a0e89c487 fix: memory leak 2022-05-10 09:06:20 +00:00
Hongze Cheng 80cfde72ad fix: drop table if exists 2022-05-07 05:34:30 +00:00
Hongze Cheng c87eb6cc47 refact 2022-05-05 03:24:00 +00:00
Hongze Cheng 7c5c1c32ee implement TDB upsert 2022-05-05 03:17:34 +00:00
Hongze Cheng ac0fb0237e drop table code 2022-05-04 03:57:16 +00:00
Hongze Cheng d3487c88c2 TDB impl delete 2022-05-03 11:24:52 +00:00
Hongze Cheng bf355e705a fix a TDB balance bug 2022-05-03 09:59:58 +00:00
Hongze Cheng f5c58a5782 more refact 2022-05-03 08:09:58 +00:00
Hongze Cheng 05f06e04c1 refact sl 2022-05-02 15:17:43 +00:00
Hongze Cheng 9d0d5295f4 more TDB delte 2022-05-02 10:13:45 +00:00
Hongze Cheng 52d157718b more tdb delte 2022-05-02 07:55:30 +00:00
Hongze Cheng 47410b16d2 refact TDB 2022-05-02 03:02:34 +00:00
Hongze Cheng fee7499cfb fix child table query problem 2022-04-29 10:02:36 +00:00
Hongze Cheng 48207a166e refact vnode and add tdb api 2022-04-29 07:55:52 +00:00
Hongze Cheng 496ec4c1dc more TDB 2022-04-29 07:40:07 +00:00
Hongze Cheng 21cec7b6d7 more 2022-04-29 07:07:49 +00:00
Hongze Cheng fd6b2ad626 more refact 2022-04-28 10:46:07 +00:00
Hongze Cheng 7ff3183a70 refact TDB 2022-04-28 07:02:49 +00:00
Hongze Cheng 85d3e4c8ae make case pass 2022-04-26 09:16:29 +00:00
Hongze Cheng de57d21765 fix big bug 2022-04-26 07:14:26 +00:00
Hongze Cheng 3204cd6879 fix empty show tables bug 2022-04-25 09:12:16 +00:00
Hongze Cheng f5e16f968d fix problems 2022-04-25 08:39:10 +00:00
Hongze Cheng 264b3f0c73 fix tdb problem 2022-04-25 07:32:41 +00:00
Hongze Cheng 13740e8988 refact TDB to support meta 2022-04-25 03:43:42 +00:00
afwerar fc24521621 fix(os): windows compile 3.0. 2022-04-22 09:54:27 +08:00
Cary Xu f9d162bae2 tsma use TDB 2022-04-13 16:02:55 +08:00
afwerar c11946fd75 [TD-13756]<fix>: Fix macro name error. 2022-04-11 18:55:43 +08:00
wangmm0220 225cf61845 merge from 3.0 2022-04-07 11:31:50 +08:00
Hongze Cheng 70810ddb39 fix a small bug 2022-04-06 11:37:34 +00:00
Hongze Cheng f136211bad fix TDB encode and decode bug 2022-04-06 10:21:36 +00:00
Hongze Cheng 610832f0b4 keep committed data in TDB 2022-04-06 08:41:53 +00:00
Hongze Cheng 69ff3cc67b fix an assert bug 2022-04-06 06:37:22 +00:00
Hongze Cheng 6b47fd8984 TDB with txn 2022-04-02 11:20:56 +00:00
Hongze Cheng f9e699bea5 more TDB 2022-04-02 06:23:04 +00:00
Hongze Cheng 9dea86249c refact 2022-04-02 05:16:32 +00:00
Hongze Cheng 08ed99b069 more TDB 2022-04-02 02:56:09 +00:00
Hongze Cheng 9525e37651 256K for 1.5G data 2022-04-01 08:44:59 +00:00
Hongze Cheng e25b407c5a optimize search process 2022-04-01 08:00:46 +00:00
Hongze Cheng 0e7a420e83 fix another bug 2022-04-01 03:35:43 +00:00
Hongze Cheng 6b0b988f46 fix a bug 2022-04-01 02:38:50 +00:00
Hongze Cheng 1a71bbfbd3 refact 2022-03-31 09:42:23 +00:00
Hongze Cheng 59398ee2df commit loop work now 2022-03-31 09:41:46 +00:00
Hongze Cheng 4e6ea0d2d2 new test 2022-03-31 08:23:17 +00:00
Hongze Cheng 0492362f38 more TDB 2022-03-31 08:04:38 +00:00