Merge branch 'main' into docs/dclow-restruct-2

docs/en/06-advanced/01-subscription.md

@@ -11,7 +11,9 @@ After subscribing to a topic, consumers can receive the latest data in real-time
 
 To implement the above functions, TDengine automatically creates indexes for Write-Ahead Logging (WAL) files to support fast random access and provides flexible and configurable file switching and retention mechanisms. Users can specify the retention time and size of WAL files according to their needs. Through these methods, WAL is transformed into a persistent storage engine that retains the order of event arrival. For queries created in the form of topics, TDengine reads data from WAL. During consumption, TDengine reads data directly from WAL based on the current consumption progress, performs filtering, transformation, and other operations using a unified query engine, and then pushes the data to consumers.
 
-## Topic Types
+Starting from version 3.2.0.0, data subscription supports vnode migration and splitting. Due to the dependence of data subscription on wal files, wal does not synchronize during vnode migration and splitting. Therefore, after migration or splitting, wal data that has not been consumed before cannot be consumed. So please ensure that all data has been consumed before proceeding with vnode migration or splitting, otherwise data loss may occur during consumption.
+
+## Topics
 
 TDengine uses SQL to create three types of topics, which are introduced below.
 

docs/zh/06-advanced/01-subscription.md

@@ -12,6 +12,8 @@ toc_max_heading_level: 4
 
 为实现上述功能，TDengine 会为预写数据日志（Write-Ahead Logging，WAL）文件自动创建索引，以支持快速随机访问，并提供了灵活可配置的文件切换与保留机制。用户可以根据需求指定 WAL 文件的保留时间和大小。通过这些方法，WAL 被改造成一个保留事件到达顺序的、可持久化的存储引擎。对于以主题形式创建的查询，TDengine 将从 WAL 读取数据。在消费过程中，TDengine 根据当前消费进度从 WAL 直接读取数据，并使用统一的查询引擎实现过滤、变换等操作，然后将数据推送给消费者。
 
+从 3.2.0.0 版本开始，数据订阅支持 vnode 迁移和分裂。 由于数据订阅依赖 wal文件，而在 vnode 迁移和分裂的过程中，wal 并不会同步过去，所以迁移或分裂后，之前没消费完的 wal数据后消费不到。所以请保证之前把数据全部消费完后，再进行 vnode 迁移或分裂，否则，消费会丢失数据。
+
 ## 主题类型
 
 TDengine 使用 SQL 创建的主题共有 3 种类型，下面分别介绍。
@@ -129,4 +131,4 @@ TDengine 的数据订阅功能支持回放（replay）功能，允许用户按
 使用数据订阅的回放功能时需要注意如下几项。
 - 数据订阅的回放功能仅查询订阅支持数据回放，超级表和库订阅不支持回放。
 - 回放不支持进度保存。
-- 因为数据回放本身需要处理时间，所以回放的精度存在几十毫秒的误差。
+- 因为数据回放本身需要处理时间，所以回放的精度存在几十毫秒的误差。

tests/parallel_test/longtimeruning_cases.task

@@ -13,6 +13,9 @@
 
 #tsim test
 #,,y,script,./test.sh -f tsim/query/timeline.sim
+,,y,script,./test.sh -f tsim/stream/streamTwaInterpFwcCheckpoint.sim
+,,y,script,./test.sh -f tsim/stream/streamFwcIntervalFill.sim
+,,y,script,./test.sh -f tsim/stream/streamTwaFwcInterval.sim
 
 #docs-examples test
 #,,n,docs-examples-test,bash c.sh

tests/script/tsim/stream/streamTwaInterpFwcCheckpoint.sim

@@ -110,10 +110,10 @@ print =====streamt4_rows=$streamt4_rows
 $loop_count = 0
 loop1:
 
-sleep 2000
+sleep 6000
 
 $loop_count = $loop_count + 1
-if $loop_count == 20 then
+if $loop_count == 100 then
   return -1
 endi
 
@@ -154,7 +154,7 @@ sql insert into t1 values(now +  3000a,10,10,10);
 $loop_count = 0
 loop2:
 
-sleep 2000
+sleep 6000
 
 $loop_count = $loop_count + 1
 if $loop_count == 20 then