6.2 KiB
| title | slug |
|---|---|
| AVEVA Historian | /advanced-features/data-connectors/aveva-historian |
import Image from '@theme/IdealImage'; import imgStep01 from '../../assets/aveva-historian-01.png'; import imgStep02 from '../../assets/aveva-historian-02.png'; import imgStep03 from '../../assets/aveva-historian-03.png'; import imgStep04 from '../../assets/aveva-historian-04.png'; import imgStep05 from '../../assets/aveva-historian-05.png'; import imgStep06 from '../../assets/aveva-historian-06.png'; import imgStep07 from '../../assets/aveva-historian-07.png'; import imgStep08 from '../../assets/aveva-historian-08.png';
This section explains how to create data migration/data synchronization tasks through the Explorer interface to migrate/synchronize data from AVEVA Historian to the current TDengine cluster.
Function Overview
AVEVA Historian is an industrial big data analytics software, formerly known as Wonderware. It captures and stores high-fidelity industrial big data, unlocking constrained potential to improve operations.
TDengine can efficiently read data from AVEVA Historian and write it to TDengine for historical data migration or real-time data synchronization.
Creating a Task
1. Add a Data Source
Click the +Add Data Source button on the data writing page to enter the Add Data Source page.
2. Configure Basic Information
In the Name field, enter a task name, such as: "test_avevaHistorian";
Select AVEVA Historian from the Type dropdown list.
The Agent field is optional; if needed, you can select a specified agent from the dropdown, or click the +Create New Agent button on the right.
In the Target Database dropdown list, select a target database, or click the +Create Database button on the right.
3. Configure Connection Information
In the Connection Configuration area, fill in the Server Address and Server Port.
In the Authentication area, fill in the Username and Password.
Click the Connectivity Check button to check if the data source is available.
4. Configure Data Collection Information
In the Collection Configuration area, fill in the parameters related to the collection task.
4.1. Migrate Data
To perform data migration, configure the following parameters:
Select migrate from the Collection Mode dropdown list.
In the Tags field, enter the list of tags to migrate, separated by commas (,).
In the Tag Group Size field, specify the size of the tag group.
In the Task Start Time field, enter the start time for the data migration task.
In the Task End Time field, enter the end time for the data migration task.
In the Query Time Window field, specify a time interval; the data migration task will segment the time window according to this interval.
4.2. Synchronize Data from the History Table
To synchronize data from the Runtime.dbo.History table to TDengine, configure the following parameters:
Select synchronize from the Collection Mode dropdown list.
In the Table field, select Runtime.dbo.History.
In the Tags field, enter the list of tags to migrate, separated by commas (,).
In the Tag Group Size field, specify the size of the tag group.
In the Task Start Time field, enter the start time for the data migration task.
In the Query Time Window field, specify a time interval; the historical data part will segment according to this time interval.
In the Real-Time Synchronization Interval field, specify a time interval for polling real-time data.
In the Out-of-Order Time Limit field, specify a time interval; data that arrives later than this interval may be lost during real-time synchronization.
4.3. Synchronize Data from the Live Table
To synchronize data from the Runtime.dbo.Live table to TDengine, configure the following parameters:
Select synchronize from the Collection Mode dropdown list.
In the Table field, select Runtime.dbo.Live.
In the Tags field, enter the list of tags to migrate, separated by commas (,).
In the Real-Time Synchronization Interval field, specify a time interval for polling real-time data.
5. Configure Data Mapping
In the Data Mapping area, fill in the parameters related to data mapping.
Click the Retrieve from Server button to get sample data from the AVEVA Historian server.
In the Extract or Split from Columns section, fill in the fields to extract or split from the message body. For example, split the vValue field into vValue_0 and vValue_1 using the split extractor, specifying , as the separator and 2 for the number.
In the Filtering section, enter filtering conditions; for example, entering Value > 0 means that only data where Value is greater than 0 will be written to TDengine.
In the Mapping section, select the supertable to map to TDengine, and specify the columns to map to the supertable.
Click Preview to view the mapping results.
6. Configure Advanced Options
In the Advanced Options area, fill in the parameters related to advanced options.
In the Maximum Read Concurrency field, set the maximum read concurrency. The default value is 0, which means auto, automatically configuring the concurrency.
In the Batch Size field, set the batch size for each write, that is, the maximum number of messages sent at one time.
In the Save Raw Data section, choose whether to save the raw data. The default is no.
When saving raw data, the following two parameters take effect.
In the Maximum Retention Days field, set the maximum retention days for the raw data.
In the Raw Data Storage Directory field, set the path to save the raw data.
7. Completion
Click the Submit button to complete the task creation. After submitting the task, return to the Data Writing page to check the task status.