Data aggregation and retention levels
Data aggregation is a multi-level process. Following are the levels supported by IT Analytics.
Level 0 (Zero): This is the level where the data is persisted. This can be at any interval of time as per probes schedules.
Level 1: This is the first aggregation level which is set to 5 minutes. Any persistence level data which has been collected at a time interval lower than 5 minutes, that data will be aggregated in this level.
For example: If LUN performance data is currently being collection at 30 seconds interval, it will get aggregated to 5 minutes aggregating 10 records to 1 record. But if the persistence collection frequency is more than 5 minutes, the same data will be inserted in the table and marked as Level 1.
Level 2: This is the second aggregation level which is set to 15 minutes. Any level 1 data which has been collected at a time interval lower than 15 minutes, will get aggregated to this level.
Level 3: This is the third aggregation level which is set to 30 minutes. Any level 2 data which has been collected at a time interval lower than 30 minutes will get aggregated to this level.
Level 4: This is the fourth aggregation level which is set to 60 minutes. Any level 3 data which has been collected at a time interval lower than 60 minutes will get aggregated to this level.
As mentioned above, IT Analytics supports data aggregation at 5 levels. Further, each level has their own data retention levels for each sub-systems.
Level 0 (Zero) retention: The level is set to 45 days. The data, collected from day One to 45th day, will be persisted at level zero. However, the 46th day data collected at frequency less than 5 minutes will get aggregated. If the frequency is equal to or greater than 5 minutes, the same data will be re-inserted without aggregation and will be marked as level 1.
Level 1 retention: The level is set to 90 day from the 46th day of post level 1 aggregation till 90th day. These records will be kept at level 1.
Level 2 retention: The level is set to 180 days from 91st day to post level 2 aggregation till 180th day. These records will be kept at level 2.
Level 3 retention: The level is set to 360 days from 181st day to post level 3 aggregation till 360th day. These records will be kept at level 3.
Level 4 retention: The Level 4 retention depends on the retention period of the table.
For example, for the LUN performance metrics table, if the retention is set to 15 months, then records at level 4 aggregation will be maintained from 361st day to 450th day.
If it is kept at 365 days, then these records will be retained for 5 days only and then purged.
If the table's final retention period is kept lower than the level 4 retention period, then no data will be purged till level 4 is achieved, making both retention periods equal.
Note:
The following is an example to enable the data aggregation option.
