Monitoring systems

Processing and data storage in DB

Information from meters is stored on the server through rsync on a copy of the measure files. This information has the following properties:

• may contains errors
• may be inconsistent: some minutes does not exist or be repeated
• contains raw values, there are only direct measures
• its access and use are tedious

For this reasons, some R scripts have been developed that perform the following features:

• clean errors and process them
• ensure consistency by creating a continuous time reference
• prepare the desired raw values to be stored and process new information from these raw values
• store this information in a MySQL DB

These scripts have been divided in two different families: create and update scripts.

create scripts

The objective of these scripts is create the DB with all required information, ensuring the previous features. The process is divided in the following steps:

They remove the previous DB, get all