Difference between revisions of "Monitoring systems"
From RobolaboWiki
| Line 1: | Line 1: | ||
| − | |||
<h1> Processing and data storage in DB </h1> | <h1> Processing and data storage in DB </h1> | ||
| Line 11: | Line 10: | ||
<li> its access and use are tedious </li> | <li> its access and use are tedious </li> | ||
</ul> | </ul> | ||
| + | |||
For this reasons, some R scripts have been developed that perform the following actions: | For this reasons, some R scripts have been developed that perform the following actions: | ||
<ul> | <ul> | ||
| Line 17: | Line 17: | ||
<li> prepare the desired raw values to be stored and process new information from these raw values </li> | <li> prepare the desired raw values to be stored and process new information from these raw values </li> | ||
<li> store this information in a MySQL DB </li> | <li> store this information in a MySQL DB </li> | ||
| + | </ul> | ||
| + | |||
| + | These scripts have been divided in two different families: <i>create</i> and <i>update</i> scripts. | ||
| + | <ul> | ||
| + | <li> | ||
| + | <i>create</i>: | ||
| + | </li> | ||
| + | <li> | ||
| + | <i>update</i>: | ||
| + | </li> | ||
</ul> | </ul> | ||
Revision as of 15:51, 8 June 2016
Processing and data storage in DB
Information from meters is stored on the server through rsync on a copy of the measure files. This information has the following properties:
- may contains errors
- may be inconsistent: some minutes does not exist or be repeated
- contains raw values, there are only direct measures
- its access and use are tedious
For this reasons, some R scripts have been developed that perform the following actions:
- clean errors and process them
- ensure consistency by creating a continuous time reference
- prepare the desired raw values to be stored and process new information from these raw values
- store this information in a MySQL DB
These scripts have been divided in two different families: create and update scripts.
- create:
- update:
