Difference between revisions of "Logging and Tracking"
| Line 1: | Line 1: | ||
===The need for logging and tracking=== | ===The need for logging and tracking=== | ||
| − | Separate components, all need to refer to a common 'map' of the status of the system | + | Separate components, all need to refer to a common 'map' of the status of the system<br/> |
| − | makes it easier to see what is happening for system, what has happened for users | + | makes it easier to see what is happening for system, what has happened for users <br/> |
| − | Therefore, records of each of the 4 main processes, map of data package statuses, logging of issues | + | Therefore, records of each of the 4 main processes, map of data package statuses, logging of issues<br/><br/> |
| − | ===The | + | ===The source data tables=== |
| − | + | The source data tables<br/> | |
| − | The source data tables | + | << diagram of tables>><br/> |
| − | << diagram of tables>> | + | study-study links (??? - in nk surely)<br/> |
| − | + | logging data layer - the logging repo<br/> | |
| − | study-study links (??? - in nk surely) | + | standard functions for doing the tracking<br/><br/> |
| − | logging data layer - the logging repo | ||
| − | standard functions for doing the tracking | ||
| − | |||
===The source parameters=== | ===The source parameters=== | ||
| − | Holds a central position | + | Holds a central position<br/> |
| − | Sources are orgs so that the original records for each source are in the contexts organisation table | + | Sources are orgs so that the original records for each source are in the contexts organisation table<br/> |
| − | That gives the ids | + | That gives the ids<br/> |
| − | But processing specific data is in this table | + | But processing specific data is in this table<br/> |
| − | Used in all phases of processing to know what tables to expect to find / process in each database | + | Used in all phases of processing to know what tables to expect to find / process in each database<br/> |
===The Event records=== | ===The Event records=== | ||
| − | + | The events tables and types<br/> | |
| − | statistics | + | Creating and filling event records<br/> |
| − | + | statistics linked to aggregation<br/><br/> | |
===Extraction notes=== | ===Extraction notes=== | ||
| + | Purpose and usage<br/> | ||
| + | Extraction tables<br/> | ||
| + | feedback and notes, serialising feedback<br/><br/> | ||
Revision as of 23:51, 2 November 2020
Contents
The need for logging and tracking
Separate components, all need to refer to a common 'map' of the status of the system
makes it easier to see what is happening for system, what has happened for users
Therefore, records of each of the 4 main processes, map of data package statuses, logging of issues
The source data tables
The source data tables
<< diagram of tables>>
study-study links (??? - in nk surely)
logging data layer - the logging repo
standard functions for doing the tracking
The source parameters
Holds a central position
Sources are orgs so that the original records for each source are in the contexts organisation table
That gives the ids
But processing specific data is in this table
Used in all phases of processing to know what tables to expect to find / process in each database
The Event records
The events tables and types
Creating and filling event records
statistics linked to aggregation
Extraction notes
Purpose and usage
Extraction tables
feedback and notes, serialising feedback
