Project

General

Profile

« Previous | Next » 

Revision 3845

README.TXT: After a new import: Added steps to check inputs' error counts and only continue with deleting previous imports, etc. if there were little to no errors. Added step to record the import times.

View differences:

README.TXT
27 27
        make schemas/rotate
28 28
        Rename the rotated schema using the date in the first datasource's log
29 29
            file name
30
        tail inputs/*/import/*.<date>-*.log.sql
31
        Check that every input's log ends in "Encountered 0 error(s)"
32
        If many do not, fix the bug and discard the current (partial) import
33
        Otherwise, continue
30 34
        Delete previous imports so they won't bloat the full DB backup:
31
            make backups/public.<date>.backup/remove
35
            make backups/public.<datetime>.backup/remove
32 36
        make backups/<schema>.backup/test & make backups/vegbien.backup/all &
33 37
        On local machine:
34 38
            make inputs/download-logs
35 39
            make backups/download &
40
            If desired, record the import times in inputs/import.stats.xls
36 41
    Archived imports:
37 42
        Back up: make backups/public.<date>.backup &
38 43
            Note: To back up the last import, you must archive it first (above)

Also available in: Unified diff