LDAD System Manager's Manual

10.0 Logs

All LDAD processes log their activity for both system monitoring and debugging. Listed below are the LDAD log files, their respective nodes and locations, and a brief description.

10.1 Data Ingest

Except as noted, all of these files are written to /data/logs/<user>/<yyyymmdd>/ on the indicated node.

Table 10.1 LDAD Data Ingest Log Files
Name Host:User Description
CO_serv<pid><hostname><timestamp> ls1:ldad communication process log: logs socket activity
hmingestd-ls1-<timestamp> ls1:ldad ingest-for-dissemination log
listener<pid><hostname><timestamp> ds1:ldad logs rcp and remsh activity by the listener
newLDADdataNotification<pid><hostname><timestamp> ls1:ldad logs sending of data from ls1 to ds1
pollForData<pid><hostname><timestamp> ds1:ldad log of sending products to ls1 for use by dissemination system
ROSA_Acq<pid><hostname><timestamp> ls1:ldad ROSA acquisition log
textdbNotify00000<hostname>000000 ds1:fxa triggers log - files notified for dissemination
dtmf<Month><day> ls1:ldad (this file is in /data/logs/ldad) logs activity on the DTMF input channel

10.2 Decoding and Storage

LDAD decoding and storage occurs on ds1. The logs below are found in ds1:/data/logs/ldad/<yyyymmdd>.

Table 10.2 LDAD Decoding/Storage Log Files
Name Description
CommsRouter<pid><hostname><timestamp> lists each LDAD dataset as its notification passes through the system
DataController<pid><hostname><timestamp> essentially similar to CommsRouter log
routerLdadDecoder<pid><hostname><timestamp> logs decoding of files from CSV format - files are read from $FXA_DATA/LDAD/Raw and written to $FXA_DATA/LDAD/decoded
routerStoreNetcdf<pid><hostname><timestamp> logs conversion of decoded files and storage in netCDF files
routerStoreText<pid><hostname><timestamp> logs conversion of decoded files and storage in the text database
routerShefEncoder<pid><hostname><timestamp> logs SHEF encoding of decoded files

10.3 Monitoring

LDAD monitor processes run on as1 and ls1. These logs are found in /data/logs/<user>/<yyyymmdd>.

Table 10.3 LDAD Monitoring Log Files
Name Host:User Description
MakeLDApage<pid><hostname><timestamp> ls1:ldad one log each for acquisition and dissemination monitor page - the script is generally run in verbose mode
MakePROCpage<pid><hostname><timestamp> as1:fxa
ls1:ldad
logs the status of each network connection and LDAD process
MakeSUMMpage<pid><hostname><timestamp> as1:fxa logs each run of the summary page
watchDogExternal<pid><hostname><timestamp> ls1:ldad logs each time it starts a process
watchDogInternal<pid><hostname><timestamp> ds1:ldad logs each time it starts a process
Both listener and pollForData seem to fail rather frequently; the watchDog restarts them. listener calls sendLDADnotification.pl; its output ends up in this log.

10.4 Dissemination

Dissemination-related processes run on ls1.

Table 10.4 Dissemination Log Files
Directory Name Description
/data/logs/ldad/<yyyymmdd> tmain<pid><hostname><timestamp> logs BBS activity
/data/logs/ldad faxmodem.<Month>.<day> logs activity of the fax modem
/var/opt/hylafax/log c0000* fax session files - one per session
note that you must be root to view these

Fax sessions are also noted in /var/adm/syslog.log.

10.5 MSAS

The MAPS Surface Assimilation System runs on AS2. Logs are written to /data/logs/fxa/ldad/MSAS/logs. "out" files are a verbose log of the script, and are written to /data/logs/fxa/ldad/MSAS/output, while "err" files, written to /data/logs/fxa/ldad/MSAS/errors, are zero length in most cases.

Table 10.5.1 MSAS Log Files
Name Description
asoslog daily ASOS QC stats run
qcdaylog QC stage 1, 2, 3 daily summary stats run
qclatelog stage 1 & 2 previous hour run
qcstg1_2log stage 1 & 2 subhourly run
sfclog hourly surface data ingest
sfcnmclog twice-daily NCEP surface grids handling

Table 10.5.2 MSAS Out/Err Files
Name Description
accept.out.<yyjjjhh00> an echo of the current QC accept list
asos.err.<yyjjj2300> The ASOS QC, run once a day, at 2353Z.
asos.qc[0..20].out.<yyjjj2300> ASOS QC logs. Each log corresponds to text product 0nnQCD<LLL>. (Except for 005, these do not deal with ASOS data.)
qcstats.[out err].<yyjjj0000> daily QC statistics run
qcstg1_2-meso.[out err].<yyjjjhh00_mm> subhourly stage 1 & 2 QC runs
qcstg1_2-meso.[out err].<yyjjjhh00_mm>_L hourly "late" stage 1 & 2 QC runs
qcstg3.[out err].<yyjjjhh00> hourly stage 3 QC run
reject.out.<yyjjjhh00> an echo of the current QC reject list
sfcanl.[out err].<yyjjjhh00> Analysis
sfchqc.[out err].<yyjjjhh00> horizontal QC
This log includes a lot of detail regarding specific stations and observations.
sfcing.[out err].<yyjjjhh00> Data Ingest
sfcncdf.[out err].<yyjjjhh00> netCDF file generator
sfcnmc.[out err].<yyjjj[00 12]00> interpolate surface NGM fields to MSAS grid
sfcver.[out err].<yyjjjhh00> verification statistics - obs vice analysis


Table of Contents Prev Next


Last updated: 18 Dec 00 AWIPS 5.1.1