DATA FILES NEEDED BY THE AWIPS BUILD 5.1.1 MSAS SURFACE ASSIMILATION SYSTEM updated 12/19/00 Contents: SFCNMC - Interpolates background forecast model data to MSAS Surface grid QCSTG1_2 - Apply QCMS stage 1 & 2 QC checks and create QC'ed mesonet files SFCING - Ingests Surface Obs to MSAS Surface grid SFCHQC - QC MSAS Surface Obs SFCANL - MSAS Surface Analysis SFCNCDF - Converts MSAS Surface to netCDF files SFCVER - Generate mean and std dev MSAS surface grid stats QCSTG3 - Add MSAS spatial consistency check QC results to QC mesonet files ASOS - Calculate daily/weekly/monthly QC stats vs obs QCSTATS - Produce summary table of QCMS stage 1, 2 & 3 QC checks Implementation Notes: * The locations of input/output files in the working directories are given relative to the production run directory ${MSAS}, or /awips/fxa/ldad/MSAS on as1/as2. * Public access to MSAS/QCMS output is provided as follows: MSAS netcdf grids: /data/fxa/Grid/FSL/netCDF/MSAS MSAS netcdf obs: /data/fxa/LDAD/sfc_netcdf QC'ed netcdf files: /data/fxa/LDAD/mesonet/qc QC'ed CSV files: /data/fxa/LDAD/qcms_data/csv Fortran output: /data/logs/fxa/ldad/MSAS/output Standard error: /data/logs/fxa/ldad/MSAS/errors Logs: /data/logs/fxa/ldad/MSAS/logs QC stats: /data/fxa/LDAD/qcmessages/qc0....qc20 Verification files: /data/fxa/LDAD/maps_data * Input data directories are as follows: ${NETCDF} = /data/fxa/Grid/SBN/netCDF/CONUS211/Eta ${BUOYDIR} = /data/fxa/point/maritime/netcdf ${SAODIR} = null ${METARDIR} = /data/fxa/point/metar/netcdf ${PROFDIR} = /data/fxa/point/profiler/netcdf ${MESORAW} = /data/fxa/LDAD/mesonet/netCDF ${GSOSDIR} = null DATA FILES NEEDED BY THE AWIPS BUILD 5.1.1 MSAS SURFACE ASSIMILATION SYSTEM SFCNMC Purpose: Reads in background forecast model grids and interpolates horizontally to MSAS surface grid points. Running times: After receipt of the forecasts. dir/file name logical name Contents I/O ---------------------------- ------------ ---------------------- --- ${YYDDDHHMDL}00 MAPTIME 9-char date/time ($ATIME mod $FC)I MAPS_PARMS/sfcnmc.ini ** SFCNMC.INI initialization file I MAPS_PARMS/topomini.dat TOPMINI Topography I MAPS_PARMS/latlon.mps LTLN MSAS lats/lons I MAPS_PARMS/msaspts.dat MSASPTS MSAS grdpts in back model coords I ${NETCDF}/ GRIDDIR netcdf grids I ---------------------------- ------------ ---------------------- --- OUT/sfcnmc.out.yydddhh00 + SFCNMC.OUT Standard output O ERR/sfcnmc.err.yydddhh00 * SFCNMC.ERR Standard error O MDL_DATA/yydddhh06.msi PVSMD06 6h-forecast surface fields O MDL_DATA/yydddhh12.msi PVSMD12 12h-forecast surface fields O MDL_DATA/yydddhh18.msi PVSMD18 18h-forecast surface fields O MDL_DATA/yydddhh24.msi PVSMD24 24h-forecast surface fields O MDL_DATA/yydddhh30.msi PVSMD30 30h-forecast surface fields O MDL_DATA/yydddhh06.mig PVMD06P 6h-forecast upper-air fields O MDL_DATA/yydddhh12.mig PVMD12P 12h-forecast upper-air fields O MDL_DATA/yydddhh18.mig PVMD18P 18h-forecast upper-air fields O MDL_DATA/yydddhh24.mig PVMD24P 24h-forecast upper-air fields O MDL_DATA/yydddhh30.mig PVMD30P 30h-forecast upper-air fields O ** MAPS_PARMS : ${MSAS}/fslparms + OUT : ${MSAS}/output * ERR : ${MSAS}/errors x MDL_DATA : ${MSAS}/mdl_data where MDL_DATA/yydddhh is the year/julian day/hour of most recent background forecast model run, and $FC is the background forecast model's cycle in hours ($FC = 12 on WFO-Advanced). DATA FILES NEEDED BY THE AWIPS BUILD 5.1.1 MSAS SURFACE ASSIMILATION SYSTEM QCSTG1_2 Purpose: Apply QCMS stage 1 & 2 QC checks (validity, internal consistency, and temporal consistency) and create QC'ed LDAD mesonet netcdf obs files. Running times: Run on any desired subhourly schedule, but right before SFCING to allow the analysis cycle the maximum number of obs. dir/file name logical name Contents I/O ------------------------------ ------------ ---------------------- --- $ATIME QCTIME 9-char date/time I $MIN CSVPRE 2-char QC CSV file prefix I MAPS_PARMS/qcstg1_2.ini ** QCSTG1_2.INI initialization file I MAPS_PARMS/accept.txt ACCEPTIN observation accept list I MAPS_PARMS/reject.txt REJECTIN observation reject list I MAPS_PARMS/stadic.txt STADIC ASOS station dictionary I MAPS_PARMS/topomini.dat TOPMINI Topography I ${MESORAW}/[yyyymmdd_hh00] RAW_DIR/[] current raw netCDF obs I ${MESORAW}/rewrites.[yyyymmdd_hh00] RAW_DIR/[] raw rewritten rec list I MAPS_DATA/yydddhh00.replist + REPLISTO previous rewritten rec list I MAPS_DATA/yydddhh00.replist.error REPLISTE previous error rec list I QC_DIR/[yyyymmdd_hh(-1h)00] xx QC_DIR/[] 1h-old QC'ed netCDF obs I QC_DIR/[yyyymmdd_hh(-3h)00] QC_DIR/[] 3h-old QC'ed netCDF obs I QC_DIR/[yyyymmdd_hh(-6h)00] QC_DIR/[] 6h-old QC'ed netCDF obs I QC_DIR/[yyyymmdd_hh(-12h)00] QC_DIR/[] 12h-old QC'ed netCDF obs I MAPS_PARMS/qc_work_table.mesonet WORKTBL QCMS stage 1&2 work table I MAPS_PARMS/QCmesonet.cdl QC_CDL CDL for QC'ed netCDF obs I ------------------------------ ------------ ---------------------- --- MAPS_PARMS/sfchqcin.dat SFCHQCIN provider-to-subsource map I/O ------------------------------ ------------ ---------------------- --- QC_DIR/[yyyymmdd_hh00] QC_DIR/[] current QC'ed netCDF obs O CSV_DIR/[utime.pd.msas_qc.pname] y CSV_DIR/[] current QC'ed CSV obs O MAPS_DATA/yydddhh00.replist REPLISTN current rewritten rec list O MAPS_DATA/yydddhh00.replist.error REPLISTE current error rec list O OUT/qcstg1_2-meso.out.yydddhh00_mm QCSTG1_2.OUT standard output O ERR/qcstg1_2-meso.err.yydddhh00_mm QCSTG1_2.ERR standard error O ** MAPS_PARMS : ${MSAS}/fslparms + MAPS_DATA : ${MSAS}/maps_data x OUT : ${MSAS}/output ++ ERR : ${MSAS}/errors xx QC_DIR : ${MSAS} [- Note that these files are copied from and to ${MSAS}/qcms_data/mesonet] y CSV_DIR : ${MSAS}/qcstg1_2 when run in qcstg1_2 directory, ${MSAS}/qcstg1_2_late when run in qcstg1_2_late directory [- Note that these files are immediately moved to ${MSAS}/qcms_data/csv] where yydddhh is the year/julian day/hour of current QCSTG1_2 run, mm is the minute of the QCSTG1_2 run, and yyyymmdd_hh is the 4-digit year, month, day, hour of the current run. Note that for late QCSTG1_2 runs (late means on previous hour's data) the _mm portion of the qcstg1_2-*.out.yydddhh00_mm log files also contains the suffix _L, e.g., qcstg1_2-*.out.yydddhh00_mm is for the current QCSTG1_2 run that occurs at hh:mm and qcstg1_2-*.out.yydddhh00_mm_L is for the late QCSTG1_2 run that occurs at hh+1:mm. *DIR represent logical names for the data directories. Filenames (within the brackets) are calculated within the code. The CSV obs files are named: utime.pd.msas_qc.pname, where: utime = formatted Unix time version of $ATIME (e.g., 993480100 --> 945133200) pd = minute of qcstg1_2 run (e.g., "06", "11") msas_qc = the *.desc file to be used by LDAD processing, pname = data type from LDADinfo.txt of the provider (e.g., "alert_wx") DATA FILES NEEDED BY THE AWIPS BUILD 5.1.1 MSAS SURFACE ASSIMILATION SYSTEM SFCING Purpose: Reads in surface observations and converts them to MSAS database format. Running times: At the start of the analysis cycle. dir/file name logical name Contents I/O ------------------------------ ----------- ---------- --- $ATIME MAPTIME 9-char date/time I ${BUOYDIR}/[yyyymmdd_hh00] BUOYDIR/[] netCDF buoy data I ${BUOYDIR}/[yyyymmdd_hh(-1h)00] BUOYDIR/[] netCDF buoy data I ${SAODIR} SAODIR/[] netCDF SAO data (not used) I ${PROFDIR}[yyyymmdd_hh00] PROFDIR/[] netCDF profiler data I ${METARDIR}/[yyyymmdd_hh00] METARDIR/[] netCDF METAR data I ${METARDIR}/[yyyymmdd_hh(-1h)00] METARDIR/[] netCDF METAR data I MESODIR/[yyyymmdd_hh00] xx MESODIR/[] netCDF local mesonet data I MESODIR/[yyyymmdd_hh(-1h)00] MESODIR/[] netCDF local mesonet data I ${GSOSDIR} GSOSDIR/[] netCDF GSOS data (not used) I MAPS_PARMS/sfcing.ini ** SFCING.INI initialization file I MAPS_PARMS/accept.txt ACCEPTIN observation accept list I MAPS_PARMS/reject.txt REJECTIN observation reject list I MAPS_PARMS/stadic.txt STADIC ASOS station dictionary I MAPS_PARMS/timwin.dat TIMWIN Time window parameters I MAPS_PARMS/topomini.dat TOPMINI Topography I MAPS_PARMS/qc_work_table.msas WORKTBL QCMS stage 1&2 work table I MDL_DATA/yydddhh06.mig MDL06P current 6h back model UA fcst I MDL_DATA/yydddhh12.mig MDL12P current 12h back model UA fcst I MDL_DATA/yydddhh18.mig MDL18P current 18h back model UA fcst I MDL_DATA/yydddhh24.mig MDL24P current 24h back model UA fcst I MDL_DATA/yydddhh30.mig MDL30P current 30h back model UA fcst I MDL_DATA/yydddhh(-$FC)06.mig PVMD06P prev 6h back model UA fcst I MDL_DATA/yydddhh(-$FC)12.mig PVMD12P prev 12h back model UA fcst I MDL_DATA/yydddhh(-$FC)18.mig PVMD18P prev 18h back model UA fcst I MDL_DATA/yydddhh(-$FC)24.mig PVMD24P prev 24h back model UA fcst I MDL_DATA/yydddhh(-$FC)30.mig PVMD30P prev 30h back model UA fcst I MAPS_DATA/yydddhh(-1h)00.msa + PVMPS01 1h-old MSAS sfc sao data I MAPS_DATA/yydddhh(-1h)00.mby PVMPB01 1h-old MSAS sfc buoy data I MAPS_DATA/yydddhh(-1h)00.mss PVSCH01 1h-old MSAS sfc search table I MAPS_DATA/yydddhh(-3h)00.msa PVMPS03 3h-old MASS sfc sao data I MAPS_DATA/yydddhh(-3h)00.mby PVMPB03 3h-old MSAS sfc buoy data I MAPS_DATA/yydddhh(-3h)00.mss PVSCH03 3h-old MSAS sfc search table I MAPS_DATA/yydddhh(-12h)00.msa PVMPS12 12h-old MSAS sfc sao data I MAPS_DATA/yydddhh(-12h)00.mby PVMPB12 12h-old MSAS sfc buoy data I MAPS_DATA/yydddhh(-12h)00.mss PVSCH12 12h-old MSAS sfc search table I ------------------------------ ---------- ---------------------- --- MAPS_PARMS/sfchqcin.dat SFCHQCIN data provider-to-subsrc map I/O ------------------------------ ---------- ---------------------- --- OUT/sfcing.out.yydddhh00 x SFCING.OUT standard output O ERR/sfcing.err.yydddhh00 ++ SFCING.ERR standard error O OUT/accept.out.yydddhh00 ACCEPTOUT accept list output O OUT/reject.out.yydddhh00 REJECTOUT reject list output O MAPS_DATA/yydddhh00.msa MPSSAO current MSAS sfc sao data O MAPS_DATA/yydddhh00.mby MPSBUOY current MSAS sfc bouy data O MAPS_DATA/yydddhh00.mss SRCH current MSAS sfc search table O MAPS_DATA/yydddhh00.sri STRCLING curr. station-rec. ingest list O ** MAPS_PARMS : ${MSAS}/fslparms * MDL_DATA : ${MSAS}/mdl_data + MAPS_DATA : ${MSAS}/maps_data xx MESODIR : ${MSAS} [- Note that these files are copied from ${MSAS}/qcms_data/mesonet] x OUT : ${MSAS}/output ++ ERR : ${MSAS}/errors where MDL_DATA/yydddhh is the year/julian day/hour of most recent background forecast model run, MAPS_DATA/yydddhh is the year/julian day/hour of current MSAS run, yyyymmdd_hh is the year/month/day/hour of current MSAS run for netCDF observations files, and $FC is the background forecast model's cycle hours ($FC = 12 on WFO- Advanced). *DIR represent logical names for the data directories. Filenames (within the brackets) are calculated within the code. DATA FILES NEEDED BY THE AWIPS BUILD 5.1.1 MSAS SURFACE ASSIMILATION SYSTEM SFCHQC Purpose: Performs horizontal quality control on the surface observations. Observations which are sufficiently inconsistent with neighboring data are flagged in the MSAS database. Running times: Every analysis cycle, after SFCING. dir/file name logical name Contents I/O ----------------------------- ------------ ---------------------- --- $ATIME MAPTIME 9-char date/time I MAPS_PARMS/sfchqc.ini ** SFCHQC.INI initialization file I MAPS_PARMS/accept.txt ACCEPTIN observation accept list I MAPS_PARMS/reject.txt REJECTIN observation reject list I MAPS_PARMS/scc_thresh.txt SCCTHR SC check threshold factors I MAPS_PARMS/sfchqcin.dat SFCHQCIN data provider-to-subsource map I MAPS_PARMS/stadic.txt STADIC ASOS station dictionary I MAPS_PARMS/analblend.dat ANLBLND weights for blending data I MAPS_PARMS/tidehh.dat DNOW tidal data, current I MAPS_PARMS/tidehh(-1h).dat TD1HAGO tidal data, 1 hr prev I MAPS_PARMS/tidehh(-2h).dat TD2HAGO tidal data, 2 hr prev I MAPS_PARMS/tidehh(-3h).dat TD3HAGO tidal data, 3 hr prev I MAPS_PARMS/tidehh(-4h).dat TD4HAGO tidal data, 4 hr prev I MAPS_PARMS/tidehh(-5h).dat TD5HAGO tidal data, 5 hr prev I MAPS_PARMS/tidehh(-6h).dat D6HAGO tidal data, 6 hr prev I MAPS_PARMS/topomini.dat TOPMINI minimum elev topography I MAPS_PARMS/guess_type.txt GUESTYP first guess type I MAPS_PARMS/msas_qcobs.cdl MSAS_QCOBS.CDL MSAS netcdf obs file CDL I MDL_DATA/yydddhh06.msi * SMDL06 current 6h back model sfc fcst I MDL_DATA/yydddhh12.msi MDL12 current 12h back model sfc fcst I MDL_DATA/yydddhh18.msi SMDL18 current 18h back model sfc fcst I MDL_DATA/yydddhh24.msi SMDL24 current 24h back model sfc fcst I MDL_DATA/yydddhh30.msi SMDL30 current 30h back model sfc fcst I MDL_DATA/yydddhh(-$FC)06.msi PVSMD06 prev 6h back model sfc fcst I MDL_DATA/yydddhh(-$FC)12.msi PVSMD12 prev 12h back model sfc fcst I MDL_DATA/yydddhh(-$FC)18.msi PV SMD18 prev 18h back model sfc fcst I MDL_DATA/yydddhh(-$FC)24.msi PVSMD24 prev 24h back model sfc fcst I MDL_DATA/yydddhh(-$FC)30.msi PVSMD30 prev 30h back model sfc fcst I MAPS_DATA/yydddhh(-1h)00.msx + PVSANX1 MSAS sfc anal, 1 hr prev I MAPS_DATA/yydddhh(-2h)00.msx PVSANX2 MSAS sfc anal, 2 hr prev I MAPS_DATA/yydddhh(-3h)00.msx PVSANX3 MSAS sfc anal, 3 hr prev I MAPS_DATA/yydddhh00.sri STRCLING current station-rec. ingest list I ------------------------------ ------------ ---------------------- --- MAPS_DATA/yydddhh00.msa MPSSAO current MSAS sfc sao data I/O MAPS_DATA/yydddhh00.mby MPSBUOY current MSAS sfc buoy data I/O MAPS_DATA/yydddhh00.mss SRCH current MSAS sfc search table I/O ------------------------------ ------------ ---------------------- --- OUT/sfchqc.out.yydddhh00 x SFCHQC.OUT standard output O ERR/sfchqc.err.yydddhh00 ++ SFCHQC.ERR standard error O MAPS_DATA/yydddhh00.mfg SFG MSAS first guess O MAPS_DATA/yydddhh00.srq STRCLQC current station-rec. QC list O MAPS_DATA/qc$/qcsumryhh.dat xx QCSMRY$ hourly qual ctrl summary O MAPS_DATA/qc$/qcobshh.dat QCOBS$ hourly qual ctrl list O QC_DIR/[yyyymmdd_hh00] y QC_DIR/[] output obs in netCDF O ** MAPS_PARMS : ${MSAS}/fslparms * MDL_DATA : ${MSAS}/mdl_data + MAPS_DATA : ${MSAS}/maps_data x OUT : ${MSAS}/output ++ ERR : ${MSAS}/errors y QC_DIR : ${MSAS}/sfchqc [- Note that these files are immediately moved to ${MSAS}/sfc_netcdf and are renamed with WFOA standards.] where MDL_DATA/yydddhh is the year/julian day/hour of most recent background forecast model run, yyyymmdd_hh is the 4-digit year, month, day, hour of the current run, MAPS_DATA/yydddhh is the year/julian day/hour of current MSAS run, and $FC is the background forecast model's cycle in hours ($FC = 12 on WFO-Advanced). xx QCOBS and QCSMRY files are produced dependent on the settings in the SFCHQCIN input file. "$" is the number of the subsource stratification. DATA FILES NEEDED BY THE AWIPS BUILD 5.1.1 MSAS SURFACE ASSIMILATION SYSTEM SFCANL Purpose: Performs the surface analysis on the observations and outputs surface grids in MSAS database format. Running times: Every analysis cycle, after SFCHQC. dir/file name logical name Contents I/O ------------------------------ ----------- --------------------- --- $ATIME MAPTIME 9-char date/time I MAPS_PARMS/sfcanl.ini ** SFCANL.INI initialization file I MAPS_PARMS/accept.txt ACCEPTIN observation accept list I MAPS_PARMS/reject.txt REJECTIN observation reject list I MAPS_PARMS/sfchqcin.dat SFCHQCIN data provider-to-subsource map I MAPS_DATA/yydddhh00.mfg SFG MSAS first guess I MAPS_PARMS/topomini.dat TOPMINI minimum elev topography I MAPS_PARMS/parms.mps GRDPARM MSAS grid parameters I MAPS_DATA/yydddhh00.msa MPSSAO current MSAS sfc sao data I MAPS_DATA/yydddhh00.mby MPSBUOY current MSAS sfc buoy data I MAPS_DATA/yydddhh00.mss SRCH current MSAS sfc search table I ------------------------------ ------------ ---------------------- --- OUT/sfcanl.out.yydddhh00 x SFCANL.OUT standard output O ERR/sfcanl.err.yydddhh00 ++ SFCANL.ERR standard error O OUT/accept.out.yydddhh00 ACCEPTOUT accept list output O OUT/reject.out.yydddhh00 REJECTOUT reject list output O MAPS_DATA/yydddhh00.msx SANX MSAS surface analysis O ** MAPS_PARMS : ${MSAS}/fslparms + MAPS_DATA : ${MSAS}/maps_data x OUT : ${MSAS}/output ++ ERR : ${MSAS}/errors where MAPS_DATA/yydddhh is the year/julian day/hour of current MSAS run. DATA FILES NEEDED BY THE AWIPS BUILD 5.1.1 MSAS SURFACE ASSIMILATION SYSTEM SFCNCDF Purpose: Converts MSAS surface grids in MSAS database format to netCDF files. Running times: Every analysis cycle, after SFCANL. dir/file name logical name Contents I/O -------------------------- ------------ ---------------------- --- $ATIME MAPTIME 9-char date/time I MAPS_PARMS/sfcncdf.ini ** SFCNCDF.INI initialization file I MAPS_PARMS/conf_file.dat CONF_FILE.DAT parms for netCDF write I (if $os is SUNOS or IRIX) MAPS_PARMS/maps_60km_surface.cdl netCDF CDL for MSAS grid I (inside conf_file.dat) MAPS_PARMS/WFOA_conf_file.dat CONF_FILE.DAT parms for netCDF write I (if $os is HPUX) MAPS_PARMS/WFOA_maps_60km_surface.cdl netCDF CDL for MSAS grid I (inside WFOA_conf_file.dat) MAPS_DATA/${YYDDDHH}00.msx + SANX current surface analysis I -------------------------- ------------ ---------------------- --- RUN/sfcncdf/yydddhh000000a * {YYDDDHH}000000a output sfc grids in netCDF O OUT/sfcncdf.out.yydddhh00 x SFCNCDF.OUT standard output O ERR/sfcncdf.err.yydddhh00 ++ SFCNCDF.ERR standard error O ** MAPS_PARMS : ${MSAS}/fslparms + MAPS_DATA : ${MSAS}/maps_data x OUT : ${MSAS}/output ++ ERR : ${MSAS}/errors * RUN : ${MSAS}/sfcncdf [- Note: files immediately moved to ${MSAS}/sfc_netcdf, then from there are moved to /data/fxa public access and renamed to WFOA standards.] where MAPS_DATA/yydddhh is the year/julian day/hour of current MSAS run. DATA FILES NEEDED BY THE AWIPS BUILD 5.1.1 MSAS SURFACE ASSIMILATION SYSTEM SFCVER Purpose: Compare MSAS surface analysis against observations. Running times: Every analysis cycle, after SFCNCDF. dir/file name logical name Contents I/O -------------------------- ------------ ---------------------- --- $ATIME MAPTIME 9-char date/time I MAPS_PARMS/sfcver.ini ** SFCVER.INI initialization file I MAPS_PARMS/accept.txt ACCEPTIN observation accept list I MAPS_PARMS/reject.txt REJECTIN observation reject list I MAPS_PARMS/sfchqcin.dat SFCHQCIN data provider-to-subsource map I MAPS_DATA/yydddhh00.msa + MPSSAO current MSAS sfc sao data I MAPS_DATA/yydddhh00.mby MPSBUOY current MASS sfc buoy data I MAPS_DATA/yydddhh00.mss SRCH current MSAS sfc search table I MAPS_DATA/yydddhh00.msx SANX current MSAS surface analysis I -------------------------- ------------ ---------------------- --- OUT/sfcver.out.yydddhh00 * SFCVER.OUT standard output O ERR/sfcver.err.yydddhh00 x SFCVER.ERR standard error O OUT/accept.out.yydddhh00 ACCEPTOUT accept list output O OUT/reject.out.yydddhh00 REJECTOUT reject list output O MAPS_DATA/sfc_residuals00.dat SFC_RESIDUALS00.DAT analysis vs. obs, all obs O MAPS_DATA/sfc_residuals01.dat SFC_RESIDUALS01.DAT analysis vs. obs, region 1 O MAPS_DATA/sfc_residuals02.dat SFC_RESIDUALS02.DAT analysis vs. obs, region 2 O MAPS_DATA/sfc_residuals03.dat SFC_RESIDUALS03.DAT analysis vs. obs, region 3 O MAPS_DATA/sfc_residuals04.dat SFC_RESIDUALS04.DAT analysis vs. obs, region 4 O MAPS_DATA/sfc_residuals05.dat SFC_RESIDUALS05.DAT analysis vs. obs, region 5 O ** MAPS_PARMS : ${MSAS}/fslparms + MAPS_DATA : ${MSAS}/maps_data * OUT : ${MSAS}/output x ERR : ${MSAS}/errors where MAPS_DATA/yydddhh is the year/julian day/hour of current MSAS run. DATA FILES NEEDED BY THE AWIPS BUILD 5.1.1 MSAS SURFACE ASSIMILATION SYSTEM QCSTG3 Purpose: Add MSAS spatial consistency check QC results to QC'ed netCDF obs files. Running times: Every analysis cycle, after SFCVER. dir/file name logical name Contents I/O -------------------------- ----------- --------------------- --- $Q3 CSVPRE 2-char QC CSV file prefix I MAPS_DATA/yydddhh00.srq + STRCLQC current station-rec. QC list I MAPS_PARMS/accept.txt ** ACCEPTIN observation accept list I MAPS_PARMS/reject.txt REJECTIN observation reject list I MAPS_PARMS/sfchqcin.dat SFCHQCIN provider-to-subsource map I MAPS_PARMS/stadic.txt STADIC ASOS station dictionary I MAPS_PARMS/topomini.dat TOPMINI Topography I -------------------------- ----------- ---------------------- --- ${METARDIR} METARDIR/[] QC'ed netCDF obs (not used) I/O MESODIR/[yyyymmdd_hh00] y MESODIR/[] QC'ed netCDF obs I/O MESODIR/[yyyymmdd_hh(-1h)00] MESODIR/[] QC'ed netCDF obs I/O ${SAODIR} SAODIR/[] QC'ed netCDF obs (not used) I/O ${BUOYDIR} BUOYDIR/[] QC'ed netCDF obs (not used) I/O ${PROFDIR} PROFDIR/[] QC'ed netCDF obs (not used) I/O ${GSOSDIR} GSOSDIR/[] QC'ed netCDF obs (not used) I/O -------------------------- ----------- ---------------------- --- CSV_DIR/[utime.pd.msas_qc.pname] xx CSV_DIR/[] current QC'ed CSV obs O OUT/qcstg3.out.yydddhh00 x QCSTG3.OUT standard output O ERR/qcstg3.err.yydddhh00 ++ QCSTG3.ERR standard error O ** MAPS_PARMS : ${MSAS}/fslparms + MAPS_DATA : ${MSAS}/maps_data x OUT : ${MSAS}/output ++ ERR : ${MSAS}/errors y MESODIR : ${MSAS} [- Note that these files are copied to ${MSAS}/qcms_data/mesonet] xx CSV_DIR : ${MSAS}/qcstg3 [- Note that these files are immediately moved to QCMS_DATA/csv] where yydddhh is the year/julian day/hour of current MSAS run, and yyyymmdd_hh is the 4-digit year, month, day, hour of the current run. *DIR represent logical names for the data directories. Filenames (within the brackets) are calculated within the code. The CSV obs files are named: utime.pd.msas_qc.pname, where: utime = formatted Unix time version of $ATIME (e.g., 993480100 --> 945133200) pd = q3 msas_qc = the *.desc file to be used by LDAD processing, pname = data type from LDADinfo.txt of the provider (e.g., "alert_wx") DATA FILES NEEDED BY THE AWIPS BUILD 5.1.1 MSAS SURFACE ASSIMILATION SYSTEM ASOS Purpose: Read the QCOBS files generated in SFCHQC, and generate daily, weekly, and monthly accumulations and summaries of QC statistics. Running times: Once each day, after the 23 UTC run. dir/file name logical name Contents I/O ------------------------------ ------------ --------------------- --- $ATIME MAPTIME 9-char date/time I MAPS_PARMS/asos.ini ** ASOS.INI initialization file I MAPS_PARMS/stadic.txt STADIC station dictionary I MAPS/qc$/qcobs00.dat x QCOBS00 QC file from 00 UTC I MAPS/qc$/qcobs01.dat QCOBS01 QC file from 01 UTC I MAPS/qc$/qcobs02.dat QCOBS02 QC file from 02 UTC I MAPS/qc$/qcobs03.dat QCOBS03 QC file from 03 UTC I MAPS/qc$/qcobs04.dat QCOBS04 QC file from 04 UTC I MAPS/qc$/qcobs05.dat QCOBS05 QC file from 05 UTC I MAPS/qc$/qcobs06.dat QCOBS06 QC file from 06 UTC I MAPS/qc$/qcobs07.dat QCOBS07 QC file from 07 UTC I MAPS/qc$/qcobs08.dat QCOBS08 QC file from 08 UTC I MAPS/qc$/qcobs09.dat QCOBS09 QC file from 09 UTC I MAPS/qc$/qcobs10.dat QCOBS10 QC file from 10 UTC I MAPS/qc$/qcobs11.dat QCOBS11 QC file from 11 UTC I MAPS/qc$/qcobs12.dat QCOBS12 QC file from 12 UTC I MAPS/qc$/qcobs13.dat QCOBS13 QC file from 13 UTC I MAPS/qc$/qcobs14.dat QCOBS14 QC file from 14 UTC I MAPS/qc$/qcobs15.dat QCOBS15 QC file from 15 UTC I MAPS/qc$/qcobs16.dat QCOBS16 QC file from 16 UTC I MAPS/qc$/qcobs17.dat QCOBS17 QC file from 17 UTC I MAPS/qc$/qcobs18.dat QCOBS18 QC file from 18 UTC I MAPS/qc$/qcobs19.dat QCOBS19 QC file from 19 UTC I MAPS/qc$/qcobs20.dat QCOBS20 QC file from 20 UTC I MAPS/qc$/qcobs21.dat QCOBS21 QC file from 21 UTC I MAPS/qc$/qcobs22.dat QCOBS22 QC file from 22 UTC I MAPS/qc$/qcobs23.dat QCOBS23 QC file from 23 UTC I ------------------------------ ------------ ---------------------- --- OUT/qc$/asos.out.yydddhh00 + ASOS.OUT standard output O ERR/asos.err.yydddhh00 * ASOS.ERR standard error O MAPS/qc$/qcday#.dat QCDAY# daily cummulated QC list O MAPS/qc$/daysum#.dat DAYSUM# daily QC summaries file O MAPS/qc$/asos.dat ASOSDAT output listing from asos O At the end of a week: MAPS/qc$/qcday0.dat x QCDAY0 daily QC list, day 0 I MAPS/qc$/qcday1.dat QCDAY1 daily QC list, day 1 I MAPS/qc$/qcday2.dat QCDAY2 daily QC list, day 2 I MAPS/qc$/qcday3.dat QCDAY3 daily QC list, day 3 I MAPS/qc$/qcday4.dat QCDAY4 daily QC list, day 4 I MAPS/qc$/qcday5.dat QCDAY5 daily QC list, day 5 I MAPS/qc$/qcday6.dat QCDAY6 daily QC list, day 6 I ------------------------------ ------------ ---------------------- --- OUT/asos.out.yydddhh00 + ASOS.OUT standard output O ERR/asos.err.yydddhh00 * ASOS.ERR standard error O MAPS/qc$/asos.dat ASOSDAT output listing from asos O MAPS/qc$/qcwk#.dat QCWK# weekly QC listing O MAPS/qc$/wksum#.dat WKSUM# weekly QC summary O At the end of a month: MAPS/qc$/qcwk0.dat QCWK0 weekly QC list, week 0 I MAPS/qc$/qcwk1.dat QCWK1 weekly QC list, week 1 I MAPS/qc$/qcwk2.dat QCWK2 weekly QC list, week 2 I MAPS/qc$/qcwk3.dat QCWK3 weekly QC list, week 3 I ------------------------------ ------------ ---------------------- --- OUT/asos.out.yydddhh00 ASOS.OUT standard output O ERR/asos.err.yydddhh00 ASOS.ERR standard error O MAPS/qc$/asos.dat ASOSDAT output listing from asos O MAPS/qc$/qcmnth.dat QCMNTH "monthly QC" listing O MAPS/qc$/mnthsum.dat MNTHSUM "monthly QC" summaries O ** MAPS_PARMS : ${MSAS}/fslparms + OUT : ${MSAS}/output * ERR : ${MSAS}/errors where yydddhh is the year/julian day/hour of current MSAS run. x MAPS/qc$ files are produced dependent on the settings in the SFCHQCIN input file. "$" is the number of the subsource stratification. # day and week number are determined as follows: day # = MOD((julian day-1),7) week # = MOD(INT((julian day-1)/7),4) DATA FILES NEEDED BY THE AWIPS BUILD 5.1.1 MSAS SURFACE ASSIMILATION SYSTEM QCSTATS Purpose: Read the QC'ed netCDF files generated by QCSTG1_2 & QCSTG3, and generate summary table of the QC results. Running times: Once each day, after the last QCSTG1_2 processing for the 23 UTC run. dir/file name logical name Contents I/O -------------------------- ------------ ---------------------- --- $ATIME QCTIME 9-char date/time I MAPS_PARMS/sfchqcin.dat ** SFCHQCIN provider-to-subsource map I MAPS_PARMS/stadic.txt STADIC ASOS station dictionary I -------------------------- ------------ ---------------------- --- ${METARQC} METARQC/[] QC'ed netCDF obs (not used) I QCMS_DATA/mesonet/[yyyymmdd_*00] xx MESOQC/[] QC'ed netCDF obs I ${SAOQC} SAOQC/[] QC'ed netCDF obs (not used) I ${BUOYQC} BUOYQC/[] QC'ed netCDF obs (not used) I ${PROFQC} PROFQC/[] QC'ed netCDF obs (not used) I ${GSOSQC} GSOSQC/[] QC'ed netCDF obs (not used) I -------------------------- ------------ ---------------------- --- QCMS_DATA/stats/qcstats.yyddd0000 QCSTATS daily QC summary table O OUT/qcstats.out.yyddd0000 x QCSTATS.OUT standard output O ERR/qcstats.err.yyddd0000 ++ QCSTATS.ERR standard error O ** MAPS_PARMS : ${MSAS}/fslparms xx QCMS_DATA : ${MSAS}/qcms_data x OUT : ${MSAS}/output ++ ERR : ${MSAS}/errors where yyddd is the year/julian day of the day being covered, and yyyymmdd is the 4-digit year, month, day, of the day being covered. *QC represent logical names for the data directories. Filenames (within the brackets) are calculated within the code. The * in the netCDF input filenames is used to indicate that all hours (00 through 23) are read in for the day being covered.