Thompson IMET Data Quality Control Report
Jennifer Lovell and Shawn R. Smith
World Ocean Circulation Experiment
Surface Meteorological Data Assembly Center
Center for Ocean Atmospheric Prediction Studies
Florida State University
August 21, 2000
Report WOCEMET 00-06
Version 1.0
Introduction:
This report summarizes the quality of surface meteorological data collected by the research vessel Thompson (identifier: WSRY) IMET system during two WOCE cruises beginning 29 October 1995 and ending 28 December 1995. The data were provided to the Florida State University Data Assembly Center (DAC) in electronic format by Bill Martin and were converted to standard DAC netCDF format. The data were then processed using an automated screening program, which added quality control flags to the data, highlighting potential problems. Finally, the Data Quality Evaluator (DQE) reviewed the data and current flags, whereby flags were added, removed, or modified according to the judgement of the DQE and other DAC personnel. Details of the WOCE quality control procedures can be found in Smith et al. (1996). The data quality control report summarizes the flags for the Thompson IMET surface meteorological data, including those added by both the preprocessor and the DQE.
Statistical Information:
The Thompson IMET data are expected to include observations taken every minute on these WOCE cruises. Values for the following variables were collected:
Time |
(TIME) |
Latitude |
(LAT) |
Longitude |
(LON) |
Platform Heading (Gyrocompass) |
(PL_HD) |
Platform Course |
(PL_CRS) |
Platform Speed Over Ground |
(PL_SPD) |
Platform Speed Over Water |
(PL_SPD2) |
Platform Relative Wind Direction (IMET) |
(PL_WDIR) |
Platform Relative Wind Speed (IMET) |
(PL_WSPD) |
Earth Relative Wind Direction (IMET) |
(DIR) |
Earth Relative Wind Speed (IMET) |
(SPD) |
Atmospheric Pressure |
(P) |
Air Temperature |
(T) |
Sea Temperature |
(TS) |
Relative Humidity |
(RH) |
Atmospheric Radiation |
(RAD) |
Rain Rate (mm/min) |
(RRATE) |
Rain Rate 2 (mm/hr) |
(RRATE2) |
Precipitation |
(PRECIP) |
Details of the cruises are listed in Table 1 and include cruise dates, number of records, number of values, number of flags, and total percentage of data flagged. A total of 1,446,246 values were evaluated with 21,360 flags added by both the preprocessor and the DQE resulting in a total of 1.48% of the values being flagged.
Table 1: Statistical Cruise Information
CTC |
Dates |
Number of |
Number of |
Number of |
Percent |
ISS02_/12 ISS02_/13 |
10/29/95 - 11/25/95 11/29/95 - 12/28/95 |
39,598 40,749 |
712,764 733,482 |
6,502 14,858 |
0.91 2.03 |
Summary:
The IMET data from the Thompson proves to be of excellent quality with a total of 1.48% of the reported values being flagged for potential problems. The rain rate (mm/min) were found to be of extremely poor quality and subsequently not included in the public release. The distribution of flags for the remaining variables is detailed in Table 2.
Table 2: Number of Flags and Percentage Flagged for Each Variable
Variable |
B |
G |
J |
K |
S |
Total Number of Flags |
Percentage of Variable Flagged |
TIME LAT LON PL_HD PL_CRS PL_SPD PL_SPD2 PL_WDIR PL_WSPD DIR SPD P T TS RH RAD RRATE2 PRECIP |
1
|
1
|
280
|
2,532 10,122 3,593 3,640
140
|
2 830
16
70 1 1 1 130
|
0 0 0 2 830 0 296 0 0 2,602 10,123 3,594 3,641 130 1 141 0 0 |
0.00 0.00 0.00 0.00* 1.03 0.00 0.37 0.00 0.00 3.24 12.60 4.47 4.53 0.16 0.00* 0.18 0.00 0.00 |
Total Number of Flags |
1 |
1 |
280 |
20,027 |
1,051 |
21,360 |
|
Percent Of All Values Flagged |
0.00* |
0.00* |
0.02 |
1.38 |
0.07 |
1.48 |
*Percentage<0.01
Bounds Flag:
There was 1 B-flag assessed to a value of atmospheric radiation of -0.2 W·m-2 by the preprocessor representing a radiation value of less than 0 W·m-2. This physically unrealistic negative radiation value is likely the result of the instrument not being tuned to low radiation values.
G-Flag:
Only 1G-flag was assessed to relative humidity by the preprocessor. The DQE felt this value was realistic as it was only 3% lower than the given data trend. The flag was left in place to highlight a value that is greater than four standard deviations from the climatological mean (da Silva et al. 1994).
J-Flag:
Platform speed over ground was assigned 280 J flags on the first day of the second cruise, which contains approximately five hours of data. The data were flat lined at 0 m/sec, so the ship was most likely stationary in port. On the following day the data resumed normal operation.
K-Flags:
Nearly all of the 20,027 suspect data flags (K) assigned to atmospheric pressure (P), earth relative wind direction (DIR), earth relative wind speed (SPD), temperature (T), and atmospheric radiation (RAD) were due to signatures of ship motion in the variables. These discontinuous stair steps in the data, related to a change in platform course, heading, and/or speed should not exist in earth relative data and were subsequently flagged as suspect.
Pressure remained fairly consistent with stair stepping occurring throughout the data sets. There were some stair steps in the pressure data that were a result of either a change in forward speed or direction. These stair steps were associated with approximately a 1/2 millibar (mb) decrease in pressure relative to both the forward speed and direction change of the ship. However, there were some stair steps in the pressure data that were not a result of ship motions. These stair steps were related to the ship relative winds and found to increase pressure approximately 1/2 mb when the platform wind direction was from around 0 degrees and were subsequently flagged with the K-flag.
The earth relative wind direction and earth relative wind speed had stair stepping occurring throughout the data sets. The cause was likely due to flow distortion. Flow distortion is the disturbance of airflow from other objects or instruments upstream from the anemometer. The significance of the stair stepping varied throughout the data set; therefore, the earth relative winds should be used with caution.
Temperature had more specific problems. The first of which was due to radiational heating of the ship. When the platform relative wind speed was low, ~3 m/sec or less, significant increases in temperature were occurring during daylight hours. The second problem was ventilation, which occurred when the platform wind direction was from around 180 degrees. This likely affected the flow of the air prior to reaching the bow-mounted thermometer. In these instances, significant increases in temperature were flagged as cautionary.
Deleted Data:
It was determined by the DQE that the rain rate (mm/min) data not be reported in the public release of the data. The rain rate (mm/min) data were inconsistent with the precipitation amounts, so they were deleted.
Spikes:
Isolated spikes occurred in most of the variables throughout the data. Spikes are a relatively common occurrence with automated data, caused by various factors (e.g. electrical interference, ship movement, etc.). These individual points were assigned the S-flag.
References:
Smith, S.R., C. Harvey, and D.M. Legler, 1996: Handbook of Quality Control
da Silva, A.M., C.C. Young and S. Levitus, 1994: Atlas of Surface Marine Data 1994,