In this work we present a set of procedures to achieve an extended air quality Data Base starting from sets of raw data which can be affected by wide gaps due to malfunction of sensors and/or weaknesses in collection software. The focus is on the statistic filling of incomplete time series, after evaluating a short range of methods. In the first step we analyse statistics and substituted undoubtedly abnormal isolated values by means of specific algorithms such as Wilcoxon rank sum test, Box-Jenkins model, trend analysis, regression etc. Then we proceed with missing data filling along time series choosing among linear interpolation, nearest neighbor and spatial averaging algorithms. Standard filling protocols such as those proposed by EPA (Environmental Protection Agency) and by NWS (National Weather Service) have also been considered. In order to enhance data set handling, we also developed an "ad hoc" Data Base and a software tool. This tool aims to manage data porting among different environments (Microsoft Access™ and Mathematica™ EDA), different data forms (lists and matrixes), diverse data fillings and data exportation formats.

Air quality data-base implementation by using time series statistic filling / Latini, G., Passerini, G., Tascini, S.. - 10:(2001), pp. 587-596.

Air quality data-base implementation by using time series statistic filling

Passerini G.;Tascini S.
2001-01-01

Abstract

In this work we present a set of procedures to achieve an extended air quality Data Base starting from sets of raw data which can be affected by wide gaps due to malfunction of sensors and/or weaknesses in collection software. The focus is on the statistic filling of incomplete time series, after evaluating a short range of methods. In the first step we analyse statistics and substituted undoubtedly abnormal isolated values by means of specific algorithms such as Wilcoxon rank sum test, Box-Jenkins model, trend analysis, regression etc. Then we proceed with missing data filling along time series choosing among linear interpolation, nearest neighbor and spatial averaging algorithms. Standard filling protocols such as those proposed by EPA (Environmental Protection Agency) and by NWS (National Weather Service) have also been considered. In order to enhance data set handling, we also developed an "ad hoc" Data Base and a software tool. This tool aims to manage data porting among different environments (Microsoft Access™ and Mathematica™ EDA), different data forms (lists and matrixes), diverse data fillings and data exportation formats.
2001
Advances in Air Pollution
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11566/366164
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? ND
social impact