MSERRHSA
From EGEE-see WIki
Contents |
Application description
Modelling System for Emergency Response to the Release of Harmful Substances in the Atmosphere
The aim of this application is to develop and deploy, on the SEEGRID-SCI infrastructure, a modeling system for emergency response to the release of harmful substances in the atmosphere, targeted at the SEE and more specifically Balkan region, which would be able to: i) Perform highly accurate and reliable risk analysis and assessment for selected “hot spots”; ii) Provide the national authorities and the international community with short-term regional scale forecast of the propagation of harmful gases; iii) Perform, in an off-line mode, a more detailed and comprehensive analysis of the possible longer-term impacts on the environment and human health in the Balkan region and make the results available to the authorities and the public.
Scientific Impact
- Applying sophysticated meteorological and pollution transport models with high spatial resolution for the very complex terrain of the Balkan Peninsula
- Following the accidentally released toxic gases from local to regional and to European scale, accounting for the mesoscale dynamic phenomena
Social Impact
Better preparedness for emergency situations and mitigation of casualties; formulation of long-term strategic measures and activities for abatement of the caused damages and gradual restoration of the environment
Collaboration
State Agency “Civil Protection” provides information of possible hazardous objects and respective emergency release scenarios, National Meteorological Administration, Romania, Lab. Of Atmospheric Physics, Aristotle University of Thessaloniki, Greece, Hydrometeorological Institute, Albania – data exchange, model tuning and validation, joint exercises
Application on the Grid
Job management The are two main stages of the execution on the grid, plus preprocessing and post-processing operations that are executed at the users’ workstations. The main executables are related to WRF and CCTM. They have been wrapped up in .jdl file and several scripts have been created to enable proper handling of parameters and to offer flexibility for the user to choose the correct scenario. For this application it is important to be able to launch an MPI job with as many CPU as possible as soon as possible.
The developers created tools, written in perl and python, for the bulk job submission.
The UPM tool is being used for monitoring of jobs success and performance tracking.
The application is using established models from the US EPA Models-3 air quality modeling system – WRF, CMAQ, SMOKE, plus some libraries and tools for transforming data into correct format, some of which are developed by the project team. All of these are installed at the environmental VO software area.
Data management
The input files are:
1.input of WRF from NCAR data base
2.the output of WRF is input for the emission model SMOKE and the Chemical Transport Model (CTM) CMAQ
3.the emission input for CMAQ is generated from the TNO emission inventory; toxic gas (chlorine) point source release is added to the emission input
The application input data can be divided into several parts – some of them are more static and some of them vary with the jobs. The total input data is several GB. The output data produced for one run is between 1 and 7 GB depending on the inputs.
The relatively more static parts of the input are installed in the Environmental VO application directory taking < 10 GB. The varying input will be transferred from the storage element and the results will be uploaded to the storage element and registered in the LFC.
The application is using the following set of tools:
1.The emission model SMOKE and own emission processing tools
2.JTS is used for creating standing reservations to ensure fast startup when this is important during the development of the application or during usage of the application for modeling.
3.UPM service is useful for obtaining some performance information for the execution of the application.
Inter-job communication
The application obtains good performance with MPI jobs run on 4, 8 and 16 processors. The limitations of the commodity Ethernet clusters and the shared NFS filesystem make use of more CPUs not advisable.
Information service
The BDII is used for obtaining information about the best available computing resource. The LFC is used for storing data about the location of files on the storage elements. With the gradual increase in obtained data we may evaluate the use of metadata catalogs (AMGA) for better organization of results.
Problem management
The use of DAG jobs has a history of problems and limitations, for instance for the proxy renewal mechanism. In general the proxy renewal mechanism in gLite is not sufficiently stable and that is why the jobs are appropriate scaled to produce result within 24 hours. We also implemented a prioritization policy which allows users of this application to request reservations from the JTS and thus ensure faster startup of their jobs, using the SEE-GRID-SCI dedicated resources. Faster execution of this application can be obtained if more bandwidth can be made available for MPI jobs. In Ethernet based clusters this can be achieved by bonding of network interfaces, but the improvement is limited. In the near future more Infiniband based resources will be available in the infrastructure which will enable much faster completion. The deployment of filesystems with better performance like Lustre will be important for this application’s future development and use.
Presentations
- G. Gadjev, “Multi-scale atmospheric composition modelling for the Balkan region”, a poster of the 4th EGEE User Forum, 2-6 March 2009, Catania, Sicily, Italy;
- K. Ganev, “Background Pollution Forecast over Bulgaria”, GRID&SEA workshop during LSSC’09 Conference, 3-8 June, Sozopol, Bulgaria;
- D. Syrakov, “Climate Change Impact Assessment of Air Pollution Levels in Bulgaria”, GRID&SEA workshop during LSSC’09 Conference, 3-8 June, Sozopol, Bulgaria;
- K. Ganev and Hr. Hristov, “Grid Computing for Air Quality and Environmental Studies in Bulgaria”, 23rd EnviroInfo 2009 Conference - Environmental Informatics and Industrial Environmental Protection: Concepts, Methods and Tools, Berlin, September 9th - 11th 2009.
- K. Ganev and e. Atanassov, “Grid Applications for Air Quality Studies in Bulgaria”, EGEE09 Conference, Workshop “Earth Science Grid Highlights”, 21-25 Sept. 2009;
Papers
- Kostadin Ganev, Dimiter Syrakov, Maria Prodanova, Emanouil Atanasov, Todor Gurov, Aneta Karaivanova, Nikolai Miloshev, 2009, Grid Computing for Air Quality and Environmental Studies in Bulgaria, 23rd EnviroInfo 2009 Conference - Environmental Informatics and Industrial Environmental Protection: Concepts, Methods and Tools, Berlin, September 9th - 11th 2009;
- K. Ganev, D. Syrakov, M. Prodanova, Hr. Hristov, E. Atanasov, T. Gurov, A. Karaivanova, N. Miloshev, Grid Computing for Air Quality and Environmental Studies in Bulgaria, in Proceedings of 23rd EnviroInfo 2009 Conference - Environmental Informatics and Industrial Environmental Protection: Concepts, Methods and Tools, Berlin, September 9th - 11th 2009, (accepted, in press).
- A. Todorova, THE SEE-GRID-SCI project and the development of grid computing for air pollution modeling abilities in BULGARIA (accepted for publishing in the EURASAP Newsletter, Sept 2009, SSN 2070-2582)
- Kostadin Ganev, Dimiter Syrakov, Maria Prodanova, Nikolay Miloshev, Georgi Jordanov, Georgi Gadjev, Angelina Todorova, Atmospheric composition modeling for the Balkan region, SEE-GRID-SCI User Forum, 6-11 December 2009, Istanbul, Turkey, pp. 77-85, ISBN: 978-975-403-510-0.
