JRA1 Commonalities

From EGEE-see WIki

Jump to: navigation, search

Contents

[edit]

Operational Tools

[edit]

BBmSAMeX (BBmSAM Extensions)

  • Status: Production/live
  • Licensing: BSD
  • Summary
    • BBmSAMeX stands for BBmSAM eXtensions and is a collection of extensions to BBmSAM monitoring system. It allows for easier integration and data exchange between BBmSAM portal and different operational tools, application services or any other automated end-point. It was developed in SEE-GRID-SCI project as an operational tool to be used by both human and machine users. Main difference between BBmSAM implementation and standard SAM is in use of free and open source technology as the whole system can be based on PHP, any standard web server and SQL database server.
  • Latest presentations: short, long, demo
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • ((One-paragraph info about origin - whether the software is new or it comes from previous projects (if so, which ones and how it been enhanced in SEE-GRID-SCI)))
    • ((One-paragraph info on how it compares with what has been developed elsewhere))
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
    • ((Description of SEE-GRID sites, applications, communities or end-users))
  • Usage by other projects and communities
    • ((Description of external projects, sites, applications, communities or end-users))
  • Download
  • Source code repository (Restricted)
  • Publications
[edit]

AMS (Alert Messaging Service)

  • Status: Production/live
  • Licensing: LGPL 3+
  • Summary
    • An infrastructural service designed to unify and simplify the process of sending and receiving different kinds of alerts in the grid (or some other) infrastructure. Alerts can be generated by various monitoring tools, ticketing systems etc. and dispatched to site administrators via Jabber/GTalk Instant Messaging, e-mail or some other transport mechanism. Subscriptions to alerts related to infrastructural elements define filtering and aggregation rules in order to avoid excess messages and false positives.
  • Latest presentations: short, long, demo
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • ((One-paragraph info about origin - whether the software is new or it comes from previous projects (if so, which ones and how it been enhanced in SEE-GRID-SCI)))
    • ((One-paragraph info on how it compares with what has been developed elsewhere))
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
    • ((Description of SEE-GRID sites, applications, communities or end-users))
  • Usage by other projects and communities
    • ((Description of external projects, sites, applications, communities or end-users))
  • Download
  • Source code repository
  • Publications
[edit]

GSSVA (Security Assessment Tool)

  • Status: Production/stable
  • Licensing: GPL v2
  • Summary
    • The primary goal of the GSSVA development was to provide accurate (online) status information about the vulnerability/security level of the grid infrastructure. The tool provides a centralized system which is monitoring the grid infrastructure from security point of view. It is using essential grid protocols in order to work on every site without changes in configuration or installing any software.
  • Latest presentations: short long
  • Introductory info and functional overview
  • Architectural description
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
    • ((Description of SEE-GRID sites, applications, communities or end-users))
  • Usage by other projects and communities
    • ((Description of external projects, sites, applications, communities or end-users))
  • Download
  • Source code repository
  • Publications
    • S. Acs, M. Kozlovszky, Z. Balaton, "Automation of Security Analysis for Service Grid Systems", in B.H.V. Topping, P. Iványi, (Editors), "Proceedings of the First International Conference on Parallel, Distributed and Grid Computing for Engineering", Civil-Comp Press, Stirlingshire, UK, Paper 25, 2009. doi:10.4203/ccp.90.25, ISSN 1759-3433.

[1]

[edit]

JTS (Job Track Service)

  • Status: Production/stable
  • Licensing: GPL
  • Summary
    • JTS implements messaging system to allow QoS for jobs, gathering and analysis of performance data and provision of application specific info from central point. Emphasis on MPI and multi-CPU jobs relevant to Environmental VO. It provides enhancements to the current monitoring and accounting system, incorporating performance information and allows provision of QoS by management of batch system reservations.
  • Latest presentations: JTS presentation(bulgarian)
  • Introductory info, functional overview, API & examples
  • Architectural description
  • Relationship with existing products
    • ((One-paragraph info about origin - whether the software is new or it comes from previous projects (if so, which ones and how it been enhanced in SEE-GRID-SCI)))
    • ((One-paragraph info on how it compares with what has been developed elsewhere))
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
    • Environmental VO users
  • Usage by other projects and communities
    • ((Description of external projects, sites, applications, communities or end-users))
  • Download
  • Source code repository
  • Publications
    • ((Publication reference with optional link to the document (if available)))
    • ((Publication reference with optional link to the document (if available)))
[edit]

Logwatch-G (Logwatch Plug-ins for Grid Services)

  • Status: Production/stable
  • Licensing: GPL 3
  • Summary
    • Logwatch for Grid Services is a set of plugins for Logwatch – a customizable log analysis system. Logwatch parses through system log files and creates a report analyzing specified areas for a given period in the past. Default Logwatch installation comes with a set of plugins for reporting on standard Linux services. The goal of this application is to extend Logwatch so that it can parse log files and report on the activity of standard Grid services. It is a tool that can aid both novice and experienced administrators in detecting and resolving problems on their Grid site.
  • Latest presentations: short, long, demo
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • Logwatch-G is an original contribution created in SEE-GRID-SCI project. It is a set of additional scripts for a well known free software log analysis system Logwatch. Logwatch is well known among Linux system administrators as it comes with the default OS installation and creates valuable reports on common system services.
    • To our knowledge no other project or person released Logwatch parsers for Grid services although some might have developed them and use them internally.
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
    • Logwatch-G plugins are currently in use on three Croatian grid sites. RPM package was also added to the SEE-GRID-SCI package repository and announced on the site admin list. There was not much feedback from the site administrators so it is hard to tell now many other sites are using this package.
  • Usage by other projects and communities
    • After the testing within SEE-GRID-SCI community, the package will be announced on the EGEE admin discussion list - LCG-ROLLOUT. Administrators of less common service nodes (VOBOX, WMS, VOMS) might find it interesting and create new or customized plugins.
  • Download
  • Source code repository
  • Publications
    • So far Logwatch-G hasn't been publicized outside of the SEE-GRID-SCI project.
[edit]

NMTT (No Mercy Ticketing System)

  • Status: Production/live
  • Licensing: GPL 3
  • Summary
    • NMTT is an enhancement of Oneorzero help desk application which is currently developed as a part of “OneOrZero Action and Information Management System (AIMS)”, a commercial application, which also includes a time manager, a knowledge base and a report manager. Onerzero has been used since SEE-GRID and SEE-GRID-2 projects, and it was also used in the EGEE, EGEE-2 projects as a regional help desk application which was interfaced with the GGUS system providing for the South-Eastern Europe ROC support system. In the SEE-GRID-SCI project NMTT was developed as a distinct application from Oneorzero, with its own source repository, with the aim to integrate it with monitoring tools in order to automate some operation activities like the creation of tickets for each problem discovered. The solution found was to integrate Nagios with NMTT, and having Nagios to send an email when an operator decides that an alarm should be converted into a ticket.
  • Latest presentations: short
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • ((One-paragraph info about origin - whether the software is new or it comes from previous projects (if so, which ones and how it been enhanced in SEE-GRID-SCI)))
    • ((One-paragraph info on how it compares with what has been developed elsewhere))
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
    • ((Description of SEE-GRID sites, applications, communities or end-users))
  • Usage by other projects and communities
    • ((Description of external projects, sites, applications, communities or end-users))
  • Download
  • Source code repository
  • Publications
    • ((Publication reference with optional link to the document (if available)))
    • ((Publication reference with optional link to the document (if available)))
[edit]

USGIME (User/application specific grid infrastructure monitoring extension of P-GRADE Portal)

  • Status: Production/stable
  • Licensing: GPL 3
  • Summary
    • The intensive usage of the grid infrastructure confronts the user with the difficulties inherent in all highly distributed and connected systems: with the mystical, not predictable errors due to the dynamic availability of the underlying infrastructure. In our experience the availability of subsystems relating with the handling of remote (or grid) files is exceptionally critical and acts as source of frequent troubles and vast amount of user complaints. In remote file handling two special critical use cases have been pinpointed, the first is when the Portal server (acting as UIF machine) creates a remote file, the second case when a Computing Element wants to use a Remote File whose file replicas are placed on far located Storage Element(s). Tests have been prefabricated to test and monitor these cases and provide status information about grid infrastructure elements for end users. USGIME development in P-GRADE Portal can be used to manage user and application specific grid infrastructure tests by the end users.
  • Latest presentations: short demo
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • This is a totally new feature extension of the P-GRADE Portal Framework.
    • There are numerous SFTs used for infrastructure monitoring, however this tool is checking the infrastructure from end-user point of view.
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
    • NMMC3D application
  • Usage by other projects and communities
    • P-GRADE Portal User community (up to 14 running instances worldwide)
  • Download
  • P-GRADE Portal /USGIME/ Source code repository
  • Publications
    • A. Balasko,S. Acs, M. Kozlovszky; User/application specific grid infrastructure monitoring extension of P-GRADE Portal, SEE-GRID-SCI User Forum 2009, Istanbul, Turkey
[edit]

Application Services

[edit]

AWT (Advanced-Workflow Development Tool and Orchestration Service)

  • Status: Alpha
  • Licensing: Apache License
  • Summary
    • One of the more advanced usages of the Grid is by using workflows of jobs. Applications that can be divided into several independent jobs that can be arranged in a workflow, are easily gridified with no special modifications. Current gLite workflow services allow the usage of workflows, but experience limitations and are not stable. AWT enables Grid execution of more complex workflows written in GWorkflowDL with more reliability. By more complex it means that workflows can now contain loops and choices structures. This will make the grid programming closer to the application developers since it is closer to today’s programming languages. To make workflow execution more reliable, the service will enable verification of the workflow using advanced workflow verification techniques and also use advanced scheduling techniques for faster and reliable execution.
  • Latest presentations: short, long, demo
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • The service was developed as a reengineering of the already existing pilot CPPWfMS project developed under the EGEE-II. The new implementation is implemented entirely in Java, uses web services for communication with other Grid services and is very easily extensible.
  • User documentation

Application service user documentation is not provided yet. On the other hand documentation regarding the user specification language can be found on the GWorkflowDL homepage: GWorkflowDL

  • Usage within SEE-GRID infrastructure and communities
    • MDSSP-WA application
  • Usage by other projects and communities
    • None so far
  • Download
  • Source code repository
  • Publications

[1] B. Jakimovski, D. Cerepnalkoski, G. Velinov: Framework for Workflow Gridication of Genetic Algorithms in Java. International Conference in Computer Science - ICCS 2008, Part III, LNCS 5103, Krakow, Poland, June 23-25, 2008, pp 463-470, ISBN 978-3-540-69388-8

[2] G. Velinov, B. Jakimovski, D. Cerepnalkoski, M. Kon-Popovska: Improvement of Data Warehouse Optimization Process by Workflow Gridification. Advances in Databases and Information Systems – ADBIS 2008 LNCS 5207/2008, Pori, Finland, September 5-9, 2008, pp 295-304, ISBN 978-3-540-85712-9

[3] D. Sahpaski, G. Velinov, B. Jakimovski, M. Kon-Popovska: Dynamic Optimization and Evolution of Data Warehouse Design. Proceedings of the 4th Balkan Conference in Informatics, IEEE BCI’09 , Thessaloniki, Greece, September 2009.

[4] B. Jakimovski, D. Sahpaski, G. Velinov: Performance Improvement of Genetic Algorithms by Adaptive Grid Workflows. Proceedings of the 11th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing, Timisoara, Romania, September 26-29, 2009 (in print)

[5] B. Jakimovski, D. Sahpaski, G. Velinov: Optimization of Adaptive Petri-Net Grid Genetic Algorithm. Proceedings of the 1st International Conference ICT Innovations 2009. Ohrid, Macedonia, September 28-29, 2009, Springer, pp. 401-410.

[6] Lj. Jordanovski, B. Jakimovski, A. Misev: Massively parallel Seismic Data Wavelet Processing Using Advanced Grid Workflows. Proceedings of the 1st International Conference ICT Innovations 2009, Ohrid, Macedonia, September 28-29, 2009, Springer, pp 411-419.

[edit]

CWRE (Common Workflow Repository Extension of P-GRADE Portal)

  • Status: Production/stable
  • Licensing: GPL 3
  • Summary
    • The previous versions of the P-GRADE Portal support the creation, management, and execution of application workflows from a user’s Portal storage space. What were lacking in all the previous implementations were the ability for users to share application workflows to help facilitate information dissemination and collaborative development. To provide this desired functionality, a general usable workflow repository system extension (CWRE) was proposed for development into the P-GRADE Portal. After analyzing various existing repository technologies, DSpace was chosen as the best candidate for integration with the P-GRADE Portal. In order to determine how the Workflow Repository connector extension for the P-GRADE Portal should be implemented, we took several steps in examining what key features were required by Portal users, how those users would interact with the repository, and how the system should be designed to behave accordingly. From those requirements we developed several use case and sequence diagrams. Finally we considered what design should be used in our implementation and done successfully the implementation. The common workflow repository can be used as a shared web space to store applications developed by the focused communities and also specific grid infrastructure tests coming from P-GRADE Portal’s user/application specific grid infrastructure monitoring extension. The developed, ready-to use workflows can be placed in the repository by grid application developers and can be used by the other P-GRADE Portal users. It builds up from the following main components: DSPACE VIEW PORTLET, DOWNLOAD PORTLET and UPLOAD PORTLET.
  • Latest presentations: long
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • This is a completely new feature extension development of the P-GARDE Portal.
  • User documentation
  • The developed feature is included into the main P-GRADE source tree as a feature extension. The P-GRADE Portal is used with up to 14 running instances worldwide.
    • NMMC3D application
  • The repository mostly contains best practices, training and demo workflows.
    • ((Description of external projects, sites, applications, communities or end-users))
  • Download
  • Source code repository
[edit]

DM-Web (Data Management Web Portal)

  • Status: Production/stable
  • Licensing: LGPL 3+
  • Summary
    • A portal that enables easy interaction with grid file catalog using a simple web-based interface is described. The portal provides a simple data management solution for applications and their users which can be reused by application developers with minimal effort. It offers the ability to manipulate the files present in grid storage elements and registered in a LFC catalog by providing directory browsing and management, upload of new files to the catalog, file retrieval, deletion, replica management, and management of file attributes, permission and aliases. Portal appearance and the set of allowed operations can be customized by using application-specific configuration files, the way it was done for WRF-ARW and REFS applications.
  • Latest presentations: short, long, demo
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • ((One-paragraph info about origin - whether the software is new or it comes from previous projects (if so, which ones and how it been enhanced in SEE-GRID-SCI)))
    • ((One-paragraph info on how it compares with what has been developed elsewhere))
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
    • WRF-ARW application
    • REFS application
  • Usage by other projects and communities
    • ((Description of external projects, sites, applications, communities or end-users))
  • Download (src, bin & examples)
  • Source code repository
  • Publications
    • Dragan Okiljevic, Branko Marovic, Web portal za upravljanje datotekama na grid-u," Proc. of 6th Symposium of Industrial Electronics - INDEL 2006, Banja Luka, Bosnia and Herzegovina, 10-11.11.2006., pp. 288-293, also in English as "Grid Data Management Web Portal" in Electronics, journal of the Faculty of Electrical Engineering, University of Banja Luka, Bosnia and Herzegovina.
    • Branko Marovic, Milan Potocnik, Dragan Okiljevic, Jovan Oklobdžija, DM-Web - Web access and management of application-specific files in LFC catalog, SEE-GRID-SCI USER FORUM 2009, Bogazici University, Istanbul, Turkey, December 9-10, 2009
[edit]

ESIP Platform (Environment oriented Satellite Data Processing Platform )

  • Status: Production/live
  • Licensing: GPL 3
  • Summary
    • The ESIP platform supports the development and the execution of the Grid based applications concerning particularly with the processing of satellite images and generally with environmental related processing and studies. ESIP is based on the gProcess platform which is an interactive toolset supporting the flexible description, instantiation, scheduling and execution of the Grid processing. The gProcess platform is a collection of Grid services and tools providing the following basic functionality: visual manipulation based interactive description of the Grid based satellite image processing by pattern workflow like directed acyclic graph (DAG); development of hypergraphs as complex composition of basic operators, Grid and Web services, and subgraphs; pattern workflow instantiation for particular satellite image, satellite data management, access and visualization; workflow based Grid execution; process execution control and visualization. ESIP layers on gProcess a set of Web and Grid services, and image oriented basic operators such as, radiometric, spatial domain, edge and line detection, pseudo colouring. A few Multispectral Imagery Operators has been experimented as well, such as Vegetation indices: DVI, NDVI, NDVI, IPVI, RVI, OSAVI, GEMI; Water indices: NDWI, VWC, WI; Nonlinear interpolation; and Change detection.
  • Latest presentations: short, long, demo
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • ((One-paragraph info about origin - whether the software is new or it comes from previous projects (if so, which ones and how it been enhanced in SEE-GRID-SCI)))
    • ((One-paragraph info on how it compares with what has been developed elsewhere))
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
  • Usage by other projects and communities
    • Endorsed by RESPECT program since April 2010.
  • Download
  • Source code repository
  • Publications

[1] Gorgan, D., Stefanut, T., Bacu, V., Mihon, D., “Grid based Environment Application Development Methodology”, SCICOM09 - 7th International Conference on "Large-Scale Scientific Computations", 4-8 June, Sozopol, Bulgaria, ISBN 978-3-642-12534-8, pp. 499-506

[2] Legrand I., Voicu R., Cirstoiu C., Grigoras C., Betev L., and Costan A., “Monitoring and control of large systems with monalisa,” Commun. ACM, vol. 52, no. 9, pp. 49–55, (2009).

[3] Petcu D., Zaharie D., Neagul M., Panica S., Frincu M., Gorgan D., Stefanut T., Bacu V., Remote Sensed Image Processing on Grids for Training in Earth Observation. Chapter in the book “Image Processing”, Yung-Sheng Chen (Ed.), Published by INTECH, ISBN 978-953-307-026-1, pp. 115-140, (2009)

[4] Gorgan D., Bacu V., Rodila D., Pop Fl., Petcu D., "Experiments on ESIP - Environment oriented Satellite Data Processing Platform". SEE-GRID-SCI User Forum, Bogazici University, Istanbul, Turkey, December 9-10, ISBN: 978-975-403-510-0, pp. 157-166, (2009)

[5] Mihon D., Bacu V., Gorgan D., Mészáros R., Gelybó G., "Practical Considerations on the GreenView Application Development and Execution over SEE-GRID". SEE-GRID-SCI User Forum, Bogazici University, Istanbul, Turkey, December 9-10, ISBN: 978-975-403-510-0, pp. 167-175, (2009)

[6] Gorgan D., Bacu V., "ESIP and gProcess based Grid Environment Application Development Methodology". Environmental VO Training at the SEE-GRID-SCI Training, Bogazici University, Istanbul, Turkey, (2009).

[7] Gorgan D., Bacu V., Stefanut T., Rodila D., “ESIP Environment Oriented Satellite Image Processing Platform”. Presentation to the SEE-GRID-SCI PSC-05, Dubrovnik, 9-11 Sept (2009)

[8] Gorgan D., Mihon D., Bacu V., “GreenView - Refinement of surface and vegetation parameters in SEE region based on satellite images”. Presentation at the SEE-GRID-SCI PSC-05, Dubrovnik, 9-11 Sept (2009)

[9] Gorgan D., "Earth Science Application Development Methodology by ESIP and gProcess Platforms". Presented at the workshop "Federation and interoperability of Earth Science Digital Repositories: data discovery, access and visualization". Conference EGEE'09 - Uniting our strengths to realise a sustainable European grid, 21-25 Sept, Barcelona (2009)

[10] Rodila D., Bacu V., Gorgan D., Semantic Annotation based Service Composition for Grid Workflow Description and Execution. SYNASC Symposium, 26-29, September 2009, Timisoara, pp. 245-253, ISBN 978-0-7695-3964-5

[11] Mihon D., Bacu V., Stefanut T., Gorgan D., Grid Based Environment Application Development – GreenView Application. Proceedings of ICCP2009 - IEEE 5th International Conference on Intelligent Computer Communication and Processing, 27-29 Aug, 2009 Cluj-Napoca. ISBN: 978-1-4244-5007-7, pp. 275-282 (2009).

[12] Rodila D., Bacu V., Gorgan D., Integration of Satellite Image Operators as Workflows in the gProcess Application. Proceedings of ICCP2009 - IEEE 5th International Conference on Intelligent Computer Communication and Processing, 27-29 Aug, 2009 Cluj-Napoca. ISBN: 978-1-4244-5007-7, pp. 355-358 (2009).

[13] Gorgan D., Bacu V., Stefanut T., Rodila D., Mihon D., Grid based Satellite Image Processing Platform for Earth Observation Applications Development. IDAACS'2009 - IEEE Fifth International Workshop on "Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications", 21-23 September, Cosenza, Italy, IEEE Published in Computer Press, ISBN 978-1-4244-4901-9, 247-252 (2009).

[14] Gorgan D., Bacu V., Stefanut T., Rodila D., Petcu D., Grid based Satellite Data Processing Platform in Earth Observation, 4th GRID & e-Collaboration Workshop – Digital Repositories, 25-26 Feb 2009, ESA/ESRIN Frascati, Italy, http://www.congrex.nl/08M16/ (2009).

[15] Gorgan D., Bacu V., Neagu G., Petcu D., Pop F., ESIP - Grid based Satellite Data Processing Platform. 4th EGEE User Forum, 2-6 March 2009, Catania, Sicily, Italy, http://egee-uf4.eu-egee.org/ (2009).

[16] Bacu V., Stefanut T., Rodila D., Gorgan D., Process Description Graph Composition by gProcess Platform. HiPerGRID - 3rd International Workshop on High Performance Grid Middleware, 28 May, Bucharest. Proceedings of CSCS-17 Conference, Vol.2., ISSN 2066-4451, pp. 423-430, (2009).

[17] Gorgan D., Environment VO - GreenView and ESIP. Presentation to "SEE-Grid-SCI: Environmental VO training in Cluj-Napoca”, 13 Jan 2009, Cluj-Napoca, http://seegrid3.lpds.sztaki.hu/indico/ (2009).

[18] Pop F., Cristea V., Gorgan D., Neagu G., Improvements of ESIP performance using scheduling algorithms based on monitoring information from the SEE-GRID platform, SEE-GRID-SCI User Forum, Bogazici University, Istanbul, Turkey, December 9-10, ISBN: 978-975-403-510-0

[edit]

Event Logger

  • Status: Production/stable
  • Licensing: LGPL 3+
  • Summary
    • Event Logger allows application users and developers to record and analyze arbitrary events generated by using the command line, RMI or web service. It supports simultaneous events from various domains, but its primary targets are grid applications and network management. Recorded events are assessed from a web-based front-end with optional grouping and statistical analysis of results. In the case of a continuous logging, old events can be aggregated.
  • Latest presentations: short, long, demo
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • ((One-paragraph info about origin - whether the software is new or it comes from previous projects (if so, which ones and how it been enhanced in SEE-GRID-SCI)))
    • ((One-paragraph info on how it compares with what has been developed elsewhere))
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
    • Work Binder application service used by several applications
    • VIVE application
    • ((Description of SEE-GRID sites, applications, communities or end-users))
  • Usage by other projects and communities
    • ((Description of external projects, sites, applications, communities or end-users))
  • Download
  • Source code repository
  • Publications
    • Branko Marovic, Milan Potocnik, Event Logger – A solution for tracking and analysis of application-generated events, SEE-GRID-SCI USER FORUM 2009, Bogazici University, Istanbul, Turkey, December 9-10, 2009
[edit]

FM-J-API (SEE-GRID File Management Java API)

  • Status: Production/stable
  • Licensing: LGPL 3+
  • Summary
    • A data management Java API supporting GRID file management. It supports most of data and logical file management operations available in gLite environment through LFC and lcg-utils C APIs. It also supports managing sets of files and replicas within the LFC Catalogue. FM-J-API provides the grid infrastructure an effective way to implement file manipulation on the grid for any application using the simple API functions within their code, making grid file usage cleaner and easier to maintain.
[edit]

MEWS (Mathematical Expressions Web Service)

  • Status: Production/stable
  • Licensing: BSD
  • Summary
    • ((One-paragraph short description containing the most relevant search keywords))
  • Latest presentations: short, long, demo
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • (MEWS is Web service for calculation of mathematical expressions. This service is intended for users who require massive processing of mathematical expressions, which mainly use the Windows operating system, and who are not familiar with programming of applications for the grid. The service is designed to facilitate the calculation of the most common mathematical operations that work with the matrix (like calculation of matrix eigenvalues).
    • This service should be a bridge between these users and library for parallel computation PETSc.
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
    • -
  • Usage by other projects and communities:
    • AEGIS05-ETFBG, student's projects, students attending concurrent and distributed programming course
  • Download:
  • Source code repository
  • Publications
    • -
[edit]

RAS (Rendering Application Service)

  • Status: Beta
  • Licensing: GPL v3, LGPL v3, some included parts may use Creative Commons license
  • Summary
    • RAS is a generic infrastructure grid service for rendering animations and visualization in science. The main aim of the service is to help users to animate and visualize its applications output results. RAS uses fast animation rendering at the grid infrastructure based on POV-Ray (Persistence of Vision Ray-Tracer) with the ability to produce output in a user defined specific format. One of the goals of the service is to reduce the necessary grid knowledge on users‘ part to minumum by reducing the number of commnads needed to operate.
  • Latest presentations: short, long, demo
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • ((One-paragraph info about origin - whether the software is new or it comes from previous projects (if so, which ones and how it been enhanced in SEE-GRID-SCI)))
    • ((One-paragraph info on how it compares with what has been developed elsewhere))
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
  • Usage by other projects and communities
    • Magnetic fields, forces and electric engine flows visualisation (Faculty of Graphic Arts, University of Zagreb)
  • Download
    • Source code for core RAS service is freely available and it's in process of uploading to SEE-GRID-SCI SVN-Trac Repository. Source code include Povray binaries and scripts for submitting jobs and collecting data from grid including examples of grid usage.
  • Source code repository
    • Service will be available at the EGEE-SEE/SEE-GRID-SCI SVN-Trac Repository . RAS source code is still in development version, although user can use existing source code but have to define their input povray file scene manually.
  • Publications
    • ((Publication reference with optional link to the document (if available)))
    • ((Publication reference with optional link to the document (if available)))
[edit]

SDSAS (SDS (Seismic Data Server) Applications Service)

  • Status: Production/live
  • Licensing: LGPL 3
  • Summary
    • SDSAS consists of: (i) scripts to collect and to organize the seismic data by utilizing storage elements, LFC and metadata catalogue AMGA, (ii) VO C++ iterators that could be used by applications to access station data, earthquake data and information about seismic waveform files collected from regional SEE countries and (iii) a client interface (plug-in) in the form of C++ iterators to interface to comprehensive European seismology data from the ORFEUS datacenter. The interface for the ORFEUS data is developed using the web services provided by the NERIES project.
  • Latest presentations: short, long, demo
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • ((One-paragraph info about origin - whether the software is new or it comes from previous projects (if so, which ones and how it been enhanced in SEE-GRID-SCI)))
    • ((One-paragraph info on how it compares with what has been developed elsewhere))
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
    • ELF application
    • FPS application
    • MDSSP-WA application
    • SRA application
  • Usage by other projects and communities
    • ((Description of external projects, sites, applications, communities or end-users))
  • SDSAS Download, NERIES Client Download
  • Source code repository
  • Publications
    • C. Ozturan., B. Bektas, M. Yilmazer,C. Sener, Challenges Faced in Building A Seismology VO for Southeastern Europe, e-Challenges Conference, Istanbul, Oct. 21-23 2009.
    • C.Ozturan, C. Sener M.Y,L. Jordanovski, B.Sule, Grid Based Virtual Organization for Seismology in South Eastern Europe, EMSC Newsletter, Dec. 2009.
    • C.Ozturan B. Bektas, M. Yilmazer, Seismic Data Server Application Service and Web Interface See-Grid-Sci User Forum, Istanbul, Dec. 8-9, 2009.
[edit]

ULMON (User Level Monitoring Tool)

  • Status: Production/live
  • Licensing: Apache License
  • Summary
    • ULMON tool enables users to get deeper understanding of their jobs’ lifetime and workflow. Also, using the tool they could have their own perspective on the underlying infrastructure and select only the sites that performed best for them in the past. The job view gives the users much more information about their job submissions than the usual command line tools. Each of the presented statistics goes beyond the usual way of presenting the data to the users. Using it, they feel much more comfortable to use the infrastructure.
  • Latest presentations: short,long, demo
  • Introductory info and functional overview
  • Architectural description
  • Relationship with existing products
    • ULMON is a new software, developed in collaboration with IPP BAS.
    • Most of the other monitoring tools are focused on the infrastructure itself, unlike ULMON, which is user oriented.
  • User documentation
  • Usage within SEE-GRID infrastructure and communities
    • The tool is currently used to monitor jobs submitted through grid-wms.ii.edu.mk
    • The tool is used by the MDSSP-WA application
  • Usage by other projects and communities
    • ((Description of external projects, sites, applications, communities or end-users))
  • Download
  • Source code repository
  • Publications
    • A. Misev, E. Atanassov: ULMon - Grid Monitoring from User Point of View, Proceedings of the 31st international conference ITI 2009, June 22-25, 2009, Cavtat/Dubrovnik, Croatia, pp. 621-626.
    • A. Misev and E. Atanassov: Performance Analysis of GRID Middleware Using Process Mining, Proceedings of the 8th International Conference ICCS 2008, Kraków, Poland, June 23-25, 2008, Part I Series: Lecture Notes in Computer Science , Vol. 5101, pp.203-214.
    • A. Misev and E. Atanassov: User Level Grid Quality of Service, Proceeding of the 7th International Conference on "Large-Scale Scientific Computations", June 4-8, 2009, Sozopol, LCNS (in print)
[edit]

Work Binder

  • Status: Production/stable
  • Licensing: LGPL 3+
  • Summary
    • A generic infrastructural grid service for submission, management, and access to computing resources and usage by applications is described. This service is suitable for interactive applications, dynamic workflows and other applications that repeatedly use many short jobs. A set of APIs facilitates communication between clients and worker jobs by providing a simple programming model through which clients can easily and quickly allocate worker jobs and communicate with them. Access to computing resources is accelerated by maintaining a pool of ready jobs, whose size is dynamically adjusted to demand produced by applications.
  • Usage within SEE-GRID infrastructure and communities
  • Usage by other projects and communities
    • Endorsed by RESPECT program since March 2010.
  • Download
  • Source code repository
  • Publications
    • Branko Marovic, Milan Potocnik, Milos Ivanovic, "Work Binder Application Service," EGEE User Forum/OGF25 & OGF Europe's 2nd International Event, March 2-6, 2009, Catania, Italy, http://indico.cern.ch/contributionDisplay.py?contribId=44&sessionId=8&confId=40435
    • Branko Marovic, Milan Potocnik, Work Binder - a service for quick access and communication with jobs, SEE-GRID-SCI USER FORUM 2009, Bogazici University, Istanbul, Turkey, December 9-10, 2009
    • Branko Marovic, Milan Potocnik, Branislav Cukanovic, Multi-application bag of jobs for interactive and on-demand computing, Scalable Computing: Practice and Experience - Scientific International Journal for Parallel and Distributed Computing (SCPE), Volume 10, no. 4, December 2009, http://www.scpe.org/?a=volume&v=42
Retrieved from "http://wiki.egee-see.org/index.php/JRA1_Commonalities"
Personal tools