Distributed Query Processing

We aim to develop tools for integrating heterogeneous data, including relational, XML and Web data sources. As part of this project, the OGSA-DQP service-based distributed query processor, which was developed as part of the OGSA-DAI UK e-Science project, has been extended to work with OGSA-WebDB and XML data sources.

A source release of the extensions is available here. The extensions are compatible with OGSA-DAI 3.0 Axis. You will need a working installation of OGSA-DQP 3.2.1 onto which the extensions can be applied.

Overview

The following two tools for providing data integration for e-Science applications are extended:

OGSA-DAI (OGSA Data Access & Integration):

  • Service-based Grid computing middleware.
  • Built on OGSA 窶 the Open Grid Services Architecture
  • Wraps various relational and XML databases.
  • A way of securely exposing data via Web services.

OGSA-DQP (OGSA distributed query processor):

  • Provides integration in the form of a distributed query processor.
  • Uses OGSA-DAI wrappers.
  • Also integrates analysis by invoking Web services.
  • Declarative interface based on SQL.
  • Other benefits include parallelism during query execution.

The extensions to OGSA-DQP:

  • Provide support for querying Web-accessible databases.
  • Provide support for XML data though extensions to the query language and evaluation infrastructure

Architecture

The extended system is able to integrate OGSA-WebDB-wrapped databases, OGSA-DAI-wrapped relational/XML databases and analysis (Web) services.

dqpx1.jpg

Future Plans

  • Modify the query compiler to support a move expressive query language.
  • Address performance issues by (i) investigating alternative query optimisation strategies, (ii) improving the efficiency of query evaluation infrastructure, in particular where data is fetched from OGSA-DAI and OGSA-WebDB.

Links

Acknowledgements

This work was made possible by the support of the Japan Society for the Promotion of Science (JSPS).


Attach file: filedqpx1.jpg 372 download [Information]

Front page   Edit Diff Backup Upload Copy Rename Reload   New List of pages Search Recent changes   Help   RSS of recent changes
Last-modified: 2009-01-06 (Tue) 11:16:26 (605d)