 |
| Titel |
The OPeNDAP and Remote NetCDF Invocation (RNI) middleware platform for Scientific Data Fusion |
| VerfasserIn |
P. Fox, S. Zednik, P. West |
| Konferenz |
EGU General Assembly 2009
|
| Medientyp |
Artikel
|
| Sprache |
Englisch
|
| Digitales Dokument |
PDF |
| Erschienen |
In: GRA - Volume 11 (2009) |
| Datensatznummer |
250030942
|
|
|
|
|
|
| Zusammenfassung |
| Across geosciences, there are large data holdings being made available via the D
AP protocol by means of OPeNDAP software. A lot of the underlying data are in th
e NetCDF format. Often, each individual dataset is a combination of hundreds of
individual NetCDF files. Requesting such datasets for analysis is an expensive d
ata fusion transaction, especially as the number and size of datasets increase.
We present a set of solutions that instead request needed portions of the datase
t fused just-in-time. The fusion includes both subsetting and agreggation operat
ions as well as analysis and data manipulation steps. We have modified the NetCD
F C library for Remote NetCDF Invocation (RNI), that is, to operate on remote da
taset, over HTTP, HTTPS or gsiFTP (or any) protocols, individual NetCDF Applicat
ion Programming Interface (API) calls as if they were local. This invocation mod
el also can be applied to OPeNDAP data streams and local files. This mechanism r
esembles the well known Remote Procedure Call (RPC) yet it radically differs on
the binding between local and remote operations. We describe our current approac
h, implementation and benefits obtained from this approach and indicate how it a
ids data fusion. |
|
|
|
|
|
|