Site Map

SET / E-SWDS Data Acquision: Direct Computer-to-Computer Access to Space Weather Data

During the 2007 and 2008 Space Weather Workshop (SWW) meetings, NOAA SWPC met with the Commercial Space Weather Interest Group (CSWIG - an informal organization of industry institutions with a common interest in operational space weather). At those meetings, SWPC and CSWIG agreed that a secure SWPC server could and should be provided to industry for real-time, unfettered access to space weather data in order to serve industry's customers. For the first time, the operations community now has the capability to directly access the full set of SWPC data on a secure server without going through the NOAA public website. In addition, there are more data on the SQL-based SWPC E-SWDS (External - Space Weather Data Store) server than are listed at the NOAA website. The complete list of E-SWDS server data are described in a NOAA SWPC data dictionary, and program information can be found at: ESWDS_Program.pdf. SET does not have an exclusive agreement with SWPC to access the E-SWDS database and the database is also accessible if you want to work directly with SWPC.

SET is a point-of-entry for pass-through data to institutions that do not want to undertake their own E-SWDS server software development. It is non-trivial to access E-SWDS since SWPC requires strict security compliance, and it is necessary for users of E-SWDS to develop and maintain software to access the SQL-server software with parameter-based queries.

Direct Java Servlet access to E-SWDS data is provided through secure SET servers. The Servlet method eliminates the additional overhead of http/ftp-based file read/write operations and permits direct data ingest into software applications without the intermediate file I/O operations. SET develops and maintains servlet software library applications end-users can install on their client computers for direct access to data based on their required data parameters (e.g., sensors, time interval, etc.). This further eliminates the latency of data.

Additionally, SET maintains a wide range of value-added data targeted specifically for end-user applications, saving our customers the considerable overhead of acquiring and processing data from a wide range of institutions employing web-based data access. The figure below illustrates the typical steps and latencies between real-time data and end-user applications.

ESWDS data acquisition

You can view a real-time sample of GOES particle data through our SET/ESWDS portal by clicking here.

If you have an interest in accessing any of these data, let us know. SET's objective is to help our community easily acquire data for operational applications. In that spirit, for SET partners, we are happy to provide access at no charge as long as the data quantity is relatively modest. For non-SET partners or for larger quantities of data, let's negotiate a reasonable charge that can save you the significant costs of software development.