Publishing data with DALToolKit (images, spectra, catalogues)

Abstract

The scope of this hands on session is to ingest and publish spectra/images according to the SSAP/SIAP standards. Final users will be able to locally create their own database, ingest test FITS files and publish them making use of the software and support we will provide. At the end of the day people who wish to work with their own data will be able to perform the necessary tasks to achieve such result. The session aims to support either people with few spectra/images who plan to create personal services and data center with large amount of data. The session is divided in two parts. The first one consist of the database creation and data ingestion; it will be done using the MEx software from ESO. The second one consist of the server building and service publishing; it will be done using the DALToolKit software from ESA.

The first part of the hands on session is described on the MEx TWiki page here : DcaJune2008ESOMEx

To start the second part of the hands on session, please open the following PDF file and follow the instructions provided : HandsOnSession-DALToolKit.pdf

Hands On Main Steps

• Environment set up
  • Introduction (context & motivations)
  • Demo of existing services (session objective)
  • Environment set up (Tomcat, MySQL... as necessary)
• Server config & testing
  • DALToolKit Server config - params/columns info
  • DALToolKit Server deployment and registration
  • DALToolKit Server testing using VOSpec / Aladin
• Support for participants data
  • Repeat the whole process using participants data with advisors support

Registering your service

The URL of the test Registry for the Workshop : http://vops1.hq.eso.org:8080/registry/

The Aladin version connecting to this Registry can be downloaded here : Aladin

Follow those steps to register your service :

• In the menu on the left click on "1. Submit new resource" under the "Register" section.
• The webpage will prompt you for a username and password. Use the following values : username -> registry / password -> test
• Input a value for the Registry Identifier of your service, for example "my_username_SxAP_service", in the input box called "Formal name ..."
• Select the "virtual observatory service" option in the list and click on "Create this entry".
• Fill in as much information as you wish using the input box and click on "Record this information in the registry"
• Your service is now registered, but some information is still missing. Notably the URL endpoint of the service.
• In the "Actions" column on the resulting page click on "Edit" and then "Edit XML text".
• You should now have a large input text box with the XML representation of your registration.
• Copy/paste the following XML code (select the right one for images or spectra), and paste it right before the last line "".

For Images :

<capability standardID="ivo://ivoa.net/std/SIA" xsi:type="sia:SimpleImageAccess" xmlns:sia="http://www.ivoa.net/xml/SIA/v1.0">
  <interface role="std" xsi:type="vs:ParamHTTP">
    <accessURL use="base">http://localhost:8080/SIAP-v1.0-mex/</accessURL>
    <queryType>GET</queryType>
    <resultType>application/xml+votable</resultType>
  </interface>
  <imageServiceType>Pointed</imageServiceType>
  <maxQueryRegionSize>
    <long>360.0</long>
    <lat>180.0</lat>
  </maxQueryRegionSize>
  <maxImageExtent>
    <long>2</long>
    <lat>2</lat>
  </maxImageExtent>
  <maxImageSize>
    <long>10000</long>
    <lat>10000</lat>
  </maxImageSize>
  <maxFileSize>1000000000</maxFileSize>
  <maxRecords>40000</maxRecords>
</capability>

For Spectra :

<capability standardID="ivo://ivoa.net/std/SSA" xsi:type="ssa:SimpleSpectralAccess" xmlns:ssa="http://www.ivoa.net/xml/SSA/v0.4">
  <interface xsi:type="vs:ParamHTTP">
    <accessURL use="base">http://localhost:8080/SSAP-v0.1-mex/</accessURL>
    <queryType>GET</queryType>
    <resultType>application/xml+votable</resultType>
  </interface>
  <complianceLevel>query</complianceLevel>
  <dataSource>pointed</dataSource>
  <creationType>archival</creationType>
  <maxSearchRadius>360.0</maxSearchRadius>
  <maxRecords>10000</maxRecords>
  <defaultMaxRecords>10000</defaultMaxRecords>
  <maxAperture>180.0</maxAperture>
  <maxFileSize>1000000000</maxFileSize>
</capability>

Before hitting on submit you may wish to change the "accessURL" value from "http://localhost:8080/SxAP-v1.0-mex/" to your real machine hostname, this will allow other participants to access and query your service located on your laptop. To find out what your machine hostname is, simply use the "hostname" command in a terminal window under Linux, MacOSX or Windows XP. Replace "localhost" in the "accessURL" value by the output of the "hostname" command.

External References

• DALToolKit

Advisors (ESA)

• Iñaki Ortiz - Inaki.Ortiz@sciops.esa.int
• Aurélien Stébé - Aurelien.Stebe@sciops.esa.int

Software Requirements

• From workshop requirements
  • Java JDK 1.5
  • Tomcat 5.5
  • MySQL 5.0
  • Apache Ant 1.7
• Workshop MEx - DALToolKit package