LVV-T2 - LSP-00-00: Verification of the presence of the expected WISE data
| Version | Status | Priority | Verification Type | Critical Event | Owner |
|---|---|---|---|---|---|
| 1 | Approved | Normal | Test | False | Gregory Dubois-Felsmann |
This test will check:
- That the expected tables are present in the database and accessible via the API Aspect and the Portal Aspect;
- That the tables are present with the expected schema as documented in the IPAC- provided WISE documentation;
- That the row counts in the tables are as expected;
- That the tables cover essentially the entire sky, as expected from the characteristics of the WISE mission.
- DMS-LSP-REQ-0001
- DMS-LSP-REQ-0005
Input specification
The test verifies, and therefore requires, the presence of the following WISE tables on the PDAC systems:
- The Source Catalog table from the AllWISE data release;
- The Multi-Epoch Photometry (MEP) table from the AllWISE data release;
- The Single-exposure Source Database from the WISE All-Sky data release (i.e., from the full-cryo 4-band phase of the original mission);
- The Single-exposure Source Database from the WISE 3-Band Cryo data release (i.e.,from the 3-band, inner-cryogen-tank-only phase of the mission);
- The Single-exposure Source Database from the NEOWISE Post-Cryo data release (i.e., from the 2-band warm phase of the mission, pre-hibernation);and
- The Single-exposure Source Database from the NEOWISE Reactivation 2015 data release (i.e., from the first year of the 2-band post-reactivation phase of the mission).
Step 1
Clone the Github lsst/LDM-540 package. Record the SHA1 for the version
of the package to be used. [Additional procedures, e.g., tagging, are
still to be confirmed.]
Step 2
Log host and networking details of the client host to be used. Log the
Web browser version to be used. Log the version of Jupyter to be used.
Step 3
Establish VPN connectivity to the PDAC at NCSA
Step 4
Execute the LDM-540/test_scripts/lsp-00-00.ipynb notebook to perform
the tests listed above against the API Aspect.
Step 5
Preserve any outputs of the script that are in the form of files outside
the notebook.
Step 6
Manually perform, and log, the following steps against the Portal
Aspect:
- Navigate to the PDAC Portal. Log the URL used to do so.
- Navigate to the list of WISE catalogs available. Preserve screen shots as needed to document that the UI offers access to the required catalogs.
- Perform a trivial query against each required catalog to confirm that the UI does in- deed provide access. These queries should match ones in the API Aspect test note- book and will generally be small cone searches around (ra=0, dec=0). Document the query results with screen shots. It is not necessary at this time to exhaustively verify that the Portal provides access to every column of every table; spot checks should be performed and documented. (A later test will perform a full column-by- column verification, once test data more closely matching the final DPDD-driven LSST data products are available.)
LVV-T3 - LSP-00-05: Demonstration of low-volume and/or indexed queries against the WISE data via API
| Version | Status | Priority | Verification Type | Critical Event | Owner |
|---|---|---|---|---|---|
| 1 | Approved | Normal | Test | False | Gregory Dubois-Felsmann |
This test will check that the following low-volume queries can be performed against the WISE catalogs via the API Aspect.
- Small cone searches against the Object-like, ForcedSource-like, and Source-like tables; and
- Searches by exact ID matching against the Object-like, ForcedSource-like, and Source- like tables
The tests will record their performance for comparison against similar
queries in the produc- tion WISE archive at IRSA, and the returned data
will be compared to that for similar queries against the API services
provided by IRSA.
DMS-LSP-REQ-004
Input specification
The test requires, the presence of the following WISE tables on the PDAC
systems:
- The Source Catalog table from the AllWISE data release;
- The Multi-Epoch Photometry (MEP) table from the AllWISE data release;
- The Single-exposure Source Database from the WISE All-Sky data release (i.e., from the full-cryo 4-band phase of the original mission); and
- TheSingle-exposureSourceDatabasefromtheNEOWISEReactivation2015datarelease (i.e., from the first year of the 2-band post-reactivation phase of the mission).
(The 3-band and 2-band Single-exposure Source Database tables from the pre-hibernation mission are not queried in this test case, for the sake of simplicity. These tables are smaller than the two Single-exposure Source Database tables that are included in the test case.)
Step 1
Clone the Github lsst/LDM-540 package. Record the SHA1 for the version
of the package to be used. [Additional procedures, e.g., tagging, are
still to be confirmed.]
Step 2
Log host and networking details of the client host to be used. Log the
Web browser version to be used. Log the version of Jupyter to be used.
Step 3
Establish VPN connectivity to the PDAC at NCSA.
Step 4
Execute the LDM-540/test_scripts/lsp-00-05.ipynb notebook to perform
the tests listed above against the API Aspect.
Step 5
Preserve any outputs of the script that are in the form of files outside
the
notebook.
LVV-T4 - LSP-00-10: Demonstration of table-scan queries against the WISE data via API
| Version | Status | Priority | Verification Type | Critical Event | Owner |
|---|---|---|---|---|---|
| 1 | Approved | Normal | Test | False | Gregory Dubois-Felsmann |
This test exercises a range of table-scan-type queries against the WISE data. Queries shall be performed against the Object-like table, the Forced-Source-like table, and against at least one of the Source-like tables. A range of query result sizes should be exercised, and shall include at least:
- Queries returning a very small amount of data, fewer than 100 rows, and a small subset of columns;
- Queries matching a scaled version of the “low volume” query definition from the Data Access White Paper; and
- Queries matching a scaled version of the “high volume” query definition from the Data Access White Paper.
The scaling of the “low volume” query definition (“50 simultaneous
queries against 10 million objects in the catalog, response 10 sec,
result data set: 0.1 GB”) is based on a assumption that the “against 10
million objects” is applied against the O(20 billion) rows anticipated
in the Object table, and that it contemplates reducing the scope of any
non-indexed portion of the WHERE clause of the query to that fraction of
one in ∼ 2000 of the rows in the table. Scaled to the ∼ 750 million rows
in the WISE Object-like (AllWISE “Source Catalog”) table, this would be
∼ 375,000 rows. Similarly scaling the result set size suggests a
result set of ∼ 3.7 MB.
Successful completion will be evaluated based on the system’s ability to
perform the query at all and to return a result with characteristics
corresponding to plausible estimates or extrap- olations from
scaled-down queries against the IRSA WISE archive. Exact verification
may not be realistic because of the lack of a system capable of
performing the equivalent queries in the production WISE archive.
At a later date it may be possible to attempt equivalent queries using a
non-database sys- tem and verify the exact correspondence of results,
but the non-database system does not presently exist1.
- DMS-LSP-REQ-0028
- DMS-LSP-REQ-0029
Input specification
This test requires the presence of the following WISE tables on the PDAC systems:
- The Source Catalog table from the AllWISE data release;
- The Multi-Epoch Photometry (MEP) table from the AllWISE data release;
The results are assumed to apply to the other tables in the PDAC WISE dataset, all of which are comparable or smaller in size.
Step 1
Clone the Github lsst/LDM-540 package. Record the SHA1 for the version
of the package to be used. [Additional procedures, e.g., tagging, are
still to be confirmed.]
Step 2
Log host and networking details of the client host to be used. Log the
Web browser version to be used. Log the version of Jupyter to be used.
Step 3
Establish VPN connectivity to the PDAC at NCSA.
Step 4
Execute the LDM-540/test_scripts/lsp-00-10.ipynb notebook to perform
the tests listed above against the API Aspect.
Step 5
Preserve any outputs of the script that are in the form of files outside
the
notebook.
LVV-T5 - LSP-00-15: Execution of basic catalog queries in the Portal
| Version | Status | Priority | Verification Type | Critical Event | Owner |
|---|---|---|---|---|---|
| 1 | Approved | Normal | Test | False | Gregory Dubois-Felsmann |
This test will test the functional requirements to be able to perform a range of basic queries through the Portal Aspect of the LSP:
- Cone searches on the Object-like, ForcedSource-like, and Source-like WISE tables; • Multi-target cone searches;
- Form-based searches for exact equality, e.g., for row IDs; and
- Form-based searches for sets of object attributes.
In addition, it tests the ability to download tabular query results from the Portal Aspect.
- DMS-LSP-REQ-0002
- DMS-LSP-REQ-0014
- DMS-PRTL-REQ-0022
- DMS-PRTL-REQ-0021
- DMS-PRTL-REQ-0026
- DMS-PRTL-REQ-0027
- DMS-PRTL-REQ-0028
- DMS-PRTL-REQ-0016
Input specification
The test requires the presence of the following WISE tables on the PDAC systems:
- The Source Catalog table from the AllWISE data release;
- The Multi-Epoch Photometry (MEP) table from the AllWISE data release;
- The Single-exposure Source Database from the WISE All-Sky data release (i.e., from the full-cryo 4-band phase of the original mission);
- TheSingle-exposure Source Database from the NEOWISE Reactivation 2015 data release (i.e., from the first year of the 2-band post-reactivation phase of the mission).
Step 1
Log host and networking details of the client host to be used. Log the
Web browser version to be used.
Step 2
Establish VPN connectivity to the PDAC at NCSA.
Step 3
Manually perform, and log, the following steps against the Portal
Aspect:
- Navigate to the PDAC Portal. Log the URL used to do so.
- Perform a cone search around (ra=0,dec=0), radius 300 arcseconds, in each of the Object-like, ForcedSource-like, and a Source-like catalog. Choose a row from each search and record the primary key value for each for later use. Take screen shots of the search form and of the results of the three searches. Record the wall clock time required for the searches, if long enough to measure.
- Perform a multi-object cone search based on the coordinates in the file LDM-540/test_scripts/lsp-00-15.coords in the Object-like table. Take screen shots of the search form and of the results of the search. Record the wall clock time required for the searches, if long enough to measure.
- Perform a search on each of the Object-like, ForcedSource-like, and Source-like catalogs for the IDs previously saved. Confirm that each search is successful and re- turns the same information as in the original search from which the ID was taken. Perform a search on the ForcedSource-like catalog using the ID from the Object- like catalog. Confirm that a time series of measurements of that object in multiple epochs is returned. Take screen shots of the search forms and of the results of the searches. Record the wall clock time required for the searches, if long enough to measure.
- On each of the Object-like catalog and a Source-like catalog, by performing searches over small regions of sky and exploring the results, choose a set of attributes and search parameters which should select a relatively small number of rows (< 100, 000) when applied to the entire sky. This may require some iterative experimentation at increasingly larger scales. Take screen shots of the final search forms and of the results of the searches. Record the wall clock time required for the searches, if long enough to measure.
LVV-T6 - LSP-00-20: Operation of the UI for interaction with tabular data results
| Version | Status | Priority | Verification Type | Critical Event | Owner |
|---|---|---|---|---|---|
| 1 | Approved | Normal | Test | False | Gregory Dubois-Felsmann |
This test will test the functional requirements to be able to perform certain basic exploratory data analysis functions on tabular data results in the Portal Aspect UI:
- Sort tabular results;
- Filter tabular results based on the contents of columns; • Perform per-row selections from a table;
- Display 1D histograms of selected attributes;
- Display 2D scatter plots of selected attributes;
- Perform graphical selections of rows from plots; and
- Download tabular query results reflecting sorting and selection.
This test does not address the limits of scaling of these capabilities to large query results. That will be addressed in future test specifications. The test report should include notes on the sizes of results that were used.
- DMS-LSP-REQ-0014
- DMS-LSP-REQ-0017
- DMS-PRTL-REQ-0049
- DMS-PRTL-REQ-0053
- DMS-PRTL-REQ-0050
- DMS-PRTL-REQ-0054
- DMS-PRTL-REQ-0055
- DMS-PRTL-REQ-0056
Input specification
The test requires the presence of at least the Source Catalog table from the AllWISE data release.
Step 1
Log host and networking details of the client host to be used. Log the
Web browser version to be used.
Step 2
Establish VPN connectivity to the PDAC at NCSA.
Step 3
Manually perform, and log, the following steps against the Portal
Aspect, recording the time required for a step if it is not trivial:
- Navigate to the PDAC Portal. Log the URL used to do so.
- Perform a cone search around (ra=0,dec=0), of a radius that produces a result of at least 10,000 records. (Note again that this is a functionality test, not a scaling test, however.)
- Download the query result. Log the file type used for the download, and the file types offered. Confirm that the download includes the same number of rows re- ported by the UI. Confirm by sampling at the beginning and end that the sort order of the download and that shown in the UI are the same.
- Exercise sorting of the table, including both numeric and text columns. Download the results of performing a sort of each type. Confirm by sampling that the sort order of the download matches that in the UI.
- Verify using external tools (e.g., Unix command-line utilities) that the sort orders for text and numeric columns are appropriate.
- Exercise filtering of a tabular result based on values of attributes. Confirm that it is possible to download the filtered result. Verify using external tools that the filter was applied as expected, by comparing the filtered download with the original one.
- Perform selections of individual rows in the tabular result. Confirm that it is possi- ble to download only the selected rows.
- Construct a 1D histogram of a numeric attribute. Using the functionality of the UI, sample a few bin values. Verify using external tools that the chosen bin values match those derived from the downloaded data.
- Construct a 2D scatter plot of selected numeric attributes. By inspecting extrema of those attributes in the table, and outlying points in the scatterplot, confirm that the plot appears to contain the expected data. (This is not meant to be an exhaustive test of completeness.)
- Perform a (rectangular) graphical selection from a 2D plot. Record the approximate dimensions of the selection as judged from the display. Record the exact values for the region boundaries reported by the UI. Download the selected data. Verify using external tools that the expected selection was applied.
LVV-T7 - LSP-00-25: Image metadata, image, and image cutout queries
| Version | Status | Priority | Verification Type | Critical Event | Owner |
|---|---|---|---|---|---|
| 1 | Approved | Normal | Test | False | Gregory Dubois-Felsmann |
This test will check basic functionality related to image search and retrieval, via both the API Aspect and the Portal Aspect of the LSST Science Platform:
- Searching for images containing a specified point;
- Displaying selected images;
- Obtaining and displaying image cutouts at a specified point; and • Downloading selected images and image cutouts.
Because of limited staff resources, these tests will be based on the original PDAC dataset, the LSST Summer 2013 processing of the SDSS Stripe 82 data. The image data for the WISE and NEOWISE missions have not been loaded into PDAC.
- DMS-LSP-REQ-0014
- DMS-LSP-REQ-0018
- DMS-PRTL-REQ-0041
- DMS-PRTL-REQ-0040
Input specification
The test requires the presence of the following SDSS data, from the Summer 2013 LSST pro- cessing, in the PDAC systems:
- The catalog of coadded image tiles;
- The catalog of calibrated single-epoch images, including photometric zero points; • The coadded image data; and
- The single-epoch calibrated image data.
Note that a significant fraction of the single-epoch calibrated images are known to have been lost between 2013 and the loading of the data into PDAC. The test report will note where that affects the result.
Step 1
Clone the Github lsst/LDM-540 package. Record the SHA1 for the version
of the package to be used. [Additional procedures, e.g., tagging, are
still to be confirmed.]
Step 2
Log host and networking details of the client host to be used. Log the
Web browser version to be used. Log the version of Jupyter to be used.
Step 3
Establish VPN connectivity to the PDAC at NCSA.
Step 4
**Execute the LDM-540/test_scripts/lsp-00-25.ipynb notebook to perform
the tests listed above against the API Aspect.
Step 5
Preserve any outputs of the script that are in the form of files outside
the notebook.
Step 6
Manually perform, and log, the following steps against the Portal
Aspect:
- Navigate to the PDAC Portal. Log the URL used to do so.
- Perform image queries against the SDSS Stripe 82 coadded and single-epoch image data. These queries should match ones in the API Aspect test notebook. Document the query results with screen shots.
- Download an example of each type of image.
- Using the public SDSS archive, attempt to retrieve corresponding images and visu- ally compare them.
- Perform image cutout requests for 300 × 300 fields at the same targets used in the full-image queries.
- Download the cutouts.
LVV-T8 - LSP-00-30: Linkage of catalog query results with associated images
| Version | Status | Priority | Verification Type | Critical Event | Owner |
|---|---|---|---|---|---|
| 1 | Approved | Normal | Test | False | Gregory Dubois-Felsmann |
This test will check for the ability, in the Portal Aspect of the LSST Science Platform, to match catalog data with the image data on which the measurements were performed, specifically:
- Navigating from a catalog query result to the associated images; and
- Overlaying catalog query results on associated images.
Because of limited staff resources, these tests will be based on the original PDAC dataset, the LSST Summer 2013 processing of the SDSS Stripe 82 data. The image data for the WISE and NEOWISE missions have not been loaded into PDAC.
- DMS-LSP-REQ-0008
- DMS-PRTL-REQ-0004
Input specification
The test requires the presence of the following SDSS data, from the Summer 2013 LSST pro- cessing, in the PDAC systems:
- The coadded source catalog;
- The forced photometry catalog driven from the i-band coadded sources;
- The catalog of coadded image tiles;
- The catalog of calibrated single-epoch images, including photometric zero points; • The coadded image data; and
- The single-epoch calibrated image data.
Note that a significant fraction of the single-epoch calibrated images are known to have been lost between 2013 and the loading of the data into PDAC. The test report will note where that affects the result.
Step 1
Log host and networking details of the client host to be used. Log the
Web browser version to be used.
Step 2
Establish VPN connectivity to the PDAC at NCSA.
Step 3
Manually perform, and log, the following steps against the Portal
Aspect:
- Navigate to the PDAC Portal. Log the URL used to do so.
- Perform a catalog query against the i-band coadded source catalog within the Stripe 82 area.
- Request the time series from the forced photometry catalog for a selected source.
- Confirm that the images associated with the forced photometry measurements are available.
- Document the query results with screen shots.
LVV-T9 - LSP-00-35: Linkage of catalog query results to related catalog data
| Version | Status | Priority | Verification Type | Critical Event | Owner |
|---|---|---|---|---|---|
| 1 | Approved | Normal | Test | False | Gregory Dubois-Felsmann |
This test will check for the ability, in the Portal Aspect of the LSST Science Platform, to match catalog data with related catalog data. Specifically, the test verifies the ability to navigate from a coadded source catalog entry to the associated forced photometry.
- DMS-LSP-REQ-0008
Input specification
The test requires the presence of the following SDSS data, from the Summer 2013 LSST pro- cessing, in the PDAC systems:
- The coadded source catalog; and
- The forced photometry catalog driven from the i-band coadded sources.
Step 1
Log host and networking details of the client host to be used. Log the
Web browser version to be used.
Step 2
Establish VPN connectivity to the PDAC at NCSA.
Step 3
Manually perform, and log, the following steps against the Portal
Aspect:
- Navigate to the PDAC Portal. Log the URL used to do so.
- Perform a catalog query against the i-band coadded source catalog within the Stripe 82 area.
- Request the time series from the forced photometry catalog for a selected source.
- Confirm that the data retrieved corresponds to the selected coadded source.
- Document the query results with screen shots.
Generated with