From nch@roe.ac.uk Fri Jun 26 15:35:30 2009 Date: Fri, 26 Jun 2009 12:47:54 +0100 (BST) From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Mike Read , Mark Holliman , Nigel Hambly , Nicholas Cross , Rob Blake , Ross Collins Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Andy Adamson , Jim Emerson , Malcolm Stewart , Lorenzo Rimoldini , Mike Irwin , Peredur Williams , Bob Mann , Stephen Warren Subject: WFAU VDFS Science Archive weekly project meeting mins, 26/06/09 Minutes of WFAU VDFS Science Archive meeting: 26th June 2009 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: NCH, MAR, NJC, ETWS, PMW, RPB, RSC Apologies: JPE, JMS, AL, RGM, MSH NB: no meeting next week: DoNM: 10am, Friday July 10th 2009 in the Vista Hut Actions discharged this week: ----------------------------- None this week. Actions partly discharged but continuing: ----------------------------------------- ACTION: ETWS to parse that latest keyword info into the VSA metadata schema files. Continues; this will go ahead using pawprint products following comments in the latest CASU minutes (see below) ACTION: NCH to draft an interface control document for VSA to ESO-SAF Continues; comments on first draft received from AL; NCH asked the team to send comments by close of play today so that we can progress this by the end of June. Actions carried forward from 19/06/09 meeting: ---------------------------------------------- None this week Specific points and new actions: -------------------------------- Project management: Nothing of note this week. WFCAM & VISTA updates: Verbose VISTA update appears in the latest CASU minutes. Comments and issues arising from CASU fortnightly minutes: The team noted the minutes of the meeting of 19th June. ETWS noted that we should check that all local software can handle TAN WCS projections (NJC pointed out that WFCAM mosaics use this so it should be fine); concerning the DR6 timescale, this is totally dependent on how long it takes to fix the deblended, extended flux measures in the WSA ingest database, so no-one is willing to give a date as we have no idea how long that will take... Networking: See notes below concerning possible configuration and/or hardware problem at the WFAU end of the UKLight connection. WSA Operations: ETWS noted: - Ingest of catalogue 08B data will finish today. - The UDS reprocessed data is coming in very slow possibly due to problems with UKLight hardware at our end. - Finished the parsing script to create SQL schemas from VISTA FITS files. The schemas might need to be changed by hand later if tile header information is available. Hardware: RPB noted: "Problems with UK Light. Jonathan said he'd received a new interface card as part of the maintenance contract and installed it. Whilst UK Light is definitely working, it's painfully slow. Linux backups up and working. Currently backed up some data on disk05 and the web stuff on horus as a test case. After some fettling is now working just fine. Will document on the TWiki and instigate a regular backup strategy. Hardware problem with a disk on Ramses2. Rather strange behaviour as the disk claims to have failed but the RAID array doesn't report being degraded. Will investigate further and call in Eclipse if I can't make sense of it." ACTION: RPB to liaise with ITSG over diagnosing and curing a network speed problem at this end. Stop press: IT Support Group warning from HME: "I intend to upgrade the server forge.roe.ac.uk on Monday morning. This hosts the external TWiki and the Software Forge (perhaps more familiar to some as the Trac projects). These services will be unavailable for about half an hour some time between 09:00 and 10:30 on Monday morning. The Trac wikis have to be processed as part of the upgrade, which accounts for the long outage." ... hence SVN unavailability for the period. Software: RSC noted: "The software is now prepared for ingest and forward curation of reprocessed GPS data, apart from the special deprecation of the unfiltered images, which will be incorporated into the software following a successful manual run for this first attempt. Finally got around to updating SVN trunk with all of the bug fixes and enhancements for reprocessed data from release_10. This also includes the last set of enhancements I had made to the automated non-survey curation process to enable the final batch of version 1 releases to be made." NJC noted work on optimising deep stack source extraction procedures. NCH noted that select/execute permissions seem to be wrong on quite a few interface user logins / all public servers / all DBs for the functions/stored procedures, e.g. hatshepsut.PSSA.dbo.fHtmLookUp(), amenhotep.UKIDSSDR3PLUS.dbo.fHtmLookUp() etc. so an audit might be a good idea... ACTION: RPB to check out wsaro/worldro permissions on public survey DBs. Survey Data Release: Thanks to MAR and RPB for making the UKIDSS Science Verification DB available through the user interface at the request of a user at IfA Hawaii. ACTION: NCH to put a UKIDSS SV release note on the web pages with an appropriate health warning. NCH noted no news from Notts regarding the DR5 UDS K stack, other than a tentative suggestion to include 08B data in it. The response from this end was firmly in the negative owing to the likely further heavy delays in release. Regarding the GPS release, survey head Phil Lucas has requested that the interface links to original unfiltered images in the case where those exist for nebular regions. Some discussion ensued, resulting in the suggestion that links are created in the image metadata schema that facilitate this, and MAR agreed to look into bodging the UI. Non-survey Data Release: RSC noted that 08A non-surveys (apart from the few projects requested to be held back by JAC) should now have flat-file products publicly available through the open time database: ACTION: RPB to release (most) 08A open-time flat-file data via the usual procedure. Astrogrid deployment & Data Analysis services: Nothing of note this week. Miscellaneous: Concerning the call for input to the latest NeSC theme of Next Generation Sky Surveys and IT challenges: http://www.nesc.ac.uk/esi/themes/theme_11/ and also http://wiki.esi.ac.uk/NGSS_Kick-Off_Inputs NJC and NCH noted that they will be attending the meeting. ============================================================= Nigel Hambly Tel: +44-131-668-8234 Institute for Astronomy Fax: +44-131-668-8416 School of Physics and Astronomy University of Edinburgh Email: nch@roe.ac.uk Royal Observatory Blackford Hill Edinburgh EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. =============================================================