From nch@roe.ac.uk Fri Aug 22 16:50:52 2008 Date: Fri, 22 Aug 2008 15:20:09 +0100 (BST) From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Mike Read , Mark Holliman , Nigel Hambly , Nicholas Cross , Rob Blake , Ross Collins Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Andy Adamson , Brian Walshe , Jim Emerson , Malcolm Stewart , Lorenzo Rimoldini , Mike Irwin , Peredur Williams , Bob Mann , Stephen Warren Subject: WFAU VDFS Science Archive weekly project meeting minutes, 22/8/8 Minutes of WFAU VDFS Science Archive meeting: 22nd August 2008 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: NCH, RPB, ETWS, RSC, NJC, MAR, PMW, MSH Apologies: JPE, JMS, AL, BCW, RGM, LGR DoNM: 10am, Friday 29th August 2008 in the Vista Hut Actions discharged this week: ----------------------------- ACTION: RPB to test out attaching a normal database as an MS SQL "reporting database" in readonly mode on thutmose/hatshepsut Discharged; RPB noted that a small database served from NAS box takelot as a read-only file (as it happens from a read/write filesystem) can be attached in readonly mode to two separate instances of SQL2005 without any problems, which is good news. ACTION: NCH to assemble all feedback from VISTA PSP PIs concerning survey design in a TWiki page Discharged; NCH (along with contributions from RSC and NJC) has finished off http://apache.roe.ac.uk/twiki/bin/view/WFAU/VSABaselineSchemas and propagated into initial SQL scripts which are now in the SVN. NJC parsed the resulting curation metadata into survey schemas, and a test VSA database is now set up on thutmose. ETWS is running the browser parser on this and the associated scripts to generate survey database browser pages to discuss with the VISTA PS PIs at the September ESO workshop. ACTION: NCH, MAR, RSC, NJC and ETWS to get together Mon 2pm to work Discharged; comprehensive notes thanks to RSC are being maintained at http://apache.roe.ac.uk/twiki/bin/view/WFAU/NonSurveyAutomation Actions partly discharged but continuing: ----------------------------------------- ACTION: RPB to formulate backup plan arising from meeting Continues; RPB has started the TWiki documentation. Actions carried forward from 15/08/08 meeting: ---------------------------------------------- None this week. Specific points and new actions: -------------------------------- Project management: Nothing of note this week. WFCAM & VISTA updates: PMW noted that WFCAM 09A will operate from February to July inclusive, so loadsadata at the same time as VISTA SV and survey start-up... Comments and issues arising from CASU fortnightly minutes: No new minutes this week. Networking: Nothing of note this week. WSA Operations: ETWS noted: - Started updating the browser page parser for the VISTA surveys. - Ingest of the re-processed GPS and UDS data has now finished, but need to be checked. - Finished the 64bit third party software installation on horus. It will run Python 2.5.1 since 2.5.2 has serious memory leaks. RPB noted that a full backup of the WSA will take place this weekend. Hardware MSH noted a tentative date of Sept 4th for start of shifting core IT services from the C1 hot-house to the beautiful new server room; this is very much TBC and contingent on Scottish Power supplying the necessary 13-amp extension leads up Blackford Hill though. RSC noted that disruption to the GPS DR4 release preparations is inevitable... Software: This week NJC has worked with NCH on setting up curation requirements and schemas for VISTA PSPs. NJC has also worked on the non-survey programme builder and fixed the issue with keeping the same pointings when it is rerun with additional data. This will be particularly useful for large VISTA surveys such as VIKING where deep stacks are required. Finally NJC has started working on producing the SynopticSource table - merged bandpasses in a finite defined period for multiple epochs. RSC reported: "Continued working on the integration of all the necessary software components to achieve automated non-survey releases. My latest thoughts are kept in the NonSurveyAutomation TWiki page and an ADASS abstract has been submitted for this work. Assigned CU ID 20 in the WSA to the quality-control of non-survey data, and CU ID 21 now covers general programme setup. Have been working with NJC on implementing the CU6 interface and necessary schema updates. Also helped go over the VSA schema specification with a view to software implications." MAR reported: Worked on non-Survet login session details and forms so as to handle the new way of releasing DBs and their content; tidied up SSS SIAP service which is now in public registry; went back to cosaxp6 migration. Survey Data Release: ETWS noted that the CU1-4 tidy-up of all outstanding odds and sods up to the end of 08A is complete, and once checked the forward curation of the GPS for DR4 phase 2 can take place (to start later this afternoon) MAR noted that UKIDSS DR2 will go world-public on Sept 1st. Non-survey Data Release: NCH emphasised that it would be good to get the new non-survey regime rolled out asap so that it is well out of the way before the VISTA tidal wave hits us. To that end, only DR4 phase-2 (GPS) operations trump this in terms of priorities. Astrogrid deployment & Data Analysis services MSH noted that the new SSS SIAP service has now been placed in the main Astrogrid registry; thanks to MAR for much work on implementing this. MSH also noted that the final release of the AG infrastructure software will take place within a few weeks, and this will be deployed when it arrives. Miscellaneous: RSC & NJC have submitted abstracts for ADAS XVIII. ============================================================= Nigel Hambly Tel: +44-131-668-8234 Institute for Astronomy Fax: +44-131-668-8416 School of Physics and Astronomy University of Edinburgh Email: nch@roe.ac.uk Royal Observatory Blackford Hill Edinburgh EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. =============================================================