From nch@roe.ac.uk Fri Jul 22 12:51:55 2005 Date: Fri, 22 Jul 2005 12:41:32 +0100 (BST) From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Mike Read , Nigel Hambly , Nicholas Cross , Bob Mann Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Andy Adamson , John Taylor , Jim Emerson , Malcolm Stewart , Martin Hill , Mike Irwin , Peredur Williams , Stephen Warren Subject: WFAU WSA weekly meeting minutes: 22 July 2005 Minutes of WFCAM Science Archive meeting: 22nd July 2005 ------------------------------------------------------------- ------------------------------------------------------------- Present: NCH, PMW, ETWS, NJC, RGM Apologies: MCH, JPE, JDT, AL, JMS, MAR DONM: 10am, Friday 29th July 2005, plate library Actions discharged: ------------------- ACTION: PMW & NCH to meet sometime next week to assemble the Q3 plan. Discharged; see Project Management below. ACTION: PMW to order new file node "khufu": as per sneferu, but 24 bay rather than 16. Discharged; new kit ordered. ACTION: NJC to examine photometric recalibration data schema and SQL required to service CU8 applications. Discharged; NJC is now editing the calibration schemas. ACTION: ETWS to communicate details of the handful of FITS catalogues that have caused archive indegestion. Discharged; awaiting response from Cambridge. ACTION: NJC to liaise with STH on any WFCAM calibration meeting. Discharged; NJC now in the loop. Actions partly discharged but continuing: ----------------------------------------- ACTION: PMW to initiate removal of old hardware from C1 by communicating with all concerned parties (JNTD, HMG, RL, ...) Meeting with HMG took place and agreement reached on relocation of cabinets in SuperCOSMOS computer room. PMW hopes to instigate storage cab removal next week; Eclipse will then be called in to relocate the older RAID server & arrays form C1 back into SuperCOS. - continues. Actions carried forward from 15/07/05 meeting: ---------------------------------------------- ACTION: MAR to liaise with MCH/JDT/ITsupport concerning shifting of the grendels out of C1. Continues (MAR on leave). ACTION: NCH to investigate the usefulness of a NAS solution for medium term archive mass storage. - CONTINUES ACTION: JDT and MAR to continue sorting out AG access option functionality for saving WSA results to "MySpace". Continues Specific points and new actions: -------------------------------- Project management: PMW has reviewed the overall project plan: The original VDFS project plan had not been formally revised for the WFCAM delivery delay but now that the instrument has been on the telescope and produced the first tranche of survey data, and the long-delayed extra software post is about to be filled, we can do this. Version 2: WSA with experience of real WFCAM data This has been revised by increasing the effort for re-factoring ingest codes and moving some of the Data Delivery tools to V3. The plan is that we finish V2 by the end of the current quarter. Version 3: WSA with enhanced Data Access and Maintenance tools This now contains some provision for refactoring Version2 tools in the light of experience with science verification data but the main thrust will be on data access/delivery tools. This will run from October 2005 to March 2006 with about 2.0 FTE effort. Version 4: VSA ready for VISTA first light in December 2006 Work on requirements capture, design, bench-marking OS/DBMS and hardware already begun, ramping up to take about 2.0 FTE from October 2005 to March 2006, in parallel with V3. >From April 2006, all hands working on implementation of V4. The data access/delivery tools for this version will be developed from those for the WSA and will be VO compatible Version 5: VSA shaken down with real VISTA data >From January 2007, depending on availability of VISTA data, shaking down databases, ingest and catalogue maintenance codes, and development of data access/delivery tools to add facilities required by users and to be fully grid aware. PMW also requested that he, NCH and RGM meet offline to examine the possible resource implications of science archiving for VST public surveys. ACTION: PMW, NCH & RGM to meet Friday PM to examine resource requirements for VST public survey science archiving. NCH noted that VDUC is now scheduled for 6th September in Cambridge; and PMW noted that the UKIDSS SV1 meeting is to be held in Edinburgh on the 18th August. Finally, PMW noted that interviews for the archive operator position will now take place on the 4th and 10th of August. WFCAM update: See the stop press pages linked from the TWiki for latest news. Comments and issues arising from CASU fortnightly minutes: No new minutes as of 22/7/05. Networking: No news this week. Hardware: All hardware still functioning normally. Software: This week software effort has been expended mainly on bug fixing and refactoring while curating/releasing SV1 data. Data Release: UKIDSS SV1 was released on the 20th July. NCH thanked all concerned. NCH noted that after a bit of a struggle with the LTO-2 system, a backup has been secured and verified. So far, only one bug has been spotted (NJC). It appears that the UKIDSS merged source tables have all non-stellar magnitudes and colours set to defaults. This appears to be due to the default flux measure that is propagated from detection into source being set to Petrosian, and this not being available in many of the pipeline catalogue files. Investigations are ongoing. ACTION: NCH to put notes on archive release history, UKIDSS SV topic and communicate with CASU regarding Petrosian flux measures. SSA: Nothing new this week Astrogrid deployment: RGM noted that MCH returned in a week or so, and that some AG Wiki pages need updates to reflect that availability of WFAU data resources published through the AG portal. Miscellaneous: Nothing else this week.