From pmw@roe.ac.uk Fri Oct 7 13:26:14 2005 Date: Fri, 7 Oct 2005 12:40:28 +0100 From: Peredur Williams To: Nigel Hambly , Eckhard Sutorius , Johann Bryant , Mike Read , Nicholas Cross , Bob Mann , Ross Collins Cc: Andrew Lawrence , Andy Adamson , John Taylor , Jim Emerson , Malcolm Stewart , Martin Hill , Mike Irwin , Peredur Williams , Stephen Warren Subject: WFAU WSA weekly project meeting minutes, 7th October 2005 Minutes of WFCAM Science Archive meeting: 7th October 2005 ------------------------------------------------------------- ------------------------------------------------------------- Present: MAR, JMS, JB, ETWS, PMW Apologies: MCH, RGM, JPE, AL, JDT, NCH, RSC, NJC DONM: 10am, Friday 14th October 2005, plate library; PMW in the chair Actions partly discharged but continuing: ----------------------------------------- None this week. Actions carried forward from 28/09/05 meeting: ---------------------------------------------- ACTION: NCH to investigate the usefulness of a NAS solution for medium term archive mass storage. - CONTINUES Specific points and new actions: -------------------------------- Project management: PMW reported on the VDMT meeting held on the 6th; he had raised the issue of the problems with the catalogue files uploaded from CASU during the week. We were assured by Mike that the catalogue data would be re-processed and made available for transfer next week. There was some discussion of version numbers of reprocessed data: i.e. incrementing them to reflect the changes, but the idea was dropped as FITS headers should contain enough information. JMS asked for sample fits file to look at the headers. ACTION: ETWS to make a specimen fits file available WFCAM update: See the stop press pages linked from the TWiki for latest news. NCH is currently observing. Networking and Archive operation: ETWS reported that the first download from CASU was quite fast, 12.6 GByte/s over 2.4TB of data. Downloading the 5 directories, which were processed later (~450GB), needed roughly the same time with a rate of 3.6 GByte/s. Since no other processes were running on both end machines, it may be that there was a network issue. The ingest of the pixel data went well, as well as the ingest of the few catalogue files without NaN value errors. Hardware: Khufu is now up and running (Debian Sarge and gcc-4.0 are installed) and ETWS has started installing the third party software. JB reported: Weekly system backups are now up and running with their own Media set, Template and Selection List in Veritas. Currently for Djoser, Sneferu, Amenhotep and Ahmose. Have liaised with IT Support so that Khufu uses the same system as Djoser and Sneferu for system backups. Documentation of the backup process is proceeding. A live run through of backing up the WSA is waiting on CU3 and CU4 successfully completing. Software: MAR has been working on tool to provide catalogue data matching user-uploaded co-ordinate lists (brought forward following science verifiers requests); now is about 80% complete. Data Release: Pending; awaiting reprocessing, retransfer & reingest of SV1 & 2 data. Astrogrid deployment: Nothing new this week. Miscellaneous: RSC is at ADASS spreading the word (poster) ------------------------------------------------------------------- Peredur Williams, Institute for Astronomy, University of Edinburgh Royal Observatory, e-mail: pmw@roe.ac.uk Blackford Hill, fax: (+44) 131 668 8416 Edinburgh EH9 3HJ www: http://www.roe.ac.uk/~pmw phone: (+44) 131 668 8300 (University exchange: 75-300) -------------------------------------------------------------------