From pmw@roe.ac.uk Sat Sep 12 14:48:00 2009 Date: Fri, 11 Sep 2009 16:14:49 +0100 From: Peredur Williams To: Peredur Williams , Nigel Hambly , Eckhard Sutorius , Mike Read , Mark Holliman , Nicholas Cross , Rob Blake , Ross Collins Cc: Andy Lawrence , Andy Adamson , Jim Emerson , Malcolm Stewart , Lorenzo Rimoldini , Mike Irwin , Bob Mann , Stephen Warren Subject: WFAU VDFS Science Archive weekly project meeting minutes 11/09/09 Minutes of WFAU VDFS Science Archive meeting: September 11th 2009 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: RSC, NJC, MSH, ETWS, MAR, PMW Apologies: JPE, JMS, RGM, NCH, AL, RPB DoNM: 10am, Friday September 18 2009 in the VISTA Hut Actions discharged this week: ----------------------------- ACTION: NJC to test his Python DB de-blend fixing code Done: see below ACTION: NJC to contact CASU (MJI) to clarify question of Areal profile non-integral values. Done. Actions partly discharged but continuing: ----------------------------------------- ACTION: NCH to draft an interface control document for VSA to ESO-SAF On hold until end August by which time the grant is supposed to be sorted out. ACTION: ALL to review the VSA metadata schema in trunk/sql SQL script VSA_MultiframeSchema.sql Continues; RSC and ETWS have continued examining/editing the schema but need more recent files from CASU to check keys. ACTION: RPB: backup all DB-driven products after UDS DR5. Continues; this can now be done; the team agreed that all science image products (diffs, mosaics, stacks) should be backed up from /disk*/wsa/products/ and RSC asked that /disk05 is included for various bits and pieces. Continues - first backup ran out of tape, so another backup needed. - PMW has arranged purchase of more tapes ACTION: ETWS to check for corresponding essential FITS keys for VSA ingest against those defined for the WSA Continues: (see above) Specific points and new actions: -------------------------------- Project management: PMW gave his regular update on progress of the various grants ... WFCAM & VISTA updates: All quiet. Comments and issues arising from CASU minutes: No new minutes. Networking: - JANET has anounced a scheduled UKLight maintenance on the night of 7/8 October. WSA Operations: Hardware: MSH had installed the new router on Monday 4th, as scheduled, and upgraded the memory of Menkaure. Djedefre had been giving trouble. Software: NJC: This week NJC has been testing the UpdateDetectionTables code with the deblend parameters fixer. This work is complete, but it led to the discovery of an inconsistency between the WFAU and CASU over the type for areal_1_profiles, which has now been fixed at the WSA and an error in MJI deblend code, which was fixed quickly by MJI. Both NJC's code and MJI's give consistent results now. RSC has made further manual edits to the VSA metadata schema to make it compatible with our existing software design, but having just realised our schema is based on a file from October 2008, there's no point in making further edits until we have more recent files from CASU. RSC also performed successful tests for creating and moving databases between cluster servers to improve CU19 and CU22 operations on the cluster. RSC also turned on the multi-epoch feature of CU7 for the LAS ready for the DR6 run, and recommend we do a mock run now of the frame set association for approval by the survey head. ETWS has finished rewriting CU2; it is now capable of using all processors on a server. This has speeded up the code by a factor of ~3.7 on menkaure (4 processors). MAR worked on integrating the new cluster design into the interface so that it'll farm out requests to the various nodes. Re-writing the archive listing service for VSA. Survey Data Release: MAR would check with Steve Warren regarding labelling designation of the first and second J-band images taken for the LAS. Non-survey Data Release: Nothing to report this week. Astrogrid deployment & Data Analysis services: Nothing of note this week. Miscellaneous: ------------------------------------------------------------------- Peredur Williams, Institute for Astronomy, University of Edinburgh Royal Observatory, e-mail: pmw@roe.ac.uk Blackford Hill, or: peredur.williams@ed.ac.uk Edinburgh fax: (+ 44) (0) 131 668 8416 EH9 3HJ www: http://www.roe.ac.uk/~pmw phone: (+44) 131 668 8300 (University exchange: 75 300) "The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336." -------------------------------------------------------------------