From nch@roe.ac.uk Tue Jun 28 00:49:43 2011 Date: Mon, 27 Jun 2011 17:20:50 +0100 From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Mike Read , Mark Holliman , Nigel Hambly , Nicholas Cross , Rob Blake , Ross Collins Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Jim Emerson , "Noddle, Keith -- Keith Noddle" , Keith Noddle , Lorenzo Rimoldini , Mike Irwin , Bob Mann , Stephen Warren , Tom Kerr Subject: WFAU VDFS Science Archive project team meeting mins, 24/06/2011 Minutes of WFAU VDFS Science Archive meeting: June 24th 2011 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: NCH, ETWS, MAR, AL, KTN, NJC Apologies: JPE, MSH, RSC, RGM, RPB DoNM: Friday July 8th 2011 in the Vista Hut Actions discharged this time: ----------------------------- None this time. Actions partly discharged but continuing: ----------------------------------------- ACTION: MSH to set up ramses10 in the cluster rack and configure as a further ingest DB server. Nearly done: all system installations done; user DB copies are in transit Actions carried forward from 10/06/11 meeting --------------------------------------------- ACTION: RPB to look into automated RAID monitoring across all servers. Continues; ramses9 (most recent SW installation) has such a facility; it was noted that on the linux side monitoring is working as normal. ACTION: RPB to set up mirror/sync for flat file DBs using MS SQL replication. Continues Specific points and new actions: -------------------------------- Project management: Nothing to report this time. WFCAM & VISTA updates: Nothing new this time. Comments and issues arising from CASU minutes: No new minutes this time. Networking: Nothing of note. WSA/VSA Operations: ETWS reported: - VHS, VMC, VVV, and VIKING are in various stages of creating releases. - Rewritten CU1 to transfer latest GPS reprocessed files. - Enhanced CU4 to split daily filelists of the VVV to find broken files easier and loose less time and data when a broken file is encountered. Hardware and Systems: MSH, MAR and NCH lugged Ramses11 (the latest DB server cluster node) up from the lodge to C2 (at least we had a trolley to help rather than having to use a wooden sled...) Software: RSC reported by email: "After wondering where our set of gripes from ESO were they duly came courtesy of the VMC PI. All except one were very minor niggles with the metadata that were easy to fix. The tough one was figuring out why the compressed images wouldn't uncompress and how to fix it. This eventually turned out to be an fpack bug (compounded by a minor PyFITS bug that was preventing us from bodging together a fix), which was fixed by upgrading to the latest version of CFITSIO. In more important news the proper motion solution implementation for the shallow UKIDSS has now been integrated into our curation software and applied to a small sample of test data for review. Only the LAS currently has a cross-match table defined for the SSA, which the other UKIDSS surveys will also need for their next releases. A bug in the frame set association code for deep surveys was discovered that only affected a single frame set of the DXS DR8 release and will be fixed in the next release." NCH has been debugging/validating the prototype proper motion implementation with RSC. It's nearly there... NJC has updated CU6 to take into account astrometric errors and has also improved the calculated of photometric errors and tested splitting the variability curation into parts to optimise memory usage. Survey Data Release: All this meeting was taken up with a discussion of the responses to the public DB release communiques sent out to the VISTA PSPIs by NCH on behalf of WFAU. So far, 4 out of 5 PIs have responded, mainly in a positive manner (one needed a little gentle persuasion from JPE). NCH will reply to each, while the ops team plan to push ahead with the DB creation so that the PIs can see the kind of thing we have in mind and all investigate any quality issues. The one survey yet to respond (VVV) will be approached directly by NJC at the Hertfordshire meeting. It was noted that the source density is challenging the curation procedures and so some descopes were discussed that may enable a usable DB to be produced in advance of the meeting. AL noted that UltraVista co-PI Jim Dunlop had been asking about the possibility of archiving their deep image and catalogue in the VSA. It was agreed that this would nicely complete the sextet of Vista surveys, and would provide enhanced features and general functionality that the originators (Terapix) probably do not have the time and energy to create. Non-survey Data Release: No news this time. Astrogrid deployment & Data Analysis services: No news this time. Miscellaneous: Nothing else to report this time. ============================================================= Nigel Hambly Tel: +44-131-668-8234 Institute for Astronomy Fax: +44-131-668-8416 School of Physics and Astronomy University of Edinburgh Email: nch@roe.ac.uk Royal Observatory Blackford Hill Edinburgh EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. ============================================================= -- Scanned by iCritical.