From nch@roe.ac.uk Mon Feb 8 15:51:09 2010 Date: Fri, 5 Feb 2010 16:03:31 +0000 (GMT) From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Mike Read , Mark Holliman , Nigel Hambly , Nicholas Cross , Rob Blake , Ross Collins Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Andy Adamson , Jim Emerson , Lorenzo Rimoldini , Mike Irwin , Peredur Williams , Bob Mann , Stephen Warren Subject: VDFS Science Archives weekly project team meeting 5/02/2010 Minutes of WFAU VDFS Science Archive meeting: February 5th 2009 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: NCH, PMW, ETWS, NJC, RGM, RSC Apologies: JPE, AL, RPB, MSH, MAR DoNM: 10am, Friday February 12th 2010 in the VISTA Hut Actions discharged this week: ----------------------------- None this week. Actions partly discharged but continuing: ----------------------------------------- ACTION: MAR, ETWS & NJC to put summary notes of the PSPIs meeting on the TWiki. NJC has done his bit; NCH suggested that once all contributions are in (asap please!) we need to distil into a prioritised list of probable/possible changes and enhancements, iterated with the PSPIs, and agreed amongst what remains of the developer effort. Actions carried forward from 29/01/10 meeting: ---------------------------------------------- ACTION: RPB to check out availability/maturity of LTO4 drives and then liaise with PMW over purchase if required. ACTION: ETWS to point RSC to an example command application that is failing in the list-driven photometry service Specific points and new actions: -------------------------------- Project management: The team filled in the progress chart for January. WFCAM & VISTA updates: Nothing new this week. Comments and issues arising from CASU minutes: None this week. Networking: JHU are sending over an SQL DB of the deep stripe 82 data for matching to DR7 et seq. thanks to Alex Szalay (and SJW for prestering for it!). WSA/VSA Operations: ETWS noted: - Updated the routines to find and fix broken JPGs and run it on the WSA 09A data. Started to look through all other semesters as well. - Enhanced the ThumbnailCreator to use multiprocessing to spot the JPG problems quicker. - Installed third party software on djoser, khufu, and djedefre. Hardware and Systems: MSH gave an update on the system OS upgrades earlier in the week: "These are all upgraded to lenny and have the latest stable kernel: djoser, djedefre, sneferu, khafre, khufu, menkaure These will need ETWS to install the WFAU software on them: djedefre, khufu, djoser All the other curation servers are complete and working as far as I know. The webservers (horus, seshat) have an even newer kernel than the curation servers (they are one Debian version ahead as well), but this should be fine. All the NFS mounts are working (as far as I've tested). The first time you run a 'df' on a machine it takes a minute to run, but after that it's quick." ETWS noted that he's half way through the third party software updates. Unfortunately an NFS mount from good ol' hatshepsut still exists in some of the system tables on the curation servers leading to NFS hangs/timeouts. PMW noted that the 96TB (raw) NAS unit has been ordered. Software: This week NJC has added notes from the VISTA PSPI meeting and has worked on updating ProgrammeBuilder to build VISTA Public Surveys. RSC noted that a new stable release (#14) branch of the VDFS curation software has been made for ops convenience. Survey Data Release: NCH noted that thanks to some clever fettling by RPB, a compromise over world DR4+ release has been reached whereby all of UKIDSS except the GPS catalogue tables has been released to open access. A new DB server role keeps the GPS catalogues proprietary for the next 2 months; flat-file metadata is available but WFAU argue that this is released to the proprietors way before the catalogue release DBs anyway. Otherwise, DR7 eyeballing is all in now so QC1 can progress apace. Non-survey Data Release: RPB has been pushing more 09A non-survey programmes through the catalogue DB release process. Astrogrid deployment & Data Analysis services: No news this week. Miscellaneous: RSC noted that he's been called up for jury service next week, but hopes to remain in contact via email. ============================================================= Nigel Hambly Tel: +44-131-668-8234 Institute for Astronomy Fax: +44-131-668-8416 School of Physics and Astronomy University of Edinburgh Email: nch@roe.ac.uk Royal Observatory Blackford Hill Edinburgh EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. =============================================================