From nch@roe.ac.uk Fri Dec 12 12:39:38 2008 Date: Fri, 12 Dec 2008 12:35:36 +0000 (GMT) From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Mike Read , Mark Holliman , Nigel Hambly , Nicholas Cross , Rob Blake , Ross Collins Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Andy Adamson , Brian Walshe , Jim Emerson , Malcolm Stewart , Lorenzo Rimoldini , Mike Irwin , Peredur Williams , Bob Mann , Stephen Warren Subject: WFAU VDFS Science Archive weekly project meeting minutes, 12/12/08 Minutes of WFAU VDFS Science Archive meeting: 12th December 2008 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: NCH, ETWS, RPB, NJC, RSC, PMW, MSH, LGR Apologies: JPE, JMS, AL, BCW, RGM, MAR DoNM: 10am, Friday 19th December 2008 in the Vista Hut Actions discharged this week: ----------------------------- ACTION: PMW to get a quote for a new NAS box a la takelot. Discharged; the usual suspects got the gig. ACTION: NCH to break everything by deprecating the loadServer DbConstant so that curations codes can be generalised to work for both VSA and WSA... but not until the WSA non-survey SW has been rolled out. Superseded by RSC's suggested SW modifications (see below) Actions partly discharged but continuing: ----------------------------------------- ACTION: ETWS to check out availability of SDSS-DR7 split over several files/groups/volumes Continues; ETWS notes that Univ. Chicago don't have a copy of DR7 yet; JHU have been contacted to see what the situation is regarding a multi-volume database. ACTION: ETWS to add a delta-mag attribute to the VSA template detection table schema. Continues; NJC volunteered to see to this Actions carried forward from 05/12/08 meeting: ---------------------------------------------- ACTION: All to comment on the development of the VSA metadata schema as described on the relevant TWiki page - continues ACTION: NJC to check out the incremental changes in DR7 over DR5 - continues Specific points and new actions: -------------------------------- Project management: The team filled in the progress chart for November. WFCAM & VISTA updates: NCH noted receiving a communique from VHS PI Richard McMahon which gives some details of proposed observing philosophy, and a new requirement for synoptic features which fit in easily to the generalised synoptic archive design. ACTION: NCH to fold the latest PI requirements into the VSA baseline schema TWiki notes NJC volunteered to incorporate the resulting schema implementation changes into his current modifications. MJI and JRL at CASU have kindly provided further VISTA pipeline processed products, and ETWS has transfered these up. The team discussed a few metadata schema issues related to producing the SQL schemas from the FITS keyword lists ACTION: ETWS to parse that latest keyword info into the VSA metadata schema files. Comments and issues arising from CASU fortnightly minutes: No new minutes this week. Networking: Nothing new to report this week WSA Operations: ETWS noted that jpegs are now up-to-date for the 08B data. RPB reported that GPS quality-bit flagging is now complete for DR5. MAR has been progressing GPS QC1 this week. Hardware: A new NAS box is in the process of being ordered. Software: RSC noted the outcome of last week's SW conflab concerning changes required to generalise the curation software to work with both WSA and VSA. Notes are available on the internal TWiki pages http://apache.roe.ac.uk/twiki/bin/view/WFAU/VSABaselineSchemas#Implementation and RSC is progressing with the agreed changes (to be checked into SVN as a new development branch). RSC reported: "I've mostly been prototyping various design ideas, following on from last Friday's software meeting on migrating the Python software towards functioning for both the WSA & VSA in a seamless way. Made some final improvements to the non-survey release script to improve the logging and make it more robust. Wiped the existing Survey and Release entries in the WSA for non-surveys, so that the new releases will all start at the same level. Also a minor enhancement to the SyncDb script to help out ETWS's software testing." Survey Data Release: DR5 preparations are on hold as we await eyeball QC results from both LAS and GPS. NCH noted that the GPS has some fields covered by 2 epochs at K in DR5, and some cunning mods to frame association in CU7 are required. MAR suggested a hack earlier in the week that might work, but NCH will discuss possible approaches and consequences with Phil Lucas at the UKIDSS meeting next week. Non-survey Data Release: In light of the current hiatus in DR5 preparations, the suggestion is to run a few non-survey programmes through the new automated curation process as a check before wholesale release of new prepared DBs for all registered non-surveys. ACTION: ALL to send suggested programmes to RPB for running through the new non-survey automated curation. Astrogrid deployment & Data Analysis services: LGR noted that his new pixel analysis tools are now ready for testing and demonstrating at the UKIDSS meeting. Miscellaneous: Nothing else this week. ============================================================= Nigel Hambly Tel: +44-131-668-8234 Institute for Astronomy Fax: +44-131-668-8416 School of Physics and Astronomy University of Edinburgh Email: nch@roe.ac.uk Royal Observatory Blackford Hill Edinburgh EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. =============================================================