From nch@roe.ac.uk Mon Oct 11 15:26:01 2010 Date: Fri, 8 Oct 2010 17:37:05 +0100 (BST) From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Mike Read , Mark Holliman , Nigel Hambly , Nicholas Cross , Rob Blake , Ross Collins Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Jim Emerson , Keith Noddle , Lorenzo Rimoldini , Mike Irwin , Peredur Williams , Bob Mann , Stephen Warren , Tom Kerr Subject: WFAU VDFS Science Archive project meeting mins, 8/10/10 Minutes of WFAU VDFS Science Archive meeting: October 8th 2010 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: NCH, RSC, ETWS, MSH, MAR, RPB Apologies: JPE, AL, RGM, KTN, NJC *** NB: DoNM: Friday October 29th in the Vista Hut *** Actions discharged this week: ----------------------------- ACTION: NCH to remember to mention SSA crossneighbour production in WSA/VSA next week (it seems to be switched off?) Discharged; thanks to RSC for checking things out. Actions partly discharged but continuing: ----------------------------------------- None this week Actions carried forward from 24/09/10 meeting --------------------------------------------- ACTION: TBD to draft and MOU on behalf of PSPIs for ESO-SAF deliveries Continues; on hold until at least next PSPI teleconf, and possibly until "Phase 3" workshop at ESO. ACTION: NJC to suggest workshop at next PSPI meeting. NJC noted that he needs to liaise with JPE about the next teleconf. Specific points and new actions: -------------------------------- Project management: All noted that the ESO PSPI Phase III meeting is scheduled for the 30th November (WFAU being informed via several PSPIs). ETWS and RPB volunteered to attend to represent science archive interests. WFAU have been asked to contribute the usual archive update for the UKIRT Board meeting in November. NCH has asked KTN and MAR to look after this. WFCAM & VISTA updates: No updates this week. Comments and issues arising from CASU minutes: The team noted the minutes of the meeting of 22th [sic] September. Regarding that WFAU "apparently need" tile software "to make their band-merged catalogues" this is not quite the case. WFAU can make band merged catalogues from catalogues derived from paw-prints, standard six-pp OB tiles or deeper tiles stacked/mosaiced across different OBs and/or nights. The fact is that some PSPIs have asked for the final option, and who are we to argue? Hence we need the tiling tool implemented at the archive end ... capiche? Anyway, we now have a working version of the tiling tool, and we thank CASU for their exceptional software. Networking: We note availability of the latest VIRCam processed products up to August 31st as of yesterday. ETWS noted that these have been set transfering and will be ingested and available to the PIs from this end within the next 24hr or so. WSA/VSA Operations: ETWS noted -- Transferred WFCAM 10B August data, ingested the metadata and created JPGs. -- Transferred VISTA P85 August data. Metadata ingests are nearly finished as well as JPG creation. -- Created new browser webpages and xml pages for WFCAM DR8. -- Included more small enhancements to the DataDeamon. -- Installed/updated third party software on djedefre. RPB reported: "VMCv20100930 release database put live last week. VIKINGv20101007 release database put live yesterday. UDS data received from Nottingham, though a slight software bug has slowed things up a wee bit at this end." Hardware and Systems: MSH noted that all curation servers are updated to the latest Debian lenny linux release apart from djoser and khufu. Also cluster node quotes are in for a high throughput DB server (20/40 Gb/s infiniband, 16 TB local storage etc.) for the VVV, and tenders are out for a new beefy curation server. Software: RSC noted: "NJC rushed through some curation software changes last week to improve mosaic support that unfortunately caused numerous regressions that hampered both the UDS and non-survey curation operations this week. So I've been mostly bug fixing and running regression tests to get everything working again." RSC instigated a discussion concerning the approach and necessary SW/procedural changes required to handle a VVV ingest DB split off from the VSA. It was agreed to make the loadserver constant a list for future flexibility, and that VVV metadata should not be duplicated between the main and its own ingest DB. ETWS noted that the VSA filter table has J and K filters as MKO spec, and asked if this is correct. ACTION: NCH to ask NJC if the VSA filter metadata is correct. Survey Data Release: UDS DR8 mosaic arrived just in time to wave NJC off on his holidays, but RPB and RSC are manfully coping with the ingest/curation process to get this released asap. A new release DB for VIKING was finished earlier this week, and MAR emailed the relevant PSPI. NCH noted that an invitation for a WFAU representative to attend VMC telecons was received from the indefatigable PI off that survey ACTION: NCH to ask NJC to attend VMC telecons. MAR volunteered to deputise if necessary. Non-survey Data Release: RPB noted that he's pushing through some 10A WFCAM non-surveys but found a small bug for which RSC has attempted a fix ... testing and resumption awaits completion of the higher priority UDS. Astrogrid deployment & Data Analysis services: MSH noted that he and MAR have been communicating with several users of VOdesktop/AG access to the UKIDSS and SDSS datasets; also continuing work with scale-out testing of distributed crossmatching between bulk datasets. MSH will be attending the VO/surveys workshop at NeSC at the end of the month (as will NCH also) and he intends to talk about these developments. Miscellaneous: NCH noted that a short-term temporary staff member would be joining the group later today to build an SQL database of the legacy SuperCOS dataset from the infamous ESO/SRC field 287 plate collection, and it was agreed that this should be done on the non-public SQL Server thutmose. ============================================================= Nigel Hambly Tel: +44-131-668-8234 Institute for Astronomy Fax: +44-131-668-8416 School of Physics and Astronomy University of Edinburgh Email: nch@roe.ac.uk Royal Observatory Blackford Hill Edinburgh EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. =============================================================