From nch@roe.ac.uk Fri Apr 17 16:41:42 2009 Date: Fri, 17 Apr 2009 14:13:14 +0100 (BST) From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Mike Read , Mark Holliman , Nigel Hambly , Nicholas Cross , Rob Blake , Ross Collins Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Andy Adamson , Jim Emerson , Malcolm Stewart , Lorenzo Rimoldini , Mike Irwin , Peredur Williams , Bob Mann , Stephen Warren Subject: WFAU VDFS Science Archive weekly project meeting minutes, 17/4/09 Minutes of WFAU VDFS Science Archive meeting: 17th April 2009 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: NCH, ETWS, MAR, NJC, RPB, MSH Apologies: JPE, JMS, AL, RGM, RSC, PMW DoNM: 10am, Friday April 24th 2009 in the Vista Hut Actions discharged this week: ----------------------------- ACTION: PMW and NCH to meet Wed 2pm to finalise the Q2 plan Discharged Actions partly discharged but continuing: ----------------------------------------- ACTION: ETWS to parse that latest keyword info into the VSA metadata schema files. Continues; ETWS noted that communications with CASU indicate that the VIRCam data FITS keys are yet to be finalised, but that the procedure for parsing a standard set into an SQL schema is set up and can be tested further in the meantime. Actions carried forward from 3/04/09 meeting: ---------------------------------------------- None this week Specific points and new actions: -------------------------------- Project management: NCH and PMW met earlier in the week to discuss the forward plan for Q2. This will be ratified with the team next week. WFCAM & VISTA updates: JAC have been in touch regarding an update for the UKIRT Board meeting in May - NCH is looking after this. Otherwise, bad weather continues to hamper UKIDSS survey observations... Comments and issues arising from CASU fortnightly minutes: No new minutes this week. Networking: Nothing of note this week. WSA Operations: NCH thanked the team for releasing UKIDSS DR5 (phase 1: LAS, GCS & DXS) on April 6th. See below for UDS/GPS considerations. RPB noted: "Took advantage of the post-Easter quiet time to run a full consistency check on the WSA. Pleased to report everything checked out fine, so will schedule a full backup for the weekend. Been struggling with SSIS, aka "Son of DTS", to output sql data to native file format. All documentation claims that this should be straightforward, but not when the option doesn't appear in the damn menu. Will see if I can make sense of it." NCH noted that he believes he's finally got bcp working consistently and fast for the SSA, which should help the proposed cluster testing using bulk exports of the SSA catalogues. Hardware: NCH noted that PMW reported earlier in the week that the tendering for a new JBOD for SDSS-DR7 is complete, and that an order will be placed early next week when admin support returns from Easter hols. MSH noted that the original catalogue server JBODs consisting of 150GB disks are up for maintenance renewal soon. NCH suggested we allow them to fall off maintenance since we've got pplenty of spare disks of that size, and they can be upgraded with bigger disks ultimately. MAR asked about the whereabouts of the LTO-3 standalone drive for linux-side backups. RPB noted that it's back on djoser, and now that ITSG have agreed to handover control of the archive servers we can install some handy backup software on djoser - hence it now becomes a general backup server. Software: RSC created a new operations release branch of the archive software earlier in the week, with all software now working on both 32 and 64 bit linux. ETWS noted that he is now upgrading all the servers with this release. NCH noted that Steve Warren has reported a few anomalies in DR5 LAS framesets when compared with those in DR4. Given that DR4 is known to contain a small number of weird things, it could be that this indicates nothing new, and nothing bad in DR5. In any case NCH is investigating, to ensure that the frameset association part of CU7 is bug-free. MAR made some tweaks this week to MultiGetImage following a user bug report. Survey Data NCH and NJC reported back from a very useful conflab with MJI in Cambridge last week concerning UDS and GPS status for possible appending into DR5; NCH has also had a useful exchange with the relevant UKIDSS folks: UDS: a new pawprint sky algorithm is producing a significant gain in depth of the the final deep stack, so the plan now is to finalise reprocessing of the K data for DR5 (J & H to be updated in subsequent DR(s)). All data up to 07B has been done; not sure if the idea is to include anything observed in 08B, but that would make the UDS inconsistent with the existing DR5 released surveys... Anyway, the main issue for the WSA is transfer and ingest of all the reprocessed intermediate image products. GPS: approximately 250 images are being recatalogued through a modified catalogue extractor to better cope with fluffy nebulosity. GPS Survey Head has indicated that these new catalogue products should be simply substituted for the old which is (probably) OK; but presumably if catalogues are reextracted then photometry and astrometry will be updated and require corresponding image header updates...? Maybe best to treat these combined updated stack image and catalogue products as new multiframes so that the old get auto-deprecated. Non-survey Data Release: Some more 08A deep stack projects are in the process of having survey-like release databases prepared. Astrogrid deployment & Data Analysis services: MSH has been investigating some anomalies with SIAP services for UKIDSS, and also a weird error with conesearches on udsDetection. All seems to be well server-side, so problems in the AG client-side software are suspected. Miscellaneous: Nothing else this week. ============================================================= Nigel Hambly Tel: +44-131-668-8234 Institute for Astronomy Fax: +44-131-668-8416 School of Physics and Astronomy University of Edinburgh Email: nch@roe.ac.uk Royal Observatory Blackford Hill Edinburgh EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. =============================================================