From nch@roe.ac.uk Mon Oct 19 15:57:25 2009 Date: Fri, 16 Oct 2009 16:05:07 +0100 (BST) From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Mike Read , Mark Holliman , Nigel Hambly , Nicholas Cross , Rob Blake , Ross Collins Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Andy Adamson , Jim Emerson , Malcolm Stewart , Lorenzo Rimoldini , Mike Irwin , Peredur Williams , Bob Mann , Stephen Warren Subject: WFAU VDFS Science Archives weekly project meeting mins, 16/10/09 Minutes of WFAU VDFS Science Archive meeting: October 16th 2009 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: PMW, RPB, NCH, MAR, NJC, AL Apologies: JPE, JMS, RGM, MSH, RSC, ETWS DoNM: 10am, Friday October 23rd 2009 in the VISTA Hut Actions discharged this week: ----------------------------- ACTION: RPB/PMW to spec/order a SCSI card to enable tape from the linux servers Discharged Actions partly discharged but continuing: ----------------------------------------- ACTION: ALL to review the VSA metadata schema in trunk/sql SQL script VSA_MultiframeSchema.sql ACTION: ETWS to check for corresponding essential FITS keys for VSA ingest against those defined for the WSA Continues; awaiting the latest nightly pipeline products from CASU... ACTION: RPB: backup all DB-driven products after UDS DR5. Continues; this can now be done; the team agreed that all science image products (diffs, mosaics, stacks) should be backed up from /disk*/wsa/products/ and RSC asked that /disk05 is included for various bits and pieces. Migration of public DBs to the cluster servers takes priority, so this has had to be delayed (see Hardware below) Actions carried forward from 09/10/09 meeting: ---------------------------------------------- ACTION: NCH to communicate with some VISTA PS and the SV PIs to finalise some schema details. Continues Specific points and new actions: -------------------------------- Project management: Nothing new to report this week. WFCAM & VISTA updates: AL asked about the VISTA SV schedule, and NCH explained that SV is starting now. Comments and issues arising from CASU minutes: WFAU eagerly await new VISTA processed products to shake down things at our end... we hope to get some prior to being suddenly presented with the SV data proper ...! Networking: All quiet on the network interfaces. WSA Operations: RPB reported: "Routine operations: All 09B data is now transferred [to mid-Sept]. Curation will continue over the weekend." Hardware and Systems: RPB reported: "Replacement SCSI card for djoser: details passed to Perry. Awaiting order. Cluster preparation: Nearly all databases are now in position on the cluster. SSA is the last big db that needs locating onto the right server. RPB suggestion that the new web server be named seshat (no giggling please) was enthusiastically endorsed by the meeting. Software: NJC noted that he's been looking into the latest features of S-Extractor and that it can now handle MEFs but not RICE compression. ACTION: NJC to email Terapix to ask about support for RICE compression in S-Extractor RSC has been working with RPB on shaking down the curation software transfer to cluster operations. Survey Data Release: AL and NCH thanked the team for getting UKIDSS DR6 out at the beginning of the week. MAR noted that thousands of queries have been thrown at DR6 already (indeed some were being thrown at it before the release announcement...) NCH thanked MAR for sorting out the GPS filtered/unfiltered image presentation issues in the user interface; looks like GPS survey head is much happier now. Non-survey Data Release: NCH asked MAR to have a look at recent non-survey registrations to bring flat-file access up to date as far as possible. Regarding survey-like DB releases for these programmes, the team discussed the necessary work required to sort these out following fall-out from the deblend extended source flux fixes. NCH suggested we prioritise those that were unaffected in their data, i.e. everything from 08B onwards, but in any case a helper script or two to automate things as far as possible is probably in order. The team deferred further discussion until RSC's return next week. Astrogrid deployment & Data Analysis services: Regarding access to UKIDSS through the AG DSAs, MAR noted that a DSA for UKIDSSDR6PLUS needs to be set up, and that authenticated access to the proprietary DBs can only by certified by MSH (this following an enquiry from Univ. Herts). AL noted that his understanding was that this procedure should be a lot easier once TAP is all up and running (?) but we really need to speak to MSH on his return from the Land of the Rising Sun. Miscellaneous: AL noted that on his recent trip to Belgium for IVOA type things, he learnt all about monet-db which seems an interesting high-performance column-oriented DBMS. NCH noted that if the developers are looking for a terabyte, billion-row scale dataset split along normalised relational lines, then we could supply one for test purposes via an external USB disk (for example). ============================================================= Nigel Hambly Tel: +44-131-668-8234 Institute for Astronomy Fax: +44-131-668-8416 School of Physics and Astronomy University of Edinburgh Email: nch@roe.ac.uk Royal Observatory Blackford Hill Edinburgh EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. =============================================================