From nch@roe.ac.uk Fri Jan 26 16:02:53 2007 Date: Fri, 26 Jan 2007 12:15:56 +0000 (GMT) From: Nigel Hambly <nch@roe.ac.uk> To: WFCAM Science Archive Team -- Eckhard Sutorius <etws@roe.ac.uk>, Johann Bryant <jb@roe.ac.uk>, Mike Read <mar@roe.ac.uk>, Nigel Hambly <nch@roe.ac.uk>, Nicholas Cross <njc@roe.ac.uk>, Bob Mann <rgm@roe.ac.uk>, Ross Collins <rsc@roe.ac.uk> Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence <al@roe.ac.uk>, Andy Adamson <a.adamson@jach.hawaii.edu>, Brian Walshe <bcw@roe.ac.uk>, John Taylor <jdt@roe.ac.uk>, Jim Emerson <j.p.emerson@qmul.ac.uk>, Malcolm Stewart <jms@roe.ac.uk>, Lorenzo Rimoldini <lgr@roe.ac.uk>, Mike Irwin <mike@ast.cam.ac.uk>, Mark Holliman <msh@roe.ac.uk>, Peredur Williams <pmw@roe.ac.uk>, Stephen Warren <s.j.warren@ic.ac.uk> Subject: WFAU VDFS Science Archive weekly project meeting minutes 26/1/07 Minutes of WFAU VDFS Science Archive meeting: 26th January 2007 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: NCH, PMW, ETWS, RSC, LGR, MAR, NJC, JB, BCW, MSH Apologies: JPE, JMS, JDT, RGM, AL DONM: 10am, Friday 2nd February 2007 in the Plate Library Actions discharged this week: ----------------------------- ACTION: PMW and JB to order new JBOD for ahmose Discharged; PMW noted that price per TB is reducing in line with expectations (Moore etc.) Actions partly discharged but continuing: ----------------------------------------- The following from last time partly done but continue: ACTION: JB to rearrange external catalogues onto batch catalogue server Continues; ETWS is juggling the DR5 files; GLIMPSE, TWOMASS and BestDR2 remain to be uploaded (possibly from tape) onto the batch server thutmose (SSA will remain on amenhotep for the time being since NCH will rebuild fully from scratch on thutmose) ACTION: RSC to profile CU4 and investigate possible optimisation Continues; on hold until parallelisation and other refactoring is complete. Actions carried forward from 19/01/07 meeting: ---------------------------------------------- The following from last time continue: o) Add in a default row for every detector appearing in every detection table (for schema consistency when querying merged sources and individual detections) - ACTION: RSC & NCH ACTION: NCH to discuss and review AstroWISE interfacing with MAR and JDT. Specific points and new actions: -------------------------------- Project management: NCH noted that a UKIDSS Survey Heads telecon has been called for next week. Agenda items include DR2 progress and the question of release database(s) (i.e. a possible split into projects). NCH finished his notes for Vista ESP PIs and forwarded to CASU for their input. NJC updated the team following the UKIDSS Calibration Working Group meeting in Cambridge earlier this week. WFCAM & VISTA updates: Vista VIRCam has arrived in Chile. Comments and issues arising from CASU fortnightly minutes: No new minutes this year. Networking: NCH noted that Clive Davenhall from NeSC visited midweek, and offered to push UKLight things from the NeSC end along with Colin Greenwood. We reiterate that we are anticipating receiving a date for implementation of the IoA-ROE link sometime next week from UKERNA. WSA Operations: MAR and NCH have been finishing off the QC for the coming release. Hardware: JB noted some time synchronisation problems between the WSA servers as proxied through thoth to the ROE time service. There is a suspicion that lack of accurate time syncs is causing some of the instabilities we have been experiencing on the Windows side. Investigations are on-going ... Software: ETWS reported: "Testing and debugging of refactored ingest CUs. Copied over the lost 4 parts of BestDR5 via FTP from Johns Hopkins after the network problems at UIC couldn't be resolved. Half of the BestDR5 files are now on thutmose. Produced metadata xml file of WORLDR2 for Astrogrid. Added LGR as a new user to the CVS." NCH has been working on the archive paper write-up and polishing up final QC for DR2. RSC has finished polishing CU8, and also the cross-talk flagging code. Some debate ensued as to whether to try to include this in DR2 or not; after some discussion, it was decided that more time was needed for testing (especially any testing by external parties). Survey Data Release: Reiterating the proto-schedule from last time: Complete transfer of 06A : Done " ingest " " : Done Photometric recal : Done Quality bit flagging : Done except for cross-talk; since time is pressing, suggest we defer cross-talk flagging to later releases QC1 : +0.5 - to be completed early next week (still awaiting LAS eyeball results tho'...) CU7 (source merging) : +3 (totally dominated by GPS) DXS CUs : To commence this week following appropriate QC1 CU16 : +1 QC2 : +1 Final CUs : +3 QC1 is almost done; awaiting final eyeball results for LAS before closing out. ACTION: NCH & MAR to close out QC1 early next week ACTION: JB & RSC to commence source merging (after backup?) after QC1 close-out ACTION: NJC & ETWS to commence CUs 13,14,2,3,4 for DXS deep stacks after QC1 close-out Non-survey Data Release: Nothing to report this week. Astrogrid deployment: MSH, MAR and ETWS reported publication of the UKIDSS World taster release (2) via the AG DSA. Miscellaneous: NCH noted that UKIDSSDR1PLUS needs to be copied onto the batch server for cross-queries with SDSS etc. RSC reported: "To celebrate the arrival of VIRCAM in Chile, I've updated the WSA TWiki pages again to continue the re-branding of the WSA to become just a part of the VDFS science archive work. I've also taken the opportunity rename a few very annoying non-TWiki word article names into proper TWiki words, so they don't keep producing random links everywhere (this was particularly annoying with the GAIA software / Gaia ESA mission confusion)! Main changes are just that these few topics have been renamed: WSA -> VDFSScienceArchives WSAHardwareNotes -> VDFSHardwareNotes GAIA -> GaiaArchive GAIABrief -> GaiaBrief Hopefully, these changes will be transparent and not cause you any problems. If you have a hard link / bookmark from outside the TWiki to the WSA page, please change it to VDFSScienceArchives."