From nch@roe.ac.uk Fri Jun 5 13:49:40 2009 Date: Fri, 5 Jun 2009 12:23:47 +0100 (BST) From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Mike Read , Mark Holliman , Nigel Hambly , Nicholas Cross , Rob Blake , Ross Collins Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Andy Adamson , Jim Emerson , Malcolm Stewart , Lorenzo Rimoldini , Mike Irwin , Peredur Williams , Bob Mann , Stephen Warren Subject: WFAU VDFS Science Archive weekly project meeting minutes, 5/6/09 Minutes of WFAU VDFS Science Archive meeting: 5th June 2009 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: NCH, RPB, PMW, MAR, MSH, NJC, ETWS, RSC Apologies: JPE, JMS, AL, RGM NB: DoNM: 10am, Friday June 19th 2009 in the Vista Hut Actions discharged this week: ----------------------------- ACTION: PMW & NCH to email the latest quarterly plan to JPE. Discharged ACTION: MAR to change the IfA UKIDSS release status. Discharged - web page now notes DR5 as the latest release. ACTION: NCH to remember to ask MSH/ETWS to set up the AG DSA for BestDR7 Discharged Actions partly discharged but continuing: ----------------------------------------- ACTION: ETWS to parse that latest keyword info into the VSA metadata schema files. Continues; the team noted in the latest CASU minutes that draft headers for tile products are being considered now. Actions carried forward from 29/05/09 meeting: ---------------------------------------------- None this week Specific points and new actions: -------------------------------- Project management: The team filled in the progress charts for May. PMW & NCH noted the continuing item of establishing interface control with ESO-SAF, especially in the light of AL's recent email concerning the same thing. ACTION: NCH to draft an interface control document for VSA to ESO-SAF WFCAM & VISTA updates: Nothing new this week. Comments and issues arising from CASU fortnightly minutes: No new minutes this week. Networking: Nothing new this week. WSA Operations: RPB noted: "SDSS DR7 problems continued. After finally managing to split the monolithic mdf file into more manageable chunks, it was then discovered that SQL Server 2008 data files are completely incompatible with SQL Server 2005, despite 2008 having a "compatibility" option when the database is created. Guess the Microsoft developers must've been laughing themselves silly when they put that one in. In order to get around this, SQL Server on thutmose was upgraded to 2008 during the scheduled downtime on Thursday. This went through without any problems and DR7 is finally up and running on the public server. Re-ran failed non-survey u07bh60 through SQL Query Analyser. Turns out that the ingest file contained some bogus data in hprobVar and jprobVar columns. Will check with NJC why bad data was produced." Now that SDSS-BestDR7 is on the public server: ACTION: NCH to run a standard science query sanity check UKIDSSDR5-BestDR7 (example Query #4.2.6 from the WSA paper) ACTION: MAR to wsa-announce availability of SDSS BestDR7. Given the brief pause in 09A transfers/ingests, NCH suggested that ETWS liaise with CASU concerning transfer of the reprocessed GPS and UDS products for UKIDSS DR5 phase-2. ACTION: ETWS to communicate with MJI/MR at CASU over transfer of the reprocessed GPS and UDS products for DR5 Hardware: RPB noted: "Installing Amanda on djoser to handle Linux backups proved to be a little harder than strictly necessary thanks to the crazy behaviour of glibc under debian. Thankfully, it was available in the package management system. So, although that means we're not running the latest version, at least it's running. Am now liasing with MAR to nominate a filesystem to backup in order to give it a test run." PMW asked about the status of the cluster DB tests. MSH and NCH noted that the SSA test load on two nodes was held off until BestDR7 had been reloaded as higher priority. Now this is finished, the final loads can be done and the trawl tests via distributed partitioned views will take place next week; subsequently join query tests will be done (NCH expressed doubts that it can work...) Software: RSC noted: "I've been helping NJC out with testing some improvements to the deep survey curation software to fix design flaws that were identified during certain non-survey release runs. Otherwise just getting back up to speed with the software changes in order to create the dev_vsa branch." NJC noted: "This week I have been working on improving the automation of the deep/synoptic data pipeline and testing it on some non-surveys. I have fixed several of the discrepancies and now understand most of the rest. These need to be fixed in time for VISTA and to improve non-survey releases." Survey Data MAR noted that UKIDSS DR3 is now live to the world as it's proprietary period has expired. Non-survey Data Release: Nothing new this week. Astrogrid deployment & Data Analysis services: New DBs available on public servers: ACTION: ETWS to send MSH the SDSS DR7 metadocs so that it can be published through the VO services ACTION: MSH to switch off the secured access to UKIDSS DR3 as it is now out of it's proprietary period ETWS noted - I've finished updating LGRs photometry code to the latest python version and am now looking into adding the columns from Richard McMahon's wish list. MAR has increased the list-driven photometry row limit for incoming queries to 5000 from 1000 at the request of a user. Miscellaneous: MSH enquired about the possibility of travel funding for ADASS given the current lack of a rolling grant announcement and the probable expense of visiting Japan. Provided they travel by boat, stay in a tent at least 50km from Sapporo and commute by bicycle, anyone is welcome to go. ============================================================= Nigel Hambly Tel: +44-131-668-8234 Institute for Astronomy Fax: +44-131-668-8416 School of Physics and Astronomy University of Edinburgh Email: nch@roe.ac.uk Royal Observatory Blackford Hill Edinburgh EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. =============================================================