From nch@roe.ac.uk Fri May 27 17:26:15 2011 Date: Fri, 27 May 2011 17:18:19 +0100 From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Mike Read , Mark Holliman , Nigel Hambly , Nicholas Cross , Rob Blake , Ross Collins Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Jim Emerson , "Noddle, Keith -- Keith Noddle" , Keith Noddle , Lorenzo Rimoldini , Mike Irwin , Bob Mann , Stephen Warren , Tom Kerr Subject: WFAU VDFS Science Archive fortnightly project meet mins, 27/05/11 Minutes of WFAU VDFS Science Archive meeting: May 27th 2011 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: NCH, ETWS, MAR, NJC, MSH, RGM, RSC, KTN, RPB Apologies: JPE, AL, MSH DoNM: Friday June 10th 2011 in the Vista Hut Actions discharged this week: ----------------------------- None this week Actions partly discharged but continuing: ----------------------------------------- ACTION: NCH to draft messages to the VISTA PIs concerning the next steps in public survey DB provision and all to comment. Drafted; content was finalised during this meeting and emails will be sent out in the coming week (following any input from JPE). Actions carried forward from 13/05/11 meeting --------------------------------------------- ACTION: RPB to look into automated RAID monitoring across all servers. Continues; ramses9 (most recent SW installation) has such a facility; it was noted that on the linux side monitoring is working as normal. ACTION: MSH to set up ramses10 in the cluster rack and configure as a further ingest DB server. Specific points and new actions: -------------------------------- Project management: WFAU grant renewal case is now confirmed as to be required in April 2012. RGM, KTN and NCH are looking at creative ways to maximise impact over the final 2 years of the current grant by optimising the staff profile. WFCAM & VISTA updates: UKIRT operations is now confirmed by the respective funding agencies to March 31st 2013. WFCAM is back to pumping out the data after considerable amounts of poor weather recently. Comments and issues arising from CASU minutes: No new minutes this week. Networking: RGM noted that discussions are ongoing with STScI-MAST on grabbing a copy of GALEX for deployment locally and crossmatching (quid pro quo: UKIDSS public release copies may go to MAST, contingent on agreement from all interested parties). WSA/VSA Operations: ETWS reported significant numbers of broken files dotted around lots of different days in the latest batches of pipeline processed files for both WFCAM and VISTA. Some are needing to be tweaked at the CASU end and retransfered, while others (missing WFAU headers) are being fixed at this end. ETWS further noted: -- Apart from 3 catalogues with non-unique sequence numbers all the catalogues from SV/DRYRUN/P85 for non-VVV surveys are ingested. VVV ingests are ongoing, but far more broken files slow the ingests down. -- The missing keywords in WFCAM data from the second half of March have been added and the day with broken WCS has been retransferred as well as the missing data from Jan 30. -- Enhanced the DataDaemon to run ingests continously, and written more code to check the data before processing so that craftily broken files are detected well before ingests fail with primary key errors. RGM asked if a list of "stuff to do" for any final all-singing, all-dancing UKIDSS release incorporating lots of issues fixed along the way but not currently propagated in the data releases was being maintained. ACTION: MAR to start a TWiki topic to track "stuff to do" in the final UKIDSS data releases. Hardware and Systems: RGM noted that the Research Councils have taken a big hit on captial expenditure allocations, and this may impact provision of compute hardware resources in future. EPSRC have already reacted to this by reviewing possibilities for shared, centralised equipment resources and there is a distinct possibility the same could happen in other RCs. RGM suggested we keep an eye on the situation, and be ready to react if it looks like we might get forced down the centralised-CPU route over the course of the next grant period. Software: RSC has worked on quality bit flags for VIRCam; NJC has been working on further integration of stacking/tiling processes. Survey Data Release: NCH suggested that a gentle reminder be sent to UKIDSS SHs concerning eyeball QC for Semester 10B to get the ball rolling on DR9. ACTION: MAR to nudge UKIDSS SHs on Semester 10B eyeball QC. Non-survey Data Release: NJC noted that a request for a multi-projecy uber-survey in Orion from Bo Reipurth is being dealt with via a new programme build for WSERV5. Astrogrid deployment & Data Analysis services: MAR noted that the latest topcat release has ADQL functionality direct to TAP services, so all the UKIDSS world releases (and indeed any other catalogue published to the VO from WFAU's datasets) is now available via that mechanism as well as all the others. Miscellaneous: Nothing else to report this time. ============================================================= Nigel Hambly Tel: +44-131-668-8234 Institute for Astronomy Fax: +44-131-668-8416 School of Physics and Astronomy University of Edinburgh Email: nch@roe.ac.uk Royal Observatory Blackford Hill Edinburgh EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. ============================================================= -- Scanned by iCritical.