From nch@roe.ac.uk Tue Dec 1 17:39:43 2009 Date: Fri, 27 Nov 2009 12:55:15 +0000 (GMT) From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Mike Read , Mark Holliman , Nigel Hambly , Nicholas Cross , Rob Blake , Ross Collins Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Andy Adamson , Jim Emerson , Malcolm Stewart , Lorenzo Rimoldini , Mike Irwin , Peredur Williams , Bob Mann , Stephen Warren Subject: WFAU VDFS Science Archive weekly project meeting, 27/11/09 Minutes of WFAU VDFS Science Archive meeting: November 27th 2009 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: PMW, NCH, MAR, RSC, ETWS, NJC, RPB Apologies: JPE, JMS, RGM, AL, MSH (Happy Thanksgiving) DoNM: 10am, Friday December 4th 2009 in the VISTA Hut Actions discharged this week: ----------------------------- ACTION: NJC to finalise VSA half-light radii detection table attributes. Discharged Actions partly discharged but continuing: ----------------------------------------- ACTION: RPB: backup all DB-driven products after UDS DR5. STILL awaiting delivery of SCSI card; RPB suggested we cannibalise ahmose's now that the tape drive has been shifted to the cluster. Scrapheap Challenge here we come. ACTION: RSC to review quality bit flagging for the VSA Continues Actions carried forward from 20/11/09 meeting: ---------------------------------------------- None this week Specific points and new actions: -------------------------------- Project management: Nothing of note this week. WFCAM & VISTA updates: ETWS has been working tirelessly on sorting out VSA ingest issues: "Finished upgrading CU4 to process VISTA catalogues. Main problem was that the starlink AST libraries don't understand the new WCS table standard. - Upgraded CU2 to create JPGs for non-MEFed tiles." ETWS noted that some weird issues have arisen with the C++ codes this week, with seg faults suddenly appearing, and not correlating with 32/64 bit, or WSA/VSA data. NCH asked RSC to profile using valgrind (or similar) to check for pernicious bugs ACTION: RSC to profile C++ codes (eg. exnumeric) to diagnose seg faults ETWS noted he'll return to working on the tile ingest issues now that VISTA catalogues are ingesting OK. Comments and issues arising from CASU minutes: Nothing new this week. Networking: Nothing new this week. WSA/VSA Operations: RPB noted: "GPS reprocessed data is now fully ingested and QC'd. CAL release has begun. Currently updating pperrbits. Probably another week or so of work to get to the release stage. Lots of wee wrinkles ironed out on the cluster, mostly to do with user permissions since the web interface was switched over. Symantec BackupExec reinstalled from scratch on the cluster to avoid any lingering problems from using the older database version imported from Ahmose. Will run a full WSA backup over the weekend and then proceed with a programme of taking new backups of everything." Hardware and Systems: MAR and RPB have sorted out UI access for the WSA (and legacy SSA) DBs on the cluster; all seems well (so far...) Software: RSC noted: - Sorted out the CU7 problems with appending second+ epoch frames into frame sets for the GPS DR6 run. - Updating post-CU24 scripts (CU7, CU16 & CU19) to be archive agnostic for VSA operations. Will test in a TestVSA database once some detections have been ingested into the VSA. NJC has finished the basic half-light radius schema and code and tested it; has made adaptions to the totalExpTime for VISTA data; and has helped RPB run the standard star data through the pipeline. RSC asked about the "missing statistics" problem in release DBs, and MAR noted that he'd also come across this. RPB is examining SQL Server documentation to educate us in the fundamentals; RSC suggested we perform a simple test with CU19, switching the auto-create-stats option on/off at DB creation time to see if it makes any difference to the known missing stats examples in the subsequent test release DB. Survey Data Release: GPS DR6 preparations continue in the background to the VSA work. RSC asked about the timescale for the next UDS mosaic; the assumption is that this will take a considerable time owing to the required J/H reprocessing so GPS DR6 should go out as soon as it's ready rather than waiting for UDS as happened for DR5. ETWS noted that we might need to run CU5 to get the non-survey H2/K pairs difference-imaged. Non-survey Data Release: No news this week. Astrogrid deployment & Data Analysis services: No news this week. Miscellaneous: So it appears that 2009 will go down in history as the year that some dubious character called Nick appeared on the BBC's Question Time ... ============================================================= Nigel Hambly Tel: +44-131-668-8234 Institute for Astronomy Fax: +44-131-668-8416 School of Physics and Astronomy University of Edinburgh Email: nch@roe.ac.uk Royal Observatory Blackford Hill Edinburgh EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. =============================================================