From nch@roe.ac.uk Sun Nov 6 20:35:04 2005 Date: Fri, 4 Nov 2005 17:50:16 +0000 (GMT) From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Johann Bryant , Mike Read , Nigel Hambly , Nicholas Cross , Bob Mann , Ross Collins Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Andy Adamson , John Taylor , Jim Emerson , Malcolm Stewart , Martin Hill , Mike Irwin , Peredur Williams , Stephen Warren Subject: WFAU WSA weekly meeting minutes, 4 November 2005 Minutes of WFCAM Science Archive meeting: 4th November 2005 ------------------------------------------------------------- ------------------------------------------------------------- Present: NCH, RSC, PMW, ETWS, MAR, NJC, JDT Apologies: MCH, RGM, JPE, AL, JMS, JB NOTE: no meeting next week since there is a UKIDSS Consortium Meet. DONM: 10am, Friday 18th November 2005, plate library Actions discharged: ------------------- ACTION: PMW to try new cross-ID tool Discharged: some minor issues being addressed, but otherwise works very well. Launch of new facility will coinicide with the next WSA data release. ACTION: NCH to contact VDMT concerning the Nov 8th meeting. Discharged: meeting to take place face-to-face in Edinburgh on Tuesday 8th Nov at 2pm with MJI and STH in attendance from CASU. ACTION: JB to detach DB USNOB from public SQL Server on amenhotep Discharged ACTION: MAR to put notes on the SSA and WSA web pages to the effect that USNOB has found to be corrupted and will remain unavailable until further notice. Discharged ACTION: NCH to notify Jan Vandenberg at JHU that the USNOB SQL DB has been found to be corrupted. Discharged ACTION: JB to put some notes on the WFAU Networking TWiki topic from his own (and PMWs) meeting notes concerning UKLight. Discharged; note also that a communication has been received from ACD at NeSC regarding the way forward. ACTION: MAR & JB to attach a copy of the existing UKIDSS release to the load server ahmose and check interface connectivity in advance of the public server being taken offline next week. Discharged Actions partly discharged but continuing: ----------------------------------------- ACTION: NCH and PMW to meet on Mon 31st to assemble the Q4'05 and Q1'06 VDFS work plans Continues; PMW and NCH met on Wed 2 Nov and assembled the Q4'05 plan; PMW has outlined the Q1'06 plan. ACTION: MAR to switch on the "save to MySpace" WSA Interface button. Continues; implemented but cannot test because AG has been down most of this week (some kind of hardware problem... we sympathise). ACTION: JDT to set up a Datascope Launcher for the WSA on the AG workbench pages. Continues; implemented, but timing/scheduling issues so not live yet. Actions carried forward from 28/10/05 meeting: ---------------------------------------------- ACTION: NCH to investigate the usefulness of a NAS solution for medium term archive mass storage. - CONTINUES; see note in CASU minutes below. Specific points and new actions: -------------------------------- Project management: NCH noted the various meetings happening next week: VDMT on the 8th at 2pm; Annual ROE workshop on the 9/10th, and then UKIDSS Consortium meeting on the 11th. NCH suggested that it might be a good idea to sit down with the CASU folks after VDMT to chew over any outstanding issues concerning WFCAM data. The team filled in the progress chart for the first month of Q4'05; PMW will assemble the usual reports for distribution prior to the meeting. WFCAM update: See the stop press pages linked from the TWiki for latest news. Comments and issues arising from CASU fortnightly minutes: No new minutes as of 4/11/05. Networking: ETWS reported: "Transfer of the rest of the available data (June 2005) went well with an overall rate of 5 MB/s for 1.8TB." WSA Operations: ETWS reported that the ingest of the SV1 and 2 data has gone well. JB reported: "USNOB as detached on Amenhotep. UKIDSSR1 was transfered from Amenhotep to Ahmose (along with usernames) on Tuesday morning leading so an hour or so's downtime for it, Mike redirected the interface and we were up and running again. cu3 and cu4 finished at the end of last week, and finished being bulkloaded into the WSA again after the WSA rebuild (see hardware issues). System backups went on as normal despite Amenhotep having new disks added (which got an extra one just before shutdown). UKIDSSR1 was backed up as it seems the we didn't have a copy on tape of the latest version. Hardware: ETWS reported: "khufu is now up and running, all the software is installed, we are now running gcc4.0.2 and python 2.4.2. " ETWS reported that software installations on khufu (under Debian Sarge and most recent g++ compilers) is progressing. JB reported that all is well with the various servers and RAID arrays, despite two consecutive power cuts on Tuesday (thank the gods for UPSs, once again). JB reported: "Amenhotep now has new disks, has had it's system rebuilt and is in the process of having it's databases restored to it. PSSA is already on it as are usernames (which hasn't changed in the last few days of being on Ahmose) and WebQueryTables. Sneferu suffered a disk error late last week but the disk has been rebuilt and there seem to be no more problems with it up to now. Ahmose had two disks in the same RAID go at once and the configuration in the controllers NVRAM disappeared, the RAID that went was the one with Ahmose's system partition on it too so Ahmose went down. The disks were manually readded to the RAID once the NVRAM's configuration was restore to it from disk, the only damaged data was, ironically, the WSA which was recreated and rebuilt from the flat files. Ahmose now seems to be back in working order." Software: NCH and RSC have been working hard on the CU7 low-level C/C++ codes, debugging and fixing pernicious seg faults / mem leaks etc. ETWS and MAR have continued working on non-survey related software, as well as doing the usual fixes to existing codes and developing functionality. Survey Data Release: Hardware and software glitches have put back the release of SV1+2 to next week... which coincides with the workshop and UKIDSS shenanigans. Dame Fate vomits in our laps once again... Non-Survey Data Release: As noted above, MAR and ETWS working hard on this. Interim arrangements have been made with users insisting on access now. Astrogrid deployment: JDT reported that the "datascope launcher" is ready to go, but that some cosmetic issues need to be discussed. ACTION: MAR and JDT to discuss details of the WSA datascope launcher sometime next week. JDT also noted the AG Consortium meeting that is to take place on the 5/6 December at Jodrell Bank. Miscellaneous: Finally, NCH noted that he has put the outline of a main-journal write-up of the WSA project on the UKIDSS TWiki (URL distributed by email) and any comments would be appreciated.