From nch@roe.ac.uk Fri Jul 21 20:32:20 2006 Date: Fri, 21 Jul 2006 11:57:30 +0100 (BST) From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Johann Bryant , Mike Read , Nigel Hambly , Nicholas Cross , Bob Mann , Ross Collins Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Andy Adamson , John Taylor , Jim Emerson , Malcolm Stewart , Mike Irwin , Mark Holliman , Peredur Williams , Stephen Warren Subject: WFAU WSA weekly meeting minutes, 21st July 2006 Minutes of WFCAM Science Archive meeting: 21st July 2006 ------------------------------------------------------------------------- ------------------------------------------------------------------------- Present: NCH, PMW, RSC, ETWS, JB, MAR, JMS Apologies: JPE, AL, RGM, MSH, NJC DONM: 10am, Friday 28th July 2006 Actions discharged this week: ----------------------------- ACTION: NCH to forward DR1 website to all so that folks can check the content. Discharged; web site has been checked by the whole team and by several UKIDSS folks. Actions partly discharged but continuing: ----------------------------------------- None this week. Actions carried forward from 14/07/06 meeting: ---------------------------------------------- ACTION: JB to review Hardware/OS/DBMS design doc to note areas that need updating and itemise new sections required - CONTINUES: Note that this is on hold until after DR1. Specific points and new actions: -------------------------------- Project management: NCH noted that there is a VDMT here on the 24th July, 2pm. PMW and NCH will be in attendance. PMW has prepared the usual charts and will put together a narrative. NCH suggested that it was not necessary for any other team members to sit through the meeting. NCH and PMW also noted the UKIDSS Consortium meeting, again here on the Tues 25th, all day. Again PMW and NCH (and possibly NJC) will attend; because much of the meeting would be taken up with high-level discussions concerning submission of the case for renewal after the 2-year plan, NCH again suggested that no other WSA team attendance would be required. Finally, JMS gave the team an update on the current VISTA schedule WFCAM update: Nothing new to report this week Comments and issues arising from CASU fortnightly minutes: No new minutes as of 21/7 am. Networking: Nothing new this week. WSA Operations: Operations have been entirely soaked up with DR1 preparations this week: running the final release procedure (CU19) in parallel with insertion of the (lately delivered) UDS data, then fettling to copy in the latter, etc. etc. A last minute fix to the GPS was also required. Routine backups proceeded as normal; ingest and DR1 backups would take place asap after release. Hardware: JB and RGM have been updating the hardware TWiki topic with further info concerning EUCS SAN provision. Interestingly, the cost profile does not compare favourably with our current home-grown solution; in any case, the TWiki material will form the basis of a new section in the Hardware documentation to be reviewed in October. Thanks to Astrogrid, another 4TB JBOD has been ordered for the high-capacity catalogue server to enable online storage of SDSS catalogue releases after DR3 (see below). Software: RSC reported: "In the development branch, I've updated the documentation of CU16 to the current standard. As well as creating generic Outgester and Ingester classes (based on DbSession classes) that will ensure all outgests and ingests are successful without crashes induced by NFS time-delays and schema discrepancies respectively. On the CVSUsagePolicy TWiki page, I've placed a note on why we shouldn't move files around in the CVS repository following the DR1_FINAL tag (see http://apache.roe.ac.uk/twiki/bin/view/WFAU/CVSUsagePolicy). Finally, I've tidied up the front WFAU TWiki page, renamed some TWiki topics to make them into proper WikiWords, and fixed up parents to reflect the current structure. Have a look around to acquaint yourself with the new design; I believe the locations of the TWiki topics are all fairly intuitive now. 90% of topics still have the same name (so old non-TWiki links still work)." NCH reported fixing a small bug (his bad) in CU19, and JB and NCH have identified a small procedural inconsistency in CU7 that will need looking at after the dust has settled on DR1. NCH also reported some progress on the WSA write-up. MAR reported updating WSA site for DR1 release and updating some of the UI code for the new database(s). The indefatigable NJC and ETWS worked hard at sorting out the UDS at the beginning of the week, with great success. Survey Data Release: NCH reported that the DR1+ database creation finished overnight, and the DB is currently being copied over to the public catalogue server. This is actually quite an achievement given its size, and the lateness of delivery of the UDS products, which has essentially left WFAU no time to run the final preparation procedures, let alone test the integrity of the DR1/DR1+ databases created in the final mad rush. In parallel, the DR1 subset is being created on the catalogue load server; this process will likely take the rest of today. The team discussed the best approach to the actual release procedure, and decided that it would be best to "switch on" DR1+ as soon as all is verified as working today; DR1 will be attached to the public server asap but this will likely not happen until Monday AM. Once again, any complaints about tardy release should be emailed to Dr.LikeIGiveADamn@where.the.sun.dont.shine Non-survey Data Release: Non-survey release status will undergo review next week. Astrogrid deployment: AG have been most generous in contributing funds for a 4TB JBOD to attach to WFAU's high-capacity catalogue server (thutmose) in order to enable online storage of all the SDSS catalogue database products. DSA access to DR3 will be implemented next week: our understanding is that all AG components are now in place and working; DBMS server access is set up on the server side; NCH has passed the necessary schema information to ETWS for parsing into a suitable XML format for the service registry entry. Switch-on is scheduled for later next week. Miscellaneous: RSC noted that he has reorganised the WFAU TWiki site to make navigation much easier and to generally tidy things up. All team members are encouraged to have a look.