From nch@roe.ac.uk Fri Jun 10 14:04:03 2005 Date: Fri, 10 Jun 2005 12:19:28 +0100 (BST) From: Nigel Hambly To: WFCAM Science Archive Team -- Eckhard Sutorius , Mike Read , Nigel Hambly , Nicholas Cross , Bob Mann Cc: CCs for WSA weekly meeting minutes distribution -- Andrew Lawrence , Andy Adamson , John Taylor , Jim Emerson , Malcolm Stewart , Martin Hill , Mike Irwin , Peredur Williams , Stephen Warren Subject: WFAU WSA weekly project meeting, 10th June 2005 Minutes of WFCAM Science Archive meeting: 10th June 2005 ------------------------------------------------------------- ------------------------------------------------------------- Present: NCH, ETWS, PMW, MAR, JMS, AL, RGM Apologies: MCH, JPE, JDT, NJC DONM: 10am, Friday 24th June 2005, plate library Actions discharged: ------------------- ACTION: NCH to gently nudge Jan to see what the hold-up is over DR3. Discharged; data are ready to copy, Jan has to enable our IP address on the JHU secure server before transfer can comence. Awaiting the all-clear from Jan before instigation of transfer. Actions partly discharged but continuing: ----------------------------------------- None this week. Actions carried forward from 27/05/05 meeting: ---------------------------------------------- None this week. Specific points and new actions: -------------------------------- Project management: NCH noted that the main issue arising from last week's VDMT meeting was the subject of the VDFS UK review. A decision as to the timing is now expected after the next VDMT meeting (face-to-face at CASU on July 8th). NCH has curculated details of the archive documentation and a suggested set for the review for the management team to look at well in advance of this meeting. NCH noted that shortlisting for the archive developer position will happen directly after this meeting [Note added after: a shortlist of 7 candidates for interview has been drawn up, and interviews are scheduled for Thurs 23rd June]. WFCAM update: The first block of survey observing finishes this week; see the stop press pages linked from the TWiki for latest news. Comments and issues arising from CASU fortnightly minutes: No new minutes as of 10/06/05. Networking: Nothing new to report. Hardware: All archive hardware are functioning normally. Software: ETWS reported that the major ingest software problem has been fixed. All memory leaks and memory fragmentation problems have been identified and worked around; the code runs well on small batches of files and will be tested on large batches using the SV data. NCH thanked ETWS for his sterling efforts in this regard, and noted that IAB had been contacted and had given an immediate and encouraging response, saying that he is very keen to support his software legacy at the IfA and will help out in any way he can when we encounter problems. MAR reported: "Turned on user verifcation via entries held in the database and maintained by community contacts (JACH community added). Think it should be reasonaly easy to allow access (archive listings and freeform SQL) to open time data by altering the login session management that will then point the servlets at the relevant database. Will need DB logins for each open time programme and an open time community. Might also need "schema browser" docs for each programme. Added "frame type" functionality to archive listing servlet. Also now returns column name links to glossary entries. Added tooltip titles to sidebar on webpages and started on "new users start here" page." Data Release: Reprocessed commissioning data release is expected to take place today, after some final bug fixing and final administrative tidy-up. AL asked what the procedure was, and NCH responded by saying that for these initial releases, a communication is sent to SJW and it's his decision as to whether to inform the entire UKIDSS community or just the testers. A further issue arose as to the status of community registration and when to go live with the full-blown system. The situation at present is that the administrative software and pages are all up and running. Some discussion ensued about whether to get all community contacts to start administering their communities now, or whether to wait (e.g. for big splash publicity purposes when a science-ready release is available). NCH pointed out the tight timescale for science verification and associated meetings, and the team agreed that it really is a question of how widely the science verification data is going to be released. If the UKIDSS testers community only are going to have access, then there is no need for other communities to be set up now; however if the idea is to throw science verification open to the whole of UKIDSS, then it might make sense to get the contacts to start uploading their community details now. NCH and JMS expressed the opinion that as wide access as possible will be needed to maximise feedback, but PMW expressed concern that it might be unwise to let too many people have access at this stage. AL agreed to contact SJW directly about this. ACTION: AL to contact SJW concerning his wishes for science verification data access. Another issue arose as to non-survey PI programme access. NCH noted that more requests for info are coming in by email concerning private programme PIs data access. NCH has email AA to ask his advice on where to get the required info to drive ingest and (limited) curation; however the team agreed that ETWS's suggestion for setting up a web form and automated schema generation might be the best way to handle this. NCH suggested that we discuss this offline. ACTION: NCH, MAR and ETWS to discuss implementation of an automated procedure for harvesting non-survey PI requirements. SSA: Nothing new this week Astrogrid deployment: No news this week. Miscellaneous: RGM noted that the fledgling project using EPCC effort to help kick-start the experiments with the Storage Area Network for VDFS v4 scaling studies has unfortunately come to nought. Work on this will now have to wait until NCH has more time to allocate to this.