From nch@roe.ac.uk Mon Jul 1 09:48:32 2013 Date: Fri, 28 Jun 2013 17:25:01 +0100 From: Nigel Hambly To: Eckhard Sutorius , Nicholas Cross , Rob Blake , Ross Collins , Mike Read , Clive Davenhall , Mark Holliman Cc: Lorenzo Rimoldini , Bob Mann , Jim Emerson , Keith Noddle , Norman Gray , Stephen Warren , Tom Shanks , Simon Dye , Stelios Voutsinas , Tom Kerr , Mike Irwin , Andy Lawrence at ROE , Nigel Metcalfe Subject: WFAU VDFS Science Archives progress meeting minutes, 28 June 2012 Present: RPB, RGM, NJC, MSH, MAR, ACD, ETWS, NCH Apologies: JPE, AL, STV, NG, KTN, RSC DoNM: 10am Friday July 12th 2013 in the Villas meeting room ACD in the chair (room is booked). Actions discharged this time: ----------------------------- ACTION: NCH to enquire with MAST as to the status of GALEX GR6 & 7 and see if an exchange of SQL DBs is warranted. Discharged; turns out that the latest DB has significantly more coverage e.g. in the Magellanic Clouds and Kepler field etc. so it has been agreed with MAST to exchange copies of GALEX GR7 and UKIDSS DR8 (complete with GPS and not to be made public before mid-August in line with the WSA release policy). ACTION: NJC to add a note to VSA knownIssues detailing VMC photometry problem. Discharged ACTION: MAR to add a note to WSA knownIssues detailing GPS astrometry problem in DR8. Discharged Actions partly discharged but continuing: ----------------------------------------- ACTION: MAR to have a go at releasing other VISTA PI DBs (e.g. for JPE) Continues; some QC issues with some projects; RPB noted that "part 2" of the release process was on hold but that it can be restarted this morning. Actions carried forward from 14/06/2013 meeting ----------------------------------------------- ACTION: ETWS, with RPB, to develop an automated helper script to keep release DB files links updated. Continues; this one still has low priority. Specific points and new actions: -------------------------------- Project management: WFAU quarterly was postponed to some future date TBC. NJC noted that he attended the VMC telecon yesterday; he will forward the minutes. WFCAM, VISTA and VST updates: Nothing to report. Comments and issues arising from CASU minutes: No new minutes this time. Networking: ETWS continues with his DOS attacks on the CASU file servers; just over 2 months of Vista V1.3 data are left to transfer and now that the new mass-storage NAS is in place we have plenty of space. WSA/VSA/OSA/GES Operations: ETWS reported: -- Transfers for the VISTA v1.3 data are going well ahead, just 2.5 months left to transfer. JPG creation and metadata ingests are running in parallel, so that we can start catalogue ingest at the beginning of next week. -- Catalogue ingest of the last 4 month of WFCAM data has nearly finished as well apart from some non-survey data. -- For the VMC the 1.3 data has been ingested into the VSA to allow for a mixed version release. -- The AKARI LMC pointsource catalogue has been transferred and prepared for ingest into the AKARI database, and crossmatching with VMC, by RPB GES update: some interaction with the Consortium concerning the availability and provenance of radial velocity information at the WFAU archive end has (we think) been cleared up, subject to confirmation from Keele. ACD has visited CASU to introduce himself and get up to speed; he is now working on example queries to aid users in extracting information from the archive. Hardware and Systems: MSH noted that a new DB node (to be ordered) will host a set of 4TB disks, and he was thinking of using this to serve large external DBs. Alternatively, it could be used as an ingest server for VVV, perhaps employing RAID10 which offers a speed advantage over RAID5 hybrid configurations (at the expense, of course, of half of gross storage volume). MSH noted also lots of work in trying to deploy the most recent MS SQL (2012 and 2008) but having difficulties with these and the associated Windows server editions made available by Microsoft. Investigations and tests continue. Survey Data Release: VMC consortium release, to the specification of the PI, is in preparation. VVV consortium release continues to grind away; more speed-ups are being identified and implemented to expedite. The team discussed the imminent ATLAS release through the new user interface, and agreed that the mid-July timescale was OK but that things must not be allowed to drift much beyond that date. Software: MAR reported: "Investigated using Aladin to generate "all-sky" (large mosaic) images. The resultant HEALPix based images can be viewed using Aladin or in the browser using Aladid-Lite. There's a note on the Twiki which includes links to all-sky images made from ATLAS - link (for internal perusal only at this stage): http://apache.roe.ac.uk/twiki/bin/view/WFAU/AllskyImages " NJC, RSC and RPB have been working steadily on CU6 speed-ups for the billions of VVV catalogue detections; also a huge speed-up for flat-file look-up updates has been identified. NJC noted also further work on the archive-end list-driven photometry pipeline. Non-survey Data Release: Nothing new to report this time. Astrogrid deployment, VO & Data Analysis services: Nothing new to report this time. Miscellaneous: RGM noted a visit this afternoon by an RA plus student from down the hill. The plan is to work on scale-out investigations with column-oriented RDBMS MonetDB, using VVV detection catalogue handling as a test case. NCH and RGM noted that the ADASS abstracts deadline (for talks at least) is imminent; both RGM and NJC are considering going and offering contributions to the programme. ============================================================= Nigel Hambly Tel: +44-131-668-8234 Institute for Astronomy Fax: +44-131-668-8416 School of Physics and Astronomy University of Edinburgh Email: nch@roe.ac.uk Royal Observatory Blackford Hill Edinburgh EH9 3HJ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. ============================================================= -- Scanned by iCritical.