From mar@roe.ac.uk Tue Sep 15 15:17:25 2015 Date: Tue, 15 Sep 2015 15:17:21 +0100 From: Mike Read To: VDFS Science Archive Team -- Clive Davenhall , dmr@roe.ac.uk, Eckhard Sutorius , Mark Holliman , Nicholas Cross , Nigel Hambly , Rob Blake , Ross Collins , Stelios Voutsinas Cc: CCs for VDFS -- Alastair Edge , Andrew Lawrence , Bob Mann , Dante Minniti , James Dunlop , Jim Emerson , Keith Noddle , Lorenzo Rimoldini , Maria-Rosa Cioni , matt.jarvis@astro.ox.ac.uk, Mike Irwin , Nigel Metcalfe , Norman Gray , Phil Lucas , Richard McMahon at IOA , Simon Dye , Stephen Warren , Tom Kerr , Tom Shanks Subject: WFAU VDFS Science Archives progress meeting minutes, 4 September 2015 WFAU VDFS Science Archives progress meeting minutes, 4 September 2015 Present: RSC, NJC, ETWS, RPB, MAR, MSH Apologies: STV, KTN, AL, RGM, ACD DoNM: 10am Friday 18 September 2015 in the Villas meeting room, ACD in the chair (room is booked). Actions discharged this time: ---------------------------- ACTION: MAR to contact Mike Irwin about resuming WFAU/CASU telecons. Telecon scheduled for Wednesday 16th September. ACTION: NJC had noticed a new problem when some of the code was run on Teti (which has the more recent libraries installed). He should isolate and characterise this problem so that it could be investigated. A particular issue with pyFITS had been fixed but there were some issues with running software on the latest installs. It looked to be a cfitsio path issue as it seemed to depend on the user i.e. works for scos but not RSC or NJC. NEW ACTION: NJC and ETWS to troubleshoot software/path issues on recent installations. Actions carried forward from 21/8/2015 meeting: ---------------------------------------------- ACTION: RGM to investigate the size and content (how does it differ from DR9?) of SDSS DR10 to see if it is worth us hosting and whether it is necessary to keep all of the earlier releases. Continues. The first part had been done: the difference between DR9 and DR10 is largely the presence of additional spectra. The part of this action that continues is that RGM had not yet established which early releases could safely be scrapped. RGM also noted that that DR11 and DR12 were now available and now need to be looked at. For further details see the WFAU SDSS strategy wiki page: http://apache.roe.ac.uk/twiki/bin/view/WFAU/SDSSDRPlan ACTION: ETWS, with RPB, to develop an automated helper script to keep release DB files links updated. Continues: this action still has low priority. ACTION: ACD to obtain the details of obtaining an mxODBC licence from ETWS and progress obtaining a sufficient number of such licences. Continues. There are currently no issues in using the version of mxODBC we have but it is not desirable to do so in the long- or medium-term. ACD should liaise with MSH to ensure that cost of the mxODBC licences is included in the plans for spending the forthcoming hardware grant. ACTION: NJC noted that VISTA mosaicing crashes with normal filtering, which he should fix. Continues. NJC had implemented a fix and checked it into SVN. However, when it was run 'in anger' it still crashed. NJC to investigate. ACTION: NJC noted that he had received a report of a problem with the ESO VVV DR1 release which he should investigate. In one pointing the merged band catalogue contained fewer sources than expected. Continues. This action was low on NJC's priority list. Actions resulting from the VVV DR3 brainstorming meeting held on 24/2/15: ------------------------------------------------------------------------ ACTION: RPB to experiment with ingest via partitioned tables, along the lines of the SSIS paper. Continues (changed from 'deferred'). RPB had started looking at this but MAR and MSH were not sure if the tests to date were on properly partitioned tables. RPB and MAR to have a further look at the SSIS paper and partitioned tables. However as the VVV release was now running again, RPB noted that this was currently on hold. ACTION: RGM (was RSC, RGM): (i) RSC to write a succinct summary of the ingest and outgest problem that is the principal bottleneck with the VVV processing (briefly the ingest and outgest speed is limited to approx. 100 Mbit/sec for no apparent reason) and (ii) RGM to compose an e-mail message around this summary and send it to Ani Thakar. Continues. RSC had composed a succinct summary and sent it to RGM. RGM had emailed Ani Thakar but no reply to date. RGM had sent a reminder but had still received no response. Specific points and new actions: -------------------------------- Project management: * Nothing for the minutes. WFCAM, VISTA and VST updates: * Nothing to report; all the telescopes were believed to be operating nominally. Networking: * Nothing to report; the networks were performing nominally. WSA/VSA/OSA/GES Operations: * ETWS reported that he'd created a WSA LM test database and was ingesting data into it. OSA ingests into the uncorr tables were ongoing. The VSA browser had been updated to pick up the full glossary text. * RPB reported that vvvDetection had finished outgesting, tilePawprints was next. A VPHAS release was also running. Hardware and Systems: * MSH reported dead disks of ramses2 and piye. Eclipse were now on our list of preferred suppliers. Software: * NJC had updated code for the VPHAS release and worked on further variability code and tables. * ETWS reported that he had made minor fixes to the OSA and VSA code and updated the WSA to allow the satellite data into separate tables. Review of Deadlines: See: http://apache.roe.ac.uk/twiki/bin/view/WFAU/ForthcomingDeadlines Survey Data Release: * None Non-survey Data Release: * None Astrogrid deployment, VO & Data Analysis services: * Nothing to report; all systems operating nominally. Miscellaneous: * MSH and RSC noted that they would be away from 9-28th September and 14-28th September respectively.