1.1 report to VISTA, UKIDSS, JAC, ATC, GSC - provide fortnightly meeting minutes, monthly reports on progress + quarterly review reports and planning, attend, prepare for and give talks at UKIDSS, VDUC meetings produce draft functionality document for VDMT --> VDUC have telecons as needed with JAC, [held minuted CASU meetings, attendend VPHAS VHS planning meeting, helped prepare assorted VISTA public survey proposals] 1.3b VISTA ICD between CASU and WFAU liase with WFAU, camera and telescope team for design of VISTA FITS headers for input to ICD PSB 1.4b monitor and update proposed VISTA FITS headers PSB give feedback on test FITS files test conformance of output FITS files with ICD [fedback comments on FITS headers; liaised with VIRCAM team on test data required and wrote wishlist document; wrote a detailed note arguing the case for fixed ordering of the FITS extensions; ] 1.5a define WFCAM observing protocols monitor and update MSB guidelines STH monitor observing efficiency and report DWE 1.5b define VISTA observing protocols liaise with development team PSB [discussed twilight flatfield and linearity strategy with SMB] 1.6a WFCAM observing strategy and survey planning liaise and monitor progress STH 1.6b VISTA observing strategy and survey planning liaise and monitor progress PSB 1.7a liaise with VDUC on VDFS products for WFCAM liaise and monitor progress finalise reports on results from WFCAM 05A SV data JRL/MJI/EGS/STH provide input for UKIDSS papers STH respond to issues raised re: data processing MJI [reports updated; input provided for UKIDSS survey and FDR papers] 1.7b liaise with VDUC on VDFS products for VISTA liaise and monitor progress assess and prioritise work for extra UK VDFS products MJI+STH revisit WPs for V1-5 in lieu of above MJI+STH 1.8a WFCAM survey progress database maintain OMP database mirror to be used with survey JRL progress database, including simplified user interface and script to add MSB flags to processed data headers [fixed with JAC help assorted problems with OMP mirror; script written to extract MSB information from database but needs upgrade to OMP database (in progress) before can implement] 1.9 system documentation update and maintain web pages of system docs DWE setup and switch over to new Plone system EGS [significant overhaul and testing of the new plone system; internal web pages rationalised and reorganised] 1.10 VST processing preparation help produce draft Survey Management Plan for ATLAS,VPHAS+ EGS+MJI [survey management plan written for VPHAS+ in collaboration with PI and NAW; this provides the frist draft for the ATLAS proposal] ----------------------------------------------------------------------------- 2.1 DFS impact document signed, and sealed PSB assess if further changes naeeded after tests 2.2 Calibration Plan update document in parallel with DRL development PSB get v1.2 signed by PS, PI [updated in parallel with DRLD changes; distributed draft v1.3 to support DRL v0.1; met with Cohen re. absolute calibration] 2.3 Data Reduction Library Design document update document in parallel with DRL development JRL [DRLD document is being updated in line with DRL development] 2.4 Data Reduction Library continue development of DRL JRL continue testing of DRL in CPL environment PSB release version 0.1 CPL recipes and modules JRL release minor version updates of DRL as required prior to 0.5 JRL liase with ESO on integrating and commissioning modules into PSB pipeline environment" [DRL v0.1 was delivered to ESO; the corresponding DRLD was signed off; development and testing of updated DRL versions continues; liaising with ESO on using VDFS modules to test new ESO pipeline environment] 2.5 ICD ESO/VPO update FITS header docs, DID/DIC and data dictionary files PSB submit VLT SPR re QFIYS Table BLOCKED keyword [negociated SPR re: FITS extension ordering] 2.6 Instrument specification and interface documents develop integration tests in CPL+QFITS environment PSB [various tests are being developed for the deliver DRL recipes] 2.7 Update and maintain ETC setup UK-based demonstration prototype of ETC PSB update ETC with better characteristic data PSB deliver ETC calculation modules and instrument PSB description data to ESO [UK ETC setup and released to the unsuspecting public; better characteristic data tables produced and added; ETC modules, tables and document (v1.1), C code and current characteristic data delivered to J. Vinther at ESO] 2.8 liaise with VISTA IR camera and TCS development teams liaise with VISTA IR camera development team PSB use data from RAL operation of VIRCAM and TCS simulator PSB to assess VIRCAM system test successive simulators, feedback comments [much discussion on FITS headers and FITS data ordering; tested data; fixed WCS and detector IDs in AIT data so data displays physically ] 2.9 development of DQC measures update QC measures as needed in light of test data PSB 2.10 documents for software modules [man pages/doxygen updates made] ------------------------------------------------------------------------------ 3.1 interactive tools for running pipeline update tools in light of 05A,B experience and document JRL 3.2 high level scripts to interrogate headers update header interrogation scripts and test MR+EGS 3.3 automatic progression of results to web pages maintain and update web-based pipeline progress web page MR 3.4 automatic checks to spot failure of pipelines continue developing automated checks for pipeline fu's JRL 3.5a tools for fixing problem datasets continue developing tools to handle problems in WFCAM data JRL [an improved sky estimation algorithm has been developed and tested which uses ALL available suitable frames to determine a more "local" sky frame to improve object rejection and rms noise contributions] 3.6 group documentation on pipeline infrastructure stress test documentation and update as necessary STH 3.7 oversee reprocessing WFCAM data after bug fixes/improvements reprocess science data from 05A,B as necessary MR [removed and subsumed in 6.8a] ------------------------------------------------------------------------------ 4.1 extend UKIRT archive for WFCAM data manage WFCAM raw data archive MR manage and monitor WFCAM - ESO raw data transfers MR [WFCAM raw archive updated as new data came in; 05B transfers to ESO complete] 4.2 ingest and verify WFCAM data ingest and verify 05B WFCAM data MR [all 05B data ingested, verified and fixed where necessary] ------------------------------------------------------------------------------ 5.1 assess hardware alternatives investigate options for more bulk disk storage PSB+MJI [investigating and trialling new bulk data storage systems] 5.2 buy hardware and install as required PSB+MJI 5.3 integrate and test any new kit PSB+MJI 5.4 manage maintain and upgrade JMI continue maintenance and upgrade programme [all processing machines upgraded to Debian Sarge 2.6 kernel] 5.5 hardware additions for further processing monitor need for extra hardware for further processing MJI [no additional CPUs needed yet] ------------------------------------------------------------------------------ 6.1a update WFCAM master calibration frames continue updating and testing calibration frames JRL+MJI [new master flats and confidence maps created as needed] 6.2 monitor WFCAM detector performance monitor with 05A and 05B data MR [monitored as part of QC checks] 6.3 oversee WFCAM standard processing process 05B data MR [05B data processed] 6.4a astrometric calibration WFCAM (re)calibrate 05A and 05B data MJI [completed] 6.5 photometric calibration WFCAM calibrate using 2MASS and continue STH compare using UKIRT FS stds develop secondary standard fields update ce's, devise scheme for Y and Z [recalibration underway using restricted 2MASS colour range; testing reliability of Z and Y calibration using external datasets] 6.6a verify science products and monitor WFCAM DQC measures assess 05A and 05B data EGS+MJI [SV of products ongoing see ....... and SV report at ........; EGS produced stacks of the DXS data and catalogues for the EDR] 6.7 monitor data product transfer to WFAU continue data transfer to WFAU and monitor MR+MJI [extensive discussions and investigations of network transfers, bottlenecks and possibility of installing UKLight connectivity] 6.8a reprocess WFCAM data as required reprocess if major bug fixes [fixed problem caused by complete lack of detector#3 for 3 nights; reprocessing of 05A started] ------------------------------------------------------------------------------ 7.1b interface test pipeline to VISTA summit DR [held discussion with ESO DMD about testing procedure for VDFS pipeline modules within new ESO software infrastructure (Condor)] 7.4a upgrade and maintain WFCAM summit pipeline upgrade and maintain as required JRL [fixed minor problems as they arose] ------------------------------------------------------------------------------ 8.1a further development of WFCAM standard pipeline update and maintain as required JRL assess persistence characteristics and develop trial version DWE [persistence report completed and released ......] 8.2a liaison with WFCAM development team continue telecons and discussions JRL [assorted discussions via email] 8.2b liaison with project scientist and VISTA development team assess any new engineering detector test data PSB 8.3b partake in planning VISTA commissioning observations liaise and discuss with camera PS and VISTA PS STH find out about current commissioning plans STH [fedback comments on VISTA technical specification documents] 8.5a tune WFCAM pipeline as needed keep on tuning as newer data comes in assess quality of science output EGS [various minor improvements implemented; science tests made on 05B data] 8.6a documentation for WFCAM processing software update software docs as necessary JRL+MJI produce photometric calibration paper STH produce data processing technical description paper MJI [produced diagram to explain cross-talk pattern and updated the SV report] 8.6b documentation for VISTA processing software document within recipes C module code doxygen compatibile [documentation added as code is written] 8.7 comparison between automated and manual data products assess CASU processed WFCAM SV data in conjunction with CSV STH and Survey Heads [various reported problems analysed and if real assessed; examples of quality of science data to be expected produced and included in SV report and on survey progress web pages] ------------------------------------------------------------------------------ 9.2a refine astrometric calibration model refine astrometric model MJI [no refinement yet needed since meets requirements and goals] 9.4 assess catalogue parameter reliability ibid do in conjunction with 9.1 MJI [completed - assessment finished in conjunction with science verification and CASU internal tests] 9.6 completeness design and report on completeness model check completeness and error estimates EGS [no progress] 9.7 update catalogue products documentation update catalogue products documentation MJI [technical description paper drafted (see also 8.6a)] ------------------------------------------------------------------------------ 10.1 manage and run further processing stages [still awaiting PSF V1,2 development completion] 10.2 development and assessment of PSF options 1,2 run prototype version of code for PSF levels 1,2 on 05A data DWE [another PSF report released ....] 10.3 develop 1D/2D PSF-deconvolved Sersic profile fits prototype methods for Sersic profile fitting MJI [no progress] 10.4 feasibility of nebulosity detection and parametersiation investigate feasibility of above MJI [waiting for results of improved sky subtraction] 10.6 develop and optimise Bayesian image classification trial Bayesian classification schemes MJI [testing Bayesian methods on real data] 10.7 completed (need to check if any work done in Q1) modelling and simulations of further processing steps simulate WFCAM data and use for PSF tests DWE [completed] ------------------------------------------------------------------------------ 11.2 choose secondary standards WFCAM + VISTA add in remaining stds and update doc (cf. 2.2) STH [no progress 2MASS calibrators working well] 11.4a WFCAM photometric zeropoints and colour equations maintain and update as necessary (see 6.5) [calibration report written and circulated, recommendations made; meeting with Martin Cohen to discuss absolute calibration held] 11.5 secondary standard system create secondary standard fields system to check 2MASS cal STH 11.6 investigate photometric calibration systematics stack 2mass residuals and assess STH 11.7 assess extinction monitoring methods use 2MASS comparison for direct estimate and assess STH expected accuracy in light of results from UKIRT FS [2MASS calibration on a per catalogue basis has removed need for individual extinction measures; now refining photometric quality measures for each catalogue product and for overall night measures] ------------------------------------------------------------------------------ 12.1 develop extra systematic noise measures awaiting VISTA test files MJI [still waiting] 12.2 refine current measures for WFCAM continue monitoring the DQC assessment by visually checking random sub-sample MJI+MR [DQC monitoring completed for 05A and 05B] 12.4 master calibration frames for detector monitoring assess quality and stability of calibration frames inc. sky MR [completed for 05A and 05B, drafted paper on properties of sky] ------------------------------------------------------------------------------ 13.2 list driven photomater test 80 parameter set (now subsumes 13.3) MJI [development completed now needs porting to C version for pipeline] ------------------------------------------------------------------------------ 14.4 stacking with optiumum weighting refine using WFCAM deep survey data and optical data MJI trial different interpolation options for WFCAM deep surveys [investigated and evaluated literature for alternative methods] 14.5 advanced stacking for variable PSF investigate alternatives as part of UK design review MJI [investigated and evaluated literature for alternative methods] ------------------------------------------------------------------------------ 15.3 develop and maintain adaptive kernel option same as before ie. keep using it and debugging MJI [maintained and updated as needed] 15.4 time series photometry test with WFCAM data STH [initial results promising using DXS and transit data fields] ------------------------------------------------------------------------------ 16.2 implications for different stacking methods completed and further dev in 14.4 16.3 implications for deriving object parameters finish testing of astrometric refinement code DWE [a better PSF determination method has been developed but the PSF refinement code is still being debugged to give optimum results] 16.5 develop oversampled spatially varying PSF model assess spatially varying PSF models, test on 05B data DWE [on hold until further tests on 05B data with V1,2 simple single PSF model completed]