1. INTRODUCTION
The calibration and analysis of Very Long Baseline Interferometry (VLBI) data has long been a time consuming process. However, with increases in computing power and hardware, it is becoming increasingly feasible to largely automate the process. The Korean VLBI Network (KVN) is an homogeneous radio array comprising of three antennas capable of simultaneously observing at 14 mm, 7mm, 3.5mm and 2.3 mm. The homogeneity of the array and the simultaneous multi-frequency capabilities allow for the transfer of phase solutions from lower frequencies to higher frequencies, make the KVN a suitable network to implement the automatic calibration of VLBI data.
Arrays such as the KVN can produce as much as four datasets simultaneously, creating a large workload for those reducing the data. Due to this and other factors, there is a large backlog of non-reduced data, not just on the KVN but on most VLBI networks. For this reason, there is a large need for either fully automating or at least partially automatising the reduction process. The technical means for producing a fully automatic pipeline for single-polarisation continuum data are already developed with the largest constraints being typically logistical. A station should ideally provide calibration information (e.g., system temperature, antenna temperature and gain information) and also a monitoring log of the telescope, VLBI recorder, VLBI back-end and receiver. This information should allow for data to be automatically agged. In many current VLBI experiments this information is unavailable or difficult to acquire. The KVN however largely provides this information. In this paper we describe a fully automatic pipeline for the KVN.
The European VLBI Network (EVN) is a large consortium of observatories that collaborate to perform regular VLBI experiments (Zensus & Ros 2015). Two pipelines have been developed to aid the calibration of EVN data. Before 2006, a pipeline was written as a special procedure within the Astronomical Image Processing System (AIPS) (Greisen 2003). The pipeline broadly followed the calibration procedure described in Section 3, but was not completely automated - although it greatly speed up the calibration process (Reynolds et al. 2002). A more recent pipeline also implemented in AIPS is the task VLBARUN, which applied phase and amplitude calibration to Very Long Baseline Array (VLBA) data before proceeding to produce a simple image. A newer pipeline was developed for the automated reduction of EVN data, written in the Python AIPS wrapper, ParselTongue and provides largely similar functionality to the earlier pipeline except while being more robust and easier to use (Kettenis et al. 2006).
This paper describes the automatic reduction software (pipeline) of an example KVN dataset and compares the results of the KVN Pipeline with that of the same dataset reduced in the manual way. In Section 2, we describe the observations that were used to test the KVN Pipeline, in Section 3, we describe the traditional approach to VLBI calibration, in Section 4 we describe the operation of the KVN Pipeline, in Section 5 we discuss the results and compare them against the traditionally reduced VLBI data and in Section 6 we present our conclusions.
2. OBSERVATIONS
The KVN is a telescope that consists of three antennas within South Korea in Seoul (Yonsei; KY), Ulsan (KU) and Jeju Island (Tamna; KT) (Lee et al. 2014). In order to describe the pipeline and analyse its performance, we selected a recent dataset observed as part of the interferometric MOnitoring of GAmma-ray Bright AGN (iMO-GABA) program. This program has been monitoring γ-ray bright AGN using the KVN at 21.7 GHz (14 mm), 43.4 GHz (7 mm), 86.8 GHz (3.5mm) and 129.3 GHz (2.3mm) since late 2012 and is ongoing. The program has been described in detail by Lee et al. (2013, 2015) and Algaba et al. (2015). The current experiment, the 32nd in the program was performed over 24 hours from March 1, 2016 until March 2, 2016. The observations were recorded in left-hand circular polarisation (LCP) mode at a recording rate of 1 Gbps in approximately 5 min long scans. The data were recorded with 2 bit sampling over four intermediate frequencies (IFs), with a total bandwidth of 512 MHz. The data were correlated at the Korean Astronomical and Space Institute in Daejeon, Korea.
3. VLBI DATA CALIBRATION
In general, there are two main stages in calibrating a VLBI dataset: amplitude calibration and phase calibration. These processes have been described in great detail in other sources such as Taylor et al. (1999) and also Martí-Vidal et al. (2012) for a description relevant to the complications of high frequency VLBI. Here we present a brief overview of the traditional approach to VLBI data reduction. In addition to the amplitude and phase calibration, additional steps such as bandpass calibration (performed using the AIPS task BPASS) and amplitude corrections computed from visibility autocorrelations (using the AIPS task ACCOR) are sometimes also performed.
3.1. Phase Calibration
Phase calibration has traditionally been the most difficult and most time consuming process in VLBI data reduction. In single polarisation data, there are two main phase calibration steps. The main tool in calibrating phases is a process called fringe fitting, where the amplitudes and phases are Fourier transformed into the delay and rate domain, and the peak in this plane is used to correct residual errors in the delays and rates and is normally performed using the AIPS task FRING. The first of the two steps involves the calibration of the phases within the intermediate frequencies (IFs), where unknown delays and phases are introduced by frequency dependent residual delay and phase errors. While this can often be calibrated for by the injection of pulses into the signal path, close to the receiver in VLBI, many stations may not be equipped with such features. Therefore, a process commonly known as manual phase calibration (MPC) is performed. MPC is performed by setting the delays and phases of a reference antenna to zero and performing a global fringe-fit (see Pearson & Readhead (1984) for details about fringe-fitting) to find delay and rate solutions independently for each IF. These solutions are then extrapolated to the rest of the dataset. MPC is typically performed on a strong source which will hopefully have common visibility with all stations in the experiment so that all other stations can be re-referenced against the reference antenna. If this is not the case, multiple MPC steps can be performed, by changing the reference antenna to a station that has already had the MPC applied and then performing MPC on scans with mutual visibility with the new reference antenna and the still uncorrected stations. This method assumes that the instrumental effects do not significantly change over the course of the experiment, which may not be the case and is a significant limitation of MPC. Once the MPC has been performed, a global fringe fit or multi-band solution is then performed.
3.2. Amplitude Calibration
Amplitude calibration is complicated at higher frequencies by the rapidly varying absorption effects in the atmosphere, so that in addition to the noise level of the receiver hardware (system temperature or Tsys), a time dependent opacity correction needs to be included. In a typical VLBI observation, Tsys values are provided to the observer. These values must then be formatted in such a way as to be directly readable into AIPS using the AIPS task ANTAB. For high frequency observations (at 7mm or shorter) it is also important to have station-based weather information provided. Of most importance for amplitude calibration is the atmospheric opacity as a function of frequency (τv). Usually, a linear fit between Tsys and airmass (computed from the weather data) is performed and then Tsys recomputed assuming zero air-mass (e.g., Martí-Vidal et al. 2012; Taylor et al. 1999). Once these corrections have been applied, the final Tsys values are used to convert the data from arbitrary units into Janskys (Jy). This is typically performed using the AIPS Task APCAL. In the case of the KVN, the opacity corrections have already been applied to the Tsys measurements and do not need to be corrected later in AIPS (Lee et al. 2014).
4. THE KVN PIPELINE
The KVN pipeline is loosely based on functions from the EVN pipeline (in particular, evn funcs.py). A flow-chart describing the general operation of the pipeline is shown in Figure 1. The KVN pipeline implements several additional features compared with a standard AIPS based pipeline such as the EVN pipeline. The first is the automation of the manual phase calibration with the use of the IF-Aligner (Section 4.1). The second utilises the simultaneous observation capabilities of the KVN to perform a frequency-phase-transfer (FPT) from lower frequencies to higher frequencies (Section 4.2). These are brie y described below.
Figure 1.A flow chart describing the calibration pipeline for the KVN.
4.1. IF-Aligner
The IF-Aligner is a ParselTongue script described in Section 4.1 of Martí-Vidal et al. (2012) that automates and improves upon the standard MPC described in Section 3.1. The script works by first performing a global fringe fit, finding independent delays and rates for all data in the observations and then high (greater than 10) signal-to-noise ratio scans are selected. One IF is selected (normally one of the central IFs) and the other IFs are then re-referenced against it. The rate and delay differences in the non-reference IFs are then interpolated over the entire experiment in order to correct weaker scans and then all IFs are re-referenced against the reference antenna. This method has several advantages over using FRING to solve for the delays. The first being that a “good” scan does not need to be manually selected. The second being that we do not need to assume that the delays are the same at any given frequency band and thirdly, under FRING, the delays are solved for at a given time-range and then applied to the whole experiment, under the assumption that they do not significantly change over the course of the experiment, while the IF-aligner takes time dependent effects into account by interpolating the solutions between good scans.
4.2. Frequency Phase Transfer
Because four wavelengths are recorded truly simultaneously and because atmospheric errors scale predictably with frequency, it is possible to use lower frequency (e.g., 14mm) data with longer coherence times to calibrate the phases of higher frequency data (e.g., 2mm data with coherence times on the order of seconds). The phases of the lower frequency are simply multiplied by the ratio in the frequencies. This is because the tropospheric component in the phase terms dominates and scales linearly. Other effects are also present, but these should be removed during the final fringe-fit. To get the best results, there are two competing factors: the number of fringe solutions found which will be determined by the ux density and system temperature (this is typically higher in steep spectrum sources, observed at 14 mm). The second factor is the increased non-tropospheric errors due to higher multiplication factors between the frequency bands. In our tests, we find that transferring phases from the most sensitive frequency (normally 14mm) compensates for losses due to multiplied non-tropospheric errors. In the case of bad weather or inverted spectrum sources, this may not be the case. As a result of this technique, it is possible to achieve significantly improved sensitivity at higher frequencies. The method is described in greater detail by Rioja & Dodson (2011); Rioja et al. (2014) and Algaba et al. (2015).
4.3. General Operation
Before beginning, the user must provide the raw data from the correlator, ANTAB1 files for each station in the experiment, and define a location to export the calibrated data. The user must also have AIPS, Parsel-Tongue and Obit installed. In default mode described in Figure 1:
Figure 2.Combined POSSM plots of all frequencies from the experiment. Left: Uncalibrated data; Right: Amplitude, bandpass and autocorrelation corrected data. Vertical axes is amplitude in Jy (bottom) and phase in degrees (top).
Figure 3.Comparison of phases (vertical axes) at 2mm between traditional (left) and FPT method (right). Note the reduced phase scatter in the KVN Pipeline version.
The KVN Pipeline also automatically generates plots at each step. Additionally, all parts of the KVN Pipeline can be selectively switched on and off and also can be run without performing the FPT. The running time of the pipeline depends on the length of the experiment and the speed of the computer running the pipeline, but typical times for a 24 hour experiment are between 1 and 3 hours.
5. DISCUSSION
In this section, we examine the performance of the KVN Pipeline. In Table 1, we compare the fringe detection rates using the traditional reduction procedure described in Section 3 against those using the KVN Pipeline using FPT as described in Section 4. Additionally, the dataset was reduced manually using the FPT. In general, both methods produce consistent numbers of good solutions, though in all cases the pipeline using FPT produces a greater numbers of solutions with the manually reduced dataset producing identical number of results as the pipeline. To investigate if the manually reduced (with FPT) dataset is identical to the pipeline version, we subtracted the differences in the visibilities and found the difference to be zero (see Figure 4).
Table 1A comparison of fringe detection rates at all frequencies both manually reduced with and without FPT and using the KVN Pipeline with the FPT. These are then compared against detection rates at 30 seconds, 2.5 mins and integrating over the length of a scan (approximately 5 mins). Numbers are successful/failed fringe solutions with the percentage of good solutions in brackets. These results were obtained with an SNR limit of 5.
Figure 4.The difference between manually reduced (with FPT) and pipelined (also with FPT) phases (top) and amplitudes (bottom) on baseline KTN-KUS for 3C454.3.
For this reason, all further comparisons are only between the Manual Non-PFT method of reduction and the KVN Pipeline version. It should however be noted that this experiment had extremely good conditions. We would expect the advantages of FPT to become more apparent if the source cannot be detected at higher frequencies with relatively short integration times. In Figure 3 we show POSSM plots after the final global fringe-fit using both the manual method (left) and the KVN Pipeline (right). The results are comparable, with differences in amplitude being due to the vector averaging performed in POSSM. To further investigate, we subtracted the differences between the amplitudes and phases (Figure 5) and find minimal differences, with 0.94° difference in phases on average and 0.00016 Jy difference on average in the amplitudes. Significant improvement can also be seen in the phase residuals (Figure 6), which compares the phase residuals of the manual method (left) and the KVN pipeline (right).
Figure 5.The difference between manually reduced (with FPT) and pipelined (also with FPT) phases (top) and amplitudes (bottom) on baseline KTN-KUS for 3C454.3.
Figure 6.Comparison of phase residuals between traditional (left) and FPT method (right).
To further check the results of the KVN Pipeline, we imaged and model-fitted a bright source (3C 454.3) in DIFMAP at 2mm and compared the results. The results (displayed in Table 2) show that the both methods create very comparable images, with almost identical peak intensities and noise levels. Our testing indicates that for bright sources, there are almost no differences in image quality between the FPT and non-FPT methods. A slightly higher total ux was recovered using the FPT dataset, but the difference is less than 1%. The CLEAN maps are displayed in Figure 7.
Table 23C454.3 was examined at 2mm in peak intensity, total flux density from model-fitting, map noise and approximate correlated flux on the shortest baseline.
Figure 7.Comparison images between Non-FPT (left) and FPT reduced data (right) in the bright blazar 3C 454.3.
6. CONCLUSIONS
The KVN pipeline has demonstrated its ability to automatically reduce a single polarisation KVN datset without direct human intervention. The performance of the KVN Pipeline is consistently superiour to manually reduced data without FPT being applied. While the KVN is a simple network consisting of 3 identical telescopes, the methods described here (although not including the FPT capability) should be applicable to less homogoneous arrays such as the GMVA, KaVA and the EAVN. Currently the pipeline is only capable of reducing single polarisation continuum data. In future versions of the pipeline, we wish to add a polarisation reduction capability, spectral line reduction and possibly automated imaging and phase referencing capabilities.
References
- Algaba, J.-C., Zhao, G.-Y., Lee, S.-S., et al. 2015, Interferometric Monitoring of Gamma-Ray Bright Active Galactic Nuclei II: Frequency Phase Transfer, JKAS, 48, 237
- Clark, B. G. 1980, An Efficient Implementation of the Algorithm 'CLEAN', A&A, 89, 377
- Greisen, E. W. 2003, Information Handling in Astronomy - Historical Vistas, 285, 109
- Kettenis, M., van Langevelde, H. J., Reynolds, C., & Cotton, B. 2006, ParselTongue: AIPS Talking Python, Astronomical Data Analysis Software and Systems XV, 351, 497
- Lee, S.-S., Han, M., Kang, S., et al. 2013, Monitoring of Multi-Frequency Polarization of Gamma-Ray Bright AGNs, European Physical Journal Web of Conferences, 61, 07007 https://doi.org/10.1051/epjconf/20136107007
- Lee, S.-S., Petrov, L., Byun, D.-Y., et al. 2014, Early Science with the Korean VLBI Network: Evaluation of System Performance, AJ, 147, 77 https://doi.org/10.1088/0004-6256/147/4/77
- Lee, S.-S., Byun, D.-Y., Oh, C. S., et al. 2015, A New Hardware Correlator in Korea: Performance Evaluation Using KVN Observations, JKAS, 48, 229
- Martí-Vidal, I., Krichbaum, T. P., Marscher, A., et al. 2012, On the Calibration of Full-Polarization 86 GHz Global VLBI Observations, A&A, 542, A107 https://doi.org/10.1051/0004-6361/201218958
- Pearson, T. J., & Readhead, A. C. S. 1984, Image Formation by Self-Calibration in Radio Astronomy, ARA&A, 22, 97 https://doi.org/10.1146/annurev.aa.22.090184.000525
- Reynolds, C., Paragi, Z., & Garrett, M. 2002, Pipeline Processing of VLBI Data, arXiv:astro-ph/0205118
- Rioja, M., & Dodson, R. 2011, High-Precision Astrometric Millimeter Very Long Baseline Interferometry Using a New Method for Atmospheric Calibration, AJ, 141, 114 https://doi.org/10.1088/0004-6256/141/4/114
- Rioja, M. J., Dodson, R., Jung, T., et al. 2014, Verification of the Astrometric Performance of the Korean VLBI Network, Using Comparative SFPR Studies with the VLBA at 14/7 mm, AJ, 148, 84 https://doi.org/10.1088/0004-6256/148/5/84
- Taylor, G. B., Carilli, C. L., & Perley, R. A. 1999, Synthesis Imaging in Radio Astronomy II, 180,
- Zensus, J. A., & Ros, E. 2015, European VLBI Network: Present and Future, arXiv:1501.050799
Cited by
- INTERFEROMETRIC MONITORING OF GAMMA-RAY BRIGHT AGNs. I. THE RESULTS OF SINGLE-EPOCH MULTIFREQUENCY OBSERVATIONS vol.227, pp.1, 2016, https://doi.org/10.3847/0067-0049/227/1/8
- Interferometric Monitoring of Gamma-Ray Bright AGNs: S5 0716+714 vol.841, pp.2, 2017, https://doi.org/10.3847/1538-4357/aa72f7
- Exploring the Variability of the Flat Spectrum Radio Source 1633+382. I. Phenomenology of the Light Curves vol.852, pp.1, 2018, https://doi.org/10.3847/1538-4357/aa9e50
- Long-term millimeter VLBI monitoring of M 87 with KVN at milliarcsecond resolution: nuclear spectrum vol.610, pp.1432-0746, 2018, https://doi.org/10.1051/0004-6361/201732421