Multivariate Analysis of 18F-DMFP PET Data to Assist the Diagnosis of Parkinsonism

An early and differential diagnosis of parkinsonian syndromes still remains a challenge mainly due to the similarity of their symptoms during the onset of the disease. Recently, ¹⁸F-Desmethoxyfallypride (DMFP) has been suggested to increase the diagnostic precision as it is an effective radioligand that allows us to analyze post-synaptic dopamine D_2/3 receptors. Nevertheless, the analysis of these data is still poorly covered and its use limited. In order to address this challenge, this paper shows a novel model to automatically distinguish idiopathic parkinsonism from non-idiopathic variants using DMFP data. The proposed method is based on a multiple kernel support vector machine and uses the linear version of this classifier to identify some regions of interest: the olfactory bulb, thalamus, and supplementary motor area. We evaluated the proposed model for both, the binary separation of idiopathic and non-idiopathic parkinsonism and the multigroup separation of parkinsonian variants. These systems achieved accuracy rates higher than 70%, outperforming DaTSCAN neuroimages for this purpose. In addition, a system that combined DaTSCAN and DMFP data was assessed.

1. Introduction

Parkinson's disease (PD) has a lifetime risk of about 2%, making it the second most common neurodegenerative disease after Alzheimer's disease. A main risk factor for PD is aging and current demographic trends predict a doubling in the number of cases by 2,050 (Bach et al., 2011). Clinically, the syndrome presents with the association of motor slowness (hypokinesia), with muscle rigidity and/or tremor and/or a postural instability (Greenberg et al., 2012). One of the neuropathological hallmarks of PD is a death of dopaminergic neurons in the substantia nigra (SN) pars compacta. Neuronal loss begins in the lateral ventral tier of the SN and throughout the illness this remains the most severely affected region. Post-mortem studies have shown that loss of cells from the SN in PD results mainly in profound dopamine (DA) depletion in the motor region of the striatum, nigral projections to the dorsal, and caudal putamen being most affected.

Because a biochemical hallmark of PD is a deficiency of striatal DA, most imaging studies have focused on studying the problem directly, using a variety of methods (Antonini et al., 1997; Constantinescu et al., 2011; Garraux et al., 2013). Measurement of striatal ¹⁸F-DOPA uptake with PET is still regarded by many as the “gold standard” for the diagnosis of PD. Several studies have reported that patients with sporadic PD have lost up to 50% of normal ¹⁸F-DOPA uptake from the caudal putamen contralateral to the side with the most severe symptoms compared with 20–30% on the ipsilateral side. The pre-synaptic striatal dopamine deficiency state can be assessed in vivo using other nuclear medicine techniques targeted to dopamine transporters (DaT) such as ¹²³I-ioflupane (also known by its tradename DaTSCAN) SPECT. These techniques are able to image a pre-synaptic striatal dopamine deficiency state shared by PD and atypical parkinsonian syndromes (APS) such as multiple system atrophy (MSA) (Wenning et al., 2013) and progressive supranuclear palsy (PSP) (Williams and Lees, 2009). They can be used to assist the clinicians to distinguish between these conditions and normal controls, essential and dystonic tremors, drug-induced, and psychogenic parkinsonism. However, it is generally considered that imaging pre-synaptic striatal dopaminergic deficit does not reliably discriminate between PD and APS.

In comparison with PD, the latter are also characterized by a post-synaptic striatal impairment. This can be demonstrated using two main approaches. The first involves ¹⁸F-FDG PET, which allows assessing the pattern of resting glucose metabolism throughout the brain. Several studies from independent groups consistently showed that FDG uptake pattern in the striatum and other regions can accurately discriminate APS from PD (Ghaemi et al., 2002; Garraux et al., 2013). These studies also showed that ¹⁸F-FDG PET may also provide some clinically-relevant information for the distinction between APS subgroups. A post-synaptic striatal deficiency state can be specifically demonstrated using radioligands of D_2/3 striatal dopamine receptors. In PD, ¹¹C-Raclopride PET studies showed preserved (or even mildly increased in de novo cases) striatal binding. In contrast, striatal ¹¹C-Raclopride D₂ binding is reduced in APS although significant decreases might only present in around 50% of individuals. Aside from ¹¹C-Raclopride, ¹²³I-Iodobenzamide (¹²³I-IBZM) SPECT has also been used to image post-synaptic striatal dopamine D_2/3 receptors. However, a meta-analysis of IBZM-SPECT studies showed that its negative predictive value was low (Vlaar et al., 2007), while another study suggest that its diagnostic accuracy was considerably lower than that of ¹⁸F-FDG PET (Hellwig et al., 2012). Finally, studies showed that ¹¹C-Raclopride PET and ¹⁸F-FDG-PET have comparable discrimination accuracy performance for the distinction between PD and MSA (Antonini et al., 1997). One of the drawbacks of ¹¹C-Raclopride is its limited clinical availability due to the short physical half-life of ¹¹C (20 min), what requires to have a local cyclotron or radiochemistry unit in the neuroimaging center. This impediment to the wider use of PET for clinical dopamine receptor studies could be overcome through the use of suitable ¹⁸F-labeled radioligands (la Fougère et al., 2010). Thus, ¹⁸F-desmethoxyfallypride (¹⁸F-DMFP) has recently emerged as a possible alternative to ¹¹C-Raclopride. Its relatively long physical half-life (109 min) enables clinical applications for differentiating between PD and APS. A study found that differences in striatal binding in the posterior putamen between PD and APS provided the larger diagnostic performance using this technique (la Fougère et al., 2010). Furthermore, as compared with IBZM and ¹¹C-Raclopride, ¹⁸F-DMFP enables D_2/3 imaging in extrastriatal regions but this property has not been exploited for the distinction between PD and APS.

Neuroimaging data used to assist the diagnosis of parkinsonism is often analyzed by means of proprietary software to delimit regions of interest (ROIs) and quantify the radiopharmaceutical uptake (Morton et al., 2005; Tossici-Bolt et al., 2006). More sophisticated systems based on machine learning were proposed for FDG PET (Garraux et al., 2013) and DaTSCAN (Prashanth et al., 2014). For the latter modality, several machine learning approaches were presented. For example, in Illán et al. (2012) the voxel intensities of DaTSCAN neuroimages were used as features along with several classifiers to separate PD patients and controls subjects. In Towey et al. (2011) and Segovia et al. (2012) two methods based, respectively, on Principal Component Analysis and Partial Least Squares were proposed to extract relevant features from DaTSCAN data. Structural data were also used to assist the diagnosis of PD (Rana et al., 2015), including the separation of PD and APS (Salvatore et al., 2014). However, the validity of DMFP data to feed statistical classification procedures is still poorly covered. The intensity profile of this imaging modality is meaningfully different of those for DaTSCAN or FDG. In the latter case, the intensity is distributed over a large number of regions, conversely for DaTSCAN most of the signal is gathered in the striatum. DMFP is half-way between DaTSCAN and FDG in terms of its intensity profile: a large proportion of the activity is located in the striatum but other regions also have intensity values large enough to contain patterns allowing the inter-subject discrimination.

In this work, we present a model to automatically distinguish between idiopathic parkinsonism and the non-idiopathic variants using DMFP data. It is based on the application of a machine learning algorithm that consider several regions of interest by means of a multiple kernel approach. We evaluated the proposed model for both, the binary separation of idiopathic and non-idiopathic parkinsonsim and the multigroup separation of PD, MSA, and PSP patients. In addition, we studied the usefulness of combining DMFP and DaTSCAN data in a single computer system. This work is intended to be the baseline of multivariate analyses of DMFP data.

2. Materials and Methods

2.1. Ethics Statement

Each patient (or a close relative) gave written informed consent to participate in the study and the protocol was accepted by the Ethics Committee of the University of Munich. All the data were anonymized by the clinicians who acquired them before being considered in this work.

2.2. Subjects

Data from 87 subjects showing parkinsonian movement disorders were used for testing purposes (demographic details and groups distribution are gathered in Table 1). Subjects on medication with drugs that have (or are suspected to have) effects on dopaminergic transporters were excluded. A ¹⁸F-DMFP PET image and a DaTSCAN SPECT image were collected for each subject during the first visit. The former images were acquired 60 min after the ¹⁸F-DMFP injection. Three (3) frames of 10 min each were recorded using a Siemens/CTI camera. Images were reconstructed as 128 × 128 matrices of 2 × 2 mm voxels by filtered backprojection using a Hann filter with a cutoff frequency of 0.5 Nyquist. The scattered and random events as well as dead time issues were also corrected (Turkington, 2011). After verification of the absence of important head motion between frames (patients had their head immobilized during the emission recording), the three frames were summed and pre-processed (la Fougère et al., 2010). DaTSCAN data were acquired using a GE Healthcare camera and according to widely accepted criteria (Koch et al., 2005).

TABLE 1

Table 1. Demographic details of the patients considered in this work (μ and σ stand for the mean and the standard deviation, respectively).

All patients were followed clinically for approximately 2 years after SPECT and PET examinations, at which time the clinical differential diagnoses were assessed by clinicians on the basis of last observations and according to the United Kingdom Parkinson Disease Society Brain Bank Diagnostic Criteria for Parkinson Disease (Hughes et al., 2002) and the second consensus statement on the diagnosis of multiple-system atrophy (Gilman et al., 2008) as well as the established criteria for the diagnosis of progressive supranuclear palsy (Litvan et al., 1996). According to these criteria, 39 patients were labeled as idiopathic parkinsonism and the remaining 48 subjects either MSA or PSP. It is worth noting that all the images were acquired during the first examinations and, therefore, they correspond to early stages of the disorders.

2.3. Data Pre-processing

After the image reconstruction the images were spatially normalized using the template matching approach implemented in the Statistical Parametric Mapping (SPM) version 8 (Friston et al., 2007). This procedure ensures that any given voxel in different images refers to the same anatomical position across the brains. It was based on the affine part of the SPM normalization procedure, a method that assumes a general affine model with 12 parameters and a Bayesian framework that maximizes the product of the prior function (which is based on the probability of obtaining a particular set of zooms and shears) and the likelihood function (derived from the residual squared difference between the template and the source image) (Ashburner et al., 1997). In order to build the templates for DMFP and DaTSCAN data, only the neuroimages from the idiopathic group was used because of this group is more homogeneous, whereas the non-idiopathic one is the union of the MSA and PSP patients. Thus, idiopathic PD data were first registered to a randomly chosen one. The resulting images and their hemisphere midplane reflections (ensuring a symmetric template) were then averaged and smoothed (8 mm FWHM Gaussian kernel) before being used to spatially normalize the whole set of images. As a result, we got brain volumes with 79 × 95 × 68 voxels of 2 × 2 × 2 mm.

In addition, after the spatial normalization the intensity of the images were also normalized to a value I_max, obtained by averaging the 0.1% of the highest intensities per image, as described in Saxena et al. (1998).

2.4. Multivariate Analysis Based on Machine Learning

Unlike univariate analyses where each voxel is independently analyzed, multivariate approaches analyze a neuroimage as a whole and explicitly consider the relationships between voxels (Schrouff et al., 2013). Effects comprised in the data, including activations and confounding and errors effects are assessed statistically both at each voxel and as interactions between voxels (Friston and Büchel, 2007).

A large proportion of multivariate analyses for neuroimaging data are based on statistical classification, such as Support Vector Machine (SVM) (Vapnik, 1998). During the training step, a binary statistical classifier builds a function f: ℝ^N → ±1 using a set of labeled samples so that f is able to predict the label of new unseen samples. SVM calculates this function by estimating the hyperplane that has the largest distance to the closest sample with any label. Then, the label of a new sample is estimated according to the side of the hyperplane in which the new sample is. Mathematically, the decision hyperplane (also named maximal margin hyperplane) is defined as:

$\begin{array}{cc}g(\text{x})={\text{w}}^T\text{x}+w_0=0,& \left(1\right)\end{array}$

where w is the weight vector, orthogonal to the decision hyperplane, and w₀ is the bias term. Calculating the hyperplane involves solving the following problem:

$\begin{array}{cc}\begin{array}{l}\text{minimize}\frac{1}{2}\parallel \text{w}{\parallel }^2+C{\displaystyle \sum _{i=1}^N{\xi }_i}\\ \text{subject to }{y}_i({\text{w}}^T\text{x}+w_0)\ge 1-{\xi }_i,i=1,2,\dots ,N\end{array}& \left(2\right)\end{array}$

where C, N, and ξ_i stand for a predefined trade-off parameter between model simplicity and classification error, the number of training instances and the slack variables, respectively. This problem can be simplified by applying Lagrangian functions and results in:

$\begin{array}{cc}\begin{array}{l}\text{maximize}{\displaystyle \sum _{i=1}^N{\alpha }_i}-\frac{1}{2}{\displaystyle \sum _{i=1}^N{\displaystyle \sum _{j=1}^N{\alpha }_i{\alpha }_j{y}_i{y}_{j}k({\text{x}}_i,{\text{x}}_j)}}\\ \text{subject to}{\displaystyle \sum _{i=1}^N{\alpha }_i{y}_i=0}\\ 0\le {\alpha }_i\le C,i=1,2,\dots ,N\end{array}& \left(3\right)\end{array}$

where α is the vector of dual variables corresponding to each separation constraint, and k(x_i, x_j) is a function ℝ^D × ℝ^D → ℝ known as “kernel” (Müller et al., 2001). For linear SVM, k(x_i, x_j) = x_ix_j.

2.5. Analysis Based on Multiple Kernel Learning

After the pre-processing steps, the data were automatically parceled using the well-known Automated Anatomical Labeling (AAL) atlas (Tzourio-Mazoyer et al., 2002). This procedure allows isolating specific regions such as the striatum or the olfactory bulb, and that way, they can be independently analyzed.

Neuroimaging from both DaTSCAN and DMFP radioligands gathers most of the total activation in the striatum. However, DMFP-based data also contain information in other regions (see Figure 1). There is therefore a reasonable prospect that DMFP data contain useful information for a diagnosis in areas outside the striatum. This would be overlooked during the visual examination of the images, while automatic procedure (based on machine learning) may efficiently exploit this information. In order to better account for the different scales and relevances of the various regions, we used a multiple kernel learning (MKL) procedure along with a SVM classifier.

FIGURE 1

Figure 1. Comparison between a DaTSCAN (top row) and a DMFP (bottom row) neuroimage from a patient diagnosed with Parkinson's disease.

In a MKL procedure, two or more kernels are built from feature subsets and then combined by means of a predefined function (Gönen and Alpaydın, 2011). In this work, we used a kernel per each region of interest and a linear combination function that provides a good performance with relatively low computational burden:

$\begin{array}{cc}k({\text{x}}_i,{\text{x}}_j)={\displaystyle \sum _{m=1}^{N_k}{q}_m}{k}_m({\text{x}}_i^m,{\text{x}}_j^m)& \left(4\right)\end{array}$

where N_k is the number of kernels; q_m stands for the weight of kernel k_m (estimated through cross-validation); x_i, x_j are two feature vectors and ${\mathbf{\text{x}}}_i^m$, ${\mathbf{\text{x}}}_j^m$ are subset of x_i, x_j with only the features used for kernel k_m.

2.6. Identifying Regions of Interest

A linear SVM trained classifier allows us to analyze the weight assigned by the classifier to each feature included in the training set (related with importance of that feature in the separation problem). This information can be directly extracted from the weight vector, w, defined in Equation (1). Thus, using all the brain voxels as feature we estimated the importance of each voxel in the separation problem. Then, the weight/importance of each region was computed as

$\begin{array}{cc}{w}_r=\frac{{\displaystyle {\sum }_{i=1}^{N_r}{w}_{x_i}}}{N_r}\forall x_i\in r& \left(5\right)\end{array}$

where w_xi is weight corresponding to the voxel x_i and x_i, i = 1, …, N_r are the voxels in the region r.

A map containing the voxel weights (rearranged into brain form) is shown in Figure 2. It was computed by training a binary SVM classifier (linear kernel) with DMFP data from PD patients in one group and data from MSA and PSP patients in other group. As expected, the most important region is the striatum, specifically the putamen area. The high weight assigned to other regions such as the olfactory bulb or the thalamus and the supplementary motor area is also interesting. Figure 3 shows the mean intensity of these five areas for all the DMFP neuroimages in our dataset. Note that the mean intensity of the putamen is largely higher than those of the thalamus, olfactory bulb, and supplementary motor area. These differences were successfully addressed by the MKL-based proposed approach. Figure 3 also suggests that there is no important differences between groups when only the mean of the pre-selected ROIs is analyzed.

FIGURE 2

Figure 2. Importance of each brain region for the classification problem. The values were estimated from the voxels weight computed by a linear SVM classifier, and normalized to the range [0, 1].

FIGURE 3

Figure 3. Analysis of the average intensity of the five regions of interest found in the analysis of DMFP data. Each patient is represented by five values: the average intensity of his DMFP neuroimage on the caudate, putamen, thalamus, olfactory, and supplementary motor area. The values of each region are grouped by the patient group: PD (red crosses), MSA (green circles), and PSP (blue squares).

3. Experiment and Results

Several experiments were conducted in order to evaluate the application of the multivariate approach described above to our DMFP dataset. Initially, we address the binary diagnosis problem, i.e., the separation of two groups: idiopathic and non-idiopathic (includes MSA and PSP disorders) parkinsonism. Table 2 shows the classification measures obtained in this case and compares the results obtained by the proposed MKL approach with the ones achieved by classical approaches such as using only the voxels at the striatum or using all the voxels inside the brain. The accuracy, sensitivity and specificity of the systems were estimated using a k-fold (k = 10) cross-validation scheme. All the systems were based on SVM classification and the parameters (trade-off parameter C and kernel weights q_m for MKL approaches) were estimated using a grid search (Varma and Simon, 2006). Values C = 2^e, e = {−3, −2, …, 5} and q_m = {0.1, 0.2, …0.9} satisfying $\sum _{m=1}^{N_k}{q}_m=1$ were assessed.

TABLE 2

Table 2. Accuracy, sensitivity, and specificity obtained by the proposed approach and other classical approaches when separating neuroimaging data from idiopathic and non-idiopathic parkinsonism.

In order to avoid biased results, the selection of the regions used in the MKL approach was performed using only the training dataset, i.e., in each iteration of the cross-validation loop, we selected the five regions with the most weight (note that the striatum is divided in two regions in the AAL atlas: putamen and caudate nucleus). The putamen, caudate nucleus, olfactory bulb, and thalamus were among the five selected regions in all the iterations. The supplementary motor area was the fifth region in 92% of all cases. The pseudo-code corresponding to this experiment is shown in Algorithm 1.

ALGORITHM 1

Algorithm 1. Evaluation procedure.

As shown in Table 2, the proposed method based on multiple kernel learning achieved an accuracy rate of 73.56%. The statistical significance of this measure was assessed by means of a permutation test. In this procedure, the classification algorithm was run 1,000 times using different label sets (generated as random permutations of the original label set). A p-value was then calculated as the fraction of the executions in which the accuracy was greater than or equal to the accuracy observed when using the correct labels (Pereira et al., 2009). As a result, a p-value of 0.001 was obtained. Figure 4 shows the histogram corresponding to the accuracy rates obtained in the procedure.

FIGURE 4

Figure 4. Pemutation test. Histogram of the accuracy rates achieved by using randomly generated label sets (1,000 repetitions) and the proposed multikernel-based method. Red and blue lines are, respectively, the accuracy associated with a p-value of 0.05 and the accuracy obtained when using the true labels (73.56%).

Subsequently, the tree-groups separation problem was addressed. In this case, the system was trained to differentiate between the disorders considered in our study: PD, MSA, and PSP. To this end, an ensemble of SVM classifiers and the one-against-one strategy was used. The results are gathered in Table 3.

TABLE 3

Table 3. Accuracy achieved by a multiclass classification system when separating PD, MSA, and PSP neuroimages.

In both classification approaches, binary and multiclass, the results obtained by using DMFP data were compared with the ones obtained by DaTSCAN neuroimages. For the latter neuroimage modality only the voxels at the striatum were considered as it is common in the field. Additionally, an experiment that combined both neuroimages modalities (DaTSCAN and DMFP) was performed. It allows us to evaluate if the information contained in DaTSCAN neuroimages can complement that contained in DMFP data. To this end, we extend the MKL approach to include six regions: the five regions selected for DMFP data and striatum from the DaTSCAN neuroimages. The results are included in Tables 2, 3.

3.1. Univariate Analysis

For the sake of completeness, we compared the regions identified in the previous section with the ones obtained by means of a t-test. A smoothed version of the DMFP PET neuroimages (Gaussian filter of 8 mm FWHM) was analyzed using a 2-sample t-test in SPM. The results indicate that patients with idiopathic parkinsonism have lower dopamine levels than non-idiopathic patients in the striatum, thalamus and supplementary motor area. Specifically, clusters showing significant difference appeared in the thalamus, anterior cingulate cortex and putamen with z-values up to 4.74 (see Figure 5). Some differences (p < 0.001) also appeared in the supplementary motor area (454 mm³) and caudate nucleus (22 mm³).

FIGURE 5

Figure 5. Result of the univariate analysis. t-test comparing patients with idiopathic and non-idiopathic parkinsonism. Regions in orange/yellow are significantly lower (p < 0.001, uncorrected) in idiopathic compared with non-idiopathic patients.

3.2. ROC Analysis

Finally, receiver operating characteristic (ROC) curves were computed to assess the trade off between sensitivity and specificity provided by the developed systems. These curves provide an estimation of the performance of a classification procedure, not only in terms of sensitivity and specificity but also in terms of the global performance by measuring the area under the curve (AUC). Curves and AUCs are shown in Figure 6.

FIGURE 6

Figure 6. ROC curves for three binary classification systems using DMFP data: (i) using only the voxels at the striatum, (ii) using all the voxels in the brain, (iii) using the proposed MKL-based approach. The AUC for each curve is shown in the legend.

4. Discussion and Conclusions

Separating idiopathic and non-idiopathic parkinsonian patients in an early stage is a challenge because both groups can show similar clinical signs and symptoms (Litvan, 1999). In addition, neuroimaging techniques such as DaTSCAN, widely used to assist the diagnosis of PD, may have difficulty to differentiate between PD and MSA or PSP, as shown in our experiments. In this work, we evaluated the use of ¹⁸F-DMFP PET in computer systems to distinguish between three parkinsonian syndromes (PD, MSA, and PSP), yielding accuracy rates about 70%. Using a multivariate analysis, we found that the striatum, olfactory bulb, thalamus, and supplementary motor area are the most important regions to separate the groups. These findings were partly corroborated through univariate analysis and are consistent with previous results reported in recent studies. For example, in Chen et al. (2014) the authors found that the volumes of the olfactory bulb and tract were significantly reduced in idiopathic PD patients compared to normal subjects and MSA patients. This corroborate the idea that the mechanisms that produce idiopathic PD also affect this region.

This result obtained by hypothesis free analysis of DMFP data is in line with clinical and histopathological observations. Clinically, olfactory testing can be used to identify patients in the premotor phase of Parkinson's disease (Berardelli et al., 2013). The olfactory deficits is caused by PD pathology in the olfactory bulb and can already be observed stage I of the Braak's staging of PD pathology (Braak et al., 2002). The key role of striatal pathology in MSA and PSP is widely established and also reflected in our hypothesis free approach (Litvan et al., 1997). On the other hand, evidences of the involvement of the motor cortex in PD were reported in Vacherot et al. (2010); Lindenbach and Bishop (2013), although results have been controversial (Viaro et al., 2011). Finally, the relationship between PD and thalamus is not yet proven on pathological bases and therefore might reflect functional disturbances on basal ganglia circuits that involve the thalamus. In short, our experiments corroborate that there exist differences in those regions (olfactory bulb, supplementary motor area, and thalamus) between PD, MSA, and PSP patients.

In this manuscript, we propose a methodology to analyze DMFP data for diagnostic purposes. The primary idea is to use not only the striatum region but additionally to take into account the other regions of the brain. In order to address the small sample size problem and overcome the differences in terms of size between different regions, we propose to use a MKL approach, which is considered to be a good solution to combine heterogeneous data sources into one classification procedure (Gönen and Alpaydın, 2011; Segovia et al., 2014). In some sense, a MKL classification procedure as the one used in this work can be seen as a kind of regularization process that assigns the same weigh to all the voxels in a specific region instead of a different weigh per each voxel as a standard SVM classifier does.

Two classification approaches were addressed. The first one consisted on separating idiopathic and non-idiopathic parkinsonism (binary classification) whereas the second one was able to differentiate between PD, MSA, and PSP data (multiclass classification). The proposed methodology based on MKL classification yields higher accuracy rates than classical approaches in both cases, however these results are limited by the relative small number of patients included in this study. Unfortunately the availability of these kind of data, especially the ones acquired using new or uncommon radiopharmaceuticals is limited. The significance of the accuracy rate achieved by the proposed method was estimated by means of permutation tests obtaining a p = 0.001. Recently, Noirhome et al. demonstrated that permutation tests are more adequate than classical approaches as binomial assessment to calculate the significance of classification measures estimated using cross-validation schemes (Noirhomme et al., 2014). It is worth noting the relatively low accuracy rates obtained for MSA and PSP classes in the multiclass approach. These results suggest that the differences between these disorders do not appear in DMFP data. This is not unique to this data modality. Previous studies based on FDG data (Garraux et al., 2013) also faced the same issue. Finally, we included an experiment combining DMFP and DaTSCAN data in the same system. The results showed that including DaTSCAN data helps in the separation problem when only the striatum voxels were used however, when the additional DMFP regions proposed in this work (the putamen, caudate nucleus, olfactory bulb, thalamus, and supplementary motor area) were included (in the MKL-based approach) DaTSCAN data did not increase the separation ability of the classifier. All in all, DaTSCAN data is probably not necessary to differentiate between PD, MSA, and PSP patients if we use new systems based on DMFP data that take advantage of all the information contained in these neuroimages (not only the striatum).

Author Contributions

Conception or design of the work: FS, JG, JR, FM, JL, GG, CP. Data collection: JL, MS, MB, AR, KB. Data analysis and interpretation: FS, JG, JR, FM, CP. Drafting the article: FS, JG, JR, FM, GG, CP. Critical revision of the article: FS, JG, JR, JL, CP.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

This work was supported by and the MINECO/FEDER under the TEC2012-34306 and TEC2015-64718-R projects and the Ministry of Economy, Innovation, Science, and Employment of the Junta de Andalucía under the Excellence Projects P09-TIC-4530 and P11-TIC-7103 and a Talent Hub project approved by the Andalucía Talent Hub Program launched by the Andalusian Knowledge Agency, co-funded by the European Union's Seventh Framework Program, Marie Sklodowska-Curie actions (COFUND Grant Agreement no. 291780) and the Ministry of Economy, Innovation, Science, and Employment of the Junta de Andalucía. The work was also supported by the “Fonds de la Recherche Scientifique - FNRS” and the Universities of LiÃĺge (Belgium), Munich (Germany) and Granada (Spain). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

Antonini, A., Leenders, K. L., Vontobel, P., Maguire, R. P., Missimer, J., Psylla, M., et al. (1997). Complementary PET studies of striatal neuronal function in the differential diagnosis between multiple system atrophy and parkinson's disease. Brain 120, 2187–2195.

PubMed Abstract | Google Scholar

Ashburner, J., Neelin, P., Collins, D. L., Evans, A., and Friston, K. (1997). Incorporating prior knowledge into image registration. NeuroImage 6, 344–352.

PubMed Abstract | Google Scholar

Bach, J., Ziegler, U., Deuschl, G., Dodel, R., and Doblhammer-Reiter, G. (2011). Projected numbers of people with movement disorders in the years 2030 and 2050. Mov. Disord. 26, 2286–2290. doi: 10.1002/mds.23878

PubMed Abstract | CrossRef Full Text | Google Scholar

Berardelli, A., Wenning, G. K., Antonini, A., Berg, D., Bloem, B. R., Bonifati, V., et al. (2013). EFNS/MDS-ES recommendations for the diagnosis of parkinson's disease. Eur. J. Neurol. 20, 16–34. doi: 10.1111/ene.12022

PubMed Abstract | CrossRef Full Text | Google Scholar

Braak, H., Del Tredici, K., Bratzke, H., Hamm-Clement, J., Sandmann-Keil, D., and Rüb, U. (2002). Staging of the intracerebral inclusion body pathology associated with idiopathic parkinson's disease (preclinical and clinical stages). J. Neurol. 249(Suppl. 3), III/1–5. doi: 10.1007/s00415-002-1301-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, S., Tan, H.-y., Wu, Z.-h., Sun, C.-p., He, J.-x., Li, X.-c., et al. (2014). Imaging of olfactory bulb and gray matter volumes in brain areas associated with olfactory function in patients with parkinson's disease and multiple system atrophy. Eur. J. Radiol. 83, 564–570. doi: 10.1016/j.ejrad.2013.11.024

PubMed Abstract | CrossRef Full Text | Google Scholar

Constantinescu, C. C., Coleman, R. A., Pan, M., and Mukherjee, J. (2011). Striatal and extrastriatal microPET imaging of D2/D3 dopamine receptors in rat brain with [¹⁸F]Fallypride and [¹⁸F]Desmethoxyfallypride. Synapse 65, 778–787. doi: 10.1002/syn.20904

CrossRef Full Text | Google Scholar

Friston, K., and Büchel, C. (2007). “Chapter 37: functional connectivity: Eigenimages and multivariate analyses,” in Statistical Parametric Mapping, eds K. Friston, J. Ashburner, S. Kiebel, T. Nichols, and W. Penny (London: Academic Press), 492–507.

Friston, K. J., Ashburner, J. T., Kiebel, S. J., Nichols, T. E., and Penny, W. D. (2007). Statistical Parametric Mapping: The Analysis of Functional Brain Images. Amsterdam: Academic Press.

Google Scholar

Garraux, G., Phillips, C., Schrouff, J., Kreisler, A., Lemaire, C., Degueldre, C., et al. (2013). Multiclass classification of FDG PET scans for the distinction between parkinson's disease and atypical parkinsonian syndromes. NeuroImage Clin. 2, 883–893. doi: 10.1016/j.nicl.2013.06.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Ghaemi, M., Hilker, R., Rudolf, J., Sobesky, J., and Heiss, W. (2002). Differentiating multiple system atrophy from parkinson's disease: contribution of striatal and midbrain MRI volumetry and multi-tracer PET imaging. J. Neurol. Neurosurg. Psychiatry 73, 517–523. doi: 10.1136/jnnp.73.5.517

PubMed Abstract | CrossRef Full Text | Google Scholar

Gilman, S., Wenning, G. K., Low, P. A., Brooks, D. J., Mathias, C. J., Trojanowski, J. Q., et al. (2008). Second consensus statement on the diagnosis of multiple system atrophy. Neurology 71, 670–676. doi: 10.1212/01.wnl.0000324625.00404.15

PubMed Abstract | CrossRef Full Text | Google Scholar

Gönen, M., and Alpaydın, E. (2011). Multiple kernel learning algorithms. J. Mach. Learn. Res. 12, 2211–2268.

Google Scholar

Greenberg, D., Aminoff, M., and Simon, R. (2012). Clinical Neurology, 8 Edn. New York, NY: McGraw-Hill Professional.

Hellwig, S., Amtage, F., Kreft, A., Buchert, R., Winz, O. H., Vach, W., et al. (2012). ¹⁸F-FDG-PET is superior to 123I-IBZM-SPECT for the differential diagnosis of parkinsonism. Neurology 79, 1314–1322. doi: 10.1212/WNL.0b013e31826c1b0a

CrossRef Full Text | Google Scholar

Hughes, A. J., Daniel, S. E., Ben-Shlomo, Y., and Lees, A. J. (2002). The accuracy of diagnosis of parkinsonian syndromes in a specialist movement disorder service. Brain 125, 861–870. doi: 10.1093/brain/awf080

PubMed Abstract | CrossRef Full Text | Google Scholar

Illán, I. A., Górriz, J. M., Ramírez, J., Segovia, F., Jiménez-Hoyuela, J. M., and Lozano, S. J. O. (2012). Automatic assistance to parkinson's disease diagnosis in DaTSCAN SPECT imaging. Med. Phys. 39, 5971–5980. doi: 10.1118/1.4742055

PubMed Abstract | CrossRef Full Text | Google Scholar

Koch, W., Radau, P. E., Hamann, C., and Tatsch, K. (2005). Clinical testing of an optimized software solution for an automated, observer-independent evaluation of dopamine transporter SPECT studies. J. Nucl. Med. 46, 1109–1118.

PubMed Abstract | Google Scholar

la Fougère, C., Pöpperl, G., Levin, J., Wängler, B., Böning, G., Uebleis, C., et al. (2010). The value of the dopamine d_2/3 receptor ligand ¹⁸F-Desmethoxyfallypride for the differentiation of idiopathic and nonidiopathic parkinsonian syndromes. J. Nucl. Med. 51, 581–587. doi: 10.2967/jnumed.109.071811

PubMed Abstract | CrossRef Full Text | Google Scholar

Lindenbach, D., and Bishop, C. (2013). Critical involvement of the motor cortex in the pathophysiology and treatment of parkinson's disease. Neurosci. Biobehav. Rev. 37(10 Pt 2), 2737–2750. doi: 10.1016/j.neubiorev.2013.09.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Litvan, I. (1999). Recent advances in atypical parkinsonian disorders. Curr. Opin. Neurol. 12, 441–446.

PubMed Abstract | Google Scholar

Litvan, I., Agid, Y., Calne, D., Campbell, G., Dubois, B., Duvoisin, R. C., et al. (1996). Clinical research criteria for the diagnosis of progressive supranuclear palsy (Steele-Richardson-Olszewski syndrome): report of the NINDS-SPSP international workshop. Neurology 47, 1–9.

PubMed Abstract | Google Scholar

Litvan, I., Campbell, G., Mangone, C. A., Verny, M., McKee, A., Chaudhuri, K. R., et al. (1997). Which clinical features differentiate progressive supranuclear palsy (Steele-Richardson-Olszewski syndrome) from related disorders? a clinicopathological study. Brain 120, 65–74.

PubMed Abstract | Google Scholar

Morton, R. J., Guy, M. J., Clauss, R., Hinton, P. J., Marshall, C. A., and Clarke, E. A. (2005). Comparison of different methods of DatSCAN quantification. Nucl. Med. Commun. 26, 1139–1146. doi: 10.1097/00006231-200512000-00015

PubMed Abstract | CrossRef Full Text | Google Scholar

Müller, K., Mika, S., Rätsch, G., Tsuda, K., and Schölkopf, B. (2001). An introduction to kernel-based learning algorithms. IEEE Trans. Neural Netw. 12, 181–201. doi: 10.1109/72.914517

PubMed Abstract | CrossRef Full Text | Google Scholar

Noirhomme, Q., Lesenfants, D., Gomez, F., Soddu, A., Schrouff, J., Garraux, G., et al. (2014). Biased binomial assessment of cross-validated estimation of classification accuracies illustrated in diagnosis predictions. NeuroImage Clin. 4, 687–694. doi: 10.1016/j.nicl.2014.04.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Pereira, F., Mitchell, T., and Botvinick, M. (2009). Machine learning classifiers and fMRI: a tutorial overview. NeuroImage 45(1 Suppl.), S199–S209. doi: 10.1016/j.neuroimage.2008.11.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Prashanth, R., Dutta Roy, S., Mandal, P. K., and Ghosh, S. (2014). Automatic classification and prediction models for early Parkinson's disease diagnosis from SPECT imaging. Expert Syst. Appl. 41, 3333–3342. doi: 10.1016/j.eswa.2013.11.031

CrossRef Full Text | Google Scholar

Rana, B., Juneja, A., Saxena, M., Gudwani, S., Senthil Kumaran, S., Agrawal, R. K., et al. (2015). Regions-of-interest based automated diagnosis of Parkinson's disease using T1-weighted MRI. Expert Syst. Appl. 42, 4506–4516. doi: 10.1016/j.eswa.2015.01.062

CrossRef Full Text | Google Scholar

Salvatore, C., Cerasa, A., Castiglioni, I., Gallivanone, F., Augimeri, A., Lopez, M., et al. (2014). Machine learning on brain MRI data for differential diagnosis of Parkinson's disease and Progressive Supranuclear Palsy. J. Neurosci. Methods 222, 230–237. doi: 10.1016/j.jneumeth.2013.11.016

PubMed Abstract | CrossRef Full Text | Google Scholar

Saxena, P., Pavel, D. G., Quintana, J. C., and Horwitz, B. (1998). “An automatic thresholdbased scaling method for enhancing the usefulness of Tc-HMPAO SPECT in the diagnosis of Alzheimers disease,” in Medical Image Computing and Computer-Assisted Intervention - MICCAI, Lecture Notes in Computer Science, Vol. 1496 (Berlin; Heidelberg: Springer), 623–630.

Google Scholar

Schrouff, J., Rosa, M. J., Rondina, J. M., Marquand, A. F., Chu, C., Ashburner, J., et al. (2013). PRoNTo: pattern recognition for neuroimaging toolbox. Neuroinformatics 11, 319–337. doi: 10.1007/s12021-013-9178-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Segovia, F., Bastin, C., Salmon, E., Górriz, J. M., Ramírez, J., and Phillips, C. (2014). Combining PET images and neuropsychological test data for automatic diagnosis of Alzheimer's disease. PLoS ONE 9:e88687. doi: 10.1371/journal.pone.0088687

PubMed Abstract | CrossRef Full Text | Google Scholar

Segovia, F., Górriz, J. M., Ramírez, J., Álvarez, I., Jiménez-Hoyuela, J. M., and Ortega, S. J. (2012). Improved parkinsonism diagnosis using a partial least squares based approach. Med. Phys. 39, 4395–4403. doi: 10.1118/1.4730289

PubMed Abstract | CrossRef Full Text | Google Scholar

Tossici-Bolt, L., Hoffmann, S., Kemp, P., Mehta, R., and Fleming, J. (2006). Quantification of [123I]FP-CIT SPECT brain images: an accurate technique for measurement of the specific binding ratio. Eur. J. Nucl. Med. Mol. Imaging 33, 1491–1499. doi: 10.1007/s00259-006-0155-x

CrossRef Full Text | Google Scholar

Towey, D. J., Bain, P. G., and Nijran, K. S. (2011). Automatic classification of 123i-FP-CIT (DaTSCAN) SPECT images. Nucl. Med. Commun. 32, 699–707. doi: 10.1097/MNM.0b013e328347cd09

PubMed Abstract | CrossRef Full Text | Google Scholar

Turkington, T. G. (2011). “PET Imaging Basics,” in Clinical PET-CT in Radiology, eds P. Shreve and D. W. Townsend (New York, NY: Springer), 21–28.

Google Scholar

Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., et al. (2002). Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI Single-Subject brain. NeuroImage 15, 273–289. doi: 10.1006/nimg.2001.0978

PubMed Abstract | CrossRef Full Text | Google Scholar

Vacherot, F., Attarian, S., Eusebio, A., and Azulay, J. P. (2010). Excitability of the lower-limb area of the motor cortex in parkinson's disease. Neurophysiol. Clin. 40, 201–208. doi: 10.1016/j.neucli.2010.04.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Vapnik, V. N. (1998). Statistical Learning Theory, 1 Edn. New York, NY: Wiley-Interscience.

Varma, S., and Simon, R. (2006). Bias in error estimation when using cross-validation for model selection. BMC Bioinformatics 7:91. doi: 10.1186/1471-2105-7-91

PubMed Abstract | CrossRef Full Text | Google Scholar

Viaro, R., Morari, M., and Franchi, G. (2011). Progressive motor cortex functional reorganization following 6-hydroxydopamine lesioning in rats. J. Neurosci. 31, 4544–4554. doi: 10.1523/JNEUROSCI.5394-10.2011

PubMed Abstract | CrossRef Full Text | Google Scholar

Vlaar, A. M., van Kroonenburgh, M. J., Kessels, A. G., and Weber, W. E. (2007). Meta-analysis of the literature on diagnostic accuracy of SPECT in parkinsonian syndromes. BMC Neurology 7:27. doi: 10.1186/1471-2377-7-27

PubMed Abstract | CrossRef Full Text | Google Scholar

Wenning, G. K., Geser, F., Krismer, F., Seppi, K., Duerr, S., Boesch, S., et al. (2013). The natural history of multiple system atrophy: a prospective european cohort study. Lancet Neurol. 12, 264–274. doi: 10.1016/S1474-4422(12)70327-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Williams, D. R., and Lees, A. J. (2009). Progressive supranuclear palsy: clinicopathological concepts and diagnostic challenges. Lancet Neurol. 8, 270–279. doi: 10.1016/S1474-4422(09)70042-0

PubMed Abstract | CrossRef Full Text | Google Scholar