Skip Navigation


ToxSci Advance Access originally published online on April 25, 2006
Toxicological Sciences 2006 92(1):219-227; doi:10.1093/toxsci/kfj209
This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
92/1/219    most recent
kfj209v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (16)
Right arrowRequest Permissions
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Dorman, D. C.
Right arrow Articles by Robertson, I. D.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Dorman, D. C.
Right arrow Articles by Robertson, I. D.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

© The Author 2006. Published by Oxford University Press on behalf of the Society of Toxicology. All rights reserved. For Permissions, please email: journals.permissions@oxfordjournals.org

Correlation of Brain Magnetic Resonance Imaging Changes with Pallidal Manganese Concentrations in Rhesus Monkeys Following Subchronic Manganese Inhalation

David C. Dorman*,1, Melanie F. Struve*, Brian A. Wong*, Janice A. Dye{dagger} and Ian D. Robertson{ddagger}

* CIIT Centers for Health Research, Research Triangle Park, North Carolina 27709-2137; {dagger} Experimental Toxicology Division, National Health and Environmental Effects Research Laboratory, ORD, U.S. Environmental Protection Agency, Research Triangle Park, North Carolina 27709; and {ddagger} Department of Biomedical Science, College of Veterinary Medicine, North Carolina State University, Raleigh, North Carolina 27606

1 To whom correspondence should be addressed at CIIT Centers for Health Research, 6 Davis Drive, PO Box 12137, Research Triangle Park, NC 27709-2137. Fax: (919) 558-1300. E-mail: dorman{at}ciit.org.

Received November 23, 2005; accepted April 3, 2006


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
High-dose manganese exposure is associated with parkinsonism. Because manganese is paramagnetic, its relative distribution within the brain can be examined using magnetic resonance imaging (MRI). Herein, we present the first comprehensive study to use MRI, pallidal index (PI), and T1 relaxation rate (R1) in concert with chemical analysis to establish a direct association between MRI changes and pallidal manganese concentration in rhesus monkeys following subchronic inhalation of manganese sulfate (MnSO4). Monkeys exposed to MnSO4 at ≥ 0.06 mg Mn/m3 developed increased manganese concentrations in the globus pallidus, putamen, olfactory epithelium, olfactory bulb, and cerebellum. Manganese concentrations within the olfactory system of the MnSO4-exposed monkeys demonstrated a decreasing rostral-caudal concentration gradient, a finding consistent with olfactory transport of inhaled manganese. Marked MRI signal hyperintensities were seen within the olfactory bulb and the globus pallidus; however, comparable changes could not be discerned in the intervening tissue. The R1 and PI were correlated with the pallidal manganese concentration. However, increases in white matter manganese concentrations in MnSO4-exposed monkeys confounded the PI measurement and may lead to underestimation of pallidal manganese accumulation. Our results indicate that the R1 can be used to estimate regional brain manganese concentrations and may be a reliable biomarker of occupational manganese exposure. To our knowledge, this study is the first to provide evidence of direct olfactory transport of an inhaled metal in a nonhuman primate. Pallidal delivery of manganese, however, likely arises primarily from systemic delivery and not directly from olfactory transport.

Key Words: Parkinson's disease, secondary; manganese poisoning; pharmacokinetics; inhalation exposure; Macaca mulatta; magnetic resonance imaging.


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Couper's 1837Go report of five Scottish workers with paraplegia, muscle weakness, and staggered gait following high-dose exposure to manganese oxide dust is widely acknowledged as the first clinical description of manganese neurotoxicity. Manganese neurotoxicity is a form of parkinsonism because affected individuals develop generalized bradykinesia, widespread rigidity, and occasional resting tremor (Pal et al., 1999Go). Manganese neurotoxicity occurs in manganese miners and workers engaged in battery assembly, ferroalloy production, iron and steel foundry work, and welding (Pal et al., 1999Go). Epidemiological reports suggesting that welders are at an increased risk for the development of Parkinson's disease (Gorell et al., 2004Go; Racette et al., 2001Go) have further fueled concerns about public health ramifications from exposure to this metal.

Increased manganese concentration in select regions of the brain is a critical step in the pathogenesis of manganese neurotoxicity. Transfer of manganese across the blood-brain barrier involves active and passive transport (Aschner et al., 2005Go). Once within the central nervous system (CNS), manganese can undergo additional translocation along nerve fibers. For example, manganese can be transported via efferent axons from the nucleus accumbens, caudate-putamen, and other brain nuclei with a high density of transferrin receptors into the ventral pallidum, globus pallidus, and substantia nigra (Lin et al., 2001Go). Excess accumulation of manganese within the basal ganglia induces degeneration predominantly within the globus pallidus and subthalamic nucleus, with less frequent injury occurring in the putamen and caudate nucleus (Pal et al., 1999Go).

Because manganese is paramagnetic, its distribution within the CNS can be visualized by nonenhanced magnetic resonance imaging (MRI). Newland and coworkers (1989)Go were among the first to use MRI to assess brain manganese deposition in nonhuman primates. Subsequent MRI studies in humans have documented that either increased manganese exposure or reduced hepatobiliary excretion of manganese can result in appreciable hyperintensities within the pallidum and other brain regions known to accumulate manganese (Ikeda et al., 2000Go; Kim, 2004Go; Krieger et al., 1995Go; Nagatomo et al., 1999Go; Newland et al., 1989Go; Rose et al., 1999Go; Sadek et al., 2003Go; Stewart et al., 2005Go). MRI has been used to support a diagnosis of manganese neurotoxicity in welders, individuals receiving total parenteral nutrition, and patients with hepatobiliary insufficiency (Kim, 2004Go; Nagatomo et al., 1999Go; Stewart et al., 2005Go). One means of quantifying the MRI signal hyperintensity is the pallidal index (PI), which reflects the relative signal intensity in the T1 MRI of the globus pallidus versus the adjacent subcortical frontal white matter (Krieger et al., 1995Go). Despite growing interest in the use of the PI as a biomarker of manganese exposure (Kim, 2004Go), there is little data available demonstrating whether changes in the PI in fact reflect actual brain manganese concentrations.

Studies documenting the presence of manganese in the olfactory bulb of rats, mice, and freshwater pike following intranasal instillation have raised concerns that manganese can undergo direct transport from the olfactory region of the nasal cavity to the brain, hence direct "nose-to-brain" transport (Tjälve and Henriksson, 1999Go). In rats, intranasal instillation of manganese has been shown to result in direct transport of manganese to the olfactory bulb and the telencephalon through translocation in secondary olfactory neurons (Tjälve and Henriksson, 1999Go). Once in the brain, manganese can continue to move across synaptic connections and along neuronal processes to sites distantly connected to the olfactory center in the brain (Tjälve and Henriksson, 1999Go). Our laboratory has demonstrated that in rats, inhaled manganese is absorbed by the olfactory epithelium and subsequently undergoes transport via the olfactory nerve to the olfactory bulb (Brenneman et al., 2000Go). Although direct nose-to-brain transport appears to be an important route by which inhaled manganese reaches the rodent brain, it remains to be determined as to whether similar processes may play a role in brain manganese deposition in nonhuman primates. Anatomical similarities between nonhuman primates and humans give such information important public health ramifications.

The following report presents the first comprehensive subchronic manganese inhalation study to use MRI to establish whether a direct association exists between MRI changes and pallidal manganese concentration in nonhuman primates. Importantly, this report also provides MRI evidence to suggest that direct nose-to-brain transport of manganese occurs in rhesus monkeys following manganese inhalation.


    MATERIALS AND METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Animals.
This study was conducted under federal guidelines for the care and use of laboratory animals (NRC, 1996Go) and was approved by the CIIT Institutional Animal Care and Use Committee. Twenty, 17- to 22-month-old, naive male rhesus monkeys were purchased from Covance Research Products, Inc. (Alice, TX). Monkeys were approximately 20- to 24-months old at the start of the inhalation exposure. Monkeys were exposed 6 h/day, 5 days/week, for 13 weeks (65 exposure days). Monkeys were allocated as follows: air (n = 6) and 0.06 mg Mn/m3 (n = 6), 0.3 mg Mn/m3 (n = 4), and 1.5 mg Mn/m3 (n = 4). Additional details concerning these animals and their husbandry have been recently published (Dorman et al., 2005Go).

Manganese exposures.
Manganese(II) sulfate monohydrate (MnSO4·H2O) was obtained from Aldrich Chemical Company, Inc. (Milwaukee, WI). Four, 8-m3, stainless steel and glass inhalation exposure chambers were used. Methods describing chamber monitoring as well as generation and characterization of the MnSO4 aerosol have been previously described (Dorman et al., 2004Go, 2005Go). Based upon optical particle sensor measurements, the overall average concentrations (± SD) for the MnSO4 atmospheres were 0.19 ± 0.01, 0.97 ± 0.06, and 4.55 ± 0.33 mg/m3 for the target concentrations of 0.18, 0.92, and 4.62 mg MnSO4/m3, respectively. The geometric mean diameter, geometric standard deviation ({sigma}g), and calculated mass median aerodynamic diameters (MMAD) of the MnSO4 aerosols were determined to be 1.04 ({sigma}g = 1.51; MMAD = 1.73 µm), 1.07 ({sigma}g = 1.54; MMAD = 1.89 µm), and 1.12 µm ({sigma}g = 1.58; MMAD = 2.12 µm) for the target concentrations of 0.18, 0.92, and 4.62 mg MnSO4/m3, respectively.

Neuroimaging studies.
T1-Weighted MRI studies of the head were performed near the end of the 13-week inhalation exposure (i.e., after 63–64 exposures and 3–4 days before the necropsies were performed). The following anesthesia protocol was used. Animals were fasted overnight and then tranquilized with ketamine (approximately 10–15 mg/kg, im, Fort Dodge Animal Health, Fort Dodge, IA). Animals were given atropine (approximately 0.05 mg/kg2, Phoenix Scientific Inc., St Joseph, MO) to decrease bronchial secretions and prevent bradycardia. This was followed by induction of generalized anesthesia using an iv bolus of propofol (Gensia Sicor Pharmaceuticals, Inc., Irvine, CA) at an approximate dose of 1.25–2.5 mg/kg followed by slow iv propofol infusion at approximately 300 µg/kg/min (range 105–470 µg/kg/min) to maintain a light plane of anesthesia (Fowler et al., 2001Go). Heart rate and pulse oximetry were monitored throughout the procedure (Nonin Medical Inc, Plymouth, MN). Earplugs were placed in the ear canal to reduce auditory arousal during imaging.

MRI scans were done on a 1.5-T MRI scanner (GE Genesis Signa, General Electric Medical, Milwaukee, WI) with a standard Quadknee coil. The anesthetized animal's head was packed into the coil using foam; however, coregistration using a coordinate system was not used. Axial images were obtained using a standard spin echo pulse sequence at different repetition times (TR). Shimming, receiver gain, radio frequency (RF) gains, and RF were calibrated at 4000 ms and kept unchanged for all subsequent TRs. Eight different TRs, 100, 200, 400, 600, 800, 1000, 2000, and 4000 ms, were used to cover the full T1 recovery range of brain tissue. The acquisition parameters of the T1-calculated images included echo time (TE) = 10 ms; slice thickness (ST) = 2 mm (contiguous); number of averages (NA) = 100 ms x 6, 200 ms x 3, 400 ms x 2, 600 m,s and all subsequent TRs x 1; field of view (FOV) = 120 mm; and matrix = 128 x 128, resulting in a cumulative imaging time of approximately 1 h per subject. Slice acquisition was done in an "interlaced" configuration to eliminate cross talk between slices. MRI data were interpolated to 256 x 256, and the images were processed at a DICOM workstation (Merge eFilm, Toronto, Canada). The standard spin echo sequences were used for generation of the T1 values. Fast spin echo (FSE) images were only used to generate images of the entire brain for anatomy. Fast imaging was not used for T1 calculation. Slices were interlaced to prevent cross talk. The signal intensities were not normalized between subjects as each animal acted as its own control in the generation of T1 values, given the imaging parameters. The images were evaluated, and the appropriate anatomy was identified by clinical evaluation. Four nonadjacent data points were selected from each anatomical region of interest from each side of the brain. Once the appropriate neuroanatomical structure was identified and voxels were selected, the coordinates of that voxel were propagated over the range of T1-weighted sequences, and the signal intensity was recorded. Average pixel signal intensity was then calculated for each TR (left vs. right). One animal had evidence of misregistration (movement), and the imaging study for that animal was repeated the following day. Otherwise, there was no evidence of scan-to-scan misregistration based on random checking of selected data points.

To calculate the left and right pallidal T1 relaxation times, these data were fitted with a standard two-parameter single exponential decay function of the form Formula where I0 is the initial signal intensity, TR is the repetition time, and T1 is the relaxation time under investigation. The nonlinear fitting of the exponential data to this equation was done using a general nonlinear Levenberg-Marquardt algorithm (Microsoft Excel, Microsoft Corporation, Redmond, WA). The spin-lattice relaxation rate (R1) was subsequently calculated from 1/T1.

An additional T1-weighted FSE sequence was generated, TR = 450 ms, TE = 12 ms, ST = 2 mm, NA = 2, echo train length (ETL) = 4, FOV = 120 mm, matrix 256 x 192. Axial images were acquired, and four pixels were evaluated in each of the left and right globus pallidus and left and right subcortical white matter. From the averages of these data, the PI as described by Krieger and coworkers (1995)Go and Spahr et al. (1996)Go was generated for each subject. Total anesthesia time was generally less than 2 h.

Necropsy procedures.
Necropsies were performed the day following the last inhalation exposure. Food was withheld overnight prior to necropsy. Monkeys were anesthetized with ketamine (20 mg/kg, im, Fort Dodge Animal Health), and blood was collected from a peripheral vein using plastic syringes with hypodermic needles. Monkeys were then euthanized with pentobarbital (80–150 mg/kg, iv, Henry Schein Inc., Port Washington, NY) followed by exsanguination. Brains were removed and divided on the midsagittal plane with anatomical structures identified using a published atlas (Martin and Bowden, 2000Go). Representative samples of olfactory epithelium, pituitary gland, olfactory bulb, olfactory tract, olfactory cortex, caudate, putamen, globus pallidus, cerebellum, white matter, frontal cortex, and whole blood were collected for manganese analyses. Tissue manganese concentrations were determined by graphite furnace atomic absorption spectrometry using previously published methods (Dorman et al., 2004Go). Globus pallidus iron concentrations were determined by inductively coupled plasma mass spectrometry (West Coast Analytical Service Inc., Santa Fe Springs, CA).

Statistics.
The data for quantitative, continuous variables were compared for the exposure and control groups by tests for homogeneity of variance (Levene's test), ANOVA, and the Dunnett multiple comparison procedure for significant ANOVA. A natural log transformation of the data was performed if the Levene's test was significant. Statistical analyses were performed using JMP Statistical Software (SAS Institute, Cary, NC). A probability value of < 0.01 was used for Levene's test, while < 0.05 was used as the critical level of significance for all other statistical tests. Unless otherwise noted, data presented represent mean values ± SEMs.


    RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Subchronic exposure of rhesus monkeys to high airborne manganese concentrations was associated with increased blood, olfactory epithelial, and brain manganese concentrations (Table 1). Importantly, the magnitude of the increase in CNS manganese concentration was dependent upon the brain region and the MnSO4 exposure concentration (Table 1). An approximate 1.7-, 2.7-, and 6-fold increase (vs. controls) in mean pallidal manganese concentration was observed following subchronic exposure to MnSO4 at 0.06, 0.3, and 1.5 mg Mn/m3, respectively. Markedly increased olfactory epithelial, olfactory bulb, and olfactory cortex manganese concentrations also occurred in monkeys exposed to MnSO4 at all exposure levels tested. Increased pituitary gland and whole-blood manganese concentrations occurred in monkeys exposed to MnSO4 at ≥ 0.3 mg Mn/m3. Increased frontal cortex manganese concentrations occurred only in monkeys from the highest exposure group, and unlike the globus pallidus, this tissue developed merely a twofold increase in manganese concentration (vs. controls). Subchronic manganese exposure did not affect pallidal iron concentrations. Mean pallidal iron concentrations were 73.7 ± 11.4, 73.3 ± 5.7, 71.6 ± 9.8, and 62.6 ± 7.2 µg/g following exposure to air or MnSO4 at 0.06, 0.3, and 1.5 mg Mn/m3, respectively.


View this table:
[in this window]
[in a new window]
 
TABLE 1 Mean (± SEM) Tissue Manganese Concentrations (µg Mn/g tissue wet weight) in Young Monkeys Following Subchronic Exposure to Either Air or MnSO4

 
Changes in manganese concentrations were in good accord with regional changes noted during brain MRI studies. Brain regions with increased manganese concentrations had increased MRI signal intensities that were symmetrical between the two hemispheres. For example, increased signal intensities in the olfactory bulb and globus pallidus were consistently observed in MnSO4-exposed monkeys (Fig. 1). As the MnSO4 exposure concentration increased, a more extensive pattern of T1 signal hyperintensity could be discerned within different brain regions (Fig. 2). Mean pallidal T1 relaxation times consistently shortened from 1008 ± 45, 879 ± 25, 761 ± 57, and 468 ± 43 ms following exposure to air or MnSO4 at 0.06, 0.3, and 1.5 mg Mn/m3, respectively. A significant decrease in pallidal T1 relaxation time (vs. air-exposed controls) was noted following exposure to MnSO4 at ≥ 0.06 mg Mn/m3. Linear correlations between pallidal, white matter, and pituitary manganese concentrations and the R1 relaxation rate were observed (Fig. 3). Mean PI values were 1.04 ± 0.02, 1.08 ± 0.03, 1.13 ± 0.05, and 1.29 ± 0.02 following exposure to air or MnSO4 at 0.06, 0.3, and 1.5 mg Mn/m3, respectively. A significant increase in PI (vs. air-exposed controls) was noted following exposure to MnSO4 at 1.5 mg Mn/m3. We found statistically significant linear relationships between both the pallidal and whole-blood manganese concentrations and the PI (Fig. 4) and between whole-blood manganese concentration and pallidal manganese concentration (r2 = 0.50) (Fig. 5).


Figure 1
View larger version (98K):
[in this window]
[in a new window]
 
FIG. 1. T1 MRI images collected from monkeys exposed subchronically to either air (A) or MnSO4 at 1.5 mg Mn/m3 (B). The MnSO4-exposed monkey demonstrates markedly increased signal intensity in the globus pallidus (asterisk). Arrow shows increased signal intensity in the olfactory bulb, a finding consistent with the accumulation of manganese at this site. Efferent tracts directly linking the olfactory bulb with the basal ganglia could not be visualized by MRI.

 

Figure 2
View larger version (128K):
[in this window]
[in a new window]
 
FIG. 2. Three-dimensional reconstruction of MRI images taken from monkeys exposed subchronically to either air or MnSO4. Pseudocolor images corresponding to increased signal intensities from the original DICOM image were constructed using Mimics 7.3 (Materialise, Glen Burnie, MD). MnSO4 exposure concentrations are provided in mg Mn/m3.

 

Figure 3
View larger version (8K):
[in this window]
[in a new window]
 
FIG. 3. Statistically significant linear relationships were found between white matter (top), globus pallidus (middle), and pituitary (bottom) manganese concentrations and the relaxation rate (R1). MnSO4 exposure concentrations are provided in mg Mn/m3. Solid symbols display mean values (± SEMs). Asterisk indicates that brain manganese concentration is increased relative to air-exposed controls (p < 0.05) while double dagger indicates that both brain manganese concentration and relaxation rate are increased relative to air-exposed controls (p < 0.05).

 

Figure 4
View larger version (5K):
[in this window]
[in a new window]
 
FIG. 4. Statistically significant linear relationships were found between globus pallidus (left) and whole-blood (right) manganese concentrations and the PI. MnSO4 exposure concentrations are provided in mg Mn/m3. Solid symbols display mean values (± SEMs). Asterisk indicates that tissue manganese concentration is increased relative to air-exposed controls (p < 0.05) while double dagger indicates that both brain manganese concentration and PI are increased relative to air-exposed controls (p < 0.05).

 

Figure 5
View larger version (7K):
[in this window]
[in a new window]
 
FIG. 5. Statistically significant linear relationships were found between globus pallidus manganese concentration and whole-blood manganese concentration. MnSO4 exposure concentrations are provided in mg Mn/m3. Solid symbols display mean values (± SEMs). Asterisk indicates that only the pallidal manganese concentration is increased relative to air-exposed controls (p < 0.05) while double dagger indicates that both pallidal and blood manganese concentrations are increased relative to air-exposed controls (p < 0.05).

 

    DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
There is overwhelming evidence that the human striatum, globus pallidus, and substantia nigra show preferential increases in manganese concentrations and are also believed to be the primary target sites for manganese neurotoxicity (Pal et al., 1999Go). Previous investigations have shown that manganese-exposed monkeys also develop elevated manganese concentrations at these target sites (Eriksson et al., 1992Go; Newland et al., 1989Go; Olanow et al., 1996Go). Although the target sites for manganese neurotoxicity are well known, the processes by which certain manganese exposure conditions lead to increased brain manganese concentrations at these susceptible sites are not as well established. This study was designed to resolve some of these uncertainties. We observed that monkeys exposed to the lowest MnSO4 exposure concentration used in our study (0.06 mg Mn/m3) developed increased globus pallidus and putamen manganese concentrations. Somewhat unexpectedly, these same animals developed increased cerebellar and white matter manganese concentrations. Increased manganese concentrations in the caudate and pituitary gland emerged following subchronic exposure to MnSO4 at 0.3 mg Mn/m3. Increased frontal cortex manganese concentrations occurred following subchronic exposure to MnSO4 at 1.5 mg Mn/m3. Brain MRI evaluations of animals exposed to MnSO4 at 0.3 mg Mn/m3 revealed basal ganglia signal hyperintensities consistent with published reports in monkeys (Eriksson et al., 1992Go; Newland et al., 1989Go; Olanow et al., 1996Go) and humans (Pal et al., 1999Go) with excessive manganese exposure. The highest MnSO4 exposure (1.5 mg Mn/m3) led to a more extensive manganese distribution pattern that could be visualized by MRI. For example, we observed increased manganese concentrations extending into the frontal cortex in monkeys exposed to the highest MnSO4 concentration. The changes noted on MRI correlated well with subsequent manganese tissue analysis.

This study confirmed that the increase in tissue manganese concentration varies among different brain regions. A greater than five- to sixfold increase (vs. controls) in mean tissue manganese concentration was observed in the globus pallidus, putamen, caudate, and white matter of monkeys exposed to MnSO4 at 1.5 mg Mn/m3. In contrast, manganese concentrations in the frontal cortex and cerebellum, two brain regions thought not to be associated with manganese neurotoxicity (Pal et al., 1999Go), had less than a threefold increase (vs. controls). An approximately sevenfold increase (vs. controls) in pituitary gland manganese concentration was observed in the most heavily exposed monkeys. These results suggest that like the globus pallidus, the pituitary gland also preferentially accumulates manganese. Brain MRI studies conducted by Newland et al. (1989)Go showed a similar distribution pattern in a cynomolgus monkey exposed to a manganese chloride aerosol, consistent with our findings.

Our study also considered whether inhaled manganese could undergo direct olfactory transport. Resolving this question is critical because the olfactory system is in direct contact with the external environment. Our previous studies showed that the olfactory system can provide a pathway by which inhaled manganese is translocated to the rodent brain (Brenneman et al., 2000Go). This present study further demonstrates that MnSO4-exposed monkeys develop markedly (7- to 15-fold) increased olfactory epithelial and olfactory bulb manganese concentrations. Interestingly, olfactory bulb manganese concentrations were comparable to those seen in the globus pallidus. Absolute manganese concentrations in the MnSO4-exposed monkeys demonstrated a decreasing peripheral-central concentration gradient within the olfactory system, i.e., olfactory epithelium >> olfactory bulb > olfactory tract > olfactory cortex. The increase in olfactory bulb manganese concentration seen in the MnSO4-exposed monkeys is qualitatively similar to that seen in young adult male rats exposed subchronically to comparable MnSO4 exposure concentrations (Dorman et al., 2004Go). When considered collectively, the data are consistent with direct olfactory transport of inhaled manganese. To our knowledge, this is the first evidence of direct nose-to-brain transport of an inhaled material in a nonhuman primate.

Neuronal connections between the rhesus monkey olfactory bulb and olfactory cortex have been examined using anterograde and retrograde axonal tracers. Anterograde tracers placed into the monkey olfactory bulb labeled axons in the anterior olfactory nucleus, piriform cortex, ventral tenia tecta, olfactory tubercle, anterior cortical nucleus of the amygdala, periamygdaloid cortex, and olfactory division of the entorhinal cortex (Carmichael et al., 1994Go; Insausti et al., 2002Go). Retrograde tracers injected into the olfactory bulb labeled cells in the nucleus of the diagonal band and the majority of the primary olfactory cortical area. The entorhinal cortex can also give rise to projections that terminate within the subiculum, hippocampus, and dentate gyrus (Witter and Amaral, 1991Go). To our knowledge, significant neuronal connections between the monkey olfactory bulb and globus pallidus do not exist. Cross et al. (2004)Go used MRI to evaluate nose-to-brain transport of manganese in rats following intranasal instillation of manganese chloride. These investigators showed that manganese-enhanced MRI results were qualitatively similar to those obtained using more classical nerve tract–tracing methods. The Cross et al. (2004) study as well as those conducted in our laboratory (Brenneman et al., 2000Go) showed that manganese does not undergo transport to the rat striatum or other more distal brain structures directly from the nasal cavity. Brain MRI studies of our MnSO4-exposed monkeys demonstrated marked signal hyperintensities within the olfactory bulb and the globus pallidus. The resolution of the MRI used in this study does not allow resolution of individual nerve tracts. However, comparable signal hyperintensities could not be visualized in the intervening brain parenchyma, and thus our study failed to provide evidence that direct translocation of manganese from the olfactory bulb to the globus pallidus occurred in the manganese-exposed monkeys. This finding is consistent with neuroanatomical studies that failed to demonstrate direct anterograde projections from the macaque olfactory bulb to the globus pallidus (Carmichael et al., 1994Go).

Another important finding of our study is that MRI can be used as a biomarker of ongoing subchronic manganese exposure. Two MRI measurements, namely the PI and the T1 relaxation rate (R1), were used to characterize manganese accumulation within the globus pallidus, pituitary, and white matter. Previous reports in rats indicate that significant correlations between the concentration of manganese in the globus pallidus and the PI are possible (Gallez et al., 2001Go). Our study further demonstrates that pallidal manganese concentrations in nonhuman primates are also linearly correlated with the PI. The primary advantage of using the PI to estimate regional brain manganese content is that this procedure is straightforward and can be performed relatively quickly using routine T1 MRI scans. However, it should be noted that calculation of the PI presumes that white matter manganese concentrations are unaffected. Our data demonstrate that this is not necessarily the case since white matter manganese concentrations increased in all exposure groups following subchronic MnSO4 inhalation.

We believe that our data may provide a rational basis for beginning to understand the relationship between PI and pallidal manganese concentration. Although there is little data evaluating whether an increased PI in humans is associated with elevated pallidal manganese concentrations, our data appear to be in relatively good concordance with the published clinical literature. For example, patients with hepatic cirrhosis demonstrate increased pallidal manganese accumulation and signal hyperintensity on MRI (Hauser et al., 1996Go; Layrargues et al., 1998Go; Maeda et al., 1997Go; Spahr et al., 1996Go). Spahr et al. (1996) reported that PI values in 62 normal and 57 cirrhotic patients were 99.1 ± 1.8 and 114 ± 17.4, respectively. A PI value of ≥ 114 was seen in six of our MnSO4-exposed monkeys. These animals had pallidal manganese concentrations ranging from 0.97 to 3.38 µg Mn/g wet weight, representing a two- to sevenfold increase in pallidal manganese concentration (vs. controls). By comparison, autopsy specimens from cirrhotic patients who died in hepatic coma also revealed a two- to sevenfold increase in pallidal manganese concentration (Layrargues et al., 1998Go; Maeda et al., 1997Go). Hence, the relative increase in pallidal manganese levels observed in our monkeys with the highest PI values are remarkably similar to those reported in people with advanced liver cirrhosis. Maeda and coworkers (1997)Go reported pallidal manganese concentrations in one normal human of 0.42 µg Mn/g wet weight compared to three individuals with hepatic cirrhosis (2.6–3.5 µg Mn/g wet weight). Lucchini and coworkers (2000)Go reported that PI values in workers with occupational exposure to manganese were lower than those occurring in patients with significant hepatic cirrhosis. The median PI value reported in seven manganese-exposed workers with neurobehavioral impairment was 107.7 ± 7.7 (Lucchini et al., 2000Go); however, very similar PI values (107.7 ± 6.5) have also been reported in 89 asymptomatic manganese-exposed workers (Kim et al., 1999Go). To put this in perspective with our study, the mean pallidal manganese concentrations in monkeys with a PI of 105–110 was 0.86 ± 0.31 µg Mn/g wet weight. This manganese concentration represents an approximate 80% increase in pallidal manganese concentration (vs. control monkeys).

Several investigators have attempted to correlate blood manganese concentrations with the PI, with mixed results. Positive correlations between blood manganese concentration and the PI have been reported in welders (Kim et al., 1999Go) and patients with liver cirrhosis (Choi et al., 2005Go; Park et al., 2003Go). In contrast, patients with iron deficiency anemia typically have a normal-appearing globus pallidus MRI signal intensity despite elevated blood manganese concentrations (Kim et al., 2005Go). We observed linear relationships between whole-blood manganese concentration and either the PI or the pallidal manganese concentration. The strengths of these correlations were weaker (i.e., r2 values from 0.45 to 0.50) than those seen between pallidal manganese concentration and the PI, suggesting that blood manganese concentration is a less robust predictor of pallidal manganese concentration.

Importantly, we also observed a linear relationship between pallidal manganese concentration and the T1 relaxation rate. In fact, the strength of the linear association between R1 and the pallidal manganese concentration was somewhat greater than that seen between the pallidal manganese concentration and PI. Unlike the PI, there was little overlap between pallidal T1 relaxation rates measured among different MnSO4 exposure groups. The major disadvantage of using the relaxivity of manganese (R1) is that the time required to acquire the T1 relaxation time results in prolonged imaging sessions of one or more hours. Although the R1 appears to be a more accurate way to estimate pallidal manganese concentrations than the PI, this measure may still not be suitable for detecting small changes (e.g., < 50% increase) in pallidal manganese concentration. There are conflicting reports as to whether age-related changes in brain iron concentrations (as estimated by MRI) and MRI signal intensity change during aging in people (Martin et al., 1998Go; Schenker et al., 1993Go). Such changes may influence the measurement of either the PI or the R1. In our study, globus pallidus iron concentrations were unaffected by MnSO4 inhalation, and thus it is unlikely that the measurements of either the PI or the R1 in the present study were confounded by alterations in pallidal iron concentration.

Our lowest exposure MnSO4 concentration (0.06 mg Mn/m3) is below the current 8-h threshold limit value for inhaled manganese of 0.2 mg Mn/m3 that has been established by the American Conference of Governmental Industrial Hygienists. Previous rodent studies have shown that brain delivery of manganese is favored following inhalation of the more soluble sulfate form of manganese (Dorman et al., 2004Go). Thus, comparable exposure (on a mg Mn/m3 basis) to mixed manganese oxides associated with welding and other metal-working occupations should be less likely to induce increased brain manganese concentrations. The present data from exposed monkeys are also relevant for environmental exposures to manganese. In particular, modern automobiles that use the gasoline fuel additive methylcyclopentadienyl manganese tricarbonyl (MMT) emit manganese primarily in the phosphate and sulfate forms with smaller amounts of manganese oxides also being discharged (Aschner et al., 2005Go). The lowest exposure concentration used in this study is > 2000-fold higher than typical air manganese concentrations observed in the ambient air samples obtained in Canadian cities where MMT was used extensively in gasoline (Pellizzari et al., 1999Go).

In conclusion, our study confirmed that rhesus monkeys subchronically exposed to MnSO4 develop increased regional brain manganese concentrations with corresponding hyperintense MRI images. Of relevance to humans with significant manganese exposure, these data suggest that clinically detectable increases in the PI occurred when the pallidal manganese concentration is approximately doubled. We also found evidence for direct nose-to-brain transport of inhaled manganese in monkeys. Known anatomical and physiological similarities between humans and monkeys suggest that this pathway is likely also operable in human beings and, as in the monkey, is not likely to transport manganese beyond the olfactory bulb to deeper brain tissues like the globus pallidus. Nevertheless, before considering manganese poisoning as the cause for enhanced pallidal MRI signal hyperintensity, a clinician must rule out other causes that may present with similar MRI changes including cerebral hemorrhage, ischemia, and other paramagnetic metal storage diseases (Herrero Hernandez et al., 2002Go).


    NOTES
 
Disclaimer: The research described in this article has been reviewed by the National Health and Environmental Effects Research Laboratory, U.S. Environmental Protection Agency, and approved for publication. Approval does not signify that the contents necessarily reflect the views and the policies of the agency nor does mention of trade names or commercial products constitute endorsement or recommendation for use.


    ACKNOWLEDGMENTS
 
The authors would like to thank John Murphy, Marianne Marshall, Carl Parkinson, R. Arden James, Paul Ross, and the staff of the CIIT animal care facility and Alliance Imaging for their contributions. The authors also thank Drs Mel Andersen, Linda Birnbaum, William Boyes, Elaina Kenyon, and Owen Moss for their critical review of the manuscript. This work is based on a study sponsored and funded by Afton Chemical Corporation in satisfaction of registration requirements arising under Section 211(a) and (b) of the Clean Air Act and corresponding regulations at 40 C. F. R. Subsections 79.50 et seq.


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 MATERIALS AND METHODS
 RESULTS
 DISCUSSION
 REFERENCES
 
Aschner, M., Erikson, K. M., and Dorman, D. C. (2005). A review of manganese toxicokinetics. Crit. Rev. Toxicol. 35, 1–32.[CrossRef][Web of Science][Medline]

Brenneman, K. A., Wong, B. A., Buccellato, M. A., Costa, E. R., Gross, E. A., and Dorman, D. C. (2000). Direct olfactory transport of inhaled manganese (54MnCl2) to the rat brain: Toxicokinetic investigations in a unilateral nasal occlusion model. Toxicol. Appl. Pharmacol. 169, 238–248.[CrossRef][Web of Science][Medline]

Carmichael, S. T., Clugnet, M. C., and Price, J. L. (1994). Central olfactory connections in the macaque monkey. J. Comp. Neurol. 346, 403–434.[CrossRef][Web of Science][Medline]

Choi, Y., Park, J. K., Park, N. H., Shin, J. W., Yoo, C. I., Lee, C. R., Lee, H., Kim, H. K., Kim, S. R., Jung, T. H., et al. (2005). Whole blood and red blood cell manganese reflected signal intensities of T1-weighted magnetic resonance images better than plasma manganese in liver cirrhotics. J. Occup. Health 47, 68–73.[Medline]

Couper, J. (1837). On the effects of black oxide of manganese when inhaled into the lungs. Br. Ann. Med. Pharmacol. 1, 41–42.

Cross, D. J., Minoshima, S., Anzai, Y., Flexman, J. A., Keogh, B. P., Kim, Y., and Maravilla, K. R. (2004). Statistical mapping of functional olfactory connections of the rat brain in vivo. Neuroimage 23, 1326–1335.[CrossRef][Web of Science][Medline]

Dorman, D. C., McManus, B. E., Parkinson, C. U., Manuel, C. A., James, R. A., Struve, M. F., McElveen, A. M., and Everitt, J. I. (2004). Nasal toxicity of manganese sulfate and manganese phosphate in young male rats following subchronic (13-week) inhalation exposure. Inhal. Toxicol. 16, 481–488.[CrossRef][Medline]

Dorman, D. C., Struve, M. F., Gross, E. A., Wong, B. A., and Howroyd, P. C. (2005). Sub-chronic inhalation of high concentrations of manganese sulfate induces lower airway pathology in rhesus monkeys. Respir. Res. 21, 6.[CrossRef]

Eriksson, H., Tedroff, J., Thuomas, K. A., Aquilonius, S. M., Hartvig, P., Fasth, K. J., Bjurling, P., Langstrom, B., Hedstrom, K. G., and Heilbronn, E. (1992). Manganese induced brain lesions in Macaca fascicularis as revealed by positron emission tomography and magnetic resonance imaging. Arch. Toxicol. 66, 403–407.[CrossRef][Web of Science][Medline]

Fowler, K. A., Huerkamp, M. J., Pullium, J. K., and Subramanian, T. (2001). Anesthetic protocol: Propofol use in Rhesus macaques (Macaca mulatta) during magnetic resonance imaging with stereotactic head frame application. Brain Res. Brain Res. Protoc. 7, 87–93.[Medline]

Gallez, B., Demeure, R., Baudelet, C., Abdelouahab, N., Beghein, N., Jordan, B., Geurts, M., and Roels, H. A. (2001). Non invasive quantification of manganese deposits in the rat brain by local measurement of NMR proton T1 relaxation times. Neurotoxicology 22, 387–392.[Medline]

Gorell, J. M., Peterson, E. L., Rybicki, B. A., and Johnson, C. C. (2004). Multiple risk factors for Parkinson's disease. J. Neurol. Sci. 217, 169–174.[CrossRef][Web of Science][Medline]

Hauser, R. A., Zesiewicz, T. A., Martinez, C., Rosemurgy, A. S., and Olanow, C. W. (1996). Blood manganese correlates with brain magnetic resonance imaging changes in patients with liver disease. Can. J. Neurol. Sci. 23, 95–98.[Web of Science][Medline]

Herrero Hernandez, E., Valentini, M. C., and Discalzi, G. (2002). T1-weighted hyperintensity in basal ganglia at brain magnetic resonance imaging: Are different pathologies sharing a common mechanism? Neurotoxicology 23, 669–674.[CrossRef][Web of Science][Medline]

Ikeda, S., Yamaguchi, Y., Sera, Y., Ohshiro, H., Uchino, S., Yamashita, Y., and Ogawa, M. (2000). Manganese deposition in the globus pallidus in patients with biliary atresia. Transplantation 69, 2339–2343.[CrossRef][Medline]

Insausti, R., Marcos, P., Arroyo-Jimenez, M. M., Blaizot, X., and Martinez-Marcos, A. (2002). Comparative aspects of the olfactory portion of the entorhinal cortex and its projection to the hippocampus in rodents, nonhuman primates, and the human brain. Brain Res. Bull. 57, 557–560.[CrossRef][Web of Science][Medline]

Kim, Y. (2004). High signal intensities on T1-weighted MRI as a biomarker of exposure to manganese. Ind. Health 42, 111–115.[Web of Science][Medline]

Kim, Y., Kim, K. S., Yang, J. S., Park, I. J., Kim, E., Jin, Y., Kwon, K. R., Chang, K. H., Kim, J. W., Park, S. H., et al. (1999). Increase in signal intensities on T1-weighted magnetic resonance images in asymptomatic manganese-exposed workers. Neurotoxicology 20, 901–907.[Web of Science][Medline]

Kim, Y., Park, J. K., Choi, Y., Yoo, C. I., Lee, C. R., Lee, H., Lee, J. H., Kim, S. R., Jeong, T. H., Yoon, C. S., et al. (2005). Blood manganese concentration is elevated in iron deficiency anemia patients, whereas globus pallidus signal intensity is minimally affected. Neurotoxicology 26, 107–111.[CrossRef][Web of Science][Medline]

Krieger, D., Krieger, S., Jansen, O., Gass, P., Theilmann, L., and Lichtnecker, H. (1995). Manganese and chronic hepatic encephalopathy. Lancet 346, 270–274.[CrossRef][Web of Science][Medline]

Layrargues, G. P., Rose, C., Spahr, L., Zayed, J., Normandin, L., and Butterworth, R. F. (1998). Role of manganese in the pathogenesis of portal-systemic encephalopathy. Metab. Brain Dis. 13, 311–317.[CrossRef][Web of Science][Medline]

Lin, C. P., Tseng, W. Y., Cheng, H. C., and Chen, J. H. (2001). Validation of diffusion tensor magnetic resonance axonal fiber imaging with registered manganese-enhanced optic tracts. Neuroimage 14, 1035–1047.[CrossRef][Medline]

Lucchini, R., Albini, E., Placidi, D., Gasparotti, R., Pigozzi, M. G., Montani, G., and Alessio, L. (2000). Brain magnetic resonance imaging and manganese exposure. Neurotoxicology 21, 769–775.[Web of Science][Medline]

Maeda, H., Sato, M., Yoshikawa, A., Kimura, M., Sonomura, T., Terada, M., and Kishi, K. (1997). Brain MR imaging in patients with hepatic cirrhosis: Relationship between high intensity signal in basal ganglia on T1-weighted images and elemental concentrations in brain. Neuroradiology 39, 546–550.[CrossRef][Web of Science][Medline]

Martin, R. F., and Bowden, D. M. (2000). Primate Brain Maps: Structure of the Macaque Brain. Elsevier, New York, p. 168.

Martin, W. R., Ye, F. Q., and Allen, P. S. (1998). Increasing striatal iron content associated with normal aging. Mov. Disord. 13, 281–286.[CrossRef][Web of Science][Medline]

Nagatomo, S., Umehara, F., Hanada, K., Nobuhara, Y., Takenaga, S., Arimura, K., and Osame, M. (1999). Manganese intoxication during total parenteral nutrition: Report of two cases and review of the literature. J. Neurol. Sci. 162, 102–105.[CrossRef][Web of Science][Medline]

National Research Council (NRC) (1996). Guide for the Care and Use of Laboratory Animals. National Academy Press, Washington, p. 125.

Newland, M. C., Ceckler, T. L., Kordower, J. H., and Weiss, B. (1989). Visualizing manganese in the primate basal ganglia with magnetic resonance imaging. Exp. Neurol. 106, 251–258.[CrossRef][Web of Science][Medline]

Olanow, C. W., Good, P. F., Shinotoh, H., Hewitt, K. A., Vingerhoets, F., Snow, B. J., Beal, M. F., Calne, D. B., and Perl, D. P. (1996). Manganese intoxication in the rhesus monkey: A clinical, imaging, pathologic, and biochemical study. Neurology 46, 492–498.[Abstract/Free Full Text]

Pal, P. K., Samii, A., and Calne, D. B. (1999). Manganese neurotoxicity: A review of clinical features, imaging and pathology. Neurotoxicology 20, 227–238.[Web of Science][Medline]

Park, N. H., Park, J. K., Choi, Y., Yoo, C. I., Lee, C. R., Lee, H., Kim, H. K., Kim, S. R., Jeong, T. H., Park, J., et al. (2003). Whole blood manganese correlates with high signal intensities on T1-weighted MRI in patients with liver cirrhosis. Neurotoxicology 24, 909–915.[CrossRef][Web of Science][Medline]

Pellizzari, E. D., Clayton, C. A., Rodes, C., Mason, R. E., Piper, L., Fort, B. F., Pfeifer, G. D., and Lynam, D. R. (1999). Particulate matter and manganese exposures in Toronto, Canada. Atmos. Environ. 33, 721–734.

Racette, B. A., McGee-Minnich, L., Moerlein, S. M., Mink, J. W., Videen, T. O., and Perlmutter, J. S. (2001). Welding-related parkinsonism: clinical features, treatment, and pathophysiology. Neurology 9, 8–13.

Rose, C., Butterworth, R. F., Zayed, J., Normandin, L., Todd, K., Michalak, A., Spahr, L., Huet, P. M., and Pomier-Layrargues, G. (1999). Manganese deposition in basal ganglia structures results from both portal-systemic shunting and liver dysfunction. Gastroenterology 117, 640–644.[CrossRef][Web of Science][Medline]

Sadek, A. H., Rauch, R., and Schulz, P. E. (2003). Parkinsonism due to manganism in a welder. Int. J. Toxicol. 22, 393–401.[Abstract/Free Full Text]

Schenker, C., Meier, D., Wichmann, W., Boesiger, P., and Valavanis, A. (1993). Age distribution and iron dependency of the T2 relaxation time in the globus pallidus and putamen. Neuroradiology 35, 119–124.[CrossRef][Web of Science][Medline]

Spahr, L., Butterworth, R. F., Fontaine, S., Bui, L., Therrien, G., Milette, P. C., Lebrun, L. H., Zayed, J., Leblanc, A., and Pomier-Layrargues, G. (1996). Increased blood manganese in cirrhotic patients: Relationship to pallidal magnetic resonance signal hyperintensity and neurological symptoms. Hepatology 24, 1116–1120.[CrossRef][Web of Science][Medline]

Stewart, C. A., Reivich, M., Lucey, M. R., and Gores, G. J. (2005). Neuroimaging in hepatic encephalopathy. Clin. Gastroenterol. Hepatol. 3, 197–207.[CrossRef][Medline]

Tjälve, H., and Henriksson, J. (1999). Uptake of metals in the brain via olfactory pathways. Neurotoxicology 20, 181–195.[Medline]

Witter, M. P., and Amaral, D. G. (1991). Entorhinal cortex of the monkey: V. Projections to the dentate gyrus, hippocampus, and subicular complex. J. Comp. Neurol. 307, 437–459.[CrossRef][Web of Science][Medline]


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?


This article has been cited by other articles:


Home page
Toxicol SciHome page
D. C. Dorman, M. F. Struve, A. Norris, and A. J. Higgins
Metabolomic Analyses of Body Fluids after Subchronic Manganese Inhalation in Rhesus Monkeys
Toxicol. Sci., November 1, 2008; 106(1): 46 - 54.
[Abstract] [Full Text] [PDF]


Home page
Arch NeurolHome page
C. Jorge da Silva, A. Jose da Rocha, M. F. Mendes, A. P. S. d. M. Braga, and S. Jeronymo
Brain Manganese Deposition Depicted by Magnetic Resonance Imaging in a Welder
Arch Neurol, July 1, 2008; 65(7): 983 - 983.
[Full Text] [PDF]


Home page
Am. J. Neuroradiol.Home page
C.J. da Silva, A.J. da Rocha, S. Jeronymo, M.F. Mendes, F.T. Milani, A.C.M. Maia Jr, F.T. Braga, Y.A.S. Sens, and L.A. Miorin
A Preliminary Study Revealing a New Association in Patients Undergoing Maintenance Hemodialysis: Manganism Symptoms and T1 Hyperintense Changes in the Basal Ganglia
AJNR Am. J. Neuroradiol., September 1, 2007; 28(8): 1474 - 1479.
[Abstract] [Full Text] [PDF]


Home page
Toxicol SciHome page
K. M. Erikson, D. C. Dorman, L. H. Lash, and M. Aschner
Manganese Inhalation by Rhesus Monkeys is Associated with Brain Regional Changes in Biomarkers of Neurotoxicity
Toxicol. Sci., June 1, 2007; 97(2): 459 - 466.
[Abstract] [Full Text] [PDF]


Home page
Toxicol SciHome page
T. R. Guilarte, J. L. McGlothan, M. Degaonkar, M.-K. Chen, P. B. Barker, T. Syversen, and J. S. Schneider
Evidence for Cortical Dysfunction and Widespread Manganese Accumulation in the Nonhuman Primate Brain following Chronic Manganese Exposure: A 1H-MRS and MRI Study
Toxicol. Sci., December 1, 2006; 94(2): 351 - 358.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
92/1/219    most recent
kfj209v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Search for citing articles in:
ISI Web of Science (16)
Right arrowRequest Permissions
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Dorman, D. C.
Right arrow Articles by Robertson, I. D.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Dorman, D. C.
Right arrow Articles by Robertson, I. D.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?