Psychosomatic Medicine Tips for Better Browsing
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS

This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrowRequest Permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Bosch, J. A.
Right arrow Articles by Marucha, P. T.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Bosch, J. A.
Right arrow Articles by Marucha, P. T.
Psychosomatic Medicine 67:366-375 (2005)
© 2005 American Psychosomatic Society


ORIGINAL ARTICLES

Differential Mobilization of Functionally Distinct Natural Killer Subsets During Acute Psychologic Stress

Jos A. Bosch, PhD, Gary G. Berntson, PhD, John T. Cacioppo, PhD and Phillip T. Marucha, PhD

From the College of Dentistry, University of Illinois at Chicago, Chicago, Illionis (J.A.B., P.T.M.); the School of Dentistry (J.A.B.) and the Department of Psychology (G.G.B.), The Ohio State University, Columbus, Ohio; and the Department of Psychology, University of Chicago, Chicago, Illinois (J.T.C.).

Address correspondence and reprint requests to Phillip T. Marucha, DMD, PhD, The University of Illinois at Chicago, College of Dentistry, Department of Periodontics (MC 859), 801 S. Paulina St., Chicago, IL 60611. E-mail marucha{at}uic.edu


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 NOTES
 REFERENCES
 
Objective and Methods: Two functionally distinct natural killer (NK) subsets can be identified according to surface CD56 expression: CD56lo cells compose the majority of NK cells and function as cytotoxic cells, whereas CD56hi cells have an immunomodulatory function through the secretion of cytokines. These NK subsets also differ in the expression levels of adhesion molecules such as CD62L and CD11a, indicating distinct potentials to migrate to lymphoid and nonlymphoid tissues. We investigated whether NK cell mobilization during acute stress varies according to these functional and phenotypic distinctions.

Methods and Results: Fifty-three undergraduate students performed a public-speaking task and 21 students participated in a control session. The task increased heart rate and catecholamines. No change was observed for the immunoregulatory CD56hi NK subset, whereas the number of cytotoxic CD56lo NK cells tripled. In line with the observation that NK mobilization is related to cytotoxic function, we found larger increases in NK cells that express higher levels of CD16 (a receptor that mediates antibody-dependent cytotoxicity). Consistent with known subset differences in adhesion molecule expression, we also found larger stress-induced increases for NK cells that were CD62L-negative and CD11ahi. Plasma levels of soluble CD62L remained unaltered, suggesting that the increase in CD62L-negative NK cells did not result from CD62L shedding. Regression analyses demonstrated independent contributions of epinephrine and norepinephrine to NK subset mobilization.

Conclusion: The marked specificity and robustness of these effects support the idea that NK cell mobilization is a functionally relevant response that is aimed at protecting the organism during acutely stressful situations.

Key Words: immunosurveillance • innate immunity • social stress • laboratory stress • L-selectin

Abbreviations: ANOVA = analysis of variance; CD = cluster of differentiation; ECG = electrocardiogram; ELISA = enzyme-linked immunosorbent assay; Hb = hemoglobin; HPLC = high-pressure liquid chromatography; Htc = hematocrit; NK = natural killer; POMS = Profile of Mood States; sCD62L = soluble CD62L; SEM = standard error of mean.


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 NOTES
 REFERENCES
 
There is now good evidence linking psychologic stress with susceptibility to inflammatory and infectious conditions (1–3), and much research is dedicated to specifying the exact pathways responsible for this link. In this quest, the study of the interactions between psychosocial factors and immune system processes has gained particular prominence. As shown in a recent metaanalysis, one of the most replicated and robust findings in human psychoneuroimmunology is the rapid increase in circulating natural killer (NK) cells during acute psychologic stressors (4). This response reflects a release of NK cells from various reservoirs such as the margins of the blood vessels into the blood (5). The essential role of the sympathetic nervous system in mediating this effect has been amply demonstrated, and the magnitude of NK cell mobilization correlates with other indicators of sympathetic nervous system activation (e.g., decreases in cardiac preejection period, increases in heart rate and blood pressure, and the release of catecholamines) (6–10). Hence, NK cell mobilization is considered to be an integrated component of the "fight–flight" response.

The longstanding interest in the effects of psychologic and neuroendocrine factors on NK cells is understandable. NK cells are critical for protection against invading pathogens and may also confer protection against malignant transformations (11,12). These lymphocytes (which are considered part of the innate immune system) are fast-acting frontline defenders that have the capacity to swiftly migrate in and out of tissues, and are among the first immune cells to arrive at sites of tissue damage and infection (13,14). There they have the ability to immediately destroy their targets (e.g., infected cells) and to attract and activate other immune cells. These functions are established through a variety of mechanisms such as the release of cytokines and the destruction of target cells, for example by inducing apoptosis or by antibody-dependent cell-mediated cytotoxicity (11,12,15). Antibody-dependent cell-mediated cytotoxicity denotes a process by which NK cells bind and destroy target cells that are coated with antibody and is mediated by the surface immunoglobulin receptor CD16 (12). Another important function of NK cells, which has only been discovered in recent years, is the modulation of adaptive immune responses (i.e., immune responses that depend on prior exposure to an antigen). This regulatory function is related to the aforementioned ability of NK cells to secrete large amounts of cytokines such as interferon-{gamma} (16,17).

Considering the many protective functions of NK cells and the fact that the mobilization of these cells represents one of the most reliable stress responses in humans, it is surprising that only a few attempts have been made to further characterize this phenomenon (see reference 18). NK cells, which are identified by the expression of the cell-surface marker CD56 and the lack of CD3 (15), can be separated into two functionally distinct subsets according to the cell-surface density of CD56. The majority of NK cells express relatively low levels of CD56 (CD56lo) and function as cytotoxic cells. The remaining subset expresses high levels of CD56 (CD56hi) and has an immunomodulatory function through the secretion of cytokines (15,17).

These functionally distinct subsets also differ in the expression of adhesion molecules such as CD62L (higher levels on the immunoregulatory CD56hi NK cells) and CD11a (higher levels on the cytotoxic CD56lo NK cells) (19–21). These surface markers are indicative of the potential of NK cells (and other lymphocytes) to migrate to particular sites in the body. For example, CD62L (also denoted as L-selectin) supports the migration of lymphocytes into the secondary lymphoid tissues. This is because the ligands of CD62L (i.e., the molecules to which CD62L binds) are heavily expressed on the specialized vascular endothelial tissues (high endothelial venules) that form a passage from the blood to these secondary lymphoid tissues. Thus, as one would predict, the immunoregulatory CD56hi NK cells, expressing high levels of CD62L, readily bind to these high endothelial venules and are the major NK subtype found in the peripheral lymph nodes (16,21). The ligands for CD11a, on the other hand, are typically upregulated on endothelial cells in the proximity of inflamed tissues (22), and therefore the cell-surface density of CD11a reflects a potential to migrate into these tissues (a feature that seems particularly appropriate for the tissue migration of cytotoxic CD56lo NK cells) (20,21). Cytotoxic CD56lo NK cells also express high levels of CD16, which enables these cells to seek out targets that are antibody-labeled for destruction (15).

Immune cells continuously traffic through the body, going from the blood, through various organs and back into the blood. This migration is essential for maintaining an effective immune defense network (22). Characterizing how stress affects this continuous redeployment may thus clarify how stressors influence the efficiency of the immune system to protect its host. It has been shown that laboratory stressors (as well as exercise and catecholamine infusions) cause a predominant increase of CD62L-negative NK cells in the blood (18,23). One possible interpretation is that this reflects a rapid catecholamine-mediated decrease in CD62L expression on circulating NK cells. However, another possibility is that NK subsets, which vary in the expression of CD62L and other markers, are heterogeneous in their mobilization response to catecholamines. The present study investigated this possible heterogeneity in relation to the functional and migratory potential of these immune cells. In addition, we used correlation analyses to assess the independent and combined contributions of epinephrine and norepinephrine to this mobilization response.


    METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 NOTES
 REFERENCES
 
Participants
Seventy-five university undergraduates (mean age 20 years, range 18–31 years, 37 women) volunteered to participate in the present study as part of a longitudinal study on psychosocial factors and wound healing. Participants were ineligible if they were using prescribed medication (except for oral contraceptives and topicals) or reported health problems indicative of cardiovascular, inflammatory, or infectious disease. Twenty-one participants (10 women) were assigned to a no-stress control condition in which they read magazines. Subjects were assigned to the control condition if they had not participated in all segments of the larger study. Control and experimental subjects received the same advance information about the experiment. Participants received monetary compensation for their participation.

Procedures
In preparation for the study, participants were instructed not to engage in strenuous physical exercise and to refrain from using alcohol or nonprescription drugs 24 hours before the experimental sessions. In addition, participants were instructed to abstain from smoking and caffeine the day of the experiment, to eat breakfast before 10:00 am, and to eat or drink nothing after that point (except for water). Women were scheduled in the 7 days after their menses. On arrival at 12:00 pm: 1) informed consent was obtained; 2) a 19-gauge indwelling catheter was placed into the antecubital vein of the nondominant arm; 3) participants were served a standardized lunch (350 kcal, containing 9 g of protein, 15 g of carbohydrate, and 16 g of fat) and water ad libitum; and 4) electrodes for electrocardiography were attached. Subsequently, while seated in a supine position, participants filled out several questionnaires and engaged in leisure reading. At 1:30 pm, a baseline blood sample was obtained and the procedure for the laboratory stressor was initiated.

The Public-Speaking Task
The stress task consisted of two back-to-back speeches, each with 2 minutes of preparation and 4 minutes of speech delivery, as described by Bosch et al. (24). To enhance social stress, the speeches were attended by a small audience (consisting of a female nurse, a female research assistant, and a male psychologist) and videotaped (allegedly to have the quality of the performance rated). To standardize timing and instructions for the task, the instructions were presented on a video screen. A blood sample was again obtained during the third minute of the second speech as well as 15 minutes after the task.

Questionnaires
Affective responses were assessed with Profile of Mood States (POMS) (25). Health and lifestyle variables were assessed by self-report questionnaire (except for height and weight). These variables included age, gender, and ethnicity, alcohol consumption, smoking and smokeless tobacco use, caffeine consumption, use of recreational drugs, exercise, body mass index (kg/[height in meters]2). Sleep quality was measured using the Pittsburgh Sleep Quality Index (PSQI), a 19-item self-report questionnaire that assesses sleep quality, latency, and duration (26).

Endocrine Assessments
Whole blood was collected in EDTA tubes, kept on ice, and spun down within 20 minutes after collection and plasma was stored at –80°C. Plasma catecholamine concentrations were determined by HPLC (ESA, Inc., Chelsford, MA). Standards and chemicals were purchased from ChromSystems (Thermo-Alko, Beverly, MA). Samples of the same participant were analyzed in a single run. Intraassay variation for norepinephrine was 3% (interassay variation 6%). Intraassay variation for epinephrine was 6% (interassay variation 13%). Sensitivity for norepinephrine and epinephrine was 15 pg/mL and 6 pg/mL, respectively.

Flow Cytometry
Flow cytometric analyses were performed on baseline and task samples only. EDTA blood was kept at room temperature and prepared within 2 hours after collection. Specific NK subtypes were identified by immunofluorescent antibody staining of whole blood using four-color flow cytometer (FACSCalibur; Becton Dickinson, San Jose, CA). CD56 PE, CD56 FITC, and CD3 PerCP were obtained from Becton Dickinson; CD8 APC, CD16 FITC, CD62L PE and CD11a PE were obtained from Pharmingen (San Diego, CA). Briefly, cell suspensions were incubated with antibody for 25 minutes at room temperature and lysed with FACS Lysing Solution (Becton Dickinson). Subsequently, cell suspensions were washed by centrifugation (600 g, 6 minutes, 4°C), resuspended in phosphate-buffered saline containing 1% formaldehyde, and stored in the dark at 4°C. Preparations were read within 24 hours with 12,000 gated events (using the lymphocyte gate) being acquired from each preparation. Matched antibody isotype controls were used to set negative staining criteria. Data were analyzed using Cell Quest-pro software (Becton Dickinson). CD56lo and CD56hi subsets were identified as described by Cooper et al. (15). Whole blood counts, hematocrit, and hemoglobin (photometric method) were determined using a Coulter GEN-S hematology analyzer (Beckman-Coulter, Miami, FL).

Soluble CD62L
Soluble CD62L was quantified with a sandwich enzyme-linked immunosorbent assay according to the directions given by the manufacturer (Quantikine kit; R&D Systems, Inc, Minneapolis, MN). The within-assay variability is <5% and between assay variability is <10%.

Hemoconcentration
Acute stressors cause an acute loss of plasma volume within the intravascular space, which results in nondiffusible blood constituents (i.e., cells and large molecules) becoming more concentrated (27,28). Hence, stress-induced increases in the concentration of blood constituents may, in part, be the result of the same amount of cells and molecules being diluted in less fluid (28). Dill and Costill (29) described a method whereby hematocrit (Hct; the volume of red blood cells) and hemoglobin (Hb) are used to calculate such changes in hemoconcentration. Leukocytes are determined as cell counts per volume of blood, and the change (%) in blood volume (%{Delta} BV) resulting from plasma loss is calculated as:



{5MMU1}

The number of immune cells during the task can subsequently be adjusted for changes in blood concentration using the formula: adjusted cell numbers = [1 + (%{Delta} BV/100)] unadjusted cell numbers.

The concentration of plasma proteins is not determined per volume of blood, but per volume of plasma (i.e., the separated noncellular fraction of the blood). The change (%) in plasma volume (%{Delta} PV) is calculated as:



{5MMU2}

The task concentration of sCD62L was adjusted for changes in plasma concentration using the formula: adjusted plasma concentration = [1 + (%{Delta} PV/100)] unadjusted plasma concentration.

Data Analysis
Repeated-measures analysis of variance (ANOVA) was used to determine group (speech, control) x time (baseline, task) interactions for each parameter. This analysis contrasts the changes within the experimental group with the changes within the control group. Subsequent repeated-measures ANOVA were conducted to examine potential time-main effects within each group. Baseline differences between the task and control group were examined by t tests for independent groups. Regression analyses were performed to assess the unique, partial, and combined contribution of epinephrine and norepinephrine reactivity to NK mobilization.

The data of one experimental participant (female) was excluded because of unsuccessful attempts to obtain a second blood sample. Occasionally, data were incomplete as a result of incomplete lysis of a blood sample (N = 1) or an excluded outlier (z-score >3) (epinephrine N = 1, norepinephrine N = 1). Degrees of freedom were adjusted accordingly.


    RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 NOTES
 REFERENCES
 
Comparisons of Experimental and Control Subjects
Analyses indicated that the two groups were not significantly different in gender composition (control 51% males; experimental 52% male) or ethnicity (control 67% white; experimental 81% white) and were of similar age (mean age controls 20.3, standard error of mean [SEM] 0.3; mean age experimental 19.8, SEM 0.3) (all p > .2). Statistical comparisons were also performed on a number of lifestyle factors, including smoking (habitual, past week, past 24 hours), alcohol consumption (habitual, past week, past 24 hours), caffeine consumption (habitual, past week, past 24 hours), hours and quality of sleep (habitual, past 3 nights, past night), body mass index, and exercise. Analyses yielded no significant differences between the two groups (t[72] < 2.0, p > .07).

Affective Reactions
Analysis of the POMS tension–anxiety and anger–hostility subscales indicated that the speech tasks were perceived as stressful. The group x time interactions were significant for both scales (F[1,72] > 7.5, p < .01), which were driven by increases during the speech task: tension–anxiety (Mbaseline 1.9 [SEM 0.4], Mtask 8.3 [SEM 0.7], F[1,51] = 74.6, p < .001) and anger–hostility (Mbaseline 0.6 [SEM 0.3], Mtask 2.1 [SEM 0.5], F[1,51] = 7.8, p < .01). No changes in these mood parameters were reported in the control condition (F[1,20] < 1.1, not significant [NS]). During baseline the experimental and control groups did not significantly differ on these subscales (t[73] < 2.0, p > .2).

Plasma Catecholamines and Heart Rate
Replicating prior research, analyses confirmed that the acute psychosocial stressor elevated plasma epinephrine, norepinephrine, and heart rate, whereas no changes were observed in the control group (see Table 1), yielding significant group x time interactions (F[2,140] > 15.0, p < .001). The control and experimental groups did not differ on these parameters during the baseline measurement (t[73] < 1.5, NS). See Table 1 for complete results.


View this table:
[in this window]
[in a new window]
 
TABLE 1. Mean (Standard Error of Mean) for Catecholamines, Heart Rate, and Leukocyte Numbers (Corrected for Blood Concentration), as Well as Results of Repeated-Measures Analysis of Variance for Time Main Effects

 

Hemoconcentration
ANOVA demonstrated a significant group difference in blood volume change (F[1,72] = 17.6, p < .001), which decreased during the speech task by –3.2% (SEM 0.4) (t[52] = 7.8, p < .001). ANOVA also indicated a significant group difference in plasma volume change (F[1,72] = 17.3, p < .001), which decreased during the speech task by –5.3% (SEM 0.7) (t[52] = 8.1, p < .001). No hemoconcentration changes (<0.2%) were observed during the control condition (t20 < 1.1, NS).

Cellular Responses
The task induced a significant leukocytosis and lymphocytosis (Table 1), as well as a threefold increase in the number of circulating NK cells (see Table 2), yielding significant group x time interaction effects (F-values ranging between 9.3 and 38.4, p < .001). Again, no significant changes were observed in the control group (see Tables 1 and 2 for analyses of time-main effects and summary data). The control and experimental group did not differ at baseline (t[72] < 1.8, p > .20).


View this table:
[in this window]
[in a new window]
 
TABLE 2. Means (Standard Error of Mean) of Total Natural Killer (NK) Cell Numbers and Numbers of NK That Differ in CD16 Expression, as Well as Results of Repeated-Measures Analysis of Variance for Time Main Effects

 

Natural Killer Subsets
Functional Subsets: CD56 and CD16
Figure 1 presents the mean numbers of the functionally distinct CD56lo and CD56hi subsets. Repeated-measures ANOVA demonstrated a significant group x time interaction effect (F[1,73] = 70.2, p < .001) for the cytotoxic CD56lo subset, which is clearly driven by the increase in CD56lo NK cell numbers during the speech task (F[1,52] = 194.4, p < .001, task values corrected for changes in blood volume). In contrast, the number of immunoregulatory CD56hi NK cells yielded a nonsignificant group x time interaction (F[1,72] = 0.2, NS). Neither subsets showed a significant change during the control condition (F[1,20] < 2.0, p > .20).



View larger version (14K):
[in this window]
[in a new window]
 
Figure 1. CD56hi and CD56lo natural killer subsets during the control and task conditions. Dots indicate means; vertical bars indicate standard error of mean. Repeated-measures analysis of variance: **p < .001.

 

NK cells can be separated into three subsets based on the expression levels of the immunoglobulin receptor CD16, that is, high expression levels (CD16hi), low expression levels (CD16lo), and CD16-negative (CD16neg). As evident in Table 2, the speech task increased the numbers in all three subsets, albeit to a different extent. The respective group x time interactions for each subset were: CD16hi (F[1,72] = 67.5, p < .001), CD16lo (F[1,72] = 28.0, p < .001), and CD16neg (F[1,72] = 4.6, p < .05) (based on values corrected for blood concentration). NK mobilization increased in parallel with CD16 expression; whereas the number of circulating CD16hi NK cells increased approximately 300% from baseline, this was approximately 140% for CD16lo NK cells and only approximately 30% for the CD16neg NK subset. Pairwise comparisons, using paired t tests, confirmed that these subsets were differentially mobilized (each comparison t[52] > 7.3, p < .001). Pairwise analyses of raw and residualized difference scores similarly indicated a differential mobilization (each comparison t[52] > 5.0, p < .001).

Migratory Potential: CD62L and CD11a
The distribution pattern of CD62L on lymphocytes allows for a categorization of NK cells into three subsets: high expression levels (CD62Lhi), low expression levels (CD62Llo), and CD62L-negative NK cells (CD62Lneg). As becomes clear from Figure 2, the speech task increased the numbers of all three subsets. The respective group x time interaction effects were: CD62Lhi (F[1,72] = 27.6, p < .001), CD62Llo (F[1,72] = 70.8, p < .001), and CD62Lneg (F[1,72] = 64.6, p < .001) (based on values corrected for hemoconcentration). Figure 2 indicates that subset mobilization was inversely related to CD62L expression; whereas the number of circulating CD62Lhi NK cells increased by approximately 100%, this was approximately 200% for CD62Llo NK cells and approximately 300% for the CD62Lneg subset. Pairwise comparisons (using paired t tests) confirmed that these subsets were differentially mobilized (each comparison t[52] > 8.5, p < .001). Pairwise analyses of raw and residualized difference scores similarly indicated a differential mobilization (each comparison t[52] > 5.3, p < .001). Subset numbers were unaffected during the control condition (F[1,20] < 1.5, p > .20). As can be expected on the basis of these results, the fluorescence intensity of CD62L on CD62L+NK cells decreased (see Table 3), indicating lower expression levels on NK cells during the task (group x time interaction, F[1,72] = 43.4, p < .001).



View larger version (13K):
[in this window]
[in a new window]
 
Figure 2. Natural killer subsets, categorized on the basis of CD62L expression, during the control and task conditions. Dots indicate means; vertical bars indicate standard error of mean. Repeated-measures analysis of variance: **p < .001 (all time x condition interactions are statistically significant; see text).

 

View this table:
[in this window]
[in a new window]
 
TABLE 3. Changes in Receptor Density (Measured as Median Cell Fluorescence Intensity) on Circulating CD62L+and CD11a + Natural Killer Cells

 

CD11a exhibits a characteristic bimodal distribution on lymphocytes on the basis of which NK cells were separated into two populations: a low CD11a-expressing subset (CD11alo) and a subset that expressed high levels of CD11a (CD11ahi) (note: all NK cells are positive for CD11a, therefore; the fraction CD11ahi cells + fraction CD11alo cells = 100%). During the task, the fraction of CD11alo NK cells decreased from 10.1% (SEM 0.8) at baseline to 5.3% (SEM 0.6) (F[1,51] = 54.3, p < .001). CD11a expression on peripheral blood NK cells increased during the task (group x time interaction F[1,71] = 10.2, p = .001). No significant changes were seen during the control condition (F[1,20] = 0.9, NS), yielding a significant group x time interaction effect (F[1,71] = 13.8, p < .001). The control and experimental group did not differ in baseline values for any of the subsets described here (t[72] < 2.0, p > .20).

Soluble CD62L
The serum concentration of soluble CD62L significantly increased during the task and returned to baseline levels 15 minutes posttask (Table 4). No changes were seen during the control condition, yielding a time x condition effect (F = 4.1, p < .05). However, correction for changes in plasma concentration abrogated this effect (see Table 4).


View this table:
[in this window]
[in a new window]
 
TABLE 4. Means (Standard Error of Mean) for Soluble CD62L Levels (pg/mL) and Results of Repeated-Measures Analysis of Variance, as Well as Results of Repeated-Measures Analysis of Variance for Time Main Effects

 

Gender Differences
Some reports have noted gender differences in NK cell numbers and autonomic stress reactivity (see reference 30). Therefore, exploratory analyses were conducted to identify potential gender differences in catecholamine, hemoconcentration changes, and NK subset distribution. We observed stronger epinephrine increases in males ({Delta}[task – baseline] males = 30.9 pg/mL [SEM 5.5]; {Delta}[task – baseline] females = 17.5 pg/mL [SEM 2.5] [gender x time interaction F[2,102] = 2.04, p < .05]). Subsequent analyses demonstrated that this gender effect was largely driven by differences in baseline values (higher levels in males) because analysis of covariance indicated no effect of gender after baseline values were entered as covariate (F[2,100] = 1.29, NS). Moreover, analysis of relative change scores ({Delta}%) yielded no gender difference ({Delta}%[task – baseline] males = 135.0% [SEM 20.1]; {Delta}%[task – baseline] females = 121.8% [SEM 18.6]). No gender differences in reactivity or baseline values were observed for NK subsets or norepinephrine (all analyses p > .17).

Catecholamine Responses and Natural Killer Subset Distribution
Regression analyses were performed to determine the unique and combined contribution of epinephrine and norepinephrine to NK subset distribution. Results, presented in Table 5, are expressed as partial and zero-order correlation coefficients; the final column presents the correlation if both catecholamines were entered together in the regression analysis. A partial correlation represents the unique contribution of one catecholamine (i.e., independent of the contributions of the other catecholamine) to individual differences in NK mobilization. The results showed that epinephrine and norepinephrine have unique and additive contributions to NK subset mobilization. Also, the strength of the correlations increased in parallel with the magnitude in which a particular NK subset became mobilized, suggesting subset differences in responsivity to catecholamines.


View this table:
[in this window]
[in a new window]
 
TABLE 5. Associations Between Catecholamine Responses and Increases in Natural Killer (NK) Subset Numbers (Both Calculated as {Delta}%)

 

To maintain a common metric for all parameters, we used {Delta}% scores in the correlation analyses (which also eliminated the influence of gender differences in epinephrine responses). All analyses are based on hemoconcentration-corrected cell counts.

Examining the Psycho -> Neuro -> Immune Pathway
The generally held belief is that affective responses drive immune reactions through a neuroendocrine pathway. We sought to test the specific hypothesis that the relation between emotionality and NK mobilization is mediated by the release of catecholamines by conducting a mediational analysis of the experimental data. Mediation requires that 1) all variables in the model (i.e., the dependent, independent, and mediator variables) are intercorrelated, and 2) that the association between the dependent and independent variable becomes significantly attenuated when the association between the mediator and dependent variable is accounted for.

To examine the first condition, correlation analyses were performed. As would be required for mediation, analyses indicated associations between individual differences in affective reactivity (i.e., responses on POMS subscales) and catecholamine and NK reactivity. Epinephrine and norepinephrine reactivity correlated with changes on the subscales tension–anxiety (0.32 and 0.30, respectively, p < .05), anger–hostility (0.44 and 0.38, p < .01), and vigor–activity (0.25, p < .05, for norepinephrine). Two of these POMS subscales also correlated with increases in the stress–reactive CD56lo NK subset: tension–anxiety (0.33, p < .05) and anger–hostility (0.29, p < .05). A comparable pattern of results was observed for other NK subsets (p values varying between .12 and .001), although no significant correlations were observed for the minimally responsive CD16neg and CD56hi subsets.

We next performed linear regression analyses to test the second condition for mediation. The model and path coefficients are summarized in Figure 3. Entering the two intercorrelated POMS subscales together, regression analyses confirmed a positive association between affective responses and CD56lo NK mobilization (F[2,50] = 3.22, p < .05, R2 = 0.11). Subsequently entering both catecholamines in the model explained a significant amount of additional variance (R2-change = 0.25, F[2,48] = 9.31, p < .001). However, if both catecholamines were entered in the model first, the two POMS subscales did not account for any additional variance (R2-change = 0.01, F[2,48] = 0.87, NS). These results support the hypothesis that catecholamine responses account for (i.e., mediate) the association between task-induced affective responses and NK mobilization.



View larger version (10K):
[in this window]
[in a new window]
 
Figure 3. Path model with standardized regression coefficients. Affective response is measured a reactivity on the Profile of Mood States subscales tension–anxiety and anger–hostility. *p < .05, **p < .001.

 


    DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 NOTES
 REFERENCES
 
The rapid mobilization of NK cells during acute psychologic stress is a well-established but poorly characterized phenomenon. The present study performed a phenotypical analysis of this response using various cell surface markers to identify NK subsets that differ in functional characteristics and migratory potential. The results demonstrated a marked specificity in the mobilization of functionally distinct NK subsets during acute psychologic stress. We found that the stress-induced increase in circulating NK cells is restricted to the cytotoxic CD56lo subset, whereas no change was seen for the immunoregulatory CD56hi subset. Consistent with the observation that stress-induced mobilization of NK cells is related to cytotoxic potential, we also observed larger increases for NK cells that express higher levels of CD16. CD16 is a receptor essential for antibody-dependent cytotoxicity and has particularly high expression levels on cytotoxic CD56lo NK cells (12,15).

In the psychoneuroimmunology literature, a distinction is often made between functional and enumerative immune changes in which the mobilization of NK cells represents a typical example of the latter. Because of this common distinction, it may become overlooked that leukocyte redistribution is, in fact, a very important functional response; it is a main mechanism through which the immune system ensures that sufficient cells can arrive at locations where they may be needed (17,22,31). Our data showed that a common speech task tripled the number of cytotoxic CD56lo NK cells in the blood (at an average increase of 220 NK cells/µL, this represents over 1 billion additional CD56lo NK cells), providing these newly released cells with ample opportunity to survey the peripheral tissues for signs of damage and infection. Although the health implications of this response pattern are not clear as yet (see the last paragraph for a discussion), our results do indicate that the blood is rapidly modifying its functional potential by selectively increasing the proportion and number of cells that have the ability to immediately destroy infectious and infected cells, and have a strong capacity to migrate into the tissues.

Indeed, consistent with previous research (18,32–34), a marked specificity was also found when NK cells were characterized on the basis of the expression levels of the adhesion molecules CD62L and CD11a. During the speech task, the average density of CD62L (a receptor that supports migration of NK cells into the secondary lymphoid tissues) on circulating NK cells decreased, whereas CD11a levels (a receptor that supports migration of NK cells into the tissues) increased. Such receptor changes are also observed after bouts of exercise and infusion of the beta-adrenergic agonist isoproterenol (23) and can be abrogated after administration of the beta-adrenergic antagonist propanolol (23,34). Moreover, we found positive correlations between the changes in various NK subsets and plasma catecholamines. Clearly, adrenergic mechanisms are largely responsible for the changes in the adhesion molecule densities on circulating NK cells.

The interpretation of these receptor density changes has been a topic of speculation. As for the changes in CD62L expression, two possible interpretations have been proposed (see reference (18), both of which were addressed in the present study. The most common interpretation is that acute psychologic stressors may rapidly downregulate CD62L expression, for example, through the shedding of this receptor from the cell surface. CD62L shedding is a process by which lymphocytes control their movement along, and the attachment to, the vascular epithelium (35). A rapid shedding of CD62L would result in a parallel increase in plasma levels of soluble CD62L (sCD62L). In support of the shedding hypothesis, Redwine and coworkers (36) observed increases in plasma sCD62L during a public-speaking task (in parallel with an increased number of CD62L-negative lymphocytes). We were able to confirm this finding, but also found that the increase in sCD62L disappeared after controlling for simultaneous changes in plasma concentration. Thus, the increased concentration in plasma sCD62L resulted from an increased hemoconcentration (i.e., filtration of fluid out of the intravascular space) rather than an actual increase of soluble receptors in the circulation.1 Further weakening the shedding hypothesis is that infusion of the beta-adrenergic agonist isoproterenol does not increase plasma sCD62L (although it does increase the number of circulating CD62Lneg lymphocytes, including CD62Lneg NK cells) (23), and that catecholamines do not affect CD62L expression on lymphocytes in vitro (35). In summary, both our current data and the existing evidence do not support the interpretation that catecholamine-dependent decreases in NK CD62L density are the result of rapid receptor downregulation either through receptor shedding or otherwise.

The second interpretation for the rapid changes in adhesion molecule densities is that acute stressors selectively mobilize NK cells that have preexisting differences in adhesion molecule expression (18). According to this interpretation, the change in average receptor density reflects a change in the cellular composition of the blood rather than a change in receptor density per cell. Our data provided strong support for this hypothesis, because we observed a selective increase in cytotoxic CD56lo NK cells (which are predominantly CD62Lneg/lo and CD11ahi) in combination with unaffected numbers of immunoregulatory CD56hi NK cells (which are CD62Lhi and largely CD11alo) (15,19,21). This phenomenon is also the most likely explanation for the preferential increase in CD16hi NK cells, because high CD16 expression is a characteristic feature of the cytotoxic CD56lo NK subset (15).

The present study also raised some issues that will require further investigation. For example, regression analyses suggested that the differential mobilization of NK subsets reflects a differential responsivity to catecholamines,2 perhaps resulting from subset differences in adrenergic receptor density and/or sensitivity. This possibility needs to be explored in receptor studies. Also, whereas our analyses demonstrated that the divergent NK response pattern is robust with regard to gender differences, the generalizability of this response pattern to other populations (e.g., elderly, patient groups) is unknown. Also unknown are the effects of the selective NK mobilization on in vitro cytotoxic activity. Most laboratory studies find, however, that in vitro NK cytotoxicity increases in parallel with increasing circulating NK numbers (4). Our results indicate that these changes in NK cytotoxicity are a direct consequence of a selective increase in CD56lo NK cells. Conversely, chronic stressors are associated with decreased in vitro NK cytotoxic activity (4), and future research might thus test whether this decrease is related to changes in the composition of the circulating pool of NK cells, i.e., a higher proportion of low cytotoxic CD56hi NK cells (see reference (39).

An important remaining issue concerns the implications of these selective immunologic changes for health. Although the historical literature has often focused on the deleterious effects of stress responses, there is now a growing recognition that acute stressors may, at least in the short run, initiate processes that could promote immune function and health (31). For example, animal studies have shown that acute stressors can lead to a faster resolution of infection (40,41), can enhance both cellular and humoral adaptive immunity (42–44), and accelerate wound healing (45). These protective effects are thought to be mediated in part by the effects of stress hormones on immune-cell trafficking (31,46). NK cell mobilization represents one of the best documented examples of this mechanism in humans (4). Evolutionary pressures may have selected for this facet of the acute stress response because it conceivably enhances immune preparedness in contexts in which tissue damage and infection are more likely to occur. Indeed, acute stress has been found to rapidly upregulate other protective systems as well, including secretory immunity, coagulation, and complement activation (2,47,48). Hence, an obvious potential implication is that acute stressors may enhance, rather than diminish, resistance to infection. This idea has already gained good support from experimental animal studies and warrants further investigation in humans.

We acknowledge the dedicated efforts of our coworkers and students who provided support with data management (Josja K. Eggen, MA, and Jason Davis, BA), logistics and recruitment (April C. Logue, BSc), experimental procedures (Josja K. Eggen, MA, and Rebecca Milliard, MA), and analyses of flow cytometry data (Harald Engler, PhD, Betsy Doerger, BA, and Rowan Karaman). Praveen Gadjendrareddy, PhD, Chris Engeland, PhD, and Felicia Swanson, MFA, gave helpful comments on earlier drafts of this manuscript. The study was performed at The Ohio State General Clinical Research Center (with special thanks to Linda Mahoney, RN, and Susan Moseley, PhD).


    NOTES
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 NOTES
 REFERENCES
 
1 Note the distinct use of plasma concentration and blood concentration to correct for plasma constituents and immune cells, respectively (see "Methods" for details). Back

2 One may argue that the correlation between catecholamines and NK mobilization could be confounded by a third (unmeasured) neuroendocrine variable. This hypothesis is refuted, however, by studies showing that adrenergic blockade abrogates stress-induced NK mobilization (37,38), indicating that nonadrenergic mechanisms explain little additional variance. Back

This study was funded by the National Institute of Health (P50 DE-13749).

DOI:10.1097/01.psy.0000160469.00312.8e


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 NOTES
 REFERENCES
 

  1. Kiecolt-Glaser JK, McGuire L, Robles TF, Glaser R. Emotions, morbidity, and mortality: new perspectives from psychoneuroimmunology. Annu Rev Psychol 2002;53:83–107.[CrossRef][Medline]
  2. Bosch JA, Ring C, de Geus EJC, Veerman ECI, Amerongen AV. Stress and secretory immunity. Int Rev Neurobiol 2002;52:213–53.[Medline]
  3. Cohen S, Herbert TB. Health psychology: psychological factors and physical disease from the perspective of human psychoneuroimmunology. Annu Rev Psychol 1996;47:113–42.[CrossRef][Medline]
  4. Segerstrom SC, Miller GE. Psychological stress and the human immune system: a meta-analytic study of 30 years of inquiry. Psychol Bull 2004;130:601–30.[CrossRef][Medline]
  5. Benschop RJ, Rodriguez-Feuerhahn M, Schedlowski M. Catecholamine-induced leukocytosis: early observations, current research, and future directions. Brain Behav Immun 1996;10:77–91.[CrossRef][Medline]
  6. Cacioppo JT, Malarkey WB, Kiecolt-Glaser JK, Uchino BN, Sgoutas-Emch SA, Sheridan JF, Berntson GG, Glaser R. Heterogeneity in neuroendocrine and immune responses to brief psychological stressors as a function of autonomic cardiac activation. Psychosom Med 1995;57:154–64.[Abstract/Free Full Text]
  7. Cacioppo JT. Social neuroscience: autonomic, neuroendocrine, and immune responses to stress. Psychophysiology 1994;31:113–28.[Medline]
  8. Uchino BN, Cacioppo JT, Malarkey W, Glaser R. Individual differences in cardiac sympathetic control predict endocrine and immune responses to acute psychological stress. J Pers Soc Psychol 1995;69:736–43.[CrossRef][Medline]
  9. Benschop RJ, Geenen R, Mills PJ, Naliboff BD, Kiecolt-Glaser JK, Herbert TB, van der Pompe G, Miller GE, Matthews KA, Godaert GL, Gilmore SL, Glaser R, Heijnen CJ, Dopp JM, Bijlsma JW, Solomon GF, Cacioppo JT. Cardiovascular and immune responses to acute psychological stress in young and old women: a meta-analysis. Psychosom Med 1998;60:290–6.[Abstract/Free Full Text]
  10. Sanders VM, Straub RH. Norepinephrine, the beta-adrenergic receptor, and immunity. Brain Behav Immun 2002;16:290–332.[CrossRef][Medline]
  11. Biron CA, Nguyen KB, Pien GC, Cousens LP, Salazar-Mather TP. Natural killer cells in antiviral defense: function and regulation by innate cytokines. Annu Rev Immunol 1999;17:189–220.[CrossRef][Medline]
  12. Lanier LL. On guard—activating NK cell receptors. Nat Immunol 2001;2:23–7.[CrossRef][Medline]
  13. Allavena P, Bianchi G, Paganin C, Giardina G, Mantovani A. Regulation of adhesion and transendothelial migration of natural killer cells. Nat Immun 1996;15:107–16.[Medline]
  14. Somersalo K. Migratory functions of natural killer cells. Nat Immun 1996;15:117–33.[Medline]
  15. Cooper MA, Fehniger TA, Caligiuri MA. The biology of human natural killer-cell subsets. Trends Immunol 2001;22:633–40.[CrossRef][Medline]
  16. Fehniger TA, Cooper MA, Nuovo GJ, Cella M, Facchetti F, Colonna M, Caligiuri MA. CD56bright natural killer cells are present in human lymph nodes and are activated by T cell-derived IL-2: a potential new link between adaptive and innate immunity. Blood 2003;101:3052–7.[Abstract/Free Full Text]
  17. Cooper MA, Fehniger TA, Turner SC, Chen KS, Ghaheri BA, Ghayur T, Carson WE, Caligiuri MA. Human natural killer cells: a unique innate immunoregulatory role for the CD56(bright) subset. Blood 2001;97:3146–51.[Abstract/Free Full Text]
  18. Goebel MU, Mills PJ. Acute psychological stress and exercise and changes in peripheral leukocyte adhesion molecule expression and density. Psychosom Med 2000;62:664–70.[Abstract/Free Full Text]
  19. Sedlmayr P, Schallhammer L, Hammer A, Wilders-Truschnig M, Wintersteiger R, Dohr G. Differential phenotypic properties of human peripheral blood CD56dim+ and CD56bright+ natural killer cell subpopulations. Int Arch Allergy Immunol 1996;110:308–13.[Medline]
  20. Lima M, Teixeira MA, Queiros ML, Leite M, Santos AH, Justica B, Orfao A. Immunophenotypic characterization of normal blood CD56+lo versus CD56+hi NK-cell subsets and its impact on the understanding of their tissue distribution and functional properties. Blood Cells Mol Dis 2001;27:731–43.[CrossRef][Medline]
  21. Frey M, Packianathan NB, Fehniger TA, Ross ME, Wang WC, Stewart CC, Caligiuri MA, Evans SS. Differential expression and function of L-selectin on CD56bright and CD56dim natural killer cell subsets. J Immunol 1998;161:400–8.[Abstract/Free Full Text]
  22. von Andrian UH, Mackay CR. T-cell function and migration. Two sides of the same coin. N Engl J Med 2000;343:1020–34.[Free Full Text]
  23. Mills PJ, Goebel M, Rehman J, Irwin MR, Maisel AS. Leukocyte adhesion molecule expression and T cell naive/memory status following isoproterenol infusion. J Neuroimmunol 2000;102:137–44.[CrossRef][Medline]
  24. Bosch JA, Berntson GG, Cacioppo JT, Dhabhar FS, Marucha PT. Acute stress evokes selective mobilization of T cells that differ in chemokine receptor expression: a potential pathway linking immunologic reactivity to cardiovascular disease. Brain Behav Immun 2003;17:251–9.[CrossRef][Medline]
  25. McNair DM, Lorr M, Droppleman LF. Manual for the Profile of Mood States. San Diego: Educational and Industrial Testing Service; 1992.
  26. Buysse DJ, Reynolds CF, Monk TH, Berman SR, Kupfer DJ. The Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research. Psychiatry Res 1989;28:193–213.[CrossRef][Medline]
  27. Allen MT, Patterson SM. Hemoconcentration and stress: a review of physiological mechanisms and relevance for cardiovascular disease risk. Biol Psychol 1995;41:1–27.[CrossRef][Medline]
  28. Marsland AL, Herbert TB, Muldoon MF, Bachen EA, Patterson S, Cohen S, Rabin B, Manuck SB. Lymphocyte subset redistribution during acute laboratory stress in young adults: mediating effects of hemoconcentration. Health Psychol 1997;16:341–8.[CrossRef][Medline]
  29. Dill DB, Costill DL. Calculation of percentage changes in volumes of blood, plasma, and red cells in dehydration. J Appl Physiol 1974;37:247–8.[Free Full Text]
  30. Willemsen G, Carroll D, Ring C, Drayson M. Cellular and mucosal immune reactions to mental and cold stress: associations with gender and cardiovascular reactivity. Psychophysiology 2002;39:222–8.[CrossRef][Medline]
  31. Dhabhar FS. Stress, leukocyte trafficking, and the augmentation of skin immune function. Ann N Y Acad Sci 2003;992:205–17.[Medline]
  32. Dopp JM, Miller GE, Myers HF, Fahey JL. Increased natural killer-cell mobilization and cytotoxicity during marital conflict. Brain Behav Immun 2000;14:10–26.[CrossRef][Medline]
  33. Adler KA, Mills PJ, Dimsdale JE, Ziegler MG, Patterson TL, Sloan RP, Grant I. Temporal stability of acute stress-induced changes in leukocyte subsets and cellular adhesion molecules in older adults. Brain Behav Immun 2002;16:262–74.[CrossRef][Medline]
  34. Kuhlwein EC, Irwin MR, Ziegler MG, Woods VL, Kennedy B, Mills PJ. Propranolol affects stress-induced leukocytosis and cellular adhesion molecule expression. Eur J Appl Physiol 2001;86:135–41.[CrossRef][Medline]
  35. Rainer TH. L-selectin in health and disease. Resuscitation 2002;52:127–41.[CrossRef][Medline]
  36. Redwine L, Snow S, Mills P, Irwin M. Acute psychological stress: effects on chemotaxis and cellular adhesion molecule expression. Psychosom Med 2003;65:598–603.[Abstract/Free Full Text]
  37. Bachen EA, Manuck SB, Cohen S, Muldoon MF, Raible R, Herbert TB, Rabin BS. Adrenergic blockade ameliorates cellular immune responses to mental stress in humans. Psychosom Med 1995;57:366–72.[Abstract/Free Full Text]
  38. Benschop RJ, Nieuwenhuis EE, Tromp EA, Godaert GL, Ballieux RE, van Doornen LJ. Effects of beta-adrenergic blockade on immunologic and cardiovascular changes induced by mental stress. Circulation 1994;89:762–9.[Abstract/Free Full Text]
  39. Suzui M, Kawai T, Kimura H, Takeda K, Yagita H, Okumura K, Shek PN, Shephard RJ. Natural killer cell lytic activity and CD56dim and CD56bright cell distributions during and after intensive training. J Appl Physiol 2004;29:29.
  40. Deak T, Nguyen KT, Fleshner M, Watkins LR, Maier SF. Acute stress may facilitate recovery from a subcutaneous bacterial challenge. Neuroimmunomodulation 1999;6:344–54.[CrossRef][Medline]
  41. Campisi J, Leem TH, Fleshner M. Acute stress decreases inflammation at the site of infection. A role for nitric oxide. Physiol Behav 2002;77:291–9.[CrossRef][Medline]
  42. Dhabhar FS, McEwen BS. Enhancing versus suppressive effects of stress hormones on skin immune function. Proc Natl Acad Sci U S A 1999;96:1059–64.[Abstract/Free Full Text]
  43. Silberman DM, Wald MR, Genaro AM. Acute and chronic stress exert opposing effects on antibody responses associated with changes in stress hormone regulation of T-lymphocyte reactivity. J Neuroimmunol 2003;144:53–60.[CrossRef][Medline]
  44. Saint-Mezard P, Chavagnac C, Bosset S, Ionescu M, Peyron E, Kaiserlian D, Nicolas JF, Berard F. Psychological stress exerts an adjuvant effect on skin dendritic cell functions in vivo. J Immunol 2003;171:4073–80.[Abstract/Free Full Text]
  45. Kinsey SG, Prendergast BJ, Nelson RJ. Photoperiod and stress affect wound healing in Siberian hamsters. Physiol Behav 2003;78:205–11.[CrossRef][Medline]
  46. Engler H, Dawils L, Hoves S, Kurth S, Stevenson JR, Schauenstein K, Stefanski V. Effects of social stress on blood leukocyte distribution: the role of alpha- and beta-adrenergic mechanisms. J Neuroimmunol 2004;156:153–62.[CrossRef][Medline]
  47. von Kanel R, Mills PJ, Fainman C, Dimsdale JE. Effects of psychological stress and psychiatric disorders on blood coagulation and fibrinolysis: a biobehavioral pathway to coronary artery disease? Psychosom Med 2001;63:531–44.[Abstract/Free Full Text]
  48. Burns VE, Ring C, Edward K, Drayson M, Carroll D. Activation of the complement cascade is not potentiated by the presence of an indwelling catheter. Pyschosom Med 2005;67:1570.



This article has been cited by other articles:


Home page
Psychosom. Med.Home page
J. A. Bosch, E. J. C. de Geus, D. Carroll, A. D. Goedhart, L. A. Anane, J. J. Veldhuizen van Zanten, E. J. Helmerhorst, and K. M. Edwards
A General Enhancement of Autonomic and Cortisol Responses During Social Evaluative Threat
Psychosom Med, October 1, 2009; 71(8): 877 - 885.
[Abstract] [Full Text] [PDF]


Home page
BloodHome page
S. Dimitrov, C. Benedict, D. Heutling, J. Westermann, J. Born, and T. Lange
Cortisol and epinephrine control opposing circadian rhythms in T cell subsets
Blood, May 21, 2009; 113(21): 5134 - 5143.
[Abstract] [Full Text] [PDF]


Home page
Mult SclerHome page
S. Kern and T. Ziemssen
Review: Brain immune communication psychoneuroimmunology of multiple sclerosis
Multiple Sclerosis, January 1, 2008; 14(1): 6 - 21.
[Abstract] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrowRequest Permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Bosch, J. A.
Right arrow Articles by Marucha, P. T.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Bosch, J. A.
Right arrow Articles by Marucha, P. T.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS