help button home button Endocrine Society JCEM
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS

This Article
Right arrow Full Text (PDF)
Right arrow Submit a related Letter to the Editor
Right arrow Purchase Article
Right arrow View Shopping Cart
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow Request Copyright Permission
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Abdu, T. A. M.
Right arrow Articles by Clayton, R. N.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Abdu, T. A. M.
Right arrow Articles by Clayton, R. N.
The Journal of Clinical Endocrinology & Metabolism Vol. 84, No. 8 2973-2974
Copyright © 1999 by The Endocrine Society


Letters to the Editor

Response to Dr. Oelkers: There Is Enough Evidence in Favor of Low Dose ACTH Test—Authors’ Response1

Tarig A. M. Abdu, Tarik A. Elhadd, Richard Neary and Richard N. Clayton

Department of Diabetes and Endocrinology City General Hospital Stroke on Trent, ST4 6QG United Kingdom

Dr. Oelkers raises some important issues. We can summarize these with three main questions: 1) What is the best cut-off to be used for LDSST? 2) Is there any difference between LDSST and SST? 3) What are the potential technical pitfalls with LDSST?

1. What is the best cut-off?

We do not agree with Dr. Oelker’s method of setting cut-off points. Deriving a fixed cut-off from responses in normal subjects is not really the correct way of doing it. Cut-off points for screening tests are normally determined by comparing performance to a "gold standard" in the population of interest. A most important factor in choosing the desired sensitivity and specificity of any screening test is the nature of the disease or condition under investigation. The cut-off should be set to maximize specificity if a false positive result is extremely undesirable, either in terms of anxiety or discomfort to the subjects (e.g. a false diagnosis of cancer), or because it would lead to further expensive investigations or a dangerous procedure (e.g. major surgery). On the other hand if a false negative result must be avoided, (i.e. when the consequences of missing the condition or disease would be deleterious), then the cut-off must be set to maximize sensitivity (1). HPA-axis impairment is a condition that has potentially serious consequences if missed, yet is easily treatable when detected. Hence a high sensitivity, not specificity, is the priority. A false positive result, in this case, will only lead to further clinical evaluation and, at most, an insulin tolerance test. By using the cut-off derived from responses in normal individuals, Dr. Oelkers found that both the LDSST and the SST have a similar sensitivity and specificity (65% and 96% respectively) for detection of HPA-axis impairment and therefore concluded that there is no need to replace the SST with LDSST. We would argue that a test with a sensitivity of 65% is not good enough for screening for HPA axis failure, a 35% false negative (false reassurance) rate would not be acceptable. The sensitivity of either test can be improved (at the expense of specificity) by increasing the cut-off value.

We further analyzed our data and determined the sensitivity and specificity of the LDSST and SST at eight different plasma cortisol cut-off points (300, 400, 450, 500, 550, 600, 650 and 700 nmol/L) compared with the gold standard of ITT and clinical evaluation in the 64 patients. Sensitivity is plotted as a function of 1-specificity (false positive rate) in the Receiver Operator Characteristic (ROC) curve (see figure). The curve portrays the trade-off involved between improving either tests’ sensitivity or their specificity (2).

An ideal test with 100% sensitivity and 100% specificity is one that reaches the upper left corner of the graph. In the steep part of the graph the sensitivity increases a great deal while the specificity (and false positive rate) hardly change. Moving up the curve in this section increases sensitivity without substantially reducing specificity. As we move along the graph, in the flat part of the curve, the sensitivity does not change but the specificity decreases progressively. The best cut-off point is therefore where the ROC curve is just on the plateau of sensitivity. By inspecting both curves, a cut-off of 600 nmol/L is optimal, ensuring maximal sensitivity (100% for LDSST and 91% for SST) and acceptable specificity (83% for both tests).

Although we chose the cut-off in our paper from other published work, the ROC analysis does confirm that a cut-of of 600 nmol/L is optimal.

2. Is there any difference between LDSST and SST?

The answer to this question from our data is yes, there is enough evidence to suggest a small but definite superiority of LDSST over SST.

From our data the diagnostic efficiency of the two tests can be compared by comparing the area under the ROC curves (see fig. 1Go), the test with greater area under the curve having better performance (2).



View larger version (18K):
[in this window]
[in a new window]
 
Figure 1. ROC curves for LDSST and SST.

 
Dr. Oelkers referred to the paper from his group by Mayneknecht et al. (3). This paper suggest that the LDSST has failed to identify patients with borderline results (n = 9) as classified by the reference test (either ITT or metyrapone test). We cannot understand why a figure of 550 nmol/L was chosen to represent an acceptable cut-off point for ITT given that all their normal controls have achieved a maximum cortisol of more than 600 nmol/L. To confuse things further this paper classifies those who failed the reference test into two groups, either clear failure or marginal failure. We have reservations about creating grey areas around the cut-off for a gold standard test. We believe that the cut-off should categorize patients as either pass or fail. In those who scored a "border fail" result on ITT as a reference test, if the cortisol cut-off for ITT was taken at 500 nmol/L (4, 5) rather than 550 nmo/L, all would have passed the reference test. Thus these patients have probably passed both the HDT and LDT because they are true passers with intact HPA axis, a fact that would obviously be in favor of the corticotropin stimulation tests. We quoted only the 14 patients who clearly failed the reference test as we believe those who achieved a maximum cortisol of more than 500 nmol/L on ITT should be considered to have intact axis (at least biochemically).

When we analyzed our results in the 42 patients who had ITT as well as LDSST and SST, we found similar sensitivity and specificity. However in the remaining 22 patients who only underwent LDSST and SST the SST failed to identify 2 patients with clinically evident cortisol deficiency, yet both were correctly identified by the LDSST. Overall LDSST performed slightly better than the SST. This is in keeping with most of the data published in this field (6, 7, 8, 9).

Although in absolute terms the superiority of LDSST over SST is small, the fact that low dose test can save a number of patients from potentially life threatening adrenal crises is a strong argument in favor of this test.

3. What are the potential pitfalls?

We agree with Dr. Oelkers that dilution of the contents of a 250-µg ACTH 1-24 ampoule could be troublesome. We did not advocate that inexperienced personnel carry out the dilution. In our center the dilution is performed by the hospital pharmacist under the very strict protocol according to published evidence. The availability of a 1-µg ampoule would certainly be an advantage.

We believe there is enough evidence to recommend that LDSST replace SST for assessment of HPA-axis. Like any new test our experience with the LDSST test procedure performance will improve with more usage.

Footnotes

1 Address correspondence to: Tarig A.M. Abdu, Department of Diabetes and Endocrinology, City General Hospital, Stroke on Trent, ST4 6QG United Kingdom. Back

Received April 18, 1999.

References

  1. Barker DJP, Rose G, eds. 1990 Epidemiology in Medical Practice. London; Churchill Livingstone.
  2. Browner WS, Newman TB, Cummings SR. 1988 Designing a new study:III. Diagnostic tests. In: Hulley SB, Cummings SR, eds. Designing Clinical Research. Baltimore; Williams & Wilkins.
  3. Mayenkmecht J, Diederich S, Bahr V, Plochinger, Olkers W. 1998 Comparison of low and high dose corticotrophin stimulation test in patients with pituitary disease. J Clin Endocrinol Metab. 80:1558–1562.
  4. Stewart PM, Corrie J, Seckle JR, Edwards CR, Padfleld PL. 1988 A rational approach for assessing the hypothalamo-pituitary-adrenal axis. Lancet. 1:1208–1210.[CrossRef][Medline]
  5. Lindholm J, Kehlet H, Blichert-Toft M, Dinesen B, Riishede J. 1978 Reliability of the 30 minute ACTH test in assessing hypothalamic pituitary adrenal axis function. J Clin Endocrinol Metab. 47:272–274.[Abstract]
  6. Tordjman K, Jaffe A, Grazas N, Apter C, Stern N. 1995 The role of the low dose (1 mcgm) adrenocorticotrophin test in the evaluation of patients with pituitary diseases. J Clin Endocrinol Metab. 80:1301–1305.[Abstract]
  7. Talwar, V., Lodha, S. & Dash, RJ. 1998 Assessing the hypothalamo-pituitary-adrenocortical axis using physiological doses of adrenocorticotrophic hormone. Q J Med. 91:285–290.[Abstract/Free Full Text]
  8. Thaler LM, Blevins Jr LS. 1998 The low dose (1-mcgm) Adrenocorticotrophin stimulation test in the evaluation of patients with suspected central adrenal insufficiency. J Clin Endocrinol Metab. 83:2726–2729.[Abstract/Free Full Text]
  9. Rasmuson S, Olsson T, Hagg E. 1996 A low dose ACTH test to assess the function of the hypothalamo-pituitary-adrenal axis. Clin Endocrionl (Oxf). 44:151–156.



This article has been cited by other articles:


Home page
ANN INTERN MEDHome page
R. I. Dorin, C. R. Qualls, and L. M. Crapo
Diagnosis of Adrenal Insufficiency
Ann Intern Med, August 5, 2003; 139(3): 194 - 204.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Full Text (PDF)
Right arrow Submit a related Letter to the Editor
Right arrow Purchase Article
Right arrow View Shopping Cart
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow Request Copyright Permission
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Abdu, T. A. M.
Right arrow Articles by Clayton, R. N.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Abdu, T. A. M.
Right arrow Articles by Clayton, R. N.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Endocrinology Endocrine Reviews J. Clin. End. & Metab.
Molecular Endocrinology Recent Prog. Horm. Res. All Endocrine Journals