| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
Centre for Paediatric Epidemiology and Biostatistics (E.H., P.C., C.P.), Institute of Child Health, London WC1N 1EH, United Kingdom; and Department of Clinical Biochemistry (S.T., I.G.), Newcastle upon Tyne Hospitals National Health Service Trust, Royal Victoria Infirmary, Newcastle upon Tyne NE1 4LP, United Kingdom
Address all correspondence and requests for reprints to: Dr. Elina Hyppönen, Centre for Pediatric Epidemiology and Biostatistics, Institute of Child Health, 30 Guilford Street, London WC1N 1EH, United Kingdom. E-mail: e.hypponen{at}ich.ucl.ac.uk.
| Abstract |
|---|
|
|
|---|
Objective: The objective of the study was to evaluate the importance of assay variation on the estimated prevalence of hypovitaminosis D and assess the use of statistical harmonization to overcome the observed differences.
Design: Agreement analyses were performed between two commercial 25(OH)D assays (IDS enzyme immunoassay and Diasorin RIA), with validation using performance data from Vitamin D External Quality Assessment Scheme (DEQAS).
Setting: The study was conducted in England, Scotland, and Wales.
Participants: Members of the 1958 British birth cohort participated in the study.
Main Outcome Measures: 25(OH)D was measured both by IDS and Diasorin RIA in 781 samples. Additional quality control data were obtained through participation in DEQAS (five distributions throughout the survey).
Results: Average 25(OH)D concentrations by IDS were –15.7 and –13.7 nmol/liter lower, compared with Diasorin or DEQAS mean, respectively (both P < 0.0001). Graphical examination demonstrated a dose-related bias between IDS with Diasorin and DEQAS mean, but log transformation removed the bias. After using the log difference between the measurements as an adjustment factor, there were no differences in average 25(OH)D concentrations (P
0.21 for comparison of IDS with Diasorin or DEQAS) and estimates for hypovitaminosis D obtained by IDS were similar to Diasorin.
Conclusions: Differences between assays have implications for public health messages about hypovitaminosis D. Harmonization of results with DEQAS enabled the use of previously determined cutoffs for hypovitaminosis D.
| Introduction |
|---|
|
|
|---|
We measured 25(OH)D from more than 7000 participants in the 1958 British birth cohort (11, 12). For this large population-based survey, we developed an automated application of Immunodiagnostic Systems Ltd. (IDS) enzyme immunoassay (EIA) with the prospect of minimizing hands-on time and interanalyst variation. To monitor and quantify the difference in 25(OH)D concentration measured by automated IDS with that obtained by the most commonly used method, namely Diasorin RIA (7), we carried out comparison analyses at the start of the study and on representative subsets of samples in monthly batches throughout a 19-month period of data collection. Further between-method comparisons were done through participation in the Vitamin D External Quality Assessment Scheme (DEQAS) (7, 9). In this paper we report how, using these evaluation data and a simple statistical procedure described by Bland and Altman (13), we transformed the values of 25(OH)D obtained by automated IDS to correspond with levels obtained by both Diasorin and the mean of DEQAS to facilitate interstudy comparisons and the use of previously determined cutoffs for hypovitaminosis D. We also demonstrate the public health implications of assay variation on the perceived problem with hypovitaminosis D.
| Subjects and Methods |
|---|
|
|
|---|
Measurement of 25(OH)D
Assessments of 25(OH)D for all survey samples were done in one centralized laboratory, the Royal Victoria Infirmary (Newcastle upon Tyne Hospitals National Health Service Trust, Newcastle upon Tyne, UK). The IDS OCTEIA 25(OH)D EIA (IDS EIA) was used to quantify 25(OH)D in serum. Serum samples, calibrators, and controls were treated with 2% sodium hydroxide and then diluted with biotin-labeled 25(OH)D. These diluted samples were incubated in microtiter wells coated with a sheep anti-25(OH)D polyclonal antibody for 2 h at room temperature before aspiration and washing. Horseradish peroxidase-labeled avidin, which binds selectively to complexed biotin, was then added. After a further wash step, color develops as a result of using the chromogen substrate tetramethylbenzoate. Absorbance reading is then indirectly proportional to 25(OH)D concentration. A fully automated application of this kit was developed and evaluated in the central analytical laboratory on a BEP2000 programmable microtiter plate analyzer (Dade-Behring, Marburg, Germany). The automated method followed the manual protocol outlined above, the analyzer programming enabling automation of sample pretreatment and predilution, sample and reagent dispensing, temperature-controlled incubation, wash processes, and plate transports to and from the incubators and to and from the integrated photometric measurement system. The instrument has a maximum capacity of 4 x 96-well plates.
Automated assay characterization
Within-assay imprecision. Performance in the automated assay was assessed by determining imprecision using 20 replicates of quality control sera at each of three 25(OH)D concentrations (18.2, 88.2, and 121 nmol/liter) in a single assay.
Between-assay imprecision. This was initially assessed using three levels of quality control sera (IDS controls 1, 2, and 3) in separate assays over 3 wk (n = 13). Data were also accumulated on further batches of these materials by analyzing them in all subsequent assay batches throughout the full 19-month study period (n = 74).
Functional sensitivity. The sensitivity was determined as the 25(OH)D concentration at which the analytical coefficient of variation (CV) = 20% in a precision profile consisting of 6-fold replicate analyses at each of 12 kit standard and standard mixture concentrations in the range 2–438 nmol/liter.
Method linearity. This was verified using replicate analyses of three serum samples with high 25(OH)D levels in doubling-dilution series up to 1 in 16.
Sample stability. In the automated procedure, the stability was assessed by repeat analysis of three serum samples over five freeze-thaw cycles over 2 wk.
Minimum sample assay volume. Small sample analysis capability of the automated procedure was assessed by presenting a series of premeasured decreasing sample volumes (250 to 50 µl) for analysis and observing the first significant deviation from the baseline 25(OH)D concentration.
Recovery of 25(OH)D. A 12.5-nmol/liter stock solution of 25(OH)D (Sigma Chemicals, Poole, UK; product code H-4014) prepared in 98% HPLC grade ethanol was added to two serum samples with known endogenous 25(OH)D levels to increase expected concentrations by 25–250 nmol/liter.
Comparison between IDS EIA and Diasorin
Agreement was evaluated between IDS with the method most commonly used for epidemiological surveys, namely (manual) Diasorin I125-radiolabeled method. Comparison data were obtained at baseline (n = 142) and in monthly subset comparison batches throughout the period of fieldwork. Data from February and March (years 2003 and 2004) were combined; hence, there were 17 batches of 46 samples each (17 x 46 = 782, final n = 781 because one sample with clear measurement error was deleted). Baseline data were used in the initial performance evaluation only. To assess the possible effects of different calibrator value assignments made by the kit manufacturers, those from the Diasorin kit were analyzed in the automated IDS method on five separate occasions and recoveries quantified.
Participation in the DEQAS
DEQAS has more than 100 participating laboratories around the world (7, 9). Five samples containing varied concentration of 25(OH)D3 [occasionally 25(OH)D2] are sent as part of the scheme to all participating laboratories at three monthly intervals (7), and results were collated for within- and between-method comparisons. Quality assessment data for the present study were obtained on five occasions during the study period.
Statistical analysis
Agreement between 25(OH)D concentration determined by IDS with Diasorin and DEQAS mean of all methods was assessed using graphical plots as described by Bland and Altman (13) and relationships between methods quantified by Passing-Bablock regression (16). Lines of identity were drawn to indicate perfect agreement between the methods. Mean differences between the log-transformed values (log difference) and limits of agreement were calculated for both comparisons (1 and 2), and the average log difference was used as a correction factor to adjust for bias.
![]() |
![]() |
![]() |
| Results |
|---|
|
|
|---|
Performance of the automated method during the initial evaluation and through the subsequent 19-month survey period is shown in Table 1
. Analysis of the functional sensitivity of the automated IDS EIA method showed a cutoff of 5 nmol/liter at a CV of 20%, and assay linearity was confirmed up to 155 nmol/liter (data not shown). We examined sample stability over five freeze thaw cycles and found no significant differences in 25(OH)D levels measured after each cycle in separate assays (Table 2
). The final analyzer configuration allowed results to be obtained on sample volumes down to 75 µl.
|
|
During the initial method evaluation, 142 patient samples from a pilot trial were analyzed by both automated IDS and Diasorin methods. Passing and Bablock regression analysis of this data set gave the relationship: IDS EIA = 0.80 (95% confidence interval 0.7, 0.9) x Diasorin – 1.2 (–6.7, 3.7). In samples collected during the 19-month fieldwork period from 781 members of the 1958 British birth cohort, there was a linear association between 25(OH)D concentration obtained by the two methods; however, 25(OH)D concentrations measured by IDS were on average –15.7 nmol/liter (SE 0.4) lower, compared with those obtained by Diasorin (P < 0.0001, Fig. 1A
). The difference between the methods was dose dependent, and it increased with 25(OH)D concentration (Fig. 1B
). As suggested by Bland and Altman (13), data were log transformed to adjust for this bias, and Fig. 1C
shows that the difference between the methods was constant on a log scale. In 15 samples (1.9%), 25(OH)D concentration measured by Diasorin was lower, compared with that measured by IDS, and as shown in Fig. 1C
in the extreme of low 25(OH)D concentrations, there was a cluster of nine observations with a large positive difference. In seven of these nine observations, 25(OH)D measured by Diasorin was less than 10 nmol/liter, and IDS produced no values less than 10 nmol/liter. Analyses of Diasorin calibrator value assignments by IDS suggested some overestimation by IDS at very low values (12.5 nmol/liter or lower), whereas recovery at 30 nmol/liter or higher concentrations was underestimated (Table 3
).
|
|
Comparison with DEQAS
During the initial method evaluation and then throughout the survey, internationally distributed DEQAS samples (five samples per distribution) were assayed by both the Diasorin method and the automated IDS method. During the period of participation (January 2003 to April 2004), the number of laboratories providing results for DEQAS varied between 82 and 97. Most of the participating laboratories (63–69%) used methods based on RIA, 9–12% used EIA, 12–17% used chemiluminescence, 3–7% used HPLC, and the remainder used other methods.
There was a linear association between 25(OH)D measured by IDS and the average 25(OH)D of all laboratories participating in the DEQAS surveys (Fig. 2A
). As in the comparison between IDS and Diasorin, concentrations by IDS were on average lower (difference –13.7 nmol/liter, SE 1.6, P < 0.0001), and there was a suggestion of dose-dependent bias, which demonstrated a greater negative difference with increasing 25(OH)D concentration (Fig. 2B
). The difference between IDS and DEQAS mean was constant after log transformation (Fig. 2C
), and dose-dependent bias was accommodated using the log difference between DEQAS mean and IDS as a harmonization factor (Fig. 2D
). There was no significant difference in average 25(OH)D concentrations between IDS and DEQAS mean after harmonization (0.9 nmol/liter, SE 1.7, P = 0.58). Most of the laboratories participating in the DEQAS survey used Diasorin, and expectedly, there was good correlation between Diasorin and DEQAS mean with some variation around the line of identity but no evidence of systematic bias (Fig. 3
).
|
|
The pattern of monthly change 25(OH)D concentration was more consistent for IDS, compared with Diasorin (Fig. 4
). Before statistical harmonization, the rates of hypovitaminosis D were higher (regardless of cutoff) when measured by IDS, compared with Diasorin. Harmonization of concentrations obtained by IDS according to either Diasorin or DEQAS mean resulted in identical prevalence rates, with only minor differences to those obtained by Diasorin (Table 4
).
|
|
| Discussion |
|---|
|
|
|---|
At all thresholds, the unmodified data suggested the prevalence of hypovitaminosis D measured by IDS EIA was markedly higher than estimates obtained by Diasorin. Harmonization of 25(OH)D levels measured by automated IDS either according to Diasorin or DEQAS mean corrected this imbalance, and the resulting prevalence rates were similar to those obtained by Diasorin. This comparison of methods demonstrates that if variation in 25(OH)D concentration by assay method is ignored, it may have crucial implications for both the comparison between observations from different (well designed) studies and the resulting public health messages. The underestimation of 25(OH)D concentrations reported in this study is likely to reflect a problem specific to IDS EIA, although issues in comparability have also been reported between other assays (4, 5, 6, 7, 8, 9, 19). Furthermore, we observed an important difference in calibrator value assignments between IDS and Diasorin at the extreme of low levels. To maintain the ranking of the concentrations measured by IDS intact, we applied the harmonization factor throughout the value range, including the low concentrations. After harmonization, the prevalence of 25(OH)D less than 25 nmol/liter (commonly used cutoff for vitamin D deficiency) was comparable, whether measured by IDS or Diasorin. However, the reported differences in calibrator value assignments between IDS and Diasorin suggests that direct comparisons should not be made at the more extreme of low concentrations. These findings clearly emphasize the need of method standardization at the level of kit manufacturers rather than data users.
Average 25(OH)D concentrations obtained by Diasorin were very close to DEQAS mean, as would be expected, given that most laboratories used RIA-based methods (7). Diasorin has the drawback of being relatively labor intensive and showing variation in 25(OH)D level by the operator carrying out the assay (8, 17). In routine quality control evaluations, the laboratory that carried out the 25(OH)D analyses for our study achieves a CV of only 19.5% for Diasorin when assays are carried out by multiple operators, improving to 9.6% with a single operator. In this respect, the automated IDS performed better than single-operator Diasorin (CV
8.5% during the survey). The better consistency with IDS, compared with manual Diasorin, was also evident in the pattern of seasonal variation in 25(OH)D concentrations, which was markedly smoother when measured by the automated IDS. For the purposes of the present large survey, selection of an automated method clearly provided marked benefits because it would have been impractical to carry out the required large number of assays using a single operator.
Compared with the HPLC method, Diasorin has been in some studies reported to overestimate vitamin D3 (the naturally most abundant form) and underestimate the synthetic D2 (6, 7), although not all comparisons have shown these differences (20, 21). Underestimation of D2 is a limitation with IDS EIA because according to manufacturers the assay detects only 75% of this metabolite (22). The main source of vitamin D2 in the cohort is likely to be multivitamin supplements because single vitamin D products were not available over the counter in the United Kingdom during the survey period (12). In our study, only 11% of the cohort members used vitamin supplements containing vitamin D (12). Given the small proportion of supplement users and that supplements in the United Kingdom often contain D3 and not D2, underestimation in 25(OH)D concentrations due to failure to account fully for vitamin D2 intake is likely to be relatively small. This is supported by the clear association between 25(OH)D concentrations and use of vitamin D supplements observed in the current study (12).
Some further limitations need to be considered in relation to these findings. The DEQAS only describes the relative performance among the participating laboratories, whereas it does not provide evidence for how accurate any single method is. Furthermore, we did not repeat the analyses with a reference method such as the HPLC, but carried out a descriptive comparison with Diasorin RIA. The reason why we chose to compare primarily against Diasorin, was that it is the method that has been most commonly used in epidemiological surveys, including the Third National Health and Nutrition Examination Survey (23). The proposed thresholds for hypovitaminosis D are determined on the basis of previous studies using various assays (24). Harmonization of 25(OH)D concentrations according to DEQAS mean has been previously done as parts of efforts aiming to identify optimal 25(OH)D concentrations for bone health (25). The comparisons of IDS with Diasorin and DEQAS mean were made to ensure that results obtained by IDS EIA are comparable with other assays currently in use, to evaluate and quantify the differences, not to suggest superiority for one method over the other. The primary purpose for measuring 25(OH)D in the British 1958 birth cohort was to obtain information on the current situation with hypovitaminosis D in Britain (12), and as we show in this paper, the estimated prevalence rates of hypovitaminosis D using the harmonized IDS are comparable with the estimates that would have been obtained using Diasorin at all thresholds.
In summary, there are marked differences in 25(OH)D concentrations between assays (3, 4, 5, 6, 7, 8, 9), which, as demonstrated in this study, may have important implications for the determination of hypovitaminosis D and the resulting public health messages (10). We used a statistical method (13) to overcome the problem of assay variation, and this enabled us to use previously suggested cutoffs for hypovitaminosis D (12). The role of DEQAS is crucial in providing an international reference against which harmonization factors can be constructed and in allowing a quantification of differences in 25(OH)D concentrations arising from different methodologies. However, as has been highlighted (4), a sustainable long-term solution to the problem of 25(OH)D assay heterogeneity will require method standardization.
| Acknowledgments |
|---|
| Footnotes |
|---|
Disclosure Statement: There are no conflicts of interest with this paper.
First Published Online August 28, 2007
Abbreviations: CV, Coefficient of variation; DEQAS, Vitamin D External Quality Assessment Scheme; EIA, enzyme immunoassay; 25(OH)D, 25-hydroxyvitamin D.
Received June 8, 2007.
Accepted August 22, 2007.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
K Atherton, D J Berry, T Parsons, G J Macfarlane, C Power, and E Hypponen Vitamin D and chronic widespread pain in a white middle-aged British population: evidence from a cross-sectional population survey Ann Rheum Dis, June 1, 2009; 68(6): 817 - 822. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. Orwoll, C. M. Nielson, L. M. Marshall, L. Lambert, K. F. Holton, A. R. Hoffman, E. Barrett-Connor, J. M. Shikany, T. Dam, J. A. Cauley, et al. Vitamin D Deficiency in Older Men J. Clin. Endocrinol. Metab., April 1, 2009; 94(4): 1214 - 1222. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. Hypponen, B. J. Boucher, D. J. Berry, and C. Power 25-Hydroxyvitamin D, IGF-1, and Metabolic Syndrome at 45 Years of Age: A Cross-Sectional Study in the 1958 British Birth Cohort Diabetes, February 1, 2008; 57(2): 298 - 305. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Endocrinology | Endocrine Reviews | J. Clin. End. & Metab. |
| Molecular Endocrinology | Recent Prog. Horm. Res. | All Endocrine Journals |