Measurement Uncertainty in Spine Bone Mineral Density by Dual Energy X-ray Absorptiometry

Article information

J Bone Metab. 2017;24(2):105-109
Publication date (electronic) : 2017 May 31
doi : https://doi.org/10.11005/jbm.2017.24.2.105
1Department of Laboratory Medicine, Chung-Ang University College of Medicine, Seoul, Korea.
2Department of Orthopaedic Surgery, Gyeongsang National University Hospital, Jinju, Korea.
3National Standard Reference Center, Korea Research Institute of Standards and Science, Daejeon, Korea.
4Department of Laboratory Medicine, Chonbuk National University School and Hospital, Jeonju, Korea.
Corresponding author: Jun-Il Yoo. Department of Orthopaedic Surgery, Gyeongsang National University Hospital, 79 Gangnam-ro, Jinju 52727, Korea. Tel: +82-55-750-9787, Fax: +82-55-750-4980, furim@daum.net
Received 2017 March 23; Revised 2017 April 19; Accepted 2017 April 21.

Abstract

Background

The purpose of this study was to calculate the measurement uncertainty of the process of bone mineral density (BMD) analysis using dual energy X-ray absorptiometry with traceability.

Methods

Between March 2015 and October 2016, among healthy participants in their 20s and 30s, the study included those who had not taken calcium, vitamin D supplements and steroids and were without a history of osteoporosis, osteopenia and diseases related to osteoporosis. Relational expression of the model was established based on Guide to the Expression of Uncertainty in Measurements and Eurachem and the uncertainty from each factor was evaluated.

Results

The combined standard uncertainty was 0.015, while the expanded uncertainty was 0.0298. The factor-specific standard uncertainties that occurred in the process of measuring BMD were 0.72% for the calibration curve, 0.9% for the internal quality control (IQC) using Aluminum Spine Phantom, 0.58% for European Spine Phantom (ESP), and 0.9% for the inspector precision (IP).

Conclusions

The combined standard uncertainty of the spine BMD corrected with ESP was 0.015 when measured at one time and targeting one participant. The uncertainties of the accuracy of the IQC and the IP were higher than that of the other factors. Therefore, there will be a need for establishment of protocols to lower these uncertainties.

INTRODUCTION

The importance of the precision medicine has been increasing recently,[12] and due to the advances in medical science, the types of the measurement instruments are also becoming more varied, and their numbers have also been increasing.[34] Among these devices, the ones for diagnosis of osteoporosis are also being improved and their numbers are rising. As such, with the bone mineral density (BMD) measurements being performed more frequently, the controversy and questions over the accuracy of various BMD measuring devices is also increasing.[567]

In general, the quality control on BMD assays using dual energy X-ray absorptiometry (DXA) is done in according to the International Society for Clinical Densitometry (ISCD) guidelines.[7] However, all the errors occurring in these processes concern the reliability of the BMD values.

Recently, measurement uncertainty has been most commonly used in determining the standard value in the field of metrology, and the traceability of the measurement process must be confirmed in order to compare measurement results, for example in a clinical setting, from other patients and other hospitals.[8] However, for among the healthcare providers, the concepts have remained unfamiliar.

The procedure for calculating uncertainty by means of Guide to the Expression of Uncertainty in Measurements (GUM) [9] is for making a statistical estimate through the function expression of the measured quantity, the calculation of the standard uncertainty of the input quantity, the calculation of combined standard uncertainty, and the calculation of expanded uncertainty.[10]

The purpose of this study was to calculate the measurement uncertainty of the process of spine BMD analysis using DXA with traceability.

METHODS

1. Participants

The design and protocol of this prospective study were approved by the Institutional Review Board of our hospital. All participants received informed consent. Between March 2015 and October 2016, among healthy participants in their 20s and 30s, the study included those who had not taken calcium that also included vitamin D supplements and steroids and had no history of osteoporosis, osteopenia and diseases related to osteoporosis.

2. Reference material: European Spine Phantom (ESP)

The ESP is a semi anthropomorphic phantom, comprised of vertebra-like structures of different sizes and densities. Our unit had three vertebrae representing low (L1), medium (L2) and high (L3) densities with actual BMD values of 0.496 g/cm2, 0.990 g/cm2, and 1.499 g/cm2, respectively. The phantom's main body consisted of a water-equivalent resin and three inserts containing varying amounts of calcium hydroxyapatite to cover the full physiological range of spongious and cortical bone densities for all age groups. The container was 260 mm long, 180 mm wide, and 110 mm in height.[61011]

3. DXA

BMD in the lumbar spine was measured with DXA (Lunar Prodigy Advance, GE Lunar, Medison, WI, USA) using standard scanning procedures. The scans were performed by trained technicians and according to the manufacturer's protocol. We aimed to reduce the coefficient of variation (CVsd) to <1.9% (least significant change [LSC]=5.3%) for the lumbar spine measurements.

4. Improving traceability in the spine BMD measurement process

All the BMD measurement processes followed the ISCD guidelines.[812] To evaluate internal precision, each of the 15 subjects were measured 3 times. After the first bone densitometry test, the second and third tests were performed after the participants first got up from the instrument table and then went on the table again to allow for body movement prior to the repeat tests. The measured values were used to produce precision for each part by using the calculation table distributed by ISCD. When the coefficients of variability exceeded 1.9% (LSC=5.3%) according to the standard of ISCD measurement errors, the participants were re-educated and measured again. In addition, traceability for the measurement process was confirmed by conducting an ESP bias evaluation. Mechanical operation and quality of radiation were adjusted by using the block phantom. In order to assess precision, accuracy and functionality of DXA, we assessed and adjusted the quality of radiation, value of tissue equivalent materials and the absorption coefficient. Movements of the equipment were also assessed (Fig. 1).[13]

Fig. 1

Fish bone diagram of uncertainty sources in bone mineral density measurement. ESP, European Spine Phantom; IQC, internal quality control.

5. Measurement uncertainty

Relational expression of the model was based on GUM and Eurachem and the uncertainty from each of the factors was evaluated (Fig. 2).

Fig. 2

Process of measurement uncertainty evaluation. Cal, calibration curve; ESP, European Spine Phantom; IQC, internal quality control; n, resolution; IP, inspector precision; Uc, standard uncertainty of calibration curve.

6. Modeling the measurement

y = f (Xcal, XESP, XIQC, XIP ..., Xn)(1)
uXiuXcal,uXESP,uXIQC,uXIP,(2)
(Cal, calibration curve; ESP, European Spine Phantom; IQC, internal quality control; Res, resolution; IP, inspector precision)

Based on relational expression of the model (1), we selected four factors of uncertainty of measurement, namely Xcal, XESP, XIQC, and XIP (2). Standard uncertainty and combined uncertainty of measurement were also calculated.

7. Measurements of standard uncertainty

Standard uncertainties of calibration curve for ESP, ESP, IQC, and IP were measured. Resolution of the equipment was decided to be ignored in the measurements of standard uncertainty.

8. Standard uncertainty of calibration curve

Mean value and standard deviation were calculated after performing repeated measurements of ESP in DXA. Regression analysis was conducted by setting the assigned value of ESP as the x-axis and the indicated value of equipment after measurement as the y-axis (Fig. 3A). In addition, bias was measured between the assigned value of ESP and the indicated value of equipment (Fig. 3B).

UcC0=sB11P+1n+C0-C2SXX(3)
(Uc, standard uncertainty of calibration curve; C0, indicated value of equipment; s, standard deviation of residual; P, number of repeated measurements in BMD; n, number of repeated measurements in standard reference; Sxx, residual sum of squares of standard reference; C, mean of standard reference; B1, slope of calibration curve)

Fig. 3

(A) Calibration curve and (B) bias were measured between the assigned value of European Spine Phantom and the indicated value of equipment. BMD, bone mineral density; Sxx, residual sum of squares of standard reference.

9. Standard uncertainty of other uncertainty sources

Standard uncertainty of ESP, IQC and IP were obtained as seen in formula, respectively (4–6).

UESP=accuracy of certified ESP value/3(4)
UIQC=standard deviation of IQC (5)
UIP=SD12+SD22++SD152/15(6)

10. Combined standard uncertainty

When measurements are from multiple entry values, the standard uncertainty of the results of the measurements is called combined standard uncertainty, which is acquired by using the law of propagation of uncertainty (8).[14]

ucy=i=1nfxi2u2xi¯(8)

11. Coverage factor (k)

In order to obtain the coverage factor k, the effective degree of freedom of the combined standard uncertainty needed to be estimated. This effective freedom is expressed as Veff, which was measured by using the Welch-Satterthwaite formula (9).[1516]

Veff=uc4yi=1nciuxi4vi(9)

12. Expanded uncertainty (U)

Expanded uncertainty was obtained by multiplying the calculated combined standard uncertainty and the inclusion factor k equivalent to confidence level, as seen in formula (10).

U = kuc (y)(10)

13. Statistical analysis

Basic calculation for measurement uncertainty and correlation coefficient were performed using Microsoft Excel 2010 software (Microsoft Corporation, Redmond, WA, USA).

RESULTS

According to the uncertainty calculation formula, standard uncertainty and combined uncertainty for one healthy man in his 20s were acquired. From this analysis, the standard uncertainty of calibration curve was 0.0072, while the standard uncertainties of IQC, ESP and IP were 0.009, 0.0058, and 0.009, respectively. The combined uncertainty based on these results was 0.015, while the expanded uncertainty was 0.0298 (k=2) (Table 1). The uncertainty budget, considering all the sources mentioned above, is presented in Table 1.

Table 1

Uncertainty budget

DISCUSSION

In this study, spine BMD after being corrected for ESP was measured one time and targeting one participant. The principle findings of our study showed that the combined standard uncertainty was 0.015, while the expanded uncertainty was 0.0298. The factor-specific standard uncertainties that occurred in the process of measuring the spine BMD were 0.72% for calibration curve, 0.9% for IQC using Aluminum Spine Phantom, 0.58% for ESP, and 0.9% for IP. It was found that the IQC and the IP were calculated to be higher than the uncertainty occurring in the process of ESP calibration. From this study, the IQC and the IP were known to have higher uncertainty than other measurement processes. Accuracy was also maintained using calculation of the LSC according to the ISCD guidelines.

Park et al. [5] evaluated discrepancy and standardizations of DXA devices from three manufacturers using a ESP. They reported that mean CVsd for L1–L3 BMD of three different devices was significantly different among the three devices (0.01%, 0.78%, and 2.46% for Lunar, Hologic, and Osteosys, respectively).

In order to compare the BMD obtained from other measurement equipment or hospitals, a value with traceability through an ESP calibration is required. Therefore, the concept of uncertainty through instrument calibration with traceability combined with the LSC should be managed to account for the error in the BMD measurement.

This study has several limitations. First, to calculate the uncertainty, it applied only a representative process critical to Quality Control in the process of measuring the BMD. Using the uncertainty calculation formula provided, future studies will need to calculate the uncertainty with the standard values from all processes. Second, it was difficult to make a direct comparison, as there were few medical data for calculating the uncertainty. Since the importance for standard values and calculation of uncertainty are being emphasized in the medical and industrial sectors, these study findings will become increasingly more valuable.

In conclusion, the combined standard uncertainty of the spine BMD corrected with ESP was 0.015 when measured at one time and targeting one participant. The uncertainties of the accuracy of the IQC and the IP were higher than that of the other factors. Therefore, there will be a need for establishment of protocols to lower these uncertainties.

ACKNOWLEDGEMENT

This research was supported (in part) by Ministry of Trade, Industry and Energy through Standard Reference Data Program.

Notes

No potential conflict of interest relevant to this article was reported.

References

1. Goodwin PN. Methodologies for the measurement of bone density and their precision and accuracy. Semin Nucl Med 1987;17:293–304. 3317844.
2. Mussmann B, Overgaard S, Torfing T, et al. Agreement and precision of periprosthetic bone density measurements in micro-CT, single and dual energy CT. J Orthop Res 2016;10.1002/jor.23417.
3. Utkualp N, Ercan I. Anthropometric measurements usage in medical sciences. Biomed Res Int 2015;2015:404261. 26413519.
4. Katusiime B, Corlett S, Reeve J, et al. Measuring medicine-related experiences from the patient perspective: a systematic review. Patient Relat Outcome Meas 2016;7:157–171. 27785116.
5. Park AJ, Choi JH, Kang H, et al. Result of proficiency test and comparison of accuracy using a european spine phantom among the three bone densitometries. J Bone Metab 2015;22:45–49. 26082913.
6. Ozdemir A, Uçar M. Standardization of spine and hip BMD measurements in different DXA devices. Eur J Radiol 2007;62:423–426. 17289322.
7. The International Society for Clinical Densitometry. Official positions 2012. cited by 2016 December 13. Available from: http://www.iscd.org/official-positions/official-positions/.
8. Theodorsson E. Uncertainty in measurement and total error: tools for coping with diagnostic uncertainty. Clin Lab Med 2017;37:15–34. 28153362.
9. Farrance I, Frenkel R. Uncertainty of measurement: a review of the rules for calculating uncertainty components through functional relationships. Clin Biochem Rev 2012;33:49–75. 22896744.
10. Genant HK, Grampp S, Glüer CC, et al. Universal standardization for dual x-ray absorptiometry: patient and phantom cross-calibration results. J Bone Miner Res 1994;9:1503–1514. 7817795.
11. Kalender WA, Felsenberg D, Genant HK, et al. The European spine phantom-a tool for standardization and quality control in spinal bone mineral measurements by DXA and QCT. Eur J Radiol 1995;20:83–92. 7588873.
12. Lenchik L, Kiebzak GM, Blunt BA. What is the role of serial bone mineral density measurements in patient management? J Clin Densitom 2002;5(Suppl):S29–S38. 12464709.
13. Kolta S, Ravaud P, Fechtenbaum J, et al. Accuracy and precision of 62 bone densitometers using a European Spine Phantom. Osteoporos Int 1999;10:14–19. 10501774.
14. Cox M, Harris P, Siebert BR. Evaluation of measurement uncertainty based on the propagation of distributions using Monte Carlo simulation. Meas Tech 2003;46:824–833.
15. Welch BL. The generalisation of student's problems when several different population variances are involved. Biometrika 1947;34:28–35. 20287819.
16. Satterthwaite FE. An approximate distribution of estimates of variance components. Biometrics 1946;2:110–114. 20287815.

Article information Continued

Funded by : Ministry of Trade, Industry and Energyhttp://dx.doi.org/10.13039/501100003052

Fig. 1

Fish bone diagram of uncertainty sources in bone mineral density measurement. ESP, European Spine Phantom; IQC, internal quality control.

Fig. 2

Process of measurement uncertainty evaluation. Cal, calibration curve; ESP, European Spine Phantom; IQC, internal quality control; n, resolution; IP, inspector precision; Uc, standard uncertainty of calibration curve.

Fig. 3

(A) Calibration curve and (B) bias were measured between the assigned value of European Spine Phantom and the indicated value of equipment. BMD, bone mineral density; Sxx, residual sum of squares of standard reference.

Table 1

Uncertainty budget

Table 1

ESP, European Spine Phantom; Uc, combined uncertainty; BMD, bone mineral density; U, expanded uncertainty.