Header image  
Proud recipient of the NIH Director's 2010 New Innovator Award  
line decor
  
line decor
 
 
 
 

 
 
DIR Spatial Accuracy Results

Below is a summary of published DIR spatial accuracy results obtained from some or all of the reference data sets available through this website. Summary statistics are presented on a case-by-case basis, with references to the published works provided below. It should be noted that an explicit comparison of model formulations and/or implementations is not provided, only numerical results of spatial accuracy measurements obtained from the reference landmark datasets. Details of the particular DIR formulations can be found in the provided references.

The format of the summary table is as follows. Algorithms are identified in the far left column, with reference to the corresponding published work. For each reference data set, errors are reported as the mean (and standard deviation) 3D Euclidean magnitude distance between calculated and reference landmark positions for the set of validation landmarks. When available, magnitude errors are also shown in right-left (RL), anterior-posterior (AP), and superior-inferior (SI) component directions. All values are reported in units of millimeters. Unless otherwise indicated, spatial accuracy results refer to the full list of coordinate pairs for each case.

Table 2. DIR Spatial Accuracy Results
Case 1 - 13 outputs
Table 2. Case 1
3D (SD) RL AP SI
MLSa 1.58 (1.30) 0.57 (0.63) 0.63 (0.73) 0.84 (1.34)
CCLGb 1.02 (1.03) 0.32 (0.48) 0.34 (0.50) 0.55 (1.05)
COFb 1.17 (1.07) 0.36 (0.51) 0.40 (0.53) 0.65 (1.13)
LCIb 1.21 (1.21) 0.33 (0.51) 0.34 (0.52) 0.80 (1.24)
LIIb 1.40 (1.27) 0.39 (0.55) 0.39 (0.57) 0.96 (1.32)
PFc 1.11 (1.09) not reported not reported not reported
EPFc 1.10 (1.09) not reported not reported not reported
AFc 1.15 (1.11) not reported not reported not reported
DFc 1.19 (1.13) not reported not reported not reported
ADFc 1.11 (1.09) not reported not reported not reported
ICc 1.24 (1.30) not reported not reported not reported
CPPd 1.07 (1.10) 0.32 (0.49) 0.34 (0.51) 0.61 (1.12)
4DLTMd 0.97 (1.02) 0.32 (0.49) 0.34 (0.50) 0.49 (1.01)
No DIR 4.01 (2.91) 0.58 (0.62) 0.67 (0.79) 3.68 (3.04)

Case 2 - 13 outputs
Table 2. Case 2
3D RL AP SI
MLSa 1.47 (1.12) 0.60 (0.68) 0.56 (0.72) 0.67 (1.13)
CCLGb 1.29 (1.22) 0.41 (0.59) 0.50 (0.69) 0.70 (1.20)
COFb 1.37 (1.27) 0.40 (0.60) 0.53 (0.70) 0.74 (1.28)
LCIb 1.44 (1.69) 0.36 (0.61) 0.41 (0.66) 0.97 (1.70)
LIIb 1.49 (1.35) 0.55 (0.71) 0.57 (0.74) 0.77 (1.33)
PFc 1.04 (1.15) not reported not reported not reported
EPFc 1.00 (1.15) not reported not reported not reported
AFc 1.05 (1.19) not reported not reported not reported
DFc 1.16 (1.23) not reported not reported not reported
ADFc 1.02 (1.14) not reported not reported not reported
ICc 1.28 (1.62) not reported not reported not reported
CPPd 0.99 (1.12) 0.35 (0.57) 0.36 (0.62) 0.49 (1.02)
4DLTMd 0.86 (1.08) 0.31 (0.55) 0.32 (0.60) 0.38 (0.95)
No DIR 4.65 (4.09) 0.72 (0.85) 0.72 (0.88) 4.09 (4.37)

Case 3 - 9 outputs
Table 2. Case 3
3D RL AP SI
MLSa 2.27 (1.40) 0.89 (0.96) 0.94 (0.94) 1.20 (1.47)
PFc 1.36 (1.20) not reported not reported not reported
EPFc 1.32 (1.21) not reported not reported not reported
AFc 1.39 (1.22) not reported not reported not reported
DFc 1.48 (1.21) not reported not reported not reported
ADFc 1.35 (1.20) not reported not reported not reported
ICc 1.42 (1.22) not reported not reported not reported
CPPd 1.23 (1.32) 0.38 (0.59) 0.40 (0.64) 0.73 (1.29)
4DLTMd 1.01 (1.17) 0.37 (0.58) 0.36 (0.61) 0.48 (1.09)
No DIR 6.73 (4.21) 1.17 (1.05) 1.28 (1.23) 6.10 (4.49)

Case 4 - 9 outputs
Table 2. Case 4
3D RL AP SI
MLSa 2.50 (1.68) 0.89 (0.87) 1.07 (1.13) 1.41 (1.76)
PFc 2.51 (2.49) not reported not reported not reported
EPFc 2.42 (2.48) not reported not reported not reported
AFc 2.34 (2.19) not reported not reported not reported
DFc 2.59 (2.48) not reported not reported not reported
ADFc 2.27 (2.09) not reported not reported not reported
ICc 3.27 (4.09) not reported not reported not reported
CPPd 1.51 (1.58) 0.52 (0.74) 0.58 (0.80) 0.81 (1.52)
4DLTMd 1.40 (1.57) 0.52 (0.76) 0.54 (0.79) 0.70 (1.48)
No DIR 9.42 (4.81) 0.94 (1.21) 1.42 (1.22) 8.98 (5.04)

Case 5 - 13 outputs
Table 2. Case 5
3D RL AP SI
MLSa 2.55 (1.92) 0.90 (1.02) 1.37 (1.60) 1.20 (1.57)
CCLGb 2.50 (1.91) 0.71 (0.81) 1.27 (1.43) 1.31 (1.83)
COFb 2.57 (1.85) 0.77 (0.84) 1.29 (1.42) 1.37 (1.77)
LCIb 3.01 (2.85) 0.78 (0.95) 1.16 (1.47) 2.05 (2.82)
LIIb 3.59 (2.83) 1.21 (1.23) 1.41 (1.53) 2.27 (2.90)
PFc 1.84 (1.74) not reported not reported not reported
EPFc 1.82 (1.87) not reported not reported not reported
AFc 1.81 (1.83) not reported not reported not reported
DFc 1.91 (1.77) not reported not reported not reported
ADFc 1.80 (1.80) not reported not reported not reported
ICc 1.67 (1.57) not reported not reported not reported
CPPd 1.95 (2.02) 0.64 (0.92) 0.69 (0.88) 1.24 (1.96)
4DLTMd 1.67 (1.79) 0.58 (0.82) 0.69 (0.96) 0.92 (1.66)
No DIR 7.10 (5.15) 0.86 (0.96) 1.74 (1.66) 6.30 (5.45)

Case 6 - 2 outputs
Table 2. Case 6
3D RL AP SI
CPPd 1.94 (1.72) 0.60 (0.95) 0.59 (0.81) 1.35 (1.62)
4DLTMd 1.58 (1.65) 0.54 (0.93) 0.61 (0.88) 0.93 (1.44)
No DIR 11.10 (6.98) 2.15 (1.89) 2.53 (2.10) 10.21 (6.97)

Case 7 - 2 outputs
Table 2. Case 7
3D RL AP SI
CPPd 1.79 (1.46) 0.55 (0.64) 0.68 (0.87) 1.11 (1.49)
4DLTMd 1.46 (1.29) 0.47 (0.61) 0.58 (0.70) 0.82 (1.30)
No DIR 11.59 (7.87) 1.28 (1.17) 2.13 (1.54) 10.85 (8.29)

Case 8 - 2 outputs
Table 2. Case 8
3D RL AP SI
CPPd 1.96 (2.33) 0.64 (0.94) 0.71 (1.07) 1.25 (2.19)
4DLTMd 1.77 (2.12) 0.53 (0.82) 0.68 (0.92) 1.08 (2.05)
No DIR 15.16 (9.11) 2.29 (1.72) 3.78 (3.25) 13.62 (9.71)

Case 9 - 2 outputs
Table 2. Case 9
3D RL AP SI
CPPd 1.33 (1.17) 0.41 (0.56) 0.59 (0.70) 0.67 (1.17)
4DLTMd 1.19 (1.12) 0.41 (0.57) 0.51 (0.62) 0.57 (1.10)
No DIR 7.82 (3.99) 1.25 (1.02) 2.98 (1.93) 6.45 (4.51)

Case 10 - 2 outputs
Table 2. Case 10
3D RL AP SI
CPPd 1.84 (1.90) 0.48 (0.66) 0.71 (0.89) 1.21 (1.89)
4DLTMd 1.59 (1.87) 0.45 (0.66) 0.65 (0.96) 0.95 (1.77)
No DIR 7.63 (6.54) 0.93 (0.91) 1.90 (1.91) 6.97 (6.60)


REFERENCES

a) Castillo, R., Castillo, E., Guerra, R., Johnson, V.E., McPhail, T., Garg, A.K., Guerrero, T. 2009 A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets Phys Med Biol 54 1849-1870. (PMB Featured Article 2009 - Free Access)

b) Castillo, E., Castillo, R., Zhang, Y., Guerrero, T. 2009 Compressible image registration for thoracic computed tomography images Journal of Medical and Biological Engineering 29 222-233. (JMBE Featured Article 2009 - Free Access)

c) Gu, X., Pan, H., Liang, Y., Castillo, R., Yang, D., Choi, D., Castillo, E., Majumdar, A., Guerrero, T., Jiang, S.B. 2009 Implementation and evaluation of various demons deformable image registration algorithms on a GPU Phys Med Biol 55 207-219.

d) Castillo, E., Castillo, R., Martinez, J., Shenoy, M., Guerrero, T. 2009 Four-dimensional deformable image registration using trajectory modeling Phys Med Biol 55 305-327.

Contact Us:

DIR-lab
c/o Richard Castillo
The University of Texas M. D. Anderson Cancer Center
1515 Holcombe Blvd - Unit 56
Houston, TX 77030

E-mail: Inquiries@DIR-lab.com