Computes an IRT version of the "reliable change index" (RCI) proposed by Jacobson and Traux (1991) but modified to use IRT information about scores and measurement error (see Jabrayilov, Emons, and Sijtsma (2016). Main benefit of the IRT approach is the inclusion of response pattern information in the pre/post data score estimates, as well as conditional standard error of measurement information.
Usage
RCI(
mod_pre,
predat,
postdat,
mod_post = mod_pre,
cutoffs = NULL,
SEM.pre = NULL,
SEM.post = NULL,
Fisher = FALSE,
shiny = FALSE,
main = "Test Scores",
...
)Arguments
- mod_pre
single-group model fitted by
mirt. If not supplied the information will be extracted from the data input objects to compute the classical test theory version of the RCI statistics- predat
a vector (if one individual) or matrix/data.frame of response data to be scored, where each individuals' responses are included in exactly one row
- postdat
same as
predat, but with respect to the post/follow-up measurement- mod_post
(optional) IRT model for post-test if different from pre-test; otherwise, the pre-test model will be used
- cutoffs
optional vector of length 2 indicating the type of cut-offs to report (e.g.,
c(-1.96, 1.96)reflects the 95 percent z-score type cut-off)- SEM.pre
standard error of measurement for the pretest. This can be used instead of
rxx.preandSD.pre- SEM.post
(optional) standard error of measurement for the post-test. Using this will create a pooled version of the SEM; otherwise,
SEM.post = SEM.pre- Fisher
logical; use the Fisher/expected information function to compute the SE terms? If
FALSEthe SE information will be extracted from the selectfscoresmethod (default). Only applicable for unidimensional models- shiny
logical; launch an interactive shiny applications for real-time scoring of supplied total-scores or response vectors? Only requires
mod_preand (optional)mod_postinputs- main
main label to use when
shiny=TRUE- ...
additional arguments passed to
fscores
References
Chalmers, R., P. (2012). mirt: A Multidimensional Item Response Theory Package for the R Environment. Journal of Statistical Software, 48(6), 1-29. doi:10.18637/jss.v048.i06
Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19.
Jabrayilov, R. , Emons, W. H. M., & Sijtsma, K. (2016). Comparison of Classical Test Theory and Item Response Theory in Individual Change Assessment. Applied Psychological Measurement, 40 (8), 559-572.
Author
Phil Chalmers rphilip.chalmers@gmail.com
Examples
# \donttest{
# simulate some data
N <- 1000
J <- 20 # number of items
a <- matrix(rlnorm(J,.2,.3))
d <- rnorm(J)
theta <- matrix(rnorm(N))
dat_pre <- simdata(a, d, itemtype = '2PL', Theta = theta)
# first 3 cases decrease by 1/2
theta2 <- theta - c(1/2, 1/2, 1/2, numeric(N-3))
dat_post <- simdata(a, d, itemtype = '2PL', Theta = theta2)
mod <- mirt(dat_pre)
# all changes using fitted model from pre data
RCI(mod, predat=dat_pre, postdat=dat_post)
#> pre.score post.score converged diff SEM z p
#> 1 -0.357 -1.747 TRUE -1.391 0.573 -2.426 0.015
#> 2 0.877 -0.225 TRUE -1.102 0.507 -2.171 0.03
#> 3 -0.346 -2.166 TRUE -1.820 0.645 -2.823 0.005
#> 4 -1.691 -0.789 TRUE 0.902 0.578 1.560 0.119
#> 5 -0.172 -0.175 TRUE -0.004 0.436 -0.008 0.993
#> 6 -0.120 -0.221 TRUE -0.100 0.437 -0.230 0.818
#> 7 -0.363 -0.238 TRUE 0.125 0.435 0.287 0.774
#> 8 1.045 1.841 TRUE 0.796 0.696 1.144 0.253
#> 9 -0.673 -1.083 TRUE -0.410 0.491 -0.836 0.403
#> 10 0.120 0.156 TRUE 0.036 0.456 0.080 0.937
#> 11 -0.822 -0.390 TRUE 0.432 0.457 0.946 0.344
#> 12 0.859 0.742 TRUE -0.117 0.556 -0.211 0.833
#> 13 -0.498 -0.040 TRUE 0.458 0.442 1.036 0.3
#> 14 -0.420 0.394 TRUE 0.814 0.464 1.755 0.079
#> 15 -1.406 -0.972 TRUE 0.434 0.550 0.789 0.43
#> 16 -1.405 -1.507 TRUE -0.103 0.607 -0.169 0.866
#> 17 1.545 1.801 TRUE 0.256 0.740 0.346 0.73
#> 18 0.739 1.265 TRUE 0.525 0.599 0.877 0.381
#> 19 -1.396 -1.083 TRUE 0.313 0.558 0.561 0.575
#> 20 -0.278 -0.440 TRUE -0.162 0.437 -0.370 0.711
#> 21 -1.036 -0.873 TRUE 0.163 0.499 0.327 0.744
#> 22 -1.306 -0.467 TRUE 0.839 0.509 1.647 0.1
#> 23 -0.087 -0.397 TRUE -0.311 0.438 -0.709 0.479
#> 24 0.749 0.300 TRUE -0.449 0.512 -0.877 0.38
#> 25 0.020 0.136 TRUE 0.116 0.451 0.257 0.797
#> 26 -0.249 0.134 TRUE 0.382 0.446 0.858 0.391
#> 27 -1.676 -2.166 TRUE -0.491 0.736 -0.667 0.505
#> 28 -0.111 -0.295 TRUE -0.185 0.437 -0.423 0.672
#> 29 -1.915 -1.356 TRUE 0.559 0.660 0.847 0.397
#> 30 -0.506 0.220 TRUE 0.726 0.454 1.598 0.11
#> 31 1.847 1.555 TRUE -0.293 0.746 -0.392 0.695
#> 32 0.617 0.315 TRUE -0.303 0.501 -0.605 0.545
#> 33 1.299 1.679 TRUE 0.380 0.700 0.543 0.587
#> 34 -0.017 -0.172 TRUE -0.155 0.440 -0.352 0.725
#> 35 -0.202 -0.163 TRUE 0.040 0.436 0.091 0.927
#> 36 0.548 1.530 TRUE 0.982 0.617 1.591 0.112
#> 37 -0.218 -0.038 TRUE 0.180 0.439 0.410 0.682
#> 38 -1.847 -1.905 TRUE -0.057 0.719 -0.079 0.937
#> 39 0.690 0.391 TRUE -0.299 0.512 -0.583 0.56
#> 40 0.156 -0.122 TRUE -0.277 0.448 -0.619 0.536
#> 41 1.193 0.327 TRUE -0.866 0.562 -1.542 0.123
#> 42 0.427 0.674 TRUE 0.247 0.513 0.481 0.63
#> 43 -1.217 -1.564 TRUE -0.347 0.594 -0.585 0.559
#> 44 -0.182 -0.243 TRUE -0.061 0.435 -0.140 0.888
#> 45 -0.731 -0.863 TRUE -0.133 0.474 -0.280 0.779
#> 46 -0.427 -1.303 TRUE -0.876 0.508 -1.723 0.085
#> 47 0.734 0.829 TRUE 0.095 0.553 0.173 0.863
#> 48 -0.914 -0.722 TRUE 0.191 0.477 0.401 0.688
#> 49 -0.896 -1.339 TRUE -0.443 0.535 -0.828 0.407
#> 50 1.237 1.035 TRUE -0.202 0.623 -0.324 0.746
#> 51 -1.784 -2.166 TRUE -0.383 0.749 -0.511 0.61
#> 52 -1.905 -1.635 TRUE 0.269 0.691 0.390 0.697
#> 53 0.134 -0.490 TRUE -0.624 0.449 -1.391 0.164
#> 54 -0.755 -1.085 TRUE -0.331 0.496 -0.667 0.505
#> 55 -1.042 -1.407 TRUE -0.365 0.556 -0.657 0.511
#> 56 0.718 0.809 TRUE 0.092 0.549 0.167 0.867
#> 57 -0.476 -0.407 TRUE 0.069 0.439 0.156 0.876
#> 58 0.221 0.553 TRUE 0.333 0.490 0.679 0.497
#> 59 -0.742 -1.332 TRUE -0.590 0.524 -1.126 0.26
#> 60 -0.507 -0.089 TRUE 0.418 0.441 0.948 0.343
#> 61 -1.682 -1.287 TRUE 0.395 0.618 0.640 0.522
#> 62 -0.089 0.373 TRUE 0.462 0.463 0.998 0.318
#> 63 -1.387 -1.097 TRUE 0.290 0.558 0.520 0.603
#> 64 1.000 1.200 TRUE 0.199 0.615 0.324 0.746
#> 65 0.590 0.470 TRUE -0.120 0.509 -0.236 0.814
#> 66 -0.901 -0.428 TRUE 0.473 0.464 1.020 0.308
#> 67 -0.325 -0.083 TRUE 0.243 0.437 0.555 0.579
#> 68 -0.182 -0.387 TRUE -0.206 0.436 -0.472 0.637
#> 69 -0.618 -1.374 TRUE -0.756 0.523 -1.445 0.149
#> 70 0.644 0.520 TRUE -0.124 0.518 -0.239 0.811
#> 71 1.216 1.263 TRUE 0.048 0.644 0.074 0.941
#> 72 -0.585 -1.033 TRUE -0.448 0.481 -0.930 0.352
#> 73 1.234 0.504 TRUE -0.730 0.578 -1.263 0.207
#> 74 1.565 0.956 TRUE -0.609 0.654 -0.931 0.352
#> 75 0.805 1.124 TRUE 0.319 0.589 0.542 0.588
#> 76 -0.914 -1.023 TRUE -0.108 0.501 -0.216 0.829
#> 77 0.066 0.747 TRUE 0.680 0.500 1.360 0.174
#> 78 -0.143 0.188 TRUE 0.332 0.449 0.738 0.461
#> 79 0.954 0.797 TRUE -0.157 0.571 -0.276 0.783
#> 80 1.060 0.546 TRUE -0.514 0.561 -0.915 0.36
#> 81 -1.399 -1.307 TRUE 0.092 0.581 0.158 0.875
#> 82 -0.199 -0.682 TRUE -0.484 0.447 -1.082 0.279
#> 83 0.099 0.208 TRUE 0.109 0.458 0.239 0.811
#> 84 -0.933 0.127 TRUE 1.060 0.475 2.231 0.026
#> 85 -0.462 -0.671 TRUE -0.210 0.449 -0.467 0.64
#> 86 -0.093 -0.473 TRUE -0.381 0.440 -0.866 0.387
#> 87 -0.356 -0.440 TRUE -0.085 0.437 -0.194 0.846
#> 88 -1.366 -0.956 TRUE 0.411 0.543 0.756 0.449
#> 89 1.342 1.699 TRUE 0.357 0.707 0.506 0.613
#> 90 0.901 0.910 TRUE 0.009 0.576 0.015 0.988
#> 91 0.030 0.391 TRUE 0.361 0.468 0.773 0.44
#> 92 0.366 0.329 TRUE -0.037 0.481 -0.077 0.939
#> 93 0.443 0.529 TRUE 0.086 0.502 0.172 0.863
#> 94 0.322 1.170 TRUE 0.848 0.559 1.518 0.129
#> 95 0.608 0.326 TRUE -0.282 0.501 -0.564 0.573
#> 96 0.028 0.247 TRUE 0.219 0.458 0.480 0.632
#> 97 -0.016 0.503 TRUE 0.519 0.475 1.092 0.275
#> 98 -0.903 -1.158 TRUE -0.256 0.514 -0.497 0.619
#> 99 -0.471 0.364 TRUE 0.835 0.463 1.805 0.071
#> 100 0.048 0.473 TRUE 0.425 0.475 0.896 0.37
#> 101 0.819 1.801 TRUE 0.982 0.672 1.461 0.144
#> 102 -0.273 0.166 TRUE 0.439 0.447 0.981 0.327
#> 103 0.269 -0.244 TRUE -0.513 0.453 -1.130 0.258
#> 104 -1.186 -1.399 TRUE -0.213 0.568 -0.374 0.708
#> 105 -0.848 -1.040 TRUE -0.192 0.497 -0.387 0.699
#> 106 -0.599 -1.166 TRUE -0.566 0.496 -1.141 0.254
#> 107 -1.018 -1.417 TRUE -0.399 0.555 -0.720 0.472
#> 108 -1.366 -1.579 TRUE -0.212 0.612 -0.346 0.729
#> 109 -0.222 -0.036 TRUE 0.186 0.439 0.424 0.672
#> 110 -0.245 0.059 TRUE 0.304 0.442 0.688 0.491
#> 111 1.360 0.919 TRUE -0.441 0.626 -0.705 0.481
#> 112 1.765 1.765 TRUE 0.000 0.760 0.000 1
#> 113 1.079 0.799 TRUE -0.280 0.584 -0.480 0.631
#> 114 0.782 0.760 TRUE -0.022 0.551 -0.040 0.968
#> 115 0.222 0.135 TRUE -0.087 0.461 -0.188 0.851
#> 116 -1.038 -0.445 TRUE 0.592 0.477 1.241 0.215
#> 117 -0.434 -0.564 TRUE -0.129 0.443 -0.292 0.77
#> 118 0.474 0.050 TRUE -0.424 0.475 -0.892 0.372
#> 119 0.570 0.709 TRUE 0.138 0.527 0.262 0.793
#> 120 -1.894 -1.297 TRUE 0.597 0.651 0.917 0.359
#> 121 -0.575 -0.654 TRUE -0.079 0.452 -0.175 0.861
#> 122 -1.213 -1.895 TRUE -0.682 0.643 -1.062 0.288
#> 123 1.115 0.947 TRUE -0.168 0.601 -0.279 0.78
#> 124 0.492 0.375 TRUE -0.117 0.494 -0.237 0.813
#> 125 -0.006 0.373 TRUE 0.379 0.465 0.815 0.415
#> 126 1.574 1.186 TRUE -0.388 0.676 -0.574 0.566
#> 127 -1.679 -1.343 TRUE 0.336 0.623 0.538 0.59
#> 128 0.006 1.342 TRUE 1.336 0.566 2.359 0.018
#> 129 0.632 0.144 TRUE -0.489 0.493 -0.992 0.321
#> 130 1.131 0.779 TRUE -0.352 0.588 -0.599 0.549
#> 131 0.744 0.809 TRUE 0.064 0.552 0.116 0.907
#> 132 0.291 -0.502 TRUE -0.793 0.458 -1.730 0.084
#> 133 0.805 0.529 TRUE -0.275 0.533 -0.516 0.606
#> 134 -1.345 -1.568 TRUE -0.223 0.608 -0.367 0.714
#> 135 -0.702 -0.926 TRUE -0.224 0.477 -0.469 0.639
#> 136 0.715 1.130 TRUE 0.415 0.582 0.712 0.476
#> 137 0.122 0.063 TRUE -0.059 0.452 -0.130 0.896
#> 138 1.801 1.237 TRUE -0.563 0.709 -0.795 0.427
#> 139 -0.424 -0.279 TRUE 0.146 0.436 0.333 0.739
#> 140 1.233 0.947 TRUE -0.286 0.614 -0.466 0.641
#> 141 -0.402 -1.317 TRUE -0.915 0.510 -1.795 0.073
#> 142 -1.894 -2.166 TRUE -0.272 0.764 -0.356 0.722
#> 143 0.074 -0.355 TRUE -0.428 0.443 -0.967 0.334
#> 144 1.514 1.555 TRUE 0.040 0.708 0.057 0.955
#> 145 0.088 -0.333 TRUE -0.420 0.444 -0.948 0.343
#> 146 -1.784 -1.253 TRUE 0.530 0.630 0.842 0.4
#> 147 0.564 1.574 TRUE 1.010 0.624 1.618 0.106
#> 148 0.278 0.045 TRUE -0.233 0.460 -0.505 0.613
#> 149 1.823 0.570 TRUE -1.253 0.657 -1.906 0.057
#> 150 1.325 0.285 TRUE -1.041 0.575 -1.808 0.071
#> 151 1.373 1.841 TRUE 0.469 0.727 0.645 0.519
#> 152 -0.169 -0.315 TRUE -0.145 0.436 -0.334 0.739
#> 153 -0.158 -0.076 TRUE 0.082 0.438 0.187 0.851
#> 154 -0.846 -0.852 TRUE -0.006 0.481 -0.013 0.989
#> 155 -0.067 -0.468 TRUE -0.401 0.440 -0.911 0.362
#> 156 0.565 -0.314 TRUE -0.879 0.476 -1.845 0.065
#> 157 -0.949 -0.814 TRUE 0.135 0.486 0.278 0.781
#> 158 -0.354 -0.718 TRUE -0.363 0.449 -0.809 0.419
#> 159 -0.532 -0.532 TRUE -0.001 0.444 -0.002 0.999
#> 160 -0.980 -1.093 TRUE -0.113 0.513 -0.220 0.826
#> 161 -0.760 -0.357 TRUE 0.403 0.452 0.891 0.373
#> 162 1.338 0.182 TRUE -1.155 0.572 -2.020 0.043
#> 163 -0.354 -0.223 TRUE 0.131 0.435 0.301 0.764
#> 164 1.233 1.019 TRUE -0.214 0.621 -0.345 0.73
#> 165 0.671 0.533 TRUE -0.138 0.521 -0.265 0.791
#> 166 -0.132 -0.694 TRUE -0.563 0.449 -1.254 0.21
#> 167 -0.670 -0.216 TRUE 0.454 0.446 1.017 0.309
#> 168 -1.019 -0.912 TRUE 0.107 0.500 0.214 0.831
#> 169 -1.216 -1.258 TRUE -0.042 0.554 -0.076 0.939
#> 170 -0.127 0.869 TRUE 0.995 0.507 1.961 0.05
#> 171 0.428 0.552 TRUE 0.124 0.503 0.246 0.806
#> 172 0.089 0.674 TRUE 0.585 0.494 1.185 0.236
#> 173 0.965 1.035 TRUE 0.071 0.595 0.119 0.905
#> 174 1.066 0.907 TRUE -0.159 0.592 -0.269 0.788
#> 175 -0.716 -1.067 TRUE -0.351 0.491 -0.715 0.475
#> 176 -0.616 -0.563 TRUE 0.053 0.449 0.118 0.906
#> 177 -1.315 -1.225 TRUE 0.090 0.562 0.160 0.872
#> 178 2.129 1.594 TRUE -0.535 0.785 -0.682 0.495
#> 179 -1.033 -0.444 TRUE 0.589 0.477 1.234 0.217
#> 180 -0.131 -0.112 TRUE 0.019 0.438 0.043 0.965
#> 181 1.170 1.801 TRUE 0.631 0.702 0.898 0.369
#> 182 -0.255 0.107 TRUE 0.362 0.444 0.814 0.415
#> 183 0.868 1.534 TRUE 0.666 0.642 1.037 0.3
#> 184 0.256 0.004 TRUE -0.252 0.457 -0.552 0.581
#> 185 -0.412 -0.188 TRUE 0.225 0.437 0.514 0.607
#> 186 0.839 0.206 TRUE -0.633 0.516 -1.228 0.22
#> 187 0.620 0.619 TRUE 0.000 0.524 -0.001 0.999
#> 188 -1.059 -0.626 TRUE 0.433 0.486 0.891 0.373
#> 189 0.581 0.411 TRUE -0.170 0.504 -0.337 0.736
#> 190 1.250 0.537 TRUE -0.713 0.582 -1.224 0.221
#> 191 0.960 1.191 TRUE 0.231 0.611 0.379 0.705
#> 192 -0.095 -0.149 TRUE -0.054 0.438 -0.123 0.902
#> 193 0.644 0.551 TRUE -0.093 0.520 -0.178 0.858
#> 194 0.402 0.515 TRUE 0.113 0.498 0.227 0.82
#> 195 -1.691 -1.895 TRUE -0.204 0.697 -0.293 0.77
#> 196 0.163 0.032 TRUE -0.131 0.453 -0.290 0.772
#> 197 0.319 -0.340 TRUE -0.659 0.457 -1.442 0.149
#> 198 -0.083 -1.046 TRUE -0.963 0.479 -2.013 0.044
#> 199 0.458 0.591 TRUE 0.133 0.508 0.261 0.794
#> 200 -0.592 0.477 TRUE 1.069 0.476 2.247 0.025
#> 201 0.030 0.738 TRUE 0.708 0.498 1.421 0.155
#> 202 -1.209 -0.828 TRUE 0.381 0.514 0.742 0.458
#> 203 -0.377 -0.470 TRUE -0.093 0.438 -0.212 0.832
#> 204 -0.774 -1.180 TRUE -0.405 0.507 -0.799 0.424
#> 205 1.098 0.586 TRUE -0.512 0.568 -0.900 0.368
#> 206 1.839 1.325 TRUE -0.514 0.722 -0.712 0.477
#> 207 -0.740 -0.804 TRUE -0.064 0.470 -0.137 0.891
#> 208 -0.122 -1.140 TRUE -1.018 0.488 -2.087 0.037
#> 209 -1.558 -1.044 TRUE 0.514 0.577 0.891 0.373
#> 210 0.028 -0.247 TRUE -0.275 0.441 -0.625 0.532
#> 211 -0.894 -0.042 TRUE 0.853 0.465 1.832 0.067
#> 212 0.070 -0.304 TRUE -0.374 0.443 -0.845 0.398
#> 213 1.337 1.063 TRUE -0.274 0.637 -0.430 0.667
#> 214 -0.184 -0.227 TRUE -0.043 0.435 -0.100 0.921
#> 215 0.360 0.568 TRUE 0.207 0.499 0.415 0.678
#> 216 -1.895 -2.166 TRUE -0.271 0.764 -0.355 0.723
#> 217 -0.459 -1.052 TRUE -0.593 0.479 -1.237 0.216
#> 218 1.473 -0.359 TRUE -1.832 0.580 -3.160 0.002
#> 219 -1.639 -1.910 TRUE -0.272 0.692 -0.392 0.695
#> 220 1.338 0.883 TRUE -0.454 0.620 -0.733 0.464
#> 221 -1.236 -1.514 TRUE -0.277 0.589 -0.471 0.637
#> 222 1.031 0.849 TRUE -0.182 0.583 -0.312 0.755
#> 223 -0.646 -0.272 TRUE 0.375 0.445 0.843 0.399
#> 224 1.585 1.175 TRUE -0.410 0.676 -0.606 0.545
#> 225 -1.531 -1.306 TRUE 0.224 0.599 0.375 0.708
#> 226 0.488 0.369 TRUE -0.119 0.493 -0.241 0.809
#> 227 1.234 0.951 TRUE -0.283 0.614 -0.461 0.645
#> 228 -0.814 -0.671 TRUE 0.142 0.466 0.305 0.76
#> 229 -1.044 -1.367 TRUE -0.323 0.551 -0.586 0.558
#> 230 0.598 0.404 TRUE -0.194 0.505 -0.383 0.702
#> 231 -0.705 -0.790 TRUE -0.084 0.467 -0.180 0.857
#> 232 0.321 0.672 TRUE 0.350 0.506 0.692 0.489
#> 233 -1.847 -0.524 TRUE 1.323 0.593 2.232 0.026
#> 234 0.172 -0.185 TRUE -0.358 0.448 -0.798 0.425
#> 235 -1.111 -1.514 TRUE -0.403 0.576 -0.698 0.485
#> 236 0.428 0.508 TRUE 0.080 0.499 0.160 0.873
#> 237 1.181 1.232 TRUE 0.051 0.637 0.080 0.937
#> 238 0.675 1.104 TRUE 0.429 0.576 0.746 0.456
#> 239 -0.089 0.055 TRUE 0.143 0.444 0.323 0.747
#> 240 0.829 0.295 TRUE -0.533 0.520 -1.026 0.305
#> 241 0.770 0.270 TRUE -0.499 0.512 -0.975 0.33
#> 242 0.610 -0.230 TRUE -0.840 0.480 -1.748 0.08
#> 243 -1.312 -1.847 TRUE -0.536 0.645 -0.831 0.406
#> 244 0.456 1.146 TRUE 0.690 0.564 1.223 0.221
#> 245 1.801 1.072 TRUE -0.729 0.693 -1.051 0.293
#> 246 -1.454 -0.786 TRUE 0.668 0.543 1.230 0.219
#> 247 0.646 0.337 TRUE -0.309 0.505 -0.613 0.54
#> 248 0.825 0.279 TRUE -0.546 0.518 -1.053 0.292
#> 249 -0.182 -0.055 TRUE 0.127 0.438 0.289 0.773
#> 250 0.201 0.786 TRUE 0.585 0.510 1.146 0.252
#> 251 -0.491 -0.726 TRUE -0.235 0.453 -0.520 0.603
#> 252 1.158 1.530 TRUE 0.372 0.668 0.557 0.578
#> 253 1.699 0.997 TRUE -0.702 0.674 -1.042 0.297
#> 254 -0.566 -0.736 TRUE -0.170 0.456 -0.372 0.71
#> 255 0.790 0.354 TRUE -0.436 0.519 -0.839 0.401
#> 256 -0.476 -0.484 TRUE -0.008 0.441 -0.019 0.985
#> 257 -1.631 -1.697 TRUE -0.066 0.661 -0.100 0.92
#> 258 -0.934 -0.875 TRUE 0.059 0.489 0.120 0.904
#> 259 -0.652 -0.296 TRUE 0.356 0.445 0.800 0.424
#> 260 0.974 0.781 TRUE -0.193 0.571 -0.337 0.736
#> 261 -0.921 -0.609 TRUE 0.313 0.472 0.663 0.507
#> 262 0.174 -1.368 TRUE -1.542 0.526 -2.930 0.003
#> 263 -0.620 -1.043 TRUE -0.423 0.484 -0.875 0.382
#> 264 -0.796 -0.877 TRUE -0.082 0.479 -0.170 0.865
#> 265 0.185 -0.343 TRUE -0.528 0.449 -1.177 0.239
#> 266 0.806 1.342 TRUE 0.536 0.614 0.873 0.383
#> 267 0.372 0.274 TRUE -0.098 0.478 -0.204 0.838
#> 268 0.759 1.052 TRUE 0.293 0.577 0.507 0.612
#> 269 -0.339 -0.323 TRUE 0.016 0.435 0.037 0.971
#> 270 0.004 -0.374 TRUE -0.378 0.441 -0.858 0.391
#> 271 0.754 0.386 TRUE -0.368 0.518 -0.711 0.477
#> 272 -0.541 -0.025 TRUE 0.516 0.444 1.162 0.245
#> 273 -0.445 0.147 TRUE 0.592 0.448 1.321 0.187
#> 274 -1.360 -0.693 TRUE 0.667 0.525 1.271 0.204
#> 275 0.323 -0.057 TRUE -0.381 0.460 -0.828 0.408
#> 276 -0.746 -0.217 TRUE 0.530 0.451 1.174 0.24
#> 277 -0.015 -0.412 TRUE -0.397 0.441 -0.901 0.368
#> 278 0.887 1.024 TRUE 0.137 0.586 0.234 0.815
#> 279 1.250 0.920 TRUE -0.329 0.613 -0.537 0.591
#> 280 -1.504 -1.103 TRUE 0.401 0.574 0.698 0.485
#> 281 -1.455 -1.591 TRUE -0.136 0.624 -0.218 0.827
#> 282 -1.485 -1.905 TRUE -0.420 0.673 -0.624 0.533
#> 283 1.374 1.159 TRUE -0.214 0.650 -0.330 0.741
#> 284 -0.287 0.208 TRUE 0.495 0.450 1.100 0.271
#> 285 -0.849 -0.487 TRUE 0.362 0.461 0.785 0.432
#> 286 -0.072 0.266 TRUE 0.337 0.456 0.741 0.459
#> 287 -1.177 -0.715 TRUE 0.462 0.503 0.918 0.359
#> 288 0.927 1.043 TRUE 0.116 0.592 0.197 0.844
#> 289 -1.492 -1.001 TRUE 0.491 0.564 0.870 0.384
#> 290 1.699 1.801 TRUE 0.101 0.757 0.134 0.894
#> 291 -0.272 -0.121 TRUE 0.151 0.436 0.347 0.729
#> 292 -0.791 -1.043 TRUE -0.252 0.493 -0.511 0.609
#> 293 -1.577 -1.353 TRUE 0.224 0.610 0.367 0.714
#> 294 -0.209 -0.243 TRUE -0.034 0.435 -0.077 0.938
#> 295 -0.420 -0.075 TRUE 0.345 0.439 0.786 0.432
#> 296 -1.182 -1.097 TRUE 0.085 0.534 0.159 0.874
#> 297 -0.530 -0.946 TRUE -0.416 0.471 -0.884 0.377
#> 298 -1.094 -1.068 TRUE 0.026 0.521 0.049 0.961
#> 299 0.378 0.078 TRUE -0.300 0.469 -0.640 0.522
#> 300 1.496 1.105 TRUE -0.390 0.659 -0.592 0.554
#> 301 -0.599 -1.286 TRUE -0.687 0.511 -1.345 0.179
#> 302 0.753 0.659 TRUE -0.094 0.539 -0.174 0.862
#> 303 -0.498 -0.988 TRUE -0.490 0.474 -1.034 0.301
#> 304 0.276 0.415 TRUE 0.139 0.482 0.288 0.773
#> 305 -1.225 -1.375 TRUE -0.149 0.569 -0.262 0.794
#> 306 -0.777 -1.905 TRUE -1.127 0.612 -1.840 0.066
#> 307 -0.463 -0.259 TRUE 0.204 0.437 0.467 0.641
#> 308 -1.176 -0.058 TRUE 1.118 0.493 2.265 0.024
#> 309 -1.679 -1.676 TRUE 0.003 0.665 0.005 0.996
#> 310 0.975 2.129 TRUE 1.154 0.728 1.586 0.113
#> 311 -1.647 -1.119 TRUE 0.528 0.596 0.886 0.376
#> 312 0.611 0.908 TRUE 0.297 0.550 0.541 0.589
#> 313 0.572 0.193 TRUE -0.379 0.490 -0.774 0.439
#> 314 -1.573 -1.292 TRUE 0.281 0.603 0.466 0.641
#> 315 -0.276 -0.083 TRUE 0.193 0.437 0.441 0.659
#> 316 0.080 0.119 TRUE 0.039 0.453 0.086 0.931
#> 317 0.267 0.689 TRUE 0.422 0.504 0.837 0.402
#> 318 0.986 1.211 TRUE 0.225 0.615 0.365 0.715
#> 319 0.998 0.693 TRUE -0.305 0.566 -0.539 0.59
#> 320 2.129 2.129 TRUE 0.000 0.844 0.000 1
#> 321 -1.905 -1.654 TRUE 0.251 0.694 0.361 0.718
#> 322 -0.333 -0.121 TRUE 0.213 0.437 0.487 0.626
#> 323 0.290 0.061 TRUE -0.230 0.462 -0.498 0.618
#> 324 1.140 1.244 TRUE 0.104 0.634 0.164 0.87
#> 325 -1.274 -1.262 TRUE 0.013 0.561 0.022 0.982
#> 326 -1.496 -1.112 TRUE 0.384 0.574 0.669 0.503
#> 327 0.647 0.960 TRUE 0.313 0.558 0.560 0.575
#> 328 0.143 0.501 TRUE 0.358 0.481 0.744 0.457
#> 329 -0.772 -0.858 TRUE -0.086 0.476 -0.180 0.857
#> 330 -0.188 -0.454 TRUE -0.266 0.438 -0.608 0.543
#> 331 -2.166 -2.166 TRUE 0.000 0.801 0.000 1
#> 332 0.879 0.524 TRUE -0.356 0.540 -0.658 0.51
#> 333 -0.712 -1.894 TRUE -1.183 0.607 -1.947 0.052
#> 334 -1.203 -0.892 TRUE 0.310 0.518 0.599 0.549
#> 335 0.617 0.658 TRUE 0.041 0.527 0.078 0.938
#> 336 1.015 0.480 TRUE -0.535 0.551 -0.970 0.332
#> 337 0.776 1.047 TRUE 0.272 0.578 0.470 0.639
#> 338 0.405 -0.074 TRUE -0.480 0.465 -1.031 0.303
#> 339 0.147 -0.374 TRUE -0.520 0.447 -1.164 0.244
#> 340 1.433 1.071 TRUE -0.362 0.648 -0.558 0.577
#> 341 -1.201 -1.895 TRUE -0.695 0.642 -1.082 0.279
#> 342 -0.484 -0.959 TRUE -0.476 0.471 -1.011 0.312
#> 343 0.384 0.620 TRUE 0.235 0.505 0.466 0.642
#> 344 0.543 0.393 TRUE -0.150 0.499 -0.300 0.764
#> 345 1.346 0.806 TRUE -0.540 0.614 -0.879 0.379
#> 346 0.054 0.223 TRUE 0.170 0.457 0.371 0.711
#> 347 -0.969 -1.050 TRUE -0.081 0.508 -0.159 0.874
#> 348 -0.157 -0.499 TRUE -0.342 0.439 -0.778 0.437
#> 349 -0.223 0.094 TRUE 0.317 0.444 0.715 0.474
#> 350 0.121 0.281 TRUE 0.159 0.464 0.343 0.731
#> 351 0.126 -0.361 TRUE -0.486 0.446 -1.091 0.275
#> 352 0.731 1.835 TRUE 1.104 0.670 1.648 0.099
#> 353 -0.675 -1.331 TRUE -0.656 0.520 -1.261 0.207
#> 354 -1.895 -1.769 TRUE 0.127 0.707 0.179 0.858
#> 355 -1.096 -1.905 TRUE -0.809 0.634 -1.276 0.202
#> 356 0.012 -0.464 TRUE -0.476 0.443 -1.075 0.282
#> 357 -1.309 -0.819 TRUE 0.490 0.526 0.933 0.351
#> 358 1.471 1.073 TRUE -0.398 0.653 -0.610 0.542
#> 359 1.238 0.895 TRUE -0.343 0.610 -0.562 0.574
#> 360 -0.049 -0.973 TRUE -0.923 0.472 -1.956 0.051
#> 361 1.160 0.664 TRUE -0.497 0.581 -0.855 0.393
#> 362 0.289 0.947 TRUE 0.658 0.532 1.237 0.216
#> 363 -0.369 -0.440 TRUE -0.070 0.438 -0.161 0.872
#> 364 -0.320 -0.232 TRUE 0.089 0.435 0.204 0.839
#> 365 0.882 0.250 TRUE -0.632 0.523 -1.210 0.226
#> 366 1.565 1.334 TRUE -0.231 0.690 -0.335 0.738
#> 367 -0.891 -0.202 TRUE 0.689 0.462 1.490 0.136
#> 368 1.458 1.075 TRUE -0.383 0.652 -0.588 0.557
#> 369 0.227 -0.162 TRUE -0.389 0.451 -0.863 0.388
#> 370 -0.386 -0.338 TRUE 0.048 0.436 0.110 0.913
#> 371 -0.264 -0.446 TRUE -0.182 0.437 -0.416 0.677
#> 372 0.998 0.473 TRUE -0.525 0.549 -0.956 0.339
#> 373 1.370 0.931 TRUE -0.439 0.628 -0.699 0.485
#> 374 1.770 1.496 TRUE -0.274 0.731 -0.375 0.708
#> 375 -1.065 -1.294 TRUE -0.229 0.543 -0.422 0.673
#> 376 1.075 1.847 TRUE 0.772 0.699 1.104 0.27
#> 377 0.275 -0.225 TRUE -0.500 0.454 -1.102 0.27
#> 378 -0.640 -0.091 TRUE 0.549 0.447 1.230 0.219
#> 379 0.428 0.370 TRUE -0.058 0.489 -0.118 0.906
#> 380 0.264 -0.378 TRUE -0.642 0.454 -1.415 0.157
#> 381 -0.074 0.138 TRUE 0.212 0.448 0.473 0.636
#> 382 -1.335 -1.697 TRUE -0.362 0.625 -0.579 0.562
#> 383 -0.840 -1.183 TRUE -0.343 0.512 -0.669 0.503
#> 384 -1.179 -0.312 TRUE 0.867 0.491 1.765 0.078
#> 385 1.654 2.129 TRUE 0.475 0.791 0.600 0.548
#> 386 0.413 -0.120 TRUE -0.533 0.465 -1.146 0.252
#> 387 -1.682 -1.905 TRUE -0.222 0.697 -0.319 0.75
#> 388 -0.652 -0.707 TRUE -0.055 0.458 -0.121 0.904
#> 389 -1.451 -0.897 TRUE 0.553 0.550 1.006 0.314
#> 390 0.466 0.138 TRUE -0.328 0.478 -0.685 0.493
#> 391 1.222 0.887 TRUE -0.336 0.607 -0.553 0.58
#> 392 0.698 1.342 TRUE 0.644 0.605 1.064 0.287
#> 393 0.719 0.904 TRUE 0.185 0.559 0.331 0.741
#> 394 2.129 0.840 TRUE -1.289 0.717 -1.797 0.072
#> 395 -0.697 -1.644 TRUE -0.947 0.566 -1.671 0.095
#> 396 1.801 1.560 TRUE -0.240 0.741 -0.324 0.746
#> 397 -1.784 -0.242 TRUE 1.542 0.579 2.664 0.008
#> 398 1.366 1.847 TRUE 0.482 0.727 0.663 0.507
#> 399 1.137 1.052 TRUE -0.085 0.614 -0.138 0.89
#> 400 1.104 1.248 TRUE 0.144 0.631 0.228 0.82
#> 401 0.574 0.030 TRUE -0.545 0.483 -1.128 0.259
#> 402 1.227 0.960 TRUE -0.267 0.614 -0.434 0.664
#> 403 -0.167 -0.291 TRUE -0.125 0.436 -0.286 0.775
#> 404 -1.514 -0.735 TRUE 0.778 0.549 1.419 0.156
#> 405 -0.127 -0.139 TRUE -0.011 0.437 -0.026 0.98
#> 406 -1.206 -1.081 TRUE 0.125 0.535 0.234 0.815
#> 407 0.749 0.333 TRUE -0.416 0.514 -0.809 0.419
#> 408 2.129 0.742 TRUE -1.387 0.710 -1.953 0.051
#> 409 -0.046 -0.047 TRUE -0.002 0.442 -0.004 0.997
#> 410 1.062 1.453 TRUE 0.392 0.650 0.603 0.547
#> 411 -1.915 -1.905 TRUE 0.011 0.729 0.015 0.988
#> 412 -0.616 -0.336 TRUE 0.280 0.444 0.631 0.528
#> 413 -0.673 -0.596 TRUE 0.077 0.454 0.169 0.866
#> 414 -0.822 -0.976 TRUE -0.153 0.489 -0.314 0.754
#> 415 2.129 1.457 TRUE -0.672 0.771 -0.872 0.383
#> 416 -0.687 0.128 TRUE 0.815 0.457 1.782 0.075
#> 417 0.971 0.660 TRUE -0.311 0.560 -0.554 0.579
#> 418 0.570 0.073 TRUE -0.497 0.484 -1.026 0.305
#> 419 -0.072 -0.231 TRUE -0.159 0.438 -0.363 0.716
#> 420 0.027 -0.104 TRUE -0.131 0.443 -0.295 0.768
#> 421 -0.631 -1.169 TRUE -0.538 0.498 -1.080 0.28
#> 422 1.246 1.801 TRUE 0.555 0.709 0.782 0.434
#> 423 0.156 0.214 TRUE 0.059 0.461 0.127 0.899
#> 424 -0.840 -1.252 TRUE -0.412 0.520 -0.792 0.428
#> 425 0.354 -0.446 TRUE -0.800 0.461 -1.735 0.083
#> 426 -0.549 -0.265 TRUE 0.284 0.440 0.645 0.519
#> 427 -0.423 -0.449 TRUE -0.026 0.439 -0.060 0.952
#> 428 -0.240 -0.330 TRUE -0.090 0.435 -0.207 0.836
#> 429 -1.221 -0.879 TRUE 0.342 0.519 0.658 0.51
#> 430 -0.247 -0.352 TRUE -0.105 0.435 -0.241 0.81
#> 431 0.764 0.385 TRUE -0.378 0.519 -0.729 0.466
#> 432 0.316 0.277 TRUE -0.039 0.475 -0.081 0.935
#> 433 -0.147 0.432 TRUE 0.579 0.466 1.242 0.214
#> 434 -1.905 -1.256 TRUE 0.649 0.648 1.001 0.317
#> 435 0.142 0.247 TRUE 0.105 0.463 0.227 0.821
#> 436 0.688 0.384 TRUE -0.305 0.512 -0.596 0.551
#> 437 0.339 0.129 TRUE -0.210 0.468 -0.448 0.654
#> 438 -0.363 -0.531 TRUE -0.168 0.440 -0.381 0.703
#> 439 -0.183 -0.244 TRUE -0.061 0.435 -0.141 0.888
#> 440 -0.023 0.362 TRUE 0.386 0.464 0.832 0.406
#> 441 0.259 -0.115 TRUE -0.374 0.454 -0.823 0.41
#> 442 0.121 1.109 TRUE 0.988 0.542 1.824 0.068
#> 443 -0.057 0.508 TRUE 0.565 0.474 1.191 0.234
#> 444 1.248 0.543 TRUE -0.704 0.582 -1.210 0.226
#> 445 -0.023 0.375 TRUE 0.398 0.465 0.857 0.392
#> 446 -0.367 0.817 TRUE 1.184 0.501 2.361 0.018
#> 447 -0.055 -0.071 TRUE -0.016 0.441 -0.037 0.97
#> 448 0.250 0.208 TRUE -0.042 0.466 -0.091 0.928
#> 449 0.732 0.827 TRUE 0.095 0.552 0.172 0.863
#> 450 -0.202 -0.325 TRUE -0.122 0.435 -0.281 0.779
#> 451 1.823 1.560 TRUE -0.263 0.744 -0.353 0.724
#> 452 0.339 0.670 TRUE 0.331 0.507 0.653 0.514
#> 453 -0.719 -0.133 TRUE 0.586 0.450 1.302 0.193
#> 454 -0.701 -0.287 TRUE 0.414 0.448 0.923 0.356
#> 455 -0.551 -0.327 TRUE 0.224 0.441 0.509 0.611
#> 456 -0.776 -0.771 TRUE 0.005 0.470 0.010 0.992
#> 457 0.818 0.068 TRUE -0.750 0.508 -1.477 0.14
#> 458 0.457 0.376 TRUE -0.081 0.491 -0.165 0.869
#> 459 -0.178 -0.229 TRUE -0.051 0.436 -0.117 0.907
#> 460 -1.166 -0.367 TRUE 0.799 0.490 1.630 0.103
#> 461 0.145 0.185 TRUE 0.039 0.459 0.086 0.932
#> 462 -0.166 -0.231 TRUE -0.065 0.436 -0.149 0.882
#> 463 1.555 1.578 TRUE 0.023 0.715 0.033 0.974
#> 464 -0.747 -0.189 TRUE 0.558 0.451 1.236 0.216
#> 465 -0.762 0.125 TRUE 0.888 0.462 1.923 0.054
#> 466 0.913 1.121 TRUE 0.208 0.599 0.348 0.728
#> 467 1.225 0.913 TRUE -0.312 0.610 -0.511 0.609
#> 468 -0.396 -0.493 TRUE -0.096 0.439 -0.219 0.826
#> 469 -0.253 0.173 TRUE 0.426 0.448 0.952 0.341
#> 470 -1.181 -1.015 TRUE 0.166 0.526 0.315 0.753
#> 471 -0.375 -0.710 TRUE -0.335 0.449 -0.745 0.456
#> 472 -1.567 -1.248 TRUE 0.319 0.597 0.534 0.594
#> 473 1.320 0.893 TRUE -0.426 0.619 -0.689 0.491
#> 474 -0.023 -0.078 TRUE -0.055 0.441 -0.125 0.901
#> 475 1.351 0.793 TRUE -0.558 0.614 -0.909 0.364
#> 476 -0.409 -0.550 TRUE -0.141 0.442 -0.319 0.75
#> 477 1.278 1.346 TRUE 0.068 0.659 0.103 0.918
#> 478 -0.654 -0.690 TRUE -0.035 0.457 -0.078 0.938
#> 479 0.421 0.334 TRUE -0.088 0.486 -0.180 0.857
#> 480 -0.149 -0.140 TRUE 0.009 0.437 0.020 0.984
#> 481 0.194 0.144 TRUE -0.051 0.460 -0.110 0.912
#> 482 1.594 1.565 TRUE -0.028 0.718 -0.039 0.969
#> 483 -0.371 -0.324 TRUE 0.047 0.436 0.108 0.914
#> 484 -0.825 -0.129 TRUE 0.696 0.458 1.520 0.129
#> 485 -1.087 -1.568 TRUE -0.480 0.582 -0.825 0.409
#> 486 -0.840 -0.540 TRUE 0.300 0.462 0.649 0.517
#> 487 1.601 0.863 TRUE -0.738 0.650 -1.135 0.256
#> 488 0.511 1.233 TRUE 0.722 0.578 1.249 0.211
#> 489 0.264 0.465 TRUE 0.200 0.485 0.414 0.679
#> 490 -1.682 -1.679 TRUE 0.003 0.665 0.005 0.996
#> 491 -0.713 -0.796 TRUE -0.083 0.467 -0.177 0.86
#> 492 -0.739 -0.580 TRUE 0.159 0.457 0.347 0.728
#> 493 -0.776 -0.781 TRUE -0.005 0.470 -0.011 0.991
#> 494 -0.246 -0.583 TRUE -0.337 0.442 -0.763 0.446
#> 495 -0.820 -1.368 TRUE -0.548 0.533 -1.027 0.304
#> 496 -0.521 -1.017 TRUE -0.496 0.478 -1.039 0.299
#> 497 -0.892 -0.920 TRUE -0.028 0.490 -0.058 0.954
#> 498 -0.173 0.148 TRUE 0.321 0.447 0.719 0.472
#> 499 1.165 1.287 TRUE 0.121 0.641 0.189 0.85
#> 500 -0.717 -0.893 TRUE -0.176 0.475 -0.371 0.711
#> 501 -1.492 -1.895 TRUE -0.403 0.672 -0.600 0.549
#> 502 1.346 1.426 TRUE 0.080 0.675 0.118 0.906
#> 503 -1.170 -0.269 TRUE 0.901 0.490 1.838 0.066
#> 504 -1.012 -0.942 TRUE 0.069 0.502 0.138 0.89
#> 505 -1.355 -0.675 TRUE 0.680 0.523 1.300 0.194
#> 506 -0.169 0.154 TRUE 0.323 0.447 0.723 0.47
#> 507 1.059 1.532 TRUE 0.473 0.659 0.717 0.473
#> 508 1.024 0.184 TRUE -0.840 0.535 -1.571 0.116
#> 509 -0.913 -1.128 TRUE -0.215 0.511 -0.421 0.674
#> 510 0.308 -0.071 TRUE -0.379 0.459 -0.826 0.409
#> 511 0.490 -0.141 TRUE -0.631 0.471 -1.341 0.18
#> 512 0.224 -0.613 TRUE -0.837 0.459 -1.825 0.068
#> 513 -0.978 -1.067 TRUE -0.089 0.510 -0.174 0.862
#> 514 0.445 0.255 TRUE -0.190 0.483 -0.393 0.694
#> 515 1.546 1.801 TRUE 0.255 0.740 0.344 0.731
#> 516 -1.181 -1.246 TRUE -0.065 0.549 -0.118 0.906
#> 517 -1.910 -1.457 TRUE 0.454 0.671 0.677 0.499
#> 518 -0.102 -0.183 TRUE -0.080 0.437 -0.183 0.855
#> 519 0.521 0.152 TRUE -0.369 0.483 -0.763 0.446
#> 520 0.511 0.525 TRUE 0.013 0.507 0.026 0.979
#> 521 -0.254 -1.117 TRUE -0.863 0.484 -1.783 0.075
#> 522 -1.843 -0.729 TRUE 1.115 0.600 1.858 0.063
#> 523 0.557 0.609 TRUE 0.051 0.518 0.099 0.921
#> 524 -0.656 -1.511 TRUE -0.855 0.544 -1.571 0.116
#> 525 0.947 1.166 TRUE 0.219 0.607 0.360 0.719
#> 526 0.257 -0.207 TRUE -0.464 0.453 -1.025 0.305
#> 527 0.676 -0.180 TRUE -0.857 0.487 -1.758 0.079
#> 528 1.081 1.295 TRUE 0.213 0.634 0.337 0.736
#> 529 -1.330 -0.772 TRUE 0.558 0.525 1.063 0.288
#> 530 -0.388 -0.589 TRUE -0.200 0.443 -0.452 0.651
#> 531 0.476 0.328 TRUE -0.148 0.490 -0.303 0.762
#> 532 -0.555 -1.104 TRUE -0.549 0.488 -1.126 0.26
#> 533 1.585 0.933 TRUE -0.652 0.654 -0.997 0.319
#> 534 0.325 0.013 TRUE -0.311 0.462 -0.674 0.5
#> 535 1.250 0.850 TRUE -0.400 0.607 -0.658 0.51
#> 536 0.234 0.110 TRUE -0.124 0.460 -0.270 0.787
#> 537 0.894 1.500 TRUE 0.606 0.640 0.946 0.344
#> 538 -0.001 0.138 TRUE 0.139 0.450 0.309 0.757
#> 539 -0.148 0.950 TRUE 1.098 0.516 2.128 0.033
#> 540 0.672 0.311 TRUE -0.361 0.505 -0.715 0.475
#> 541 0.947 0.472 TRUE -0.476 0.544 -0.875 0.382
#> 542 0.878 0.863 TRUE -0.015 0.569 -0.027 0.979
#> 543 -1.378 -1.772 TRUE -0.394 0.641 -0.615 0.538
#> 544 -0.621 -1.157 TRUE -0.536 0.496 -1.081 0.28
#> 545 0.196 0.269 TRUE 0.073 0.467 0.156 0.876
#> 546 -1.261 -1.248 TRUE 0.013 0.558 0.024 0.981
#> 547 0.209 -0.155 TRUE -0.363 0.450 -0.807 0.42
#> 548 -1.085 -1.380 TRUE -0.296 0.556 -0.532 0.595
#> 549 0.362 0.137 TRUE -0.225 0.470 -0.478 0.633
#> 550 1.191 0.878 TRUE -0.313 0.603 -0.520 0.603
#> 551 -0.369 0.001 TRUE 0.370 0.440 0.841 0.4
#> 552 0.821 1.655 TRUE 0.834 0.653 1.276 0.202
#> 553 -1.085 -1.256 TRUE -0.170 0.541 -0.315 0.753
#> 554 -0.371 -1.274 TRUE -0.904 0.504 -1.794 0.073
#> 555 0.773 0.990 TRUE 0.216 0.572 0.378 0.705
#> 556 1.594 1.801 TRUE 0.207 0.745 0.278 0.781
#> 557 0.675 1.046 TRUE 0.371 0.570 0.651 0.515
#> 558 -1.786 -1.542 TRUE 0.244 0.662 0.368 0.713
#> 559 0.535 0.491 TRUE -0.044 0.506 -0.087 0.93
#> 560 -0.402 -1.100 TRUE -0.699 0.483 -1.446 0.148
#> 561 -1.784 -1.360 TRUE 0.424 0.641 0.662 0.508
#> 562 1.683 1.841 TRUE 0.158 0.760 0.208 0.835
#> 563 -0.541 -0.928 TRUE -0.387 0.470 -0.823 0.41
#> 564 0.080 -0.358 TRUE -0.438 0.443 -0.988 0.323
#> 565 -0.583 0.032 TRUE 0.615 0.448 1.373 0.17
#> 566 0.343 0.962 TRUE 0.620 0.537 1.155 0.248
#> 567 0.112 0.300 TRUE 0.188 0.465 0.404 0.686
#> 568 -0.204 -0.647 TRUE -0.443 0.445 -0.996 0.319
#> 569 -0.701 -1.156 TRUE -0.454 0.500 -0.908 0.364
#> 570 -1.248 -1.895 TRUE -0.647 0.646 -1.002 0.316
#> 571 1.325 1.801 TRUE 0.475 0.717 0.662 0.508
#> 572 0.422 1.426 TRUE 1.004 0.596 1.684 0.092
#> 573 0.850 0.929 TRUE 0.079 0.573 0.138 0.89
#> 574 1.234 0.074 TRUE -1.161 0.555 -2.091 0.037
#> 575 0.682 0.654 TRUE -0.027 0.532 -0.052 0.959
#> 576 -0.864 -0.410 TRUE 0.454 0.461 0.985 0.325
#> 577 -0.289 -0.532 TRUE -0.243 0.440 -0.553 0.58
#> 578 1.847 0.943 TRUE -0.905 0.688 -1.315 0.189
#> 579 -0.929 -0.509 TRUE 0.421 0.469 0.898 0.369
#> 580 -1.407 -1.149 TRUE 0.258 0.566 0.457 0.648
#> 581 0.780 0.539 TRUE -0.241 0.532 -0.452 0.651
#> 582 -0.234 -0.192 TRUE 0.043 0.435 0.098 0.922
#> 583 -0.405 -0.313 TRUE 0.092 0.436 0.210 0.834
#> 584 1.841 2.129 TRUE 0.288 0.811 0.355 0.723
#> 585 -0.563 -0.788 TRUE -0.225 0.459 -0.490 0.624
#> 586 -1.895 -1.697 TRUE 0.198 0.698 0.284 0.777
#> 587 0.807 0.924 TRUE 0.116 0.568 0.205 0.838
#> 588 1.072 1.160 TRUE 0.088 0.618 0.142 0.887
#> 589 0.025 0.255 TRUE 0.230 0.458 0.501 0.616
#> 590 -0.395 0.007 TRUE 0.402 0.441 0.912 0.362
#> 591 1.025 1.839 TRUE 0.815 0.694 1.174 0.24
#> 592 -0.315 0.217 TRUE 0.533 0.450 1.183 0.237
#> 593 0.489 0.436 TRUE -0.052 0.498 -0.105 0.916
#> 594 1.238 1.159 TRUE -0.079 0.635 -0.125 0.901
#> 595 0.408 0.630 TRUE 0.223 0.508 0.438 0.661
#> 596 -0.243 -0.016 TRUE 0.227 0.439 0.518 0.605
#> 597 -0.966 -1.115 TRUE -0.149 0.514 -0.290 0.772
#> 598 0.199 0.074 TRUE -0.125 0.457 -0.275 0.784
#> 599 0.384 0.313 TRUE -0.071 0.482 -0.147 0.883
#> 600 1.234 1.847 TRUE 0.613 0.714 0.858 0.391
#> 601 -0.984 0.126 TRUE 1.110 0.480 2.314 0.021
#> 602 1.683 1.847 TRUE 0.164 0.760 0.216 0.829
#> 603 -0.543 -0.666 TRUE -0.123 0.451 -0.273 0.785
#> 604 1.578 0.794 TRUE -0.784 0.641 -1.222 0.222
#> 605 -0.200 -0.146 TRUE 0.053 0.436 0.123 0.902
#> 606 0.140 -0.049 TRUE -0.189 0.449 -0.421 0.674
#> 607 -1.063 -0.112 TRUE 0.950 0.480 1.981 0.048
#> 608 -0.106 -0.113 TRUE -0.007 0.438 -0.016 0.987
#> 609 -0.451 -0.829 TRUE -0.379 0.459 -0.825 0.409
#> 610 -0.347 -0.453 TRUE -0.106 0.438 -0.241 0.809
#> 611 0.000 0.614 TRUE 0.613 0.485 1.264 0.206
#> 612 0.163 0.237 TRUE 0.073 0.463 0.158 0.874
#> 613 0.239 0.112 TRUE -0.127 0.461 -0.277 0.782
#> 614 -1.691 -2.166 TRUE -0.475 0.738 -0.644 0.52
#> 615 -1.006 -0.705 TRUE 0.301 0.485 0.622 0.534
#> 616 -1.679 -1.380 TRUE 0.299 0.628 0.476 0.634
#> 617 -0.245 0.434 TRUE 0.679 0.465 1.459 0.145
#> 618 1.520 1.130 TRUE -0.389 0.664 -0.586 0.558
#> 619 0.551 0.958 TRUE 0.407 0.550 0.739 0.46
#> 620 -0.256 -0.417 TRUE -0.161 0.436 -0.369 0.712
#> 621 -0.043 -0.468 TRUE -0.426 0.441 -0.965 0.334
#> 622 -0.030 -0.658 TRUE -0.628 0.449 -1.398 0.162
#> 623 -0.471 -0.519 TRUE -0.048 0.442 -0.110 0.913
#> 624 -0.964 -1.375 TRUE -0.411 0.545 -0.754 0.451
#> 625 -0.242 -0.103 TRUE 0.138 0.437 0.317 0.751
#> 626 0.275 0.096 TRUE -0.179 0.462 -0.386 0.699
#> 627 1.565 1.350 TRUE -0.215 0.692 -0.312 0.755
#> 628 0.411 0.228 TRUE -0.183 0.478 -0.382 0.703
#> 629 0.077 0.704 TRUE 0.626 0.496 1.261 0.207
#> 630 0.615 1.046 TRUE 0.432 0.565 0.764 0.445
#> 631 -0.521 -0.522 TRUE -0.001 0.444 -0.002 0.998
#> 632 0.782 0.622 TRUE -0.161 0.539 -0.298 0.766
#> 633 -0.718 -1.058 TRUE -0.340 0.490 -0.693 0.488
#> 634 1.580 0.575 TRUE -1.005 0.625 -1.606 0.108
#> 635 0.812 0.144 TRUE -0.669 0.510 -1.311 0.19
#> 636 0.800 0.986 TRUE 0.187 0.574 0.325 0.745
#> 637 0.683 2.129 TRUE 1.446 0.706 2.047 0.041
#> 638 0.996 0.654 TRUE -0.342 0.563 -0.607 0.544
#> 639 1.033 0.997 TRUE -0.036 0.598 -0.061 0.952
#> 640 0.208 0.719 TRUE 0.512 0.504 1.015 0.31
#> 641 -0.235 0.024 TRUE 0.260 0.441 0.589 0.556
#> 642 -0.502 0.109 TRUE 0.610 0.448 1.363 0.173
#> 643 1.109 1.546 TRUE 0.437 0.665 0.657 0.511
#> 644 1.282 0.878 TRUE -0.404 0.613 -0.659 0.51
#> 645 -0.160 -0.260 TRUE -0.100 0.436 -0.230 0.818
#> 646 2.129 1.428 TRUE -0.701 0.768 -0.912 0.362
#> 647 0.665 -0.088 TRUE -0.753 0.488 -1.545 0.122
#> 648 0.720 0.697 TRUE -0.023 0.539 -0.042 0.966
#> 649 0.019 -0.782 TRUE -0.801 0.459 -1.746 0.081
#> 650 -0.216 -0.224 TRUE -0.008 0.435 -0.018 0.985
#> 651 0.006 0.215 TRUE 0.209 0.455 0.459 0.646
#> 652 -0.934 -0.900 TRUE 0.034 0.491 0.069 0.945
#> 653 -0.465 -1.017 TRUE -0.552 0.476 -1.160 0.246
#> 654 -0.503 -0.263 TRUE 0.240 0.439 0.547 0.584
#> 655 -0.131 0.142 TRUE 0.273 0.447 0.610 0.542
#> 656 -0.903 -1.092 TRUE -0.189 0.507 -0.373 0.709
#> 657 0.839 0.814 TRUE -0.025 0.561 -0.044 0.965
#> 658 0.161 0.840 TRUE 0.679 0.514 1.321 0.186
#> 659 -0.012 0.738 TRUE 0.750 0.497 1.510 0.131
#> 660 0.168 0.561 TRUE 0.393 0.487 0.806 0.42
#> 661 -0.353 -0.076 TRUE 0.277 0.438 0.633 0.527
#> 662 -0.736 -0.731 TRUE 0.005 0.465 0.011 0.991
#> 663 0.685 -0.227 TRUE -0.912 0.488 -1.870 0.062
#> 664 0.351 0.497 TRUE 0.146 0.493 0.297 0.767
#> 665 0.233 -0.163 TRUE -0.396 0.452 -0.877 0.381
#> 666 -1.407 -1.097 TRUE 0.311 0.561 0.554 0.58
#> 667 -0.051 0.670 TRUE 0.721 0.489 1.475 0.14
#> 668 0.442 1.244 TRUE 0.802 0.575 1.395 0.163
#> 669 -0.569 -0.449 TRUE 0.120 0.443 0.270 0.787
#> 670 0.684 0.608 TRUE -0.076 0.528 -0.145 0.885
#> 671 1.571 1.565 TRUE -0.006 0.716 -0.009 0.993
#> 672 -0.228 0.012 TRUE 0.240 0.440 0.544 0.586
#> 673 0.228 0.760 TRUE 0.533 0.509 1.046 0.295
#> 674 -1.271 -0.646 TRUE 0.625 0.511 1.224 0.221
#> 675 -1.905 -1.389 TRUE 0.516 0.662 0.778 0.436
#> 676 0.805 0.812 TRUE 0.007 0.557 0.012 0.99
#> 677 -1.905 -1.248 TRUE 0.657 0.648 1.014 0.311
#> 678 1.801 0.754 TRUE -1.047 0.667 -1.569 0.117
#> 679 -2.166 -1.329 TRUE 0.837 0.698 1.200 0.23
#> 680 1.475 1.367 TRUE -0.108 0.683 -0.158 0.874
#> 681 -0.348 0.853 TRUE 1.201 0.505 2.379 0.017
#> 682 1.601 1.255 TRUE -0.346 0.686 -0.504 0.614
#> 683 0.036 -0.740 TRUE -0.776 0.456 -1.700 0.089
#> 684 1.262 1.246 TRUE -0.016 0.647 -0.025 0.98
#> 685 -0.387 -0.359 TRUE 0.028 0.436 0.063 0.95
#> 686 -1.351 -1.014 TRUE 0.337 0.546 0.618 0.537
#> 687 0.342 0.598 TRUE 0.256 0.501 0.511 0.609
#> 688 0.376 0.402 TRUE 0.027 0.487 0.055 0.957
#> 689 1.457 1.558 TRUE 0.102 0.702 0.145 0.885
#> 690 -0.054 0.495 TRUE 0.549 0.473 1.161 0.246
#> 691 0.640 0.699 TRUE 0.059 0.532 0.110 0.912
#> 692 0.180 -0.115 TRUE -0.295 0.450 -0.657 0.511
#> 693 -0.179 -0.201 TRUE -0.022 0.436 -0.049 0.961
#> 694 0.587 -0.060 TRUE -0.647 0.481 -1.345 0.179
#> 695 0.779 0.986 TRUE 0.207 0.572 0.362 0.718
#> 696 -0.593 -0.314 TRUE 0.279 0.442 0.630 0.529
#> 697 -0.477 -0.708 TRUE -0.231 0.451 -0.513 0.608
#> 698 0.247 -0.189 TRUE -0.436 0.452 -0.964 0.335
#> 699 -0.485 -0.047 TRUE 0.438 0.441 0.993 0.321
#> 700 0.174 0.204 TRUE 0.030 0.462 0.065 0.949
#> 701 1.208 0.612 TRUE -0.596 0.583 -1.022 0.307
#> 702 0.648 0.373 TRUE -0.275 0.507 -0.543 0.587
#> 703 0.727 1.151 TRUE 0.424 0.585 0.724 0.469
#> 704 0.336 -0.017 TRUE -0.353 0.462 -0.765 0.444
#> 705 -0.886 -0.353 TRUE 0.533 0.462 1.154 0.248
#> 706 -0.306 -0.379 TRUE -0.073 0.436 -0.167 0.867
#> 707 -1.266 -1.409 TRUE -0.143 0.578 -0.248 0.804
#> 708 -0.882 -1.154 TRUE -0.272 0.512 -0.531 0.595
#> 709 -0.034 0.239 TRUE 0.273 0.455 0.600 0.548
#> 710 1.250 0.772 TRUE -0.478 0.600 -0.796 0.426
#> 711 0.446 0.206 TRUE -0.240 0.480 -0.500 0.617
#> 712 -0.056 -0.310 TRUE -0.254 0.438 -0.580 0.562
#> 713 0.954 0.102 TRUE -0.852 0.523 -1.628 0.103
#> 714 0.100 0.041 TRUE -0.060 0.450 -0.133 0.894
#> 715 1.014 0.158 TRUE -0.856 0.532 -1.608 0.108
#> 716 -1.178 -0.798 TRUE 0.380 0.508 0.747 0.455
#> 717 0.318 1.104 TRUE 0.786 0.551 1.427 0.154
#> 718 -1.575 -2.166 TRUE -0.592 0.724 -0.817 0.414
#> 719 -0.671 -1.462 TRUE -0.791 0.538 -1.470 0.142
#> 720 -1.400 -0.599 TRUE 0.801 0.526 1.523 0.128
#> 721 1.170 1.034 TRUE -0.136 0.615 -0.221 0.825
#> 722 -1.784 -1.690 TRUE 0.094 0.681 0.138 0.89
#> 723 1.839 0.824 TRUE -1.015 0.677 -1.498 0.134
#> 724 0.489 -0.430 TRUE -0.918 0.471 -1.948 0.051
#> 725 0.393 2.129 TRUE 1.736 0.689 2.519 0.012
#> 726 -0.935 -1.162 TRUE -0.227 0.517 -0.439 0.661
#> 727 0.603 0.122 TRUE -0.481 0.489 -0.983 0.326
#> 728 -0.881 -1.155 TRUE -0.273 0.512 -0.534 0.593
#> 729 -0.613 -1.195 TRUE -0.583 0.500 -1.165 0.244
#> 730 -0.954 -0.678 TRUE 0.276 0.478 0.578 0.563
#> 731 -1.005 -1.015 TRUE -0.010 0.508 -0.020 0.984
#> 732 -0.643 0.210 TRUE 0.853 0.459 1.857 0.063
#> 733 1.801 1.440 TRUE -0.361 0.729 -0.495 0.621
#> 734 -1.246 -0.533 TRUE 0.713 0.504 1.415 0.157
#> 735 0.676 0.587 TRUE -0.090 0.526 -0.170 0.865
#> 736 0.098 0.342 TRUE 0.244 0.467 0.524 0.601
#> 737 0.428 1.250 TRUE 0.821 0.575 1.430 0.153
#> 738 -0.422 -0.051 TRUE 0.372 0.440 0.845 0.398
#> 739 0.094 -0.722 TRUE -0.816 0.458 -1.783 0.075
#> 740 -0.242 1.200 TRUE 1.442 0.545 2.647 0.008
#> 741 -1.448 -1.380 TRUE 0.068 0.596 0.113 0.91
#> 742 -1.267 -1.577 TRUE -0.310 0.601 -0.517 0.605
#> 743 -0.450 0.206 TRUE 0.656 0.452 1.452 0.147
#> 744 -0.347 -0.807 TRUE -0.460 0.455 -1.010 0.312
#> 745 1.320 2.129 TRUE 0.809 0.758 1.067 0.286
#> 746 0.722 1.228 TRUE 0.507 0.594 0.853 0.393
#> 747 0.443 0.557 TRUE 0.114 0.504 0.227 0.821
#> 748 -1.701 -1.847 TRUE -0.147 0.691 -0.212 0.832
#> 749 0.828 0.386 TRUE -0.442 0.525 -0.841 0.4
#> 750 -0.532 -0.255 TRUE 0.277 0.440 0.630 0.529
#> 751 -0.911 -1.110 TRUE -0.199 0.509 -0.390 0.696
#> 752 1.329 2.129 TRUE 0.800 0.759 1.055 0.291
#> 753 -1.334 -1.462 TRUE -0.128 0.593 -0.216 0.829
#> 754 0.537 0.219 TRUE -0.318 0.488 -0.651 0.515
#> 755 -0.539 -0.304 TRUE 0.235 0.440 0.535 0.593
#> 756 -1.847 -1.565 TRUE 0.283 0.674 0.420 0.675
#> 757 -1.423 -1.341 TRUE 0.083 0.588 0.140 0.888
#> 758 -0.437 -0.570 TRUE -0.132 0.443 -0.299 0.765
#> 759 -0.491 -0.429 TRUE 0.062 0.440 0.141 0.888
#> 760 0.328 0.156 TRUE -0.172 0.469 -0.367 0.713
#> 761 0.784 0.975 TRUE 0.190 0.572 0.333 0.739
#> 762 0.198 0.411 TRUE 0.213 0.477 0.447 0.655
#> 763 -0.334 -0.008 TRUE 0.326 0.440 0.742 0.458
#> 764 1.052 1.237 TRUE 0.186 0.624 0.297 0.766
#> 765 0.266 0.449 TRUE 0.183 0.484 0.378 0.705
#> 766 1.342 1.765 TRUE 0.423 0.714 0.592 0.554
#> 767 0.445 0.159 TRUE -0.286 0.477 -0.599 0.549
#> 768 0.348 0.112 TRUE -0.236 0.468 -0.504 0.614
#> 769 0.348 0.361 TRUE 0.013 0.482 0.028 0.978
#> 770 0.422 0.475 TRUE 0.053 0.496 0.107 0.915
#> 771 -0.152 -0.148 TRUE 0.004 0.437 0.009 0.993
#> 772 -0.731 -0.424 TRUE 0.306 0.451 0.679 0.497
#> 773 0.439 -0.616 TRUE -1.055 0.474 -2.228 0.026
#> 774 -0.384 -0.530 TRUE -0.146 0.441 -0.332 0.74
#> 775 0.409 0.429 TRUE 0.020 0.492 0.041 0.967
#> 776 0.840 0.574 TRUE -0.267 0.540 -0.493 0.622
#> 777 -0.705 -0.628 TRUE 0.078 0.457 0.170 0.865
#> 778 -1.496 -0.634 TRUE 0.862 0.541 1.593 0.111
#> 779 0.094 0.934 TRUE 0.839 0.521 1.612 0.107
#> 780 -0.703 0.435 TRUE 1.138 0.478 2.383 0.017
#> 781 0.084 -0.023 TRUE -0.107 0.447 -0.239 0.811
#> 782 1.257 1.138 TRUE -0.119 0.635 -0.187 0.851
#> 783 2.129 1.654 TRUE -0.475 0.791 -0.600 0.548
#> 784 -0.286 -1.036 TRUE -0.750 0.475 -1.578 0.115
#> 785 1.031 1.432 TRUE 0.401 0.644 0.622 0.534
#> 786 -0.681 -1.297 TRUE -0.616 0.516 -1.194 0.233
#> 787 -0.706 -0.451 TRUE 0.255 0.450 0.566 0.571
#> 788 1.339 0.778 TRUE -0.560 0.611 -0.917 0.359
#> 789 0.194 -0.536 TRUE -0.730 0.454 -1.609 0.108
#> 790 -1.263 -0.929 TRUE 0.335 0.528 0.634 0.526
#> 791 -1.209 -1.375 TRUE -0.166 0.568 -0.292 0.77
#> 792 0.581 1.010 TRUE 0.429 0.558 0.768 0.442
#> 793 -0.239 -0.828 TRUE -0.589 0.457 -1.289 0.197
#> 794 -0.305 -1.065 TRUE -0.760 0.478 -1.588 0.112
#> 795 -0.859 -0.305 TRUE 0.553 0.459 1.206 0.228
#> 796 0.201 0.915 TRUE 0.715 0.524 1.365 0.172
#> 797 0.940 0.894 TRUE -0.047 0.578 -0.081 0.936
#> 798 0.190 0.619 TRUE 0.429 0.494 0.869 0.385
#> 799 -0.585 -0.716 TRUE -0.130 0.456 -0.286 0.775
#> 800 -0.929 -1.380 TRUE -0.451 0.543 -0.831 0.406
#> 801 -1.262 -0.893 TRUE 0.369 0.525 0.703 0.482
#> 802 0.023 0.459 TRUE 0.436 0.473 0.923 0.356
#> 803 -1.082 -1.478 TRUE -0.396 0.569 -0.696 0.486
#> 804 -0.677 0.144 TRUE 0.821 0.457 1.796 0.073
#> 805 -0.048 -0.020 TRUE 0.028 0.442 0.062 0.95
#> 806 0.232 0.164 TRUE -0.068 0.463 -0.147 0.883
#> 807 0.940 1.823 TRUE 0.883 0.685 1.290 0.197
#> 808 0.964 1.801 TRUE 0.836 0.684 1.223 0.221
#> 809 -1.256 -1.784 TRUE -0.528 0.630 -0.838 0.402
#> 810 0.661 0.624 TRUE -0.037 0.528 -0.070 0.945
#> 811 0.878 1.440 TRUE 0.562 0.632 0.889 0.374
#> 812 -1.056 -0.974 TRUE 0.082 0.509 0.161 0.872
#> 813 1.432 1.299 TRUE -0.133 0.671 -0.198 0.843
#> 814 -0.630 -1.057 TRUE -0.427 0.486 -0.879 0.379
#> 815 0.239 -0.082 TRUE -0.322 0.454 -0.709 0.478
#> 816 -0.875 -1.574 TRUE -0.699 0.566 -1.236 0.217
#> 817 -1.327 -1.498 TRUE -0.171 0.597 -0.286 0.775
#> 818 1.467 0.703 TRUE -0.764 0.621 -1.231 0.218
#> 819 -0.162 -0.232 TRUE -0.070 0.436 -0.161 0.872
#> 820 -0.083 -0.298 TRUE -0.215 0.437 -0.493 0.622
#> 821 0.649 1.175 TRUE 0.526 0.582 0.904 0.366
#> 822 -1.099 -1.119 TRUE -0.020 0.527 -0.037 0.97
#> 823 -0.776 -0.513 TRUE 0.263 0.457 0.577 0.564
#> 824 -0.733 -0.424 TRUE 0.310 0.452 0.686 0.493
#> 825 1.401 1.841 TRUE 0.440 0.730 0.603 0.546
#> 826 0.374 0.087 TRUE -0.287 0.469 -0.613 0.54
#> 827 -0.631 -0.527 TRUE 0.104 0.449 0.233 0.816
#> 828 -0.605 -1.037 TRUE -0.431 0.483 -0.894 0.371
#> 829 -1.895 -1.676 TRUE 0.220 0.695 0.316 0.752
#> 830 -0.503 -0.400 TRUE 0.103 0.440 0.234 0.815
#> 831 -0.077 -0.746 TRUE -0.669 0.453 -1.476 0.14
#> 832 0.115 -0.235 TRUE -0.350 0.445 -0.788 0.431
#> 833 0.615 1.440 TRUE 0.824 0.611 1.350 0.177
#> 834 -1.083 -1.345 TRUE -0.261 0.551 -0.474 0.636
#> 835 -0.605 0.084 TRUE 0.689 0.451 1.528 0.126
#> 836 1.006 0.103 TRUE -0.903 0.529 -1.707 0.088
#> 837 0.166 0.362 TRUE 0.196 0.472 0.415 0.678
#> 838 -0.148 -0.029 TRUE 0.118 0.440 0.269 0.788
#> 839 1.062 0.745 TRUE -0.318 0.577 -0.550 0.582
#> 840 1.823 0.370 TRUE -1.453 0.645 -2.252 0.024
#> 841 -0.887 -0.724 TRUE 0.163 0.475 0.343 0.731
#> 842 -0.527 -0.951 TRUE -0.424 0.471 -0.899 0.369
#> 843 -0.545 -0.373 TRUE 0.173 0.441 0.391 0.695
#> 844 -0.213 -0.622 TRUE -0.409 0.444 -0.922 0.357
#> 845 1.326 1.835 TRUE 0.508 0.721 0.705 0.481
#> 846 0.221 0.614 TRUE 0.393 0.495 0.794 0.427
#> 847 -0.171 -0.111 TRUE 0.059 0.437 0.136 0.892
#> 848 1.823 1.801 TRUE -0.023 0.771 -0.029 0.977
#> 849 -0.547 -0.204 TRUE 0.344 0.441 0.780 0.435
#> 850 1.423 1.233 TRUE -0.189 0.663 -0.286 0.775
#> 851 0.116 0.295 TRUE 0.179 0.464 0.386 0.7
#> 852 0.851 1.299 TRUE 0.448 0.613 0.731 0.465
#> 853 -0.160 -0.288 TRUE -0.128 0.436 -0.294 0.769
#> 854 -0.251 -0.950 TRUE -0.699 0.467 -1.497 0.134
#> 855 0.567 0.455 TRUE -0.113 0.506 -0.223 0.824
#> 856 0.319 0.886 TRUE 0.567 0.527 1.075 0.282
#> 857 -0.613 0.113 TRUE 0.726 0.453 1.604 0.109
#> 858 -0.544 -0.369 TRUE 0.174 0.441 0.396 0.692
#> 859 -1.458 -1.910 TRUE -0.452 0.671 -0.674 0.501
#> 860 -0.518 -1.360 TRUE -0.842 0.518 -1.626 0.104
#> 861 1.440 0.978 TRUE -0.462 0.640 -0.721 0.471
#> 862 0.674 1.247 TRUE 0.573 0.592 0.968 0.333
#> 863 -0.894 -0.839 TRUE 0.055 0.483 0.113 0.91
#> 864 0.260 -0.108 TRUE -0.368 0.454 -0.810 0.418
#> 865 0.549 0.435 TRUE -0.114 0.503 -0.227 0.82
#> 866 0.763 0.592 TRUE -0.171 0.534 -0.320 0.749
#> 867 0.309 0.675 TRUE 0.366 0.506 0.723 0.469
#> 868 0.128 -0.278 TRUE -0.406 0.445 -0.912 0.362
#> 869 0.236 0.637 TRUE 0.401 0.498 0.805 0.421
#> 870 -1.463 -1.654 TRUE -0.191 0.634 -0.301 0.763
#> 871 0.955 0.864 TRUE -0.091 0.577 -0.157 0.875
#> 872 1.823 1.500 TRUE -0.324 0.738 -0.439 0.661
#> 873 -1.498 -1.139 TRUE 0.359 0.577 0.622 0.534
#> 874 0.178 0.268 TRUE 0.090 0.466 0.194 0.846
#> 875 1.046 1.295 TRUE 0.248 0.630 0.394 0.694
#> 876 0.676 0.768 TRUE 0.092 0.542 0.170 0.865
#> 877 -1.352 -1.905 TRUE -0.552 0.658 -0.839 0.402
#> 878 0.219 1.565 TRUE 1.346 0.603 2.231 0.026
#> 879 1.061 0.739 TRUE -0.322 0.577 -0.559 0.576
#> 880 0.321 1.126 TRUE 0.805 0.554 1.455 0.146
#> 881 -1.000 -0.639 TRUE 0.360 0.481 0.750 0.453
#> 882 -0.360 -0.822 TRUE -0.462 0.457 -1.012 0.312
#> 883 1.823 1.216 TRUE -0.608 0.709 -0.857 0.392
#> 884 0.237 -0.326 TRUE -0.563 0.452 -1.246 0.213
#> 885 -2.166 -1.784 TRUE 0.383 0.749 0.511 0.61
#> 886 -0.252 -0.411 TRUE -0.158 0.436 -0.363 0.716
#> 887 1.765 1.601 TRUE -0.165 0.742 -0.222 0.824
#> 888 0.469 0.348 TRUE -0.121 0.490 -0.246 0.806
#> 889 1.060 0.041 TRUE -1.019 0.533 -1.911 0.056
#> 890 0.787 0.669 TRUE -0.118 0.543 -0.217 0.828
#> 891 0.109 0.029 TRUE -0.080 0.450 -0.178 0.859
#> 892 0.196 0.209 TRUE 0.013 0.463 0.028 0.978
#> 893 0.019 -0.467 TRUE -0.486 0.443 -1.097 0.273
#> 894 0.319 0.356 TRUE 0.037 0.480 0.076 0.939
#> 895 0.224 0.156 TRUE -0.068 0.462 -0.146 0.884
#> 896 1.068 0.962 TRUE -0.106 0.598 -0.177 0.86
#> 897 1.035 0.338 TRUE -0.697 0.544 -1.281 0.2
#> 898 0.219 -0.191 TRUE -0.410 0.451 -0.909 0.363
#> 899 -0.711 -0.053 TRUE 0.658 0.452 1.457 0.145
#> 900 -1.177 -0.969 TRUE 0.209 0.521 0.400 0.689
#> 901 -1.127 -0.769 TRUE 0.358 0.501 0.715 0.475
#> 902 -1.264 -0.487 TRUE 0.777 0.504 1.541 0.123
#> 903 0.957 0.770 TRUE -0.186 0.568 -0.327 0.743
#> 904 -1.204 -1.223 TRUE -0.019 0.549 -0.035 0.972
#> 905 0.756 1.015 TRUE 0.259 0.573 0.451 0.652
#> 906 1.025 0.804 TRUE -0.221 0.579 -0.382 0.702
#> 907 0.469 0.043 TRUE -0.426 0.474 -0.899 0.369
#> 908 -0.767 -0.519 TRUE 0.247 0.456 0.542 0.588
#> 909 -1.259 -1.124 TRUE 0.135 0.545 0.248 0.804
#> 910 -0.613 0.542 TRUE 1.155 0.482 2.397 0.017
#> 911 0.786 -0.211 TRUE -0.998 0.498 -2.004 0.045
#> 912 -1.048 -1.166 TRUE -0.118 0.527 -0.225 0.822
#> 913 -1.240 -0.913 TRUE 0.327 0.524 0.623 0.533
#> 914 -0.009 0.103 TRUE 0.112 0.448 0.249 0.803
#> 915 1.131 1.140 TRUE 0.009 0.622 0.014 0.988
#> 916 -0.479 -0.361 TRUE 0.118 0.438 0.269 0.788
#> 917 0.447 1.471 TRUE 1.024 0.603 1.698 0.089
#> 918 -0.101 -0.369 TRUE -0.268 0.437 -0.613 0.54
#> 919 -0.673 -1.138 TRUE -0.465 0.497 -0.935 0.35
#> 920 1.401 2.129 TRUE 0.728 0.766 0.951 0.342
#> 921 -0.783 -0.902 TRUE -0.118 0.480 -0.247 0.805
#> 922 1.496 0.986 TRUE -0.510 0.648 -0.786 0.432
#> 923 0.287 0.125 TRUE -0.161 0.464 -0.347 0.729
#> 924 0.278 0.011 TRUE -0.266 0.459 -0.581 0.562
#> 925 1.558 0.586 TRUE -0.972 0.623 -1.560 0.119
#> 926 -0.758 -0.219 TRUE 0.539 0.452 1.193 0.233
#> 927 -0.196 -0.313 TRUE -0.117 0.435 -0.268 0.789
#> 928 -0.696 -0.161 TRUE 0.535 0.448 1.194 0.233
#> 929 -0.345 0.120 TRUE 0.464 0.445 1.043 0.297
#> 930 0.240 0.307 TRUE 0.067 0.472 0.143 0.886
#> 931 -0.772 -0.328 TRUE 0.444 0.453 0.980 0.327
#> 932 0.060 0.998 TRUE 0.938 0.527 1.781 0.075
#> 933 -0.069 0.146 TRUE 0.215 0.449 0.479 0.632
#> 934 -1.905 -1.644 TRUE 0.261 0.692 0.376 0.707
#> 935 1.277 1.565 TRUE 0.288 0.684 0.421 0.673
#> 936 -1.211 -0.872 TRUE 0.339 0.517 0.655 0.513
#> 937 -0.308 -0.840 TRUE -0.532 0.458 -1.163 0.245
#> 938 1.297 0.487 TRUE -0.809 0.584 -1.386 0.166
#> 939 -0.899 -1.072 TRUE -0.173 0.504 -0.343 0.732
#> 940 -1.492 -1.265 TRUE 0.227 0.589 0.386 0.7
#> 941 1.801 1.118 TRUE -0.683 0.697 -0.979 0.328
#> 942 -0.671 -0.728 TRUE -0.057 0.461 -0.123 0.902
#> 943 0.536 1.839 TRUE 1.303 0.657 1.984 0.047
#> 944 0.893 1.068 TRUE 0.175 0.591 0.296 0.767
#> 945 1.654 0.921 TRUE -0.733 0.662 -1.108 0.268
#> 946 -0.675 -0.349 TRUE 0.326 0.447 0.730 0.465
#> 947 1.459 0.735 TRUE -0.724 0.622 -1.165 0.244
#> 948 -0.499 -0.505 TRUE -0.005 0.442 -0.012 0.99
#> 949 0.955 0.843 TRUE -0.112 0.575 -0.195 0.845
#> 950 -0.196 -0.053 TRUE 0.143 0.438 0.327 0.744
#> 951 0.784 1.558 TRUE 0.775 0.638 1.214 0.225
#> 952 0.156 0.744 TRUE 0.588 0.504 1.167 0.243
#> 953 0.509 0.763 TRUE 0.253 0.528 0.480 0.631
#> 954 1.170 0.840 TRUE -0.330 0.597 -0.552 0.581
#> 955 -0.099 -0.707 TRUE -0.608 0.450 -1.350 0.177
#> 956 0.489 1.546 TRUE 1.057 0.615 1.717 0.086
#> 957 -0.050 0.441 TRUE 0.491 0.469 1.048 0.295
#> 958 -1.097 -0.527 TRUE 0.570 0.486 1.172 0.241
#> 959 -0.736 -0.596 TRUE 0.140 0.457 0.305 0.76
#> 960 -0.311 -0.414 TRUE -0.103 0.436 -0.236 0.813
#> 961 0.733 0.875 TRUE 0.142 0.557 0.255 0.799
#> 962 0.546 0.580 TRUE 0.034 0.514 0.067 0.947
#> 963 0.153 0.219 TRUE 0.065 0.462 0.141 0.887
#> 964 -0.369 -0.461 TRUE -0.093 0.438 -0.211 0.833
#> 965 -0.373 -0.417 TRUE -0.044 0.437 -0.101 0.92
#> 966 0.393 -0.405 TRUE -0.798 0.463 -1.722 0.085
#> 967 0.449 -0.063 TRUE -0.512 0.469 -1.092 0.275
#> 968 -0.603 -0.283 TRUE 0.320 0.443 0.723 0.47
#> 969 -0.073 0.155 TRUE 0.227 0.449 0.506 0.613
#> 970 -0.065 0.322 TRUE 0.387 0.460 0.841 0.4
#> 971 -0.105 -0.177 TRUE -0.072 0.437 -0.165 0.869
#> 972 -0.835 -1.052 TRUE -0.216 0.497 -0.435 0.664
#> 973 0.911 0.487 TRUE -0.424 0.541 -0.783 0.433
#> 974 -0.695 -0.864 TRUE -0.169 0.472 -0.357 0.721
#> 975 -0.856 -0.614 TRUE 0.243 0.467 0.520 0.603
#> 976 0.803 0.295 TRUE -0.508 0.517 -0.983 0.326
#> 977 0.094 -0.295 TRUE -0.388 0.444 -0.875 0.382
#> 978 0.766 0.207 TRUE -0.560 0.509 -1.101 0.271
#> 979 0.281 0.247 TRUE -0.033 0.471 -0.071 0.944
#> 980 -0.314 -0.703 TRUE -0.389 0.448 -0.868 0.386
#> 981 -0.143 0.269 TRUE 0.412 0.454 0.906 0.365
#> 982 1.012 0.821 TRUE -0.191 0.579 -0.330 0.741
#> 983 -0.150 -0.042 TRUE 0.108 0.439 0.246 0.806
#> 984 -1.574 -1.421 TRUE 0.154 0.618 0.249 0.803
#> 985 1.015 0.265 TRUE -0.750 0.538 -1.395 0.163
#> 986 1.585 0.470 TRUE -1.115 0.619 -1.801 0.072
#> 987 0.030 0.310 TRUE 0.280 0.462 0.606 0.545
#> 988 2.129 2.129 TRUE 0.000 0.844 0.000 1
#> 989 0.263 0.373 TRUE 0.111 0.478 0.231 0.817
#> 990 -0.083 0.032 TRUE 0.115 0.443 0.259 0.796
#> 991 -0.715 -0.585 TRUE 0.130 0.456 0.285 0.776
#> 992 -0.978 -1.461 TRUE -0.483 0.557 -0.867 0.386
#> 993 -0.128 -0.407 TRUE -0.278 0.437 -0.636 0.524
#> 994 0.302 0.244 TRUE -0.058 0.472 -0.123 0.902
#> 995 -0.771 -0.807 TRUE -0.036 0.472 -0.076 0.94
#> 996 0.976 1.654 TRUE 0.679 0.666 1.018 0.308
#> 997 -0.941 -0.643 TRUE 0.298 0.475 0.627 0.53
#> 998 -0.396 -0.396 TRUE 0.000 0.437 0.000 1
#> 999 0.522 -0.012 TRUE -0.534 0.477 -1.120 0.263
#> 1000 -0.864 -0.608 TRUE 0.255 0.467 0.547 0.585
# single response pattern change using EAP information
RCI(mod, predat=dat_pre[1,], postdat=dat_post[1,])
#> pre.score post.score converged diff SEM z p
#> 1 -0.357 -1.747 TRUE -1.391 0.573 -2.426 0.015
# WLE estimator with Fisher information for SE (see Jabrayilov et al. 2016)
RCI(mod, predat = dat_pre[1,], postdat = dat_post[1,],
method = 'WLE', Fisher = TRUE)
#> pre.score post.score converged diff SEM z p
#> 1 -0.378 -2.021 TRUE -1.643 0.726 -2.264 0.024
# multiple respondents
RCI(mod, predat = dat_pre[1:6,], postdat = dat_post[1:6,])
#> pre.score post.score converged diff SEM z p
#> 1 -0.357 -1.747 TRUE -1.391 0.573 -2.426 0.015
#> 2 0.877 -0.225 TRUE -1.102 0.507 -2.171 0.03
#> 3 -0.346 -2.166 TRUE -1.820 0.645 -2.823 0.005
#> 4 -1.691 -0.789 TRUE 0.902 0.578 1.560 0.119
#> 5 -0.172 -0.175 TRUE -0.004 0.436 -0.008 0.993
#> 6 -0.120 -0.221 TRUE -0.100 0.437 -0.230 0.818
# include large-sample z-type cutoffs
RCI(mod, predat = dat_pre[1:6,], postdat = dat_post[1:6,],
cutoffs = c(-1.96, 1.96))
#> pre.score post.score converged diff SEM z p cut_decision
#> 1 -0.357 -1.747 TRUE -1.391 0.573 -2.426 0.015 decreased
#> 2 0.877 -0.225 TRUE -1.102 0.507 -2.171 0.03 decreased
#> 3 -0.346 -2.166 TRUE -1.820 0.645 -2.823 0.005 decreased
#> 4 -1.691 -0.789 TRUE 0.902 0.578 1.560 0.119 unchanged
#> 5 -0.172 -0.175 TRUE -0.004 0.436 -0.008 0.993 unchanged
#> 6 -0.120 -0.221 TRUE -0.100 0.437 -0.230 0.818 unchanged
######
# CTT version by omitting IRT model
# Requires either sample or population SEM's as input
(istats <- itemstats(dat_pre)$overall)
#> N mean_total.score sd_total.score ave.r sd.r alpha SEM.alpha
#> 1000 10.356 5.006 0.233 0.075 0.86 1.875
SEM.alpha <- istats$SEM.alpha # SEM estimate of dat_pre
# assumes SEM.post = SEM.pre
RCI(predat = dat_pre, postdat = dat_post, SEM.pre=SEM.alpha)
#> pre.score post.score diff SEM z p
#> 1 7 1 -6 2.652 -2.263 0.024
#> 2 16 9 -7 2.652 -2.640 0.008
#> 3 8 0 -8 2.652 -3.017 0.003
#> 4 2 6 4 2.652 1.508 0.131
#> 5 10 10 0 2.652 0.000 1
#> 6 10 10 0 2.652 0.000 1
#> 7 9 10 1 2.652 0.377 0.706
#> 8 16 19 3 2.652 1.131 0.258
#> 9 6 4 -2 2.652 -0.754 0.451
#> 10 12 11 -1 2.652 -0.377 0.706
#> 11 5 8 3 2.652 1.131 0.258
#> 12 15 15 0 2.652 0.000 1
#> 13 7 9 2 2.652 0.754 0.451
#> 14 8 13 5 2.652 1.885 0.059
#> 15 2 4 2 2.652 0.754 0.451
#> 16 2 2 0 2.652 0.000 1
#> 17 18 19 1 2.652 0.377 0.706
#> 18 14 17 3 2.652 1.131 0.258
#> 19 3 4 1 2.652 0.377 0.706
#> 20 9 9 0 2.652 0.000 1
#> 21 5 5 0 2.652 0.000 1
#> 22 3 8 5 2.652 1.885 0.059
#> 23 9 7 -2 2.652 -0.754 0.451
#> 24 15 13 -2 2.652 -0.754 0.451
#> 25 11 12 1 2.652 0.377 0.706
#> 26 10 11 1 2.652 0.377 0.706
#> 27 1 0 -1 2.652 -0.377 0.706
#> 28 11 8 -3 2.652 -1.131 0.258
#> 29 1 3 2 2.652 0.754 0.451
#> 30 9 14 5 2.652 1.885 0.059
#> 31 19 18 -1 2.652 -0.377 0.706
#> 32 14 13 -1 2.652 -0.377 0.706
#> 33 17 19 2 2.652 0.754 0.451
#> 34 10 9 -1 2.652 -0.377 0.706
#> 35 9 10 1 2.652 0.377 0.706
#> 36 14 18 4 2.652 1.508 0.131
#> 37 9 10 1 2.652 0.377 0.706
#> 38 1 1 0 2.652 0.000 1
#> 39 15 12 -3 2.652 -1.131 0.258
#> 40 11 10 -1 2.652 -0.377 0.706
#> 41 17 13 -4 2.652 -1.508 0.131
#> 42 14 15 1 2.652 0.377 0.706
#> 43 4 2 -2 2.652 -0.754 0.451
#> 44 10 9 -1 2.652 -0.377 0.706
#> 45 6 5 -1 2.652 -0.377 0.706
#> 46 8 4 -4 2.652 -1.508 0.131
#> 47 14 15 1 2.652 0.377 0.706
#> 48 6 6 0 2.652 0.000 1
#> 49 5 3 -2 2.652 -0.754 0.451
#> 50 17 16 -1 2.652 -0.377 0.706
#> 51 1 0 -1 2.652 -0.377 0.706
#> 52 1 2 1 2.652 0.377 0.706
#> 53 12 5 -7 2.652 -2.640 0.008
#> 54 6 4 -2 2.652 -0.754 0.451
#> 55 4 3 -1 2.652 -0.377 0.706
#> 56 14 15 1 2.652 0.377 0.706
#> 57 6 8 2 2.652 0.754 0.451
#> 58 11 13 2 2.652 0.754 0.451
#> 59 6 4 -2 2.652 -0.754 0.451
#> 60 7 10 3 2.652 1.131 0.258
#> 61 2 3 1 2.652 0.377 0.706
#> 62 10 13 3 2.652 1.131 0.258
#> 63 3 4 1 2.652 0.377 0.706
#> 64 16 17 1 2.652 0.377 0.706
#> 65 13 13 0 2.652 0.000 1
#> 66 5 7 2 2.652 0.754 0.451
#> 67 9 10 1 2.652 0.377 0.706
#> 68 10 8 -2 2.652 -0.754 0.451
#> 69 7 3 -4 2.652 -1.508 0.131
#> 70 15 14 -1 2.652 -0.377 0.706
#> 71 17 17 0 2.652 0.000 1
#> 72 7 5 -2 2.652 -0.754 0.451
#> 73 17 15 -2 2.652 -0.754 0.451
#> 74 18 16 -2 2.652 -0.754 0.451
#> 75 15 16 1 2.652 0.377 0.706
#> 76 5 4 -1 2.652 -0.377 0.706
#> 77 11 15 4 2.652 1.508 0.131
#> 78 9 12 3 2.652 1.131 0.258
#> 79 17 15 -2 2.652 -0.754 0.451
#> 80 17 14 -3 2.652 -1.131 0.258
#> 81 3 3 0 2.652 0.000 1
#> 82 9 7 -2 2.652 -0.754 0.451
#> 83 12 13 1 2.652 0.377 0.706
#> 84 5 12 7 2.652 2.640 0.008
#> 85 7 6 -1 2.652 -0.377 0.706
#> 86 11 8 -3 2.652 -1.131 0.258
#> 87 9 9 0 2.652 0.000 1
#> 88 3 5 2 2.652 0.754 0.451
#> 89 17 19 2 2.652 0.754 0.451
#> 90 15 16 1 2.652 0.377 0.706
#> 91 12 13 1 2.652 0.377 0.706
#> 92 12 13 1 2.652 0.377 0.706
#> 93 12 15 3 2.652 1.131 0.258
#> 94 12 17 5 2.652 1.885 0.059
#> 95 14 13 -1 2.652 -0.377 0.706
#> 96 12 14 2 2.652 0.754 0.451
#> 97 11 14 3 2.652 1.131 0.258
#> 98 5 4 -1 2.652 -0.377 0.706
#> 99 7 12 5 2.652 1.885 0.059
#> 100 12 14 2 2.652 0.754 0.451
#> 101 15 19 4 2.652 1.508 0.131
#> 102 9 12 3 2.652 1.131 0.258
#> 103 13 9 -4 2.652 -1.508 0.131
#> 104 3 3 0 2.652 0.000 1
#> 105 5 5 0 2.652 0.000 1
#> 106 7 3 -4 2.652 -1.508 0.131
#> 107 4 3 -1 2.652 -0.377 0.706
#> 108 3 2 -1 2.652 -0.377 0.706
#> 109 8 10 2 2.652 0.754 0.451
#> 110 9 10 1 2.652 0.377 0.706
#> 111 17 15 -2 2.652 -0.754 0.451
#> 112 19 19 0 2.652 0.000 1
#> 113 16 14 -2 2.652 -0.754 0.451
#> 114 15 14 -1 2.652 -0.377 0.706
#> 115 12 10 -2 2.652 -0.754 0.451
#> 116 4 8 4 2.652 1.508 0.131
#> 117 8 8 0 2.652 0.000 1
#> 118 13 11 -2 2.652 -0.754 0.451
#> 119 14 15 1 2.652 0.377 0.706
#> 120 1 3 2 2.652 0.754 0.451
#> 121 7 7 0 2.652 0.000 1
#> 122 3 1 -2 2.652 -0.754 0.451
#> 123 17 16 -1 2.652 -0.377 0.706
#> 124 13 13 0 2.652 0.000 1
#> 125 9 13 4 2.652 1.508 0.131
#> 126 18 16 -2 2.652 -0.754 0.451
#> 127 2 3 1 2.652 0.377 0.706
#> 128 11 17 6 2.652 2.263 0.024
#> 129 15 10 -5 2.652 -1.885 0.059
#> 130 17 15 -2 2.652 -0.754 0.451
#> 131 15 16 1 2.652 0.377 0.706
#> 132 13 8 -5 2.652 -1.885 0.059
#> 133 15 14 -1 2.652 -0.377 0.706
#> 134 4 2 -2 2.652 -0.754 0.451
#> 135 6 6 0 2.652 0.000 1
#> 136 14 17 3 2.652 1.131 0.258
#> 137 11 10 -1 2.652 -0.377 0.706
#> 138 19 17 -2 2.652 -0.754 0.451
#> 139 9 8 -1 2.652 -0.377 0.706
#> 140 17 16 -1 2.652 -0.377 0.706
#> 141 7 3 -4 2.652 -1.508 0.131
#> 142 1 0 -1 2.652 -0.377 0.706
#> 143 12 7 -5 2.652 -1.885 0.059
#> 144 18 18 0 2.652 0.000 1
#> 145 11 9 -2 2.652 -0.754 0.451
#> 146 1 4 3 2.652 1.131 0.258
#> 147 13 18 5 2.652 1.885 0.059
#> 148 13 12 -1 2.652 -0.377 0.706
#> 149 19 14 -5 2.652 -1.885 0.059
#> 150 17 12 -5 2.652 -1.885 0.059
#> 151 17 19 2 2.652 0.754 0.451
#> 152 10 7 -3 2.652 -1.131 0.258
#> 153 10 10 0 2.652 0.000 1
#> 154 5 5 0 2.652 0.000 1
#> 155 11 7 -4 2.652 -1.508 0.131
#> 156 13 10 -3 2.652 -1.131 0.258
#> 157 5 5 0 2.652 0.000 1
#> 158 7 6 -1 2.652 -0.377 0.706
#> 159 7 7 0 2.652 0.000 1
#> 160 4 4 0 2.652 0.000 1
#> 161 6 8 2 2.652 0.754 0.451
#> 162 17 12 -5 2.652 -1.885 0.059
#> 163 8 9 1 2.652 0.377 0.706
#> 164 17 16 -1 2.652 -0.377 0.706
#> 165 14 14 0 2.652 0.000 1
#> 166 10 7 -3 2.652 -1.131 0.258
#> 167 6 9 3 2.652 1.131 0.258
#> 168 3 5 2 2.652 0.754 0.451
#> 169 4 3 -1 2.652 -0.377 0.706
#> 170 9 15 6 2.652 2.263 0.024
#> 171 13 13 0 2.652 0.000 1
#> 172 10 14 4 2.652 1.508 0.131
#> 173 17 16 -1 2.652 -0.377 0.706
#> 174 16 15 -1 2.652 -0.377 0.706
#> 175 6 4 -2 2.652 -0.754 0.451
#> 176 6 7 1 2.652 0.377 0.706
#> 177 3 4 1 2.652 0.377 0.706
#> 178 20 18 -2 2.652 -0.754 0.451
#> 179 4 8 4 2.652 1.508 0.131
#> 180 11 9 -2 2.652 -0.754 0.451
#> 181 16 19 3 2.652 1.131 0.258
#> 182 10 12 2 2.652 0.754 0.451
#> 183 15 18 3 2.652 1.131 0.258
#> 184 11 11 0 2.652 0.000 1
#> 185 9 9 0 2.652 0.000 1
#> 186 15 12 -3 2.652 -1.131 0.258
#> 187 14 14 0 2.652 0.000 1
#> 188 4 6 2 2.652 0.754 0.451
#> 189 14 12 -2 2.652 -0.754 0.451
#> 190 17 15 -2 2.652 -0.754 0.451
#> 191 16 17 1 2.652 0.377 0.706
#> 192 9 10 1 2.652 0.377 0.706
#> 193 15 14 -1 2.652 -0.377 0.706
#> 194 13 13 0 2.652 0.000 1
#> 195 2 1 -1 2.652 -0.377 0.706
#> 196 11 11 0 2.652 0.000 1
#> 197 12 8 -4 2.652 -1.508 0.131
#> 198 10 4 -6 2.652 -2.263 0.024
#> 199 14 14 0 2.652 0.000 1
#> 200 8 14 6 2.652 2.263 0.024
#> 201 10 16 6 2.652 2.263 0.024
#> 202 4 5 1 2.652 0.377 0.706
#> 203 7 7 0 2.652 0.000 1
#> 204 6 4 -2 2.652 -0.754 0.451
#> 205 18 13 -5 2.652 -1.885 0.059
#> 206 19 17 -2 2.652 -0.754 0.451
#> 207 6 5 -1 2.652 -0.377 0.706
#> 208 9 4 -5 2.652 -1.885 0.059
#> 209 2 4 2 2.652 0.754 0.451
#> 210 12 10 -2 2.652 -0.754 0.451
#> 211 4 10 6 2.652 2.263 0.024
#> 212 12 10 -2 2.652 -0.754 0.451
#> 213 17 16 -1 2.652 -0.377 0.706
#> 214 9 8 -1 2.652 -0.377 0.706
#> 215 14 14 0 2.652 0.000 1
#> 216 1 0 -1 2.652 -0.377 0.706
#> 217 8 4 -4 2.652 -1.508 0.131
#> 218 18 9 -9 2.652 -3.394 0.001
#> 219 2 1 -1 2.652 -0.377 0.706
#> 220 17 16 -1 2.652 -0.377 0.706
#> 221 4 2 -2 2.652 -0.754 0.451
#> 222 16 15 -1 2.652 -0.377 0.706
#> 223 7 9 2 2.652 0.754 0.451
#> 224 18 16 -2 2.652 -0.754 0.451
#> 225 2 3 1 2.652 0.377 0.706
#> 226 13 12 -1 2.652 -0.377 0.706
#> 227 17 16 -1 2.652 -0.377 0.706
#> 228 5 7 2 2.652 0.754 0.451
#> 229 4 3 -1 2.652 -0.377 0.706
#> 230 14 13 -1 2.652 -0.377 0.706
#> 231 6 7 1 2.652 0.377 0.706
#> 232 12 14 2 2.652 0.754 0.451
#> 233 1 8 7 2.652 2.640 0.008
#> 234 11 8 -3 2.652 -1.131 0.258
#> 235 4 3 -1 2.652 -0.377 0.706
#> 236 12 13 1 2.652 0.377 0.706
#> 237 17 17 0 2.652 0.000 1
#> 238 14 16 2 2.652 0.754 0.451
#> 239 10 11 1 2.652 0.377 0.706
#> 240 15 13 -2 2.652 -0.754 0.451
#> 241 14 12 -2 2.652 -0.754 0.451
#> 242 14 9 -5 2.652 -1.885 0.059
#> 243 2 1 -1 2.652 -0.377 0.706
#> 244 13 16 3 2.652 1.131 0.258
#> 245 19 16 -3 2.652 -1.131 0.258
#> 246 3 6 3 2.652 1.131 0.258
#> 247 14 13 -1 2.652 -0.377 0.706
#> 248 16 12 -4 2.652 -1.508 0.131
#> 249 8 11 3 2.652 1.131 0.258
#> 250 11 15 4 2.652 1.508 0.131
#> 251 9 7 -2 2.652 -0.754 0.451
#> 252 16 18 2 2.652 0.754 0.451
#> 253 19 17 -2 2.652 -0.754 0.451
#> 254 6 6 0 2.652 0.000 1
#> 255 15 13 -2 2.652 -0.754 0.451
#> 256 7 7 0 2.652 0.000 1
#> 257 2 1 -1 2.652 -0.377 0.706
#> 258 5 6 1 2.652 0.377 0.706
#> 259 6 10 4 2.652 1.508 0.131
#> 260 16 15 -1 2.652 -0.377 0.706
#> 261 5 7 2 2.652 0.754 0.451
#> 262 13 3 -10 2.652 -3.771 0
#> 263 6 4 -2 2.652 -0.754 0.451
#> 264 6 5 -1 2.652 -0.377 0.706
#> 265 11 7 -4 2.652 -1.508 0.131
#> 266 15 17 2 2.652 0.754 0.451
#> 267 13 12 -1 2.652 -0.377 0.706
#> 268 15 17 2 2.652 0.754 0.451
#> 269 8 8 0 2.652 0.000 1
#> 270 12 8 -4 2.652 -1.508 0.131
#> 271 15 13 -2 2.652 -0.754 0.451
#> 272 7 11 4 2.652 1.508 0.131
#> 273 7 11 4 2.652 1.508 0.131
#> 274 3 6 3 2.652 1.131 0.258
#> 275 12 9 -3 2.652 -1.131 0.258
#> 276 6 9 3 2.652 1.131 0.258
#> 277 11 9 -2 2.652 -0.754 0.451
#> 278 16 17 1 2.652 0.377 0.706
#> 279 17 16 -1 2.652 -0.377 0.706
#> 280 2 4 2 2.652 0.754 0.451
#> 281 3 2 -1 2.652 -0.377 0.706
#> 282 2 1 -1 2.652 -0.377 0.706
#> 283 18 16 -2 2.652 -0.754 0.451
#> 284 9 11 2 2.652 0.754 0.451
#> 285 5 8 3 2.652 1.131 0.258
#> 286 10 13 3 2.652 1.131 0.258
#> 287 4 5 1 2.652 0.377 0.706
#> 288 16 16 0 2.652 0.000 1
#> 289 2 5 3 2.652 1.131 0.258
#> 290 19 19 0 2.652 0.000 1
#> 291 10 11 1 2.652 0.377 0.706
#> 292 6 4 -2 2.652 -0.754 0.451
#> 293 2 3 1 2.652 0.377 0.706
#> 294 9 9 0 2.652 0.000 1
#> 295 9 11 2 2.652 0.754 0.451
#> 296 3 5 2 2.652 0.754 0.451
#> 297 8 5 -3 2.652 -1.131 0.258
#> 298 5 3 -2 2.652 -0.754 0.451
#> 299 13 11 -2 2.652 -0.754 0.451
#> 300 18 16 -2 2.652 -0.754 0.451
#> 301 7 3 -4 2.652 -1.508 0.131
#> 302 14 14 0 2.652 0.000 1
#> 303 8 4 -4 2.652 -1.508 0.131
#> 304 13 13 0 2.652 0.000 1
#> 305 4 3 -1 2.652 -0.377 0.706
#> 306 6 1 -5 2.652 -1.885 0.059
#> 307 9 9 0 2.652 0.000 1
#> 308 3 10 7 2.652 2.640 0.008
#> 309 2 1 -1 2.652 -0.377 0.706
#> 310 16 20 4 2.652 1.508 0.131
#> 311 2 4 2 2.652 0.754 0.451
#> 312 14 16 2 2.652 0.754 0.451
#> 313 14 12 -2 2.652 -0.754 0.451
#> 314 1 3 2 2.652 0.754 0.451
#> 315 9 10 1 2.652 0.377 0.706
#> 316 10 11 1 2.652 0.377 0.706
#> 317 12 14 2 2.652 0.754 0.451
#> 318 16 17 1 2.652 0.377 0.706
#> 319 16 15 -1 2.652 -0.377 0.706
#> 320 20 20 0 2.652 0.000 1
#> 321 1 2 1 2.652 0.377 0.706
#> 322 9 11 2 2.652 0.754 0.451
#> 323 14 11 -3 2.652 -1.131 0.258
#> 324 17 17 0 2.652 0.000 1
#> 325 3 4 1 2.652 0.377 0.706
#> 326 2 4 2 2.652 0.754 0.451
#> 327 14 16 2 2.652 0.754 0.451
#> 328 11 14 3 2.652 1.131 0.258
#> 329 4 5 1 2.652 0.377 0.706
#> 330 8 8 0 2.652 0.000 1
#> 331 0 0 0 2.652 0.000 1
#> 332 15 13 -2 2.652 -0.754 0.451
#> 333 6 1 -5 2.652 -1.885 0.059
#> 334 3 4 1 2.652 0.377 0.706
#> 335 14 14 0 2.652 0.000 1
#> 336 16 13 -3 2.652 -1.131 0.258
#> 337 15 16 1 2.652 0.377 0.706
#> 338 12 10 -2 2.652 -0.754 0.451
#> 339 12 9 -3 2.652 -1.131 0.258
#> 340 18 16 -2 2.652 -0.754 0.451
#> 341 4 1 -3 2.652 -1.131 0.258
#> 342 8 5 -3 2.652 -1.131 0.258
#> 343 13 14 1 2.652 0.377 0.706
#> 344 13 13 0 2.652 0.000 1
#> 345 17 15 -2 2.652 -0.754 0.451
#> 346 11 13 2 2.652 0.754 0.451
#> 347 5 3 -2 2.652 -0.754 0.451
#> 348 9 8 -1 2.652 -0.377 0.706
#> 349 8 11 3 2.652 1.131 0.258
#> 350 11 13 2 2.652 0.754 0.451
#> 351 12 8 -4 2.652 -1.508 0.131
#> 352 14 19 5 2.652 1.885 0.059
#> 353 7 4 -3 2.652 -1.131 0.258
#> 354 1 1 0 2.652 0.000 1
#> 355 5 1 -4 2.652 -1.508 0.131
#> 356 12 8 -4 2.652 -1.508 0.131
#> 357 2 6 4 2.652 1.508 0.131
#> 358 18 16 -2 2.652 -0.754 0.451
#> 359 17 16 -1 2.652 -0.377 0.706
#> 360 10 5 -5 2.652 -1.885 0.059
#> 361 17 14 -3 2.652 -1.131 0.258
#> 362 12 16 4 2.652 1.508 0.131
#> 363 8 8 0 2.652 0.000 1
#> 364 8 8 0 2.652 0.000 1
#> 365 15 12 -3 2.652 -1.131 0.258
#> 366 18 17 -1 2.652 -0.377 0.706
#> 367 5 9 4 2.652 1.508 0.131
#> 368 18 17 -1 2.652 -0.377 0.706
#> 369 12 10 -2 2.652 -0.754 0.451
#> 370 8 8 0 2.652 0.000 1
#> 371 10 8 -2 2.652 -0.754 0.451
#> 372 16 13 -3 2.652 -1.131 0.258
#> 373 18 16 -2 2.652 -0.754 0.451
#> 374 19 18 -1 2.652 -0.377 0.706
#> 375 4 3 -1 2.652 -0.377 0.706
#> 376 16 19 3 2.652 1.131 0.258
#> 377 13 9 -4 2.652 -1.508 0.131
#> 378 6 10 4 2.652 1.508 0.131
#> 379 13 13 0 2.652 0.000 1
#> 380 12 7 -5 2.652 -1.885 0.059
#> 381 10 12 2 2.652 0.754 0.451
#> 382 3 1 -2 2.652 -0.754 0.451
#> 383 7 4 -3 2.652 -1.131 0.258
#> 384 4 9 5 2.652 1.885 0.059
#> 385 19 20 1 2.652 0.377 0.706
#> 386 13 9 -4 2.652 -1.508 0.131
#> 387 2 1 -1 2.652 -0.377 0.706
#> 388 7 6 -1 2.652 -0.377 0.706
#> 389 3 6 3 2.652 1.131 0.258
#> 390 12 11 -1 2.652 -0.377 0.706
#> 391 17 16 -1 2.652 -0.377 0.706
#> 392 15 18 3 2.652 1.131 0.258
#> 393 14 15 1 2.652 0.377 0.706
#> 394 20 15 -5 2.652 -1.885 0.059
#> 395 6 2 -4 2.652 -1.508 0.131
#> 396 19 18 -1 2.652 -0.377 0.706
#> 397 1 10 9 2.652 3.394 0.001
#> 398 18 19 1 2.652 0.377 0.706
#> 399 17 16 -1 2.652 -0.377 0.706
#> 400 16 17 1 2.652 0.377 0.706
#> 401 14 11 -3 2.652 -1.131 0.258
#> 402 17 16 -1 2.652 -0.377 0.706
#> 403 10 8 -2 2.652 -0.754 0.451
#> 404 3 7 4 2.652 1.508 0.131
#> 405 9 9 0 2.652 0.000 1
#> 406 4 4 0 2.652 0.000 1
#> 407 15 12 -3 2.652 -1.131 0.258
#> 408 20 14 -6 2.652 -2.263 0.024
#> 409 11 10 -1 2.652 -0.377 0.706
#> 410 16 18 2 2.652 0.754 0.451
#> 411 1 1 0 2.652 0.000 1
#> 412 7 7 0 2.652 0.000 1
#> 413 6 7 1 2.652 0.377 0.706
#> 414 5 4 -1 2.652 -0.377 0.706
#> 415 20 18 -2 2.652 -0.754 0.451
#> 416 6 12 6 2.652 2.263 0.024
#> 417 16 15 -1 2.652 -0.377 0.706
#> 418 14 12 -2 2.652 -0.754 0.451
#> 419 10 9 -1 2.652 -0.377 0.706
#> 420 12 9 -3 2.652 -1.131 0.258
#> 421 6 4 -2 2.652 -0.754 0.451
#> 422 17 19 2 2.652 0.754 0.451
#> 423 11 12 1 2.652 0.377 0.706
#> 424 6 4 -2 2.652 -0.754 0.451
#> 425 12 7 -5 2.652 -1.885 0.059
#> 426 8 9 1 2.652 0.377 0.706
#> 427 8 7 -1 2.652 -0.377 0.706
#> 428 9 9 0 2.652 0.000 1
#> 429 4 5 1 2.652 0.377 0.706
#> 430 9 9 0 2.652 0.000 1
#> 431 15 14 -1 2.652 -0.377 0.706
#> 432 12 13 1 2.652 0.377 0.706
#> 433 10 12 2 2.652 0.754 0.451
#> 434 1 3 2 2.652 0.754 0.451
#> 435 11 11 0 2.652 0.000 1
#> 436 15 13 -2 2.652 -0.754 0.451
#> 437 12 10 -2 2.652 -0.754 0.451
#> 438 8 8 0 2.652 0.000 1
#> 439 10 10 0 2.652 0.000 1
#> 440 12 13 1 2.652 0.377 0.706
#> 441 12 9 -3 2.652 -1.131 0.258
#> 442 10 16 6 2.652 2.263 0.024
#> 443 11 14 3 2.652 1.131 0.258
#> 444 17 13 -4 2.652 -1.508 0.131
#> 445 10 13 3 2.652 1.131 0.258
#> 446 7 15 8 2.652 3.017 0.003
#> 447 10 11 1 2.652 0.377 0.706
#> 448 13 12 -1 2.652 -0.377 0.706
#> 449 15 16 1 2.652 0.377 0.706
#> 450 9 8 -1 2.652 -0.377 0.706
#> 451 19 18 -1 2.652 -0.377 0.706
#> 452 13 14 1 2.652 0.377 0.706
#> 453 6 9 3 2.652 1.131 0.258
#> 454 6 9 3 2.652 1.131 0.258
#> 455 7 8 1 2.652 0.377 0.706
#> 456 5 6 1 2.652 0.377 0.706
#> 457 15 11 -4 2.652 -1.508 0.131
#> 458 14 13 -1 2.652 -0.377 0.706
#> 459 10 10 0 2.652 0.000 1
#> 460 4 7 3 2.652 1.131 0.258
#> 461 11 12 1 2.652 0.377 0.706
#> 462 10 9 -1 2.652 -0.377 0.706
#> 463 18 18 0 2.652 0.000 1
#> 464 6 9 3 2.652 1.131 0.258
#> 465 6 11 5 2.652 1.885 0.059
#> 466 15 16 1 2.652 0.377 0.706
#> 467 17 15 -2 2.652 -0.754 0.451
#> 468 7 7 0 2.652 0.000 1
#> 469 9 11 2 2.652 0.754 0.451
#> 470 4 5 1 2.652 0.377 0.706
#> 471 7 7 0 2.652 0.000 1
#> 472 2 3 1 2.652 0.377 0.706
#> 473 18 16 -2 2.652 -0.754 0.451
#> 474 10 10 0 2.652 0.000 1
#> 475 17 14 -3 2.652 -1.131 0.258
#> 476 7 7 0 2.652 0.000 1
#> 477 17 17 0 2.652 0.000 1
#> 478 6 7 1 2.652 0.377 0.706
#> 479 14 13 -1 2.652 -0.377 0.706
#> 480 9 9 0 2.652 0.000 1
#> 481 11 11 0 2.652 0.000 1
#> 482 18 18 0 2.652 0.000 1
#> 483 8 8 0 2.652 0.000 1
#> 484 5 10 5 2.652 1.885 0.059
#> 485 4 2 -2 2.652 -0.754 0.451
#> 486 6 7 1 2.652 0.377 0.706
#> 487 18 15 -3 2.652 -1.131 0.258
#> 488 13 17 4 2.652 1.508 0.131
#> 489 12 14 2 2.652 0.754 0.451
#> 490 2 2 0 2.652 0.000 1
#> 491 6 6 0 2.652 0.000 1
#> 492 6 6 0 2.652 0.000 1
#> 493 6 5 -1 2.652 -0.377 0.706
#> 494 9 8 -1 2.652 -0.377 0.706
#> 495 6 3 -3 2.652 -1.131 0.258
#> 496 8 5 -3 2.652 -1.131 0.258
#> 497 6 5 -1 2.652 -0.377 0.706
#> 498 9 13 4 2.652 1.508 0.131
#> 499 16 18 2 2.652 0.754 0.451
#> 500 6 5 -1 2.652 -0.377 0.706
#> 501 2 1 -1 2.652 -0.377 0.706
#> 502 17 18 1 2.652 0.377 0.706
#> 503 4 8 4 2.652 1.508 0.131
#> 504 4 4 0 2.652 0.000 1
#> 505 3 6 3 2.652 1.131 0.258
#> 506 10 11 1 2.652 0.377 0.706
#> 507 16 18 2 2.652 0.754 0.451
#> 508 16 12 -4 2.652 -1.508 0.131
#> 509 4 4 0 2.652 0.000 1
#> 510 12 11 -1 2.652 -0.377 0.706
#> 511 13 9 -4 2.652 -1.508 0.131
#> 512 12 7 -5 2.652 -1.885 0.059
#> 513 5 4 -1 2.652 -0.377 0.706
#> 514 13 13 0 2.652 0.000 1
#> 515 18 19 1 2.652 0.377 0.706
#> 516 4 3 -1 2.652 -0.377 0.706
#> 517 1 3 2 2.652 0.754 0.451
#> 518 11 10 -1 2.652 -0.377 0.706
#> 519 14 12 -2 2.652 -0.754 0.451
#> 520 14 13 -1 2.652 -0.377 0.706
#> 521 8 4 -4 2.652 -1.508 0.131
#> 522 1 7 6 2.652 2.263 0.024
#> 523 14 15 1 2.652 0.377 0.706
#> 524 6 2 -4 2.652 -1.508 0.131
#> 525 16 16 0 2.652 0.000 1
#> 526 12 8 -4 2.652 -1.508 0.131
#> 527 15 10 -5 2.652 -1.885 0.059
#> 528 17 17 0 2.652 0.000 1
#> 529 3 5 2 2.652 0.754 0.451
#> 530 9 8 -1 2.652 -0.377 0.706
#> 531 13 13 0 2.652 0.000 1
#> 532 8 4 -4 2.652 -1.508 0.131
#> 533 18 16 -2 2.652 -0.754 0.451
#> 534 13 11 -2 2.652 -0.754 0.451
#> 535 17 15 -2 2.652 -0.754 0.451
#> 536 13 12 -1 2.652 -0.377 0.706
#> 537 15 18 3 2.652 1.131 0.258
#> 538 10 12 2 2.652 0.754 0.451
#> 539 8 15 7 2.652 2.640 0.008
#> 540 14 12 -2 2.652 -0.754 0.451
#> 541 15 13 -2 2.652 -0.754 0.451
#> 542 15 15 0 2.652 0.000 1
#> 543 3 1 -2 2.652 -0.754 0.451
#> 544 6 4 -2 2.652 -0.754 0.451
#> 545 12 12 0 2.652 0.000 1
#> 546 4 3 -1 2.652 -0.377 0.706
#> 547 12 9 -3 2.652 -1.131 0.258
#> 548 4 3 -1 2.652 -0.377 0.706
#> 549 13 11 -2 2.652 -0.754 0.451
#> 550 17 16 -1 2.652 -0.377 0.706
#> 551 9 11 2 2.652 0.754 0.451
#> 552 15 19 4 2.652 1.508 0.131
#> 553 4 3 -1 2.652 -0.377 0.706
#> 554 8 3 -5 2.652 -1.885 0.059
#> 555 15 16 1 2.652 0.377 0.706
#> 556 18 19 1 2.652 0.377 0.706
#> 557 14 16 2 2.652 0.754 0.451
#> 558 1 2 1 2.652 0.377 0.706
#> 559 13 14 1 2.652 0.377 0.706
#> 560 10 4 -6 2.652 -2.263 0.024
#> 561 1 3 2 2.652 0.754 0.451
#> 562 19 19 0 2.652 0.000 1
#> 563 6 4 -2 2.652 -0.754 0.451
#> 564 12 8 -4 2.652 -1.508 0.131
#> 565 8 10 2 2.652 0.754 0.451
#> 566 13 16 3 2.652 1.131 0.258
#> 567 11 13 2 2.652 0.754 0.451
#> 568 9 7 -2 2.652 -0.754 0.451
#> 569 5 4 -1 2.652 -0.377 0.706
#> 570 3 1 -2 2.652 -0.754 0.451
#> 571 17 19 2 2.652 0.754 0.451
#> 572 13 18 5 2.652 1.885 0.059
#> 573 16 15 -1 2.652 -0.377 0.706
#> 574 17 12 -5 2.652 -1.885 0.059
#> 575 14 14 0 2.652 0.000 1
#> 576 5 9 4 2.652 1.508 0.131
#> 577 9 6 -3 2.652 -1.131 0.258
#> 578 19 16 -3 2.652 -1.131 0.258
#> 579 4 8 4 2.652 1.508 0.131
#> 580 3 4 1 2.652 0.377 0.706
#> 581 15 14 -1 2.652 -0.377 0.706
#> 582 9 9 0 2.652 0.000 1
#> 583 9 8 -1 2.652 -0.377 0.706
#> 584 19 20 1 2.652 0.377 0.706
#> 585 7 6 -1 2.652 -0.377 0.706
#> 586 1 1 0 2.652 0.000 1
#> 587 15 16 1 2.652 0.377 0.706
#> 588 16 16 0 2.652 0.000 1
#> 589 11 11 0 2.652 0.000 1
#> 590 8 10 2 2.652 0.754 0.451
#> 591 16 19 3 2.652 1.131 0.258
#> 592 10 11 1 2.652 0.377 0.706
#> 593 13 15 2 2.652 0.754 0.451
#> 594 17 16 -1 2.652 -0.377 0.706
#> 595 12 14 2 2.652 0.754 0.451
#> 596 10 11 1 2.652 0.377 0.706
#> 597 5 4 -1 2.652 -0.377 0.706
#> 598 11 11 0 2.652 0.000 1
#> 599 12 12 0 2.652 0.000 1
#> 600 17 19 2 2.652 0.754 0.451
#> 601 4 11 7 2.652 2.640 0.008
#> 602 19 19 0 2.652 0.000 1
#> 603 7 6 -1 2.652 -0.377 0.706
#> 604 18 15 -3 2.652 -1.131 0.258
#> 605 10 10 0 2.652 0.000 1
#> 606 11 11 0 2.652 0.000 1
#> 607 4 10 6 2.652 2.263 0.024
#> 608 10 10 0 2.652 0.000 1
#> 609 8 6 -2 2.652 -0.754 0.451
#> 610 8 8 0 2.652 0.000 1
#> 611 9 14 5 2.652 1.885 0.059
#> 612 12 13 1 2.652 0.377 0.706
#> 613 12 12 0 2.652 0.000 1
#> 614 2 0 -2 2.652 -0.754 0.451
#> 615 5 6 1 2.652 0.377 0.706
#> 616 2 3 1 2.652 0.377 0.706
#> 617 9 13 4 2.652 1.508 0.131
#> 618 18 16 -2 2.652 -0.754 0.451
#> 619 14 16 2 2.652 0.754 0.451
#> 620 9 8 -1 2.652 -0.377 0.706
#> 621 11 6 -5 2.652 -1.885 0.059
#> 622 10 6 -4 2.652 -1.508 0.131
#> 623 8 8 0 2.652 0.000 1
#> 624 5 3 -2 2.652 -0.754 0.451
#> 625 8 10 2 2.652 0.754 0.451
#> 626 12 12 0 2.652 0.000 1
#> 627 18 17 -1 2.652 -0.377 0.706
#> 628 12 11 -1 2.652 -0.377 0.706
#> 629 10 14 4 2.652 1.508 0.131
#> 630 15 16 1 2.652 0.377 0.706
#> 631 6 8 2 2.652 0.754 0.451
#> 632 15 14 -1 2.652 -0.377 0.706
#> 633 7 5 -2 2.652 -0.754 0.451
#> 634 18 15 -3 2.652 -1.131 0.258
#> 635 15 12 -3 2.652 -1.131 0.258
#> 636 15 15 0 2.652 0.000 1
#> 637 14 20 6 2.652 2.263 0.024
#> 638 16 14 -2 2.652 -0.754 0.451
#> 639 16 16 0 2.652 0.000 1
#> 640 13 15 2 2.652 0.754 0.451
#> 641 9 10 1 2.652 0.377 0.706
#> 642 8 11 3 2.652 1.131 0.258
#> 643 16 18 2 2.652 0.754 0.451
#> 644 17 15 -2 2.652 -0.754 0.451
#> 645 11 9 -2 2.652 -0.754 0.451
#> 646 20 18 -2 2.652 -0.754 0.451
#> 647 14 11 -3 2.652 -1.131 0.258
#> 648 14 15 1 2.652 0.377 0.706
#> 649 11 5 -6 2.652 -2.263 0.024
#> 650 9 9 0 2.652 0.000 1
#> 651 11 12 1 2.652 0.377 0.706
#> 652 5 5 0 2.652 0.000 1
#> 653 7 4 -3 2.652 -1.131 0.258
#> 654 7 8 1 2.652 0.377 0.706
#> 655 11 11 0 2.652 0.000 1
#> 656 5 5 0 2.652 0.000 1
#> 657 15 15 0 2.652 0.000 1
#> 658 12 15 3 2.652 1.131 0.258
#> 659 10 15 5 2.652 1.885 0.059
#> 660 12 14 2 2.652 0.754 0.451
#> 661 10 10 0 2.652 0.000 1
#> 662 5 7 2 2.652 0.754 0.451
#> 663 14 10 -4 2.652 -1.508 0.131
#> 664 12 14 2 2.652 0.754 0.451
#> 665 12 10 -2 2.652 -0.754 0.451
#> 666 3 4 1 2.652 0.377 0.706
#> 667 9 14 5 2.652 1.885 0.059
#> 668 13 17 4 2.652 1.508 0.131
#> 669 7 7 0 2.652 0.000 1
#> 670 14 13 -1 2.652 -0.377 0.706
#> 671 19 18 -1 2.652 -0.377 0.706
#> 672 9 9 0 2.652 0.000 1
#> 673 13 15 2 2.652 0.754 0.451
#> 674 3 5 2 2.652 0.754 0.451
#> 675 1 3 2 2.652 0.754 0.451
#> 676 15 15 0 2.652 0.000 1
#> 677 1 3 2 2.652 0.754 0.451
#> 678 19 15 -4 2.652 -1.508 0.131
#> 679 0 3 3 2.652 1.131 0.258
#> 680 18 17 -1 2.652 -0.377 0.706
#> 681 9 15 6 2.652 2.263 0.024
#> 682 18 18 0 2.652 0.000 1
#> 683 11 7 -4 2.652 -1.508 0.131
#> 684 17 17 0 2.652 0.000 1
#> 685 9 9 0 2.652 0.000 1
#> 686 2 5 3 2.652 1.131 0.258
#> 687 13 14 1 2.652 0.377 0.706
#> 688 15 13 -2 2.652 -0.754 0.451
#> 689 18 18 0 2.652 0.000 1
#> 690 10 13 3 2.652 1.131 0.258
#> 691 14 14 0 2.652 0.000 1
#> 692 12 9 -3 2.652 -1.131 0.258
#> 693 9 9 0 2.652 0.000 1
#> 694 14 11 -3 2.652 -1.131 0.258
#> 695 14 15 1 2.652 0.377 0.706
#> 696 6 8 2 2.652 0.754 0.451
#> 697 7 7 0 2.652 0.000 1
#> 698 12 8 -4 2.652 -1.508 0.131
#> 699 7 9 2 2.652 0.754 0.451
#> 700 12 12 0 2.652 0.000 1
#> 701 17 14 -3 2.652 -1.131 0.258
#> 702 14 12 -2 2.652 -0.754 0.451
#> 703 15 16 1 2.652 0.377 0.706
#> 704 12 10 -2 2.652 -0.754 0.451
#> 705 5 8 3 2.652 1.131 0.258
#> 706 9 8 -1 2.652 -0.377 0.706
#> 707 3 3 0 2.652 0.000 1
#> 708 4 4 0 2.652 0.000 1
#> 709 10 12 2 2.652 0.754 0.451
#> 710 17 15 -2 2.652 -0.754 0.451
#> 711 13 12 -1 2.652 -0.377 0.706
#> 712 10 9 -1 2.652 -0.377 0.706
#> 713 16 12 -4 2.652 -1.508 0.131
#> 714 12 11 -1 2.652 -0.377 0.706
#> 715 16 13 -3 2.652 -1.131 0.258
#> 716 4 5 1 2.652 0.377 0.706
#> 717 14 17 3 2.652 1.131 0.258
#> 718 2 0 -2 2.652 -0.754 0.451
#> 719 6 2 -4 2.652 -1.508 0.131
#> 720 3 8 5 2.652 1.885 0.059
#> 721 16 16 0 2.652 0.000 1
#> 722 1 2 1 2.652 0.377 0.706
#> 723 19 16 -3 2.652 -1.131 0.258
#> 724 13 8 -5 2.652 -1.885 0.059
#> 725 13 20 7 2.652 2.640 0.008
#> 726 4 3 -1 2.652 -0.377 0.706
#> 727 15 11 -4 2.652 -1.508 0.131
#> 728 5 4 -1 2.652 -0.377 0.706
#> 729 7 4 -3 2.652 -1.131 0.258
#> 730 6 6 0 2.652 0.000 1
#> 731 4 5 1 2.652 0.377 0.706
#> 732 6 12 6 2.652 2.263 0.024
#> 733 19 18 -1 2.652 -0.377 0.706
#> 734 3 7 4 2.652 1.508 0.131
#> 735 14 14 0 2.652 0.000 1
#> 736 11 14 3 2.652 1.131 0.258
#> 737 13 17 4 2.652 1.508 0.131
#> 738 8 10 2 2.652 0.754 0.451
#> 739 11 7 -4 2.652 -1.508 0.131
#> 740 9 17 8 2.652 3.017 0.003
#> 741 2 3 1 2.652 0.377 0.706
#> 742 3 2 -1 2.652 -0.377 0.706
#> 743 9 11 2 2.652 0.754 0.451
#> 744 8 6 -2 2.652 -0.754 0.451
#> 745 18 20 2 2.652 0.754 0.451
#> 746 14 17 3 2.652 1.131 0.258
#> 747 13 14 1 2.652 0.377 0.706
#> 748 2 1 -1 2.652 -0.377 0.706
#> 749 15 12 -3 2.652 -1.131 0.258
#> 750 6 8 2 2.652 0.754 0.451
#> 751 5 4 -1 2.652 -0.377 0.706
#> 752 17 20 3 2.652 1.131 0.258
#> 753 3 2 -1 2.652 -0.377 0.706
#> 754 14 12 -2 2.652 -0.754 0.451
#> 755 8 9 1 2.652 0.377 0.706
#> 756 1 2 1 2.652 0.377 0.706
#> 757 3 2 -1 2.652 -0.377 0.706
#> 758 7 6 -1 2.652 -0.377 0.706
#> 759 7 7 0 2.652 0.000 1
#> 760 13 11 -2 2.652 -0.754 0.451
#> 761 15 16 1 2.652 0.377 0.706
#> 762 11 13 2 2.652 0.754 0.451
#> 763 9 10 1 2.652 0.377 0.706
#> 764 16 17 1 2.652 0.377 0.706
#> 765 11 13 2 2.652 0.754 0.451
#> 766 17 19 2 2.652 0.754 0.451
#> 767 13 11 -2 2.652 -0.754 0.451
#> 768 12 11 -1 2.652 -0.377 0.706
#> 769 13 13 0 2.652 0.000 1
#> 770 14 13 -1 2.652 -0.377 0.706
#> 771 10 9 -1 2.652 -0.377 0.706
#> 772 6 7 1 2.652 0.377 0.706
#> 773 13 6 -7 2.652 -2.640 0.008
#> 774 9 7 -2 2.652 -0.754 0.451
#> 775 13 13 0 2.652 0.000 1
#> 776 15 14 -1 2.652 -0.377 0.706
#> 777 6 7 1 2.652 0.377 0.706
#> 778 2 7 5 2.652 1.885 0.059
#> 779 11 15 4 2.652 1.508 0.131
#> 780 7 13 6 2.652 2.263 0.024
#> 781 10 10 0 2.652 0.000 1
#> 782 17 16 -1 2.652 -0.377 0.706
#> 783 20 19 -1 2.652 -0.377 0.706
#> 784 10 5 -5 2.652 -1.885 0.059
#> 785 16 18 2 2.652 0.754 0.451
#> 786 6 3 -3 2.652 -1.131 0.258
#> 787 6 8 2 2.652 0.754 0.451
#> 788 17 15 -2 2.652 -0.754 0.451
#> 789 12 7 -5 2.652 -1.885 0.059
#> 790 3 4 1 2.652 0.377 0.706
#> 791 3 3 0 2.652 0.000 1
#> 792 13 16 3 2.652 1.131 0.258
#> 793 8 5 -3 2.652 -1.131 0.258
#> 794 9 5 -4 2.652 -1.508 0.131
#> 795 5 8 3 2.652 1.131 0.258
#> 796 12 16 4 2.652 1.508 0.131
#> 797 16 15 -1 2.652 -0.377 0.706
#> 798 11 14 3 2.652 1.131 0.258
#> 799 7 6 -1 2.652 -0.377 0.706
#> 800 5 3 -2 2.652 -0.754 0.451
#> 801 2 5 3 2.652 1.131 0.258
#> 802 11 14 3 2.652 1.131 0.258
#> 803 4 2 -2 2.652 -0.754 0.451
#> 804 6 11 5 2.652 1.885 0.059
#> 805 10 10 0 2.652 0.000 1
#> 806 11 11 0 2.652 0.000 1
#> 807 16 19 3 2.652 1.131 0.258
#> 808 16 19 3 2.652 1.131 0.258
#> 809 3 1 -2 2.652 -0.754 0.451
#> 810 14 14 0 2.652 0.000 1
#> 811 16 18 2 2.652 0.754 0.451
#> 812 5 5 0 2.652 0.000 1
#> 813 18 17 -1 2.652 -0.377 0.706
#> 814 7 5 -2 2.652 -0.754 0.451
#> 815 13 10 -3 2.652 -1.131 0.258
#> 816 5 2 -3 2.652 -1.131 0.258
#> 817 3 3 0 2.652 0.000 1
#> 818 18 15 -3 2.652 -1.131 0.258
#> 819 9 8 -1 2.652 -0.377 0.706
#> 820 11 9 -2 2.652 -0.754 0.451
#> 821 14 16 2 2.652 0.754 0.451
#> 822 4 4 0 2.652 0.000 1
#> 823 5 8 3 2.652 1.131 0.258
#> 824 6 8 2 2.652 0.754 0.451
#> 825 18 19 1 2.652 0.377 0.706
#> 826 12 12 0 2.652 0.000 1
#> 827 7 7 0 2.652 0.000 1
#> 828 7 5 -2 2.652 -0.754 0.451
#> 829 1 1 0 2.652 0.000 1
#> 830 8 9 1 2.652 0.377 0.706
#> 831 10 6 -4 2.652 -1.508 0.131
#> 832 12 9 -3 2.652 -1.131 0.258
#> 833 14 18 4 2.652 1.508 0.131
#> 834 4 4 0 2.652 0.000 1
#> 835 7 12 5 2.652 1.885 0.059
#> 836 16 11 -5 2.652 -1.885 0.059
#> 837 11 13 2 2.652 0.754 0.451
#> 838 10 11 1 2.652 0.377 0.706
#> 839 16 15 -1 2.652 -0.377 0.706
#> 840 19 12 -7 2.652 -2.640 0.008
#> 841 5 5 0 2.652 0.000 1
#> 842 8 6 -2 2.652 -0.754 0.451
#> 843 7 9 2 2.652 0.754 0.451
#> 844 8 7 -1 2.652 -0.377 0.706
#> 845 17 19 2 2.652 0.754 0.451
#> 846 11 13 2 2.652 0.754 0.451
#> 847 9 9 0 2.652 0.000 1
#> 848 19 19 0 2.652 0.000 1
#> 849 7 10 3 2.652 1.131 0.258
#> 850 18 17 -1 2.652 -0.377 0.706
#> 851 11 11 0 2.652 0.000 1
#> 852 15 17 2 2.652 0.754 0.451
#> 853 11 9 -2 2.652 -0.754 0.451
#> 854 9 6 -3 2.652 -1.131 0.258
#> 855 14 12 -2 2.652 -0.754 0.451
#> 856 12 16 4 2.652 1.508 0.131
#> 857 7 11 4 2.652 1.508 0.131
#> 858 6 9 3 2.652 1.131 0.258
#> 859 3 1 -2 2.652 -0.754 0.451
#> 860 9 3 -6 2.652 -2.263 0.024
#> 861 18 16 -2 2.652 -0.754 0.451
#> 862 14 17 3 2.652 1.131 0.258
#> 863 6 7 1 2.652 0.377 0.706
#> 864 11 9 -2 2.652 -0.754 0.451
#> 865 14 13 -1 2.652 -0.377 0.706
#> 866 15 14 -1 2.652 -0.377 0.706
#> 867 14 14 0 2.652 0.000 1
#> 868 11 9 -2 2.652 -0.754 0.451
#> 869 11 14 3 2.652 1.131 0.258
#> 870 3 2 -1 2.652 -0.377 0.706
#> 871 16 15 -1 2.652 -0.377 0.706
#> 872 19 18 -1 2.652 -0.377 0.706
#> 873 3 3 0 2.652 0.000 1
#> 874 12 12 0 2.652 0.000 1
#> 875 16 17 1 2.652 0.377 0.706
#> 876 14 15 1 2.652 0.377 0.706
#> 877 3 1 -2 2.652 -0.754 0.451
#> 878 12 18 6 2.652 2.263 0.024
#> 879 16 15 -1 2.652 -0.377 0.706
#> 880 12 17 5 2.652 1.885 0.059
#> 881 5 6 1 2.652 0.377 0.706
#> 882 8 6 -2 2.652 -0.754 0.451
#> 883 19 17 -2 2.652 -0.754 0.451
#> 884 12 8 -4 2.652 -1.508 0.131
#> 885 0 1 1 2.652 0.377 0.706
#> 886 9 8 -1 2.652 -0.377 0.706
#> 887 19 18 -1 2.652 -0.377 0.706
#> 888 13 12 -1 2.652 -0.377 0.706
#> 889 16 12 -4 2.652 -1.508 0.131
#> 890 15 15 0 2.652 0.000 1
#> 891 11 11 0 2.652 0.000 1
#> 892 13 11 -2 2.652 -0.754 0.451
#> 893 10 7 -3 2.652 -1.131 0.258
#> 894 12 13 1 2.652 0.377 0.706
#> 895 12 12 0 2.652 0.000 1
#> 896 17 16 -1 2.652 -0.377 0.706
#> 897 16 13 -3 2.652 -1.131 0.258
#> 898 12 9 -3 2.652 -1.131 0.258
#> 899 6 10 4 2.652 1.508 0.131
#> 900 4 5 1 2.652 0.377 0.706
#> 901 4 7 3 2.652 1.131 0.258
#> 902 3 8 5 2.652 1.885 0.059
#> 903 16 14 -2 2.652 -0.754 0.451
#> 904 3 4 1 2.652 0.377 0.706
#> 905 15 16 1 2.652 0.377 0.706
#> 906 16 15 -1 2.652 -0.377 0.706
#> 907 13 11 -2 2.652 -0.754 0.451
#> 908 6 7 1 2.652 0.377 0.706
#> 909 2 4 2 2.652 0.754 0.451
#> 910 6 14 8 2.652 3.017 0.003
#> 911 15 9 -6 2.652 -2.263 0.024
#> 912 4 4 0 2.652 0.000 1
#> 913 4 5 1 2.652 0.377 0.706
#> 914 13 11 -2 2.652 -0.754 0.451
#> 915 17 17 0 2.652 0.000 1
#> 916 7 9 2 2.652 0.754 0.451
#> 917 13 18 5 2.652 1.885 0.059
#> 918 10 9 -1 2.652 -0.377 0.706
#> 919 8 3 -5 2.652 -1.885 0.059
#> 920 18 20 2 2.652 0.754 0.451
#> 921 5 5 0 2.652 0.000 1
#> 922 18 16 -2 2.652 -0.754 0.451
#> 923 13 12 -1 2.652 -0.377 0.706
#> 924 12 12 0 2.652 0.000 1
#> 925 18 14 -4 2.652 -1.508 0.131
#> 926 6 10 4 2.652 1.508 0.131
#> 927 10 8 -2 2.652 -0.754 0.451
#> 928 6 9 3 2.652 1.131 0.258
#> 929 9 12 3 2.652 1.131 0.258
#> 930 12 14 2 2.652 0.754 0.451
#> 931 6 8 2 2.652 0.754 0.451
#> 932 11 16 5 2.652 1.885 0.059
#> 933 11 11 0 2.652 0.000 1
#> 934 1 2 1 2.652 0.377 0.706
#> 935 17 18 1 2.652 0.377 0.706
#> 936 3 5 2 2.652 0.754 0.451
#> 937 9 5 -4 2.652 -1.508 0.131
#> 938 17 14 -3 2.652 -1.131 0.258
#> 939 5 4 -1 2.652 -0.377 0.706
#> 940 2 4 2 2.652 0.754 0.451
#> 941 19 17 -2 2.652 -0.754 0.451
#> 942 6 6 0 2.652 0.000 1
#> 943 14 19 5 2.652 1.885 0.059
#> 944 16 16 0 2.652 0.000 1
#> 945 19 15 -4 2.652 -1.508 0.131
#> 946 7 8 1 2.652 0.377 0.706
#> 947 18 14 -4 2.652 -1.508 0.131
#> 948 7 7 0 2.652 0.000 1
#> 949 16 16 0 2.652 0.000 1
#> 950 10 10 0 2.652 0.000 1
#> 951 15 18 3 2.652 1.131 0.258
#> 952 11 15 4 2.652 1.508 0.131
#> 953 14 14 0 2.652 0.000 1
#> 954 16 15 -1 2.652 -0.377 0.706
#> 955 10 7 -3 2.652 -1.131 0.258
#> 956 14 18 4 2.652 1.508 0.131
#> 957 10 14 4 2.652 1.508 0.131
#> 958 4 8 4 2.652 1.508 0.131
#> 959 6 7 1 2.652 0.377 0.706
#> 960 9 7 -2 2.652 -0.754 0.451
#> 961 14 16 2 2.652 0.754 0.451
#> 962 13 14 1 2.652 0.377 0.706
#> 963 11 11 0 2.652 0.000 1
#> 964 8 6 -2 2.652 -0.754 0.451
#> 965 8 8 0 2.652 0.000 1
#> 966 13 8 -5 2.652 -1.885 0.059
#> 967 14 10 -4 2.652 -1.508 0.131
#> 968 7 9 2 2.652 0.754 0.451
#> 969 10 12 2 2.652 0.754 0.451
#> 970 10 13 3 2.652 1.131 0.258
#> 971 11 9 -2 2.652 -0.754 0.451
#> 972 6 5 -1 2.652 -0.377 0.706
#> 973 15 13 -2 2.652 -0.754 0.451
#> 974 8 5 -3 2.652 -1.131 0.258
#> 975 5 7 2 2.652 0.754 0.451
#> 976 15 11 -4 2.652 -1.508 0.131
#> 977 10 9 -1 2.652 -0.377 0.706
#> 978 15 12 -3 2.652 -1.131 0.258
#> 979 13 11 -2 2.652 -0.754 0.451
#> 980 8 6 -2 2.652 -0.754 0.451
#> 981 9 11 2 2.652 0.754 0.451
#> 982 16 15 -1 2.652 -0.377 0.706
#> 983 9 10 1 2.652 0.377 0.706
#> 984 2 3 1 2.652 0.377 0.706
#> 985 16 13 -3 2.652 -1.131 0.258
#> 986 18 12 -6 2.652 -2.263 0.024
#> 987 10 12 2 2.652 0.754 0.451
#> 988 20 20 0 2.652 0.000 1
#> 989 13 13 0 2.652 0.000 1
#> 990 10 10 0 2.652 0.000 1
#> 991 7 7 0 2.652 0.000 1
#> 992 6 3 -3 2.652 -1.131 0.258
#> 993 9 8 -1 2.652 -0.377 0.706
#> 994 12 11 -1 2.652 -0.377 0.706
#> 995 5 5 0 2.652 0.000 1
#> 996 16 19 3 2.652 1.131 0.258
#> 997 6 7 1 2.652 0.377 0.706
#> 998 8 9 1 2.652 0.377 0.706
#> 999 15 11 -4 2.652 -1.508 0.131
#> 1000 5 7 2 2.652 0.754 0.451
# include cutoffs
RCI(predat = dat_pre, postdat = dat_post, SEM.pre=SEM.alpha,
cutoffs=c(-1.96, 1.96))
#> pre.score post.score diff SEM z p cut_decision
#> 1 7 1 -6 2.652 -2.263 0.024 decreased
#> 2 16 9 -7 2.652 -2.640 0.008 decreased
#> 3 8 0 -8 2.652 -3.017 0.003 decreased
#> 4 2 6 4 2.652 1.508 0.131 unchanged
#> 5 10 10 0 2.652 0.000 1 unchanged
#> 6 10 10 0 2.652 0.000 1 unchanged
#> 7 9 10 1 2.652 0.377 0.706 unchanged
#> 8 16 19 3 2.652 1.131 0.258 unchanged
#> 9 6 4 -2 2.652 -0.754 0.451 unchanged
#> 10 12 11 -1 2.652 -0.377 0.706 unchanged
#> 11 5 8 3 2.652 1.131 0.258 unchanged
#> 12 15 15 0 2.652 0.000 1 unchanged
#> 13 7 9 2 2.652 0.754 0.451 unchanged
#> 14 8 13 5 2.652 1.885 0.059 unchanged
#> 15 2 4 2 2.652 0.754 0.451 unchanged
#> 16 2 2 0 2.652 0.000 1 unchanged
#> 17 18 19 1 2.652 0.377 0.706 unchanged
#> 18 14 17 3 2.652 1.131 0.258 unchanged
#> 19 3 4 1 2.652 0.377 0.706 unchanged
#> 20 9 9 0 2.652 0.000 1 unchanged
#> 21 5 5 0 2.652 0.000 1 unchanged
#> 22 3 8 5 2.652 1.885 0.059 unchanged
#> 23 9 7 -2 2.652 -0.754 0.451 unchanged
#> 24 15 13 -2 2.652 -0.754 0.451 unchanged
#> 25 11 12 1 2.652 0.377 0.706 unchanged
#> 26 10 11 1 2.652 0.377 0.706 unchanged
#> 27 1 0 -1 2.652 -0.377 0.706 unchanged
#> 28 11 8 -3 2.652 -1.131 0.258 unchanged
#> 29 1 3 2 2.652 0.754 0.451 unchanged
#> 30 9 14 5 2.652 1.885 0.059 unchanged
#> 31 19 18 -1 2.652 -0.377 0.706 unchanged
#> 32 14 13 -1 2.652 -0.377 0.706 unchanged
#> 33 17 19 2 2.652 0.754 0.451 unchanged
#> 34 10 9 -1 2.652 -0.377 0.706 unchanged
#> 35 9 10 1 2.652 0.377 0.706 unchanged
#> 36 14 18 4 2.652 1.508 0.131 unchanged
#> 37 9 10 1 2.652 0.377 0.706 unchanged
#> 38 1 1 0 2.652 0.000 1 unchanged
#> 39 15 12 -3 2.652 -1.131 0.258 unchanged
#> 40 11 10 -1 2.652 -0.377 0.706 unchanged
#> 41 17 13 -4 2.652 -1.508 0.131 unchanged
#> 42 14 15 1 2.652 0.377 0.706 unchanged
#> 43 4 2 -2 2.652 -0.754 0.451 unchanged
#> 44 10 9 -1 2.652 -0.377 0.706 unchanged
#> 45 6 5 -1 2.652 -0.377 0.706 unchanged
#> 46 8 4 -4 2.652 -1.508 0.131 unchanged
#> 47 14 15 1 2.652 0.377 0.706 unchanged
#> 48 6 6 0 2.652 0.000 1 unchanged
#> 49 5 3 -2 2.652 -0.754 0.451 unchanged
#> 50 17 16 -1 2.652 -0.377 0.706 unchanged
#> 51 1 0 -1 2.652 -0.377 0.706 unchanged
#> 52 1 2 1 2.652 0.377 0.706 unchanged
#> 53 12 5 -7 2.652 -2.640 0.008 decreased
#> 54 6 4 -2 2.652 -0.754 0.451 unchanged
#> 55 4 3 -1 2.652 -0.377 0.706 unchanged
#> 56 14 15 1 2.652 0.377 0.706 unchanged
#> 57 6 8 2 2.652 0.754 0.451 unchanged
#> 58 11 13 2 2.652 0.754 0.451 unchanged
#> 59 6 4 -2 2.652 -0.754 0.451 unchanged
#> 60 7 10 3 2.652 1.131 0.258 unchanged
#> 61 2 3 1 2.652 0.377 0.706 unchanged
#> 62 10 13 3 2.652 1.131 0.258 unchanged
#> 63 3 4 1 2.652 0.377 0.706 unchanged
#> 64 16 17 1 2.652 0.377 0.706 unchanged
#> 65 13 13 0 2.652 0.000 1 unchanged
#> 66 5 7 2 2.652 0.754 0.451 unchanged
#> 67 9 10 1 2.652 0.377 0.706 unchanged
#> 68 10 8 -2 2.652 -0.754 0.451 unchanged
#> 69 7 3 -4 2.652 -1.508 0.131 unchanged
#> 70 15 14 -1 2.652 -0.377 0.706 unchanged
#> 71 17 17 0 2.652 0.000 1 unchanged
#> 72 7 5 -2 2.652 -0.754 0.451 unchanged
#> 73 17 15 -2 2.652 -0.754 0.451 unchanged
#> 74 18 16 -2 2.652 -0.754 0.451 unchanged
#> 75 15 16 1 2.652 0.377 0.706 unchanged
#> 76 5 4 -1 2.652 -0.377 0.706 unchanged
#> 77 11 15 4 2.652 1.508 0.131 unchanged
#> 78 9 12 3 2.652 1.131 0.258 unchanged
#> 79 17 15 -2 2.652 -0.754 0.451 unchanged
#> 80 17 14 -3 2.652 -1.131 0.258 unchanged
#> 81 3 3 0 2.652 0.000 1 unchanged
#> 82 9 7 -2 2.652 -0.754 0.451 unchanged
#> 83 12 13 1 2.652 0.377 0.706 unchanged
#> 84 5 12 7 2.652 2.640 0.008 increased
#> 85 7 6 -1 2.652 -0.377 0.706 unchanged
#> 86 11 8 -3 2.652 -1.131 0.258 unchanged
#> 87 9 9 0 2.652 0.000 1 unchanged
#> 88 3 5 2 2.652 0.754 0.451 unchanged
#> 89 17 19 2 2.652 0.754 0.451 unchanged
#> 90 15 16 1 2.652 0.377 0.706 unchanged
#> 91 12 13 1 2.652 0.377 0.706 unchanged
#> 92 12 13 1 2.652 0.377 0.706 unchanged
#> 93 12 15 3 2.652 1.131 0.258 unchanged
#> 94 12 17 5 2.652 1.885 0.059 unchanged
#> 95 14 13 -1 2.652 -0.377 0.706 unchanged
#> 96 12 14 2 2.652 0.754 0.451 unchanged
#> 97 11 14 3 2.652 1.131 0.258 unchanged
#> 98 5 4 -1 2.652 -0.377 0.706 unchanged
#> 99 7 12 5 2.652 1.885 0.059 unchanged
#> 100 12 14 2 2.652 0.754 0.451 unchanged
#> 101 15 19 4 2.652 1.508 0.131 unchanged
#> 102 9 12 3 2.652 1.131 0.258 unchanged
#> 103 13 9 -4 2.652 -1.508 0.131 unchanged
#> 104 3 3 0 2.652 0.000 1 unchanged
#> 105 5 5 0 2.652 0.000 1 unchanged
#> 106 7 3 -4 2.652 -1.508 0.131 unchanged
#> 107 4 3 -1 2.652 -0.377 0.706 unchanged
#> 108 3 2 -1 2.652 -0.377 0.706 unchanged
#> 109 8 10 2 2.652 0.754 0.451 unchanged
#> 110 9 10 1 2.652 0.377 0.706 unchanged
#> 111 17 15 -2 2.652 -0.754 0.451 unchanged
#> 112 19 19 0 2.652 0.000 1 unchanged
#> 113 16 14 -2 2.652 -0.754 0.451 unchanged
#> 114 15 14 -1 2.652 -0.377 0.706 unchanged
#> 115 12 10 -2 2.652 -0.754 0.451 unchanged
#> 116 4 8 4 2.652 1.508 0.131 unchanged
#> 117 8 8 0 2.652 0.000 1 unchanged
#> 118 13 11 -2 2.652 -0.754 0.451 unchanged
#> 119 14 15 1 2.652 0.377 0.706 unchanged
#> 120 1 3 2 2.652 0.754 0.451 unchanged
#> 121 7 7 0 2.652 0.000 1 unchanged
#> 122 3 1 -2 2.652 -0.754 0.451 unchanged
#> 123 17 16 -1 2.652 -0.377 0.706 unchanged
#> 124 13 13 0 2.652 0.000 1 unchanged
#> 125 9 13 4 2.652 1.508 0.131 unchanged
#> 126 18 16 -2 2.652 -0.754 0.451 unchanged
#> 127 2 3 1 2.652 0.377 0.706 unchanged
#> 128 11 17 6 2.652 2.263 0.024 increased
#> 129 15 10 -5 2.652 -1.885 0.059 unchanged
#> 130 17 15 -2 2.652 -0.754 0.451 unchanged
#> 131 15 16 1 2.652 0.377 0.706 unchanged
#> 132 13 8 -5 2.652 -1.885 0.059 unchanged
#> 133 15 14 -1 2.652 -0.377 0.706 unchanged
#> 134 4 2 -2 2.652 -0.754 0.451 unchanged
#> 135 6 6 0 2.652 0.000 1 unchanged
#> 136 14 17 3 2.652 1.131 0.258 unchanged
#> 137 11 10 -1 2.652 -0.377 0.706 unchanged
#> 138 19 17 -2 2.652 -0.754 0.451 unchanged
#> 139 9 8 -1 2.652 -0.377 0.706 unchanged
#> 140 17 16 -1 2.652 -0.377 0.706 unchanged
#> 141 7 3 -4 2.652 -1.508 0.131 unchanged
#> 142 1 0 -1 2.652 -0.377 0.706 unchanged
#> 143 12 7 -5 2.652 -1.885 0.059 unchanged
#> 144 18 18 0 2.652 0.000 1 unchanged
#> 145 11 9 -2 2.652 -0.754 0.451 unchanged
#> 146 1 4 3 2.652 1.131 0.258 unchanged
#> 147 13 18 5 2.652 1.885 0.059 unchanged
#> 148 13 12 -1 2.652 -0.377 0.706 unchanged
#> 149 19 14 -5 2.652 -1.885 0.059 unchanged
#> 150 17 12 -5 2.652 -1.885 0.059 unchanged
#> 151 17 19 2 2.652 0.754 0.451 unchanged
#> 152 10 7 -3 2.652 -1.131 0.258 unchanged
#> 153 10 10 0 2.652 0.000 1 unchanged
#> 154 5 5 0 2.652 0.000 1 unchanged
#> 155 11 7 -4 2.652 -1.508 0.131 unchanged
#> 156 13 10 -3 2.652 -1.131 0.258 unchanged
#> 157 5 5 0 2.652 0.000 1 unchanged
#> 158 7 6 -1 2.652 -0.377 0.706 unchanged
#> 159 7 7 0 2.652 0.000 1 unchanged
#> 160 4 4 0 2.652 0.000 1 unchanged
#> 161 6 8 2 2.652 0.754 0.451 unchanged
#> 162 17 12 -5 2.652 -1.885 0.059 unchanged
#> 163 8 9 1 2.652 0.377 0.706 unchanged
#> 164 17 16 -1 2.652 -0.377 0.706 unchanged
#> 165 14 14 0 2.652 0.000 1 unchanged
#> 166 10 7 -3 2.652 -1.131 0.258 unchanged
#> 167 6 9 3 2.652 1.131 0.258 unchanged
#> 168 3 5 2 2.652 0.754 0.451 unchanged
#> 169 4 3 -1 2.652 -0.377 0.706 unchanged
#> 170 9 15 6 2.652 2.263 0.024 increased
#> 171 13 13 0 2.652 0.000 1 unchanged
#> 172 10 14 4 2.652 1.508 0.131 unchanged
#> 173 17 16 -1 2.652 -0.377 0.706 unchanged
#> 174 16 15 -1 2.652 -0.377 0.706 unchanged
#> 175 6 4 -2 2.652 -0.754 0.451 unchanged
#> 176 6 7 1 2.652 0.377 0.706 unchanged
#> 177 3 4 1 2.652 0.377 0.706 unchanged
#> 178 20 18 -2 2.652 -0.754 0.451 unchanged
#> 179 4 8 4 2.652 1.508 0.131 unchanged
#> 180 11 9 -2 2.652 -0.754 0.451 unchanged
#> 181 16 19 3 2.652 1.131 0.258 unchanged
#> 182 10 12 2 2.652 0.754 0.451 unchanged
#> 183 15 18 3 2.652 1.131 0.258 unchanged
#> 184 11 11 0 2.652 0.000 1 unchanged
#> 185 9 9 0 2.652 0.000 1 unchanged
#> 186 15 12 -3 2.652 -1.131 0.258 unchanged
#> 187 14 14 0 2.652 0.000 1 unchanged
#> 188 4 6 2 2.652 0.754 0.451 unchanged
#> 189 14 12 -2 2.652 -0.754 0.451 unchanged
#> 190 17 15 -2 2.652 -0.754 0.451 unchanged
#> 191 16 17 1 2.652 0.377 0.706 unchanged
#> 192 9 10 1 2.652 0.377 0.706 unchanged
#> 193 15 14 -1 2.652 -0.377 0.706 unchanged
#> 194 13 13 0 2.652 0.000 1 unchanged
#> 195 2 1 -1 2.652 -0.377 0.706 unchanged
#> 196 11 11 0 2.652 0.000 1 unchanged
#> 197 12 8 -4 2.652 -1.508 0.131 unchanged
#> 198 10 4 -6 2.652 -2.263 0.024 decreased
#> 199 14 14 0 2.652 0.000 1 unchanged
#> 200 8 14 6 2.652 2.263 0.024 increased
#> 201 10 16 6 2.652 2.263 0.024 increased
#> 202 4 5 1 2.652 0.377 0.706 unchanged
#> 203 7 7 0 2.652 0.000 1 unchanged
#> 204 6 4 -2 2.652 -0.754 0.451 unchanged
#> 205 18 13 -5 2.652 -1.885 0.059 unchanged
#> 206 19 17 -2 2.652 -0.754 0.451 unchanged
#> 207 6 5 -1 2.652 -0.377 0.706 unchanged
#> 208 9 4 -5 2.652 -1.885 0.059 unchanged
#> 209 2 4 2 2.652 0.754 0.451 unchanged
#> 210 12 10 -2 2.652 -0.754 0.451 unchanged
#> 211 4 10 6 2.652 2.263 0.024 increased
#> 212 12 10 -2 2.652 -0.754 0.451 unchanged
#> 213 17 16 -1 2.652 -0.377 0.706 unchanged
#> 214 9 8 -1 2.652 -0.377 0.706 unchanged
#> 215 14 14 0 2.652 0.000 1 unchanged
#> 216 1 0 -1 2.652 -0.377 0.706 unchanged
#> 217 8 4 -4 2.652 -1.508 0.131 unchanged
#> 218 18 9 -9 2.652 -3.394 0.001 decreased
#> 219 2 1 -1 2.652 -0.377 0.706 unchanged
#> 220 17 16 -1 2.652 -0.377 0.706 unchanged
#> 221 4 2 -2 2.652 -0.754 0.451 unchanged
#> 222 16 15 -1 2.652 -0.377 0.706 unchanged
#> 223 7 9 2 2.652 0.754 0.451 unchanged
#> 224 18 16 -2 2.652 -0.754 0.451 unchanged
#> 225 2 3 1 2.652 0.377 0.706 unchanged
#> 226 13 12 -1 2.652 -0.377 0.706 unchanged
#> 227 17 16 -1 2.652 -0.377 0.706 unchanged
#> 228 5 7 2 2.652 0.754 0.451 unchanged
#> 229 4 3 -1 2.652 -0.377 0.706 unchanged
#> 230 14 13 -1 2.652 -0.377 0.706 unchanged
#> 231 6 7 1 2.652 0.377 0.706 unchanged
#> 232 12 14 2 2.652 0.754 0.451 unchanged
#> 233 1 8 7 2.652 2.640 0.008 increased
#> 234 11 8 -3 2.652 -1.131 0.258 unchanged
#> 235 4 3 -1 2.652 -0.377 0.706 unchanged
#> 236 12 13 1 2.652 0.377 0.706 unchanged
#> 237 17 17 0 2.652 0.000 1 unchanged
#> 238 14 16 2 2.652 0.754 0.451 unchanged
#> 239 10 11 1 2.652 0.377 0.706 unchanged
#> 240 15 13 -2 2.652 -0.754 0.451 unchanged
#> 241 14 12 -2 2.652 -0.754 0.451 unchanged
#> 242 14 9 -5 2.652 -1.885 0.059 unchanged
#> 243 2 1 -1 2.652 -0.377 0.706 unchanged
#> 244 13 16 3 2.652 1.131 0.258 unchanged
#> 245 19 16 -3 2.652 -1.131 0.258 unchanged
#> 246 3 6 3 2.652 1.131 0.258 unchanged
#> 247 14 13 -1 2.652 -0.377 0.706 unchanged
#> 248 16 12 -4 2.652 -1.508 0.131 unchanged
#> 249 8 11 3 2.652 1.131 0.258 unchanged
#> 250 11 15 4 2.652 1.508 0.131 unchanged
#> 251 9 7 -2 2.652 -0.754 0.451 unchanged
#> 252 16 18 2 2.652 0.754 0.451 unchanged
#> 253 19 17 -2 2.652 -0.754 0.451 unchanged
#> 254 6 6 0 2.652 0.000 1 unchanged
#> 255 15 13 -2 2.652 -0.754 0.451 unchanged
#> 256 7 7 0 2.652 0.000 1 unchanged
#> 257 2 1 -1 2.652 -0.377 0.706 unchanged
#> 258 5 6 1 2.652 0.377 0.706 unchanged
#> 259 6 10 4 2.652 1.508 0.131 unchanged
#> 260 16 15 -1 2.652 -0.377 0.706 unchanged
#> 261 5 7 2 2.652 0.754 0.451 unchanged
#> 262 13 3 -10 2.652 -3.771 0 decreased
#> 263 6 4 -2 2.652 -0.754 0.451 unchanged
#> 264 6 5 -1 2.652 -0.377 0.706 unchanged
#> 265 11 7 -4 2.652 -1.508 0.131 unchanged
#> 266 15 17 2 2.652 0.754 0.451 unchanged
#> 267 13 12 -1 2.652 -0.377 0.706 unchanged
#> 268 15 17 2 2.652 0.754 0.451 unchanged
#> 269 8 8 0 2.652 0.000 1 unchanged
#> 270 12 8 -4 2.652 -1.508 0.131 unchanged
#> 271 15 13 -2 2.652 -0.754 0.451 unchanged
#> 272 7 11 4 2.652 1.508 0.131 unchanged
#> 273 7 11 4 2.652 1.508 0.131 unchanged
#> 274 3 6 3 2.652 1.131 0.258 unchanged
#> 275 12 9 -3 2.652 -1.131 0.258 unchanged
#> 276 6 9 3 2.652 1.131 0.258 unchanged
#> 277 11 9 -2 2.652 -0.754 0.451 unchanged
#> 278 16 17 1 2.652 0.377 0.706 unchanged
#> 279 17 16 -1 2.652 -0.377 0.706 unchanged
#> 280 2 4 2 2.652 0.754 0.451 unchanged
#> 281 3 2 -1 2.652 -0.377 0.706 unchanged
#> 282 2 1 -1 2.652 -0.377 0.706 unchanged
#> 283 18 16 -2 2.652 -0.754 0.451 unchanged
#> 284 9 11 2 2.652 0.754 0.451 unchanged
#> 285 5 8 3 2.652 1.131 0.258 unchanged
#> 286 10 13 3 2.652 1.131 0.258 unchanged
#> 287 4 5 1 2.652 0.377 0.706 unchanged
#> 288 16 16 0 2.652 0.000 1 unchanged
#> 289 2 5 3 2.652 1.131 0.258 unchanged
#> 290 19 19 0 2.652 0.000 1 unchanged
#> 291 10 11 1 2.652 0.377 0.706 unchanged
#> 292 6 4 -2 2.652 -0.754 0.451 unchanged
#> 293 2 3 1 2.652 0.377 0.706 unchanged
#> 294 9 9 0 2.652 0.000 1 unchanged
#> 295 9 11 2 2.652 0.754 0.451 unchanged
#> 296 3 5 2 2.652 0.754 0.451 unchanged
#> 297 8 5 -3 2.652 -1.131 0.258 unchanged
#> 298 5 3 -2 2.652 -0.754 0.451 unchanged
#> 299 13 11 -2 2.652 -0.754 0.451 unchanged
#> 300 18 16 -2 2.652 -0.754 0.451 unchanged
#> 301 7 3 -4 2.652 -1.508 0.131 unchanged
#> 302 14 14 0 2.652 0.000 1 unchanged
#> 303 8 4 -4 2.652 -1.508 0.131 unchanged
#> 304 13 13 0 2.652 0.000 1 unchanged
#> 305 4 3 -1 2.652 -0.377 0.706 unchanged
#> 306 6 1 -5 2.652 -1.885 0.059 unchanged
#> 307 9 9 0 2.652 0.000 1 unchanged
#> 308 3 10 7 2.652 2.640 0.008 increased
#> 309 2 1 -1 2.652 -0.377 0.706 unchanged
#> 310 16 20 4 2.652 1.508 0.131 unchanged
#> 311 2 4 2 2.652 0.754 0.451 unchanged
#> 312 14 16 2 2.652 0.754 0.451 unchanged
#> 313 14 12 -2 2.652 -0.754 0.451 unchanged
#> 314 1 3 2 2.652 0.754 0.451 unchanged
#> 315 9 10 1 2.652 0.377 0.706 unchanged
#> 316 10 11 1 2.652 0.377 0.706 unchanged
#> 317 12 14 2 2.652 0.754 0.451 unchanged
#> 318 16 17 1 2.652 0.377 0.706 unchanged
#> 319 16 15 -1 2.652 -0.377 0.706 unchanged
#> 320 20 20 0 2.652 0.000 1 unchanged
#> 321 1 2 1 2.652 0.377 0.706 unchanged
#> 322 9 11 2 2.652 0.754 0.451 unchanged
#> 323 14 11 -3 2.652 -1.131 0.258 unchanged
#> 324 17 17 0 2.652 0.000 1 unchanged
#> 325 3 4 1 2.652 0.377 0.706 unchanged
#> 326 2 4 2 2.652 0.754 0.451 unchanged
#> 327 14 16 2 2.652 0.754 0.451 unchanged
#> 328 11 14 3 2.652 1.131 0.258 unchanged
#> 329 4 5 1 2.652 0.377 0.706 unchanged
#> 330 8 8 0 2.652 0.000 1 unchanged
#> 331 0 0 0 2.652 0.000 1 unchanged
#> 332 15 13 -2 2.652 -0.754 0.451 unchanged
#> 333 6 1 -5 2.652 -1.885 0.059 unchanged
#> 334 3 4 1 2.652 0.377 0.706 unchanged
#> 335 14 14 0 2.652 0.000 1 unchanged
#> 336 16 13 -3 2.652 -1.131 0.258 unchanged
#> 337 15 16 1 2.652 0.377 0.706 unchanged
#> 338 12 10 -2 2.652 -0.754 0.451 unchanged
#> 339 12 9 -3 2.652 -1.131 0.258 unchanged
#> 340 18 16 -2 2.652 -0.754 0.451 unchanged
#> 341 4 1 -3 2.652 -1.131 0.258 unchanged
#> 342 8 5 -3 2.652 -1.131 0.258 unchanged
#> 343 13 14 1 2.652 0.377 0.706 unchanged
#> 344 13 13 0 2.652 0.000 1 unchanged
#> 345 17 15 -2 2.652 -0.754 0.451 unchanged
#> 346 11 13 2 2.652 0.754 0.451 unchanged
#> 347 5 3 -2 2.652 -0.754 0.451 unchanged
#> 348 9 8 -1 2.652 -0.377 0.706 unchanged
#> 349 8 11 3 2.652 1.131 0.258 unchanged
#> 350 11 13 2 2.652 0.754 0.451 unchanged
#> 351 12 8 -4 2.652 -1.508 0.131 unchanged
#> 352 14 19 5 2.652 1.885 0.059 unchanged
#> 353 7 4 -3 2.652 -1.131 0.258 unchanged
#> 354 1 1 0 2.652 0.000 1 unchanged
#> 355 5 1 -4 2.652 -1.508 0.131 unchanged
#> 356 12 8 -4 2.652 -1.508 0.131 unchanged
#> 357 2 6 4 2.652 1.508 0.131 unchanged
#> 358 18 16 -2 2.652 -0.754 0.451 unchanged
#> 359 17 16 -1 2.652 -0.377 0.706 unchanged
#> 360 10 5 -5 2.652 -1.885 0.059 unchanged
#> 361 17 14 -3 2.652 -1.131 0.258 unchanged
#> 362 12 16 4 2.652 1.508 0.131 unchanged
#> 363 8 8 0 2.652 0.000 1 unchanged
#> 364 8 8 0 2.652 0.000 1 unchanged
#> 365 15 12 -3 2.652 -1.131 0.258 unchanged
#> 366 18 17 -1 2.652 -0.377 0.706 unchanged
#> 367 5 9 4 2.652 1.508 0.131 unchanged
#> 368 18 17 -1 2.652 -0.377 0.706 unchanged
#> 369 12 10 -2 2.652 -0.754 0.451 unchanged
#> 370 8 8 0 2.652 0.000 1 unchanged
#> 371 10 8 -2 2.652 -0.754 0.451 unchanged
#> 372 16 13 -3 2.652 -1.131 0.258 unchanged
#> 373 18 16 -2 2.652 -0.754 0.451 unchanged
#> 374 19 18 -1 2.652 -0.377 0.706 unchanged
#> 375 4 3 -1 2.652 -0.377 0.706 unchanged
#> 376 16 19 3 2.652 1.131 0.258 unchanged
#> 377 13 9 -4 2.652 -1.508 0.131 unchanged
#> 378 6 10 4 2.652 1.508 0.131 unchanged
#> 379 13 13 0 2.652 0.000 1 unchanged
#> 380 12 7 -5 2.652 -1.885 0.059 unchanged
#> 381 10 12 2 2.652 0.754 0.451 unchanged
#> 382 3 1 -2 2.652 -0.754 0.451 unchanged
#> 383 7 4 -3 2.652 -1.131 0.258 unchanged
#> 384 4 9 5 2.652 1.885 0.059 unchanged
#> 385 19 20 1 2.652 0.377 0.706 unchanged
#> 386 13 9 -4 2.652 -1.508 0.131 unchanged
#> 387 2 1 -1 2.652 -0.377 0.706 unchanged
#> 388 7 6 -1 2.652 -0.377 0.706 unchanged
#> 389 3 6 3 2.652 1.131 0.258 unchanged
#> 390 12 11 -1 2.652 -0.377 0.706 unchanged
#> 391 17 16 -1 2.652 -0.377 0.706 unchanged
#> 392 15 18 3 2.652 1.131 0.258 unchanged
#> 393 14 15 1 2.652 0.377 0.706 unchanged
#> 394 20 15 -5 2.652 -1.885 0.059 unchanged
#> 395 6 2 -4 2.652 -1.508 0.131 unchanged
#> 396 19 18 -1 2.652 -0.377 0.706 unchanged
#> 397 1 10 9 2.652 3.394 0.001 increased
#> 398 18 19 1 2.652 0.377 0.706 unchanged
#> 399 17 16 -1 2.652 -0.377 0.706 unchanged
#> 400 16 17 1 2.652 0.377 0.706 unchanged
#> 401 14 11 -3 2.652 -1.131 0.258 unchanged
#> 402 17 16 -1 2.652 -0.377 0.706 unchanged
#> 403 10 8 -2 2.652 -0.754 0.451 unchanged
#> 404 3 7 4 2.652 1.508 0.131 unchanged
#> 405 9 9 0 2.652 0.000 1 unchanged
#> 406 4 4 0 2.652 0.000 1 unchanged
#> 407 15 12 -3 2.652 -1.131 0.258 unchanged
#> 408 20 14 -6 2.652 -2.263 0.024 decreased
#> 409 11 10 -1 2.652 -0.377 0.706 unchanged
#> 410 16 18 2 2.652 0.754 0.451 unchanged
#> 411 1 1 0 2.652 0.000 1 unchanged
#> 412 7 7 0 2.652 0.000 1 unchanged
#> 413 6 7 1 2.652 0.377 0.706 unchanged
#> 414 5 4 -1 2.652 -0.377 0.706 unchanged
#> 415 20 18 -2 2.652 -0.754 0.451 unchanged
#> 416 6 12 6 2.652 2.263 0.024 increased
#> 417 16 15 -1 2.652 -0.377 0.706 unchanged
#> 418 14 12 -2 2.652 -0.754 0.451 unchanged
#> 419 10 9 -1 2.652 -0.377 0.706 unchanged
#> 420 12 9 -3 2.652 -1.131 0.258 unchanged
#> 421 6 4 -2 2.652 -0.754 0.451 unchanged
#> 422 17 19 2 2.652 0.754 0.451 unchanged
#> 423 11 12 1 2.652 0.377 0.706 unchanged
#> 424 6 4 -2 2.652 -0.754 0.451 unchanged
#> 425 12 7 -5 2.652 -1.885 0.059 unchanged
#> 426 8 9 1 2.652 0.377 0.706 unchanged
#> 427 8 7 -1 2.652 -0.377 0.706 unchanged
#> 428 9 9 0 2.652 0.000 1 unchanged
#> 429 4 5 1 2.652 0.377 0.706 unchanged
#> 430 9 9 0 2.652 0.000 1 unchanged
#> 431 15 14 -1 2.652 -0.377 0.706 unchanged
#> 432 12 13 1 2.652 0.377 0.706 unchanged
#> 433 10 12 2 2.652 0.754 0.451 unchanged
#> 434 1 3 2 2.652 0.754 0.451 unchanged
#> 435 11 11 0 2.652 0.000 1 unchanged
#> 436 15 13 -2 2.652 -0.754 0.451 unchanged
#> 437 12 10 -2 2.652 -0.754 0.451 unchanged
#> 438 8 8 0 2.652 0.000 1 unchanged
#> 439 10 10 0 2.652 0.000 1 unchanged
#> 440 12 13 1 2.652 0.377 0.706 unchanged
#> 441 12 9 -3 2.652 -1.131 0.258 unchanged
#> 442 10 16 6 2.652 2.263 0.024 increased
#> 443 11 14 3 2.652 1.131 0.258 unchanged
#> 444 17 13 -4 2.652 -1.508 0.131 unchanged
#> 445 10 13 3 2.652 1.131 0.258 unchanged
#> 446 7 15 8 2.652 3.017 0.003 increased
#> 447 10 11 1 2.652 0.377 0.706 unchanged
#> 448 13 12 -1 2.652 -0.377 0.706 unchanged
#> 449 15 16 1 2.652 0.377 0.706 unchanged
#> 450 9 8 -1 2.652 -0.377 0.706 unchanged
#> 451 19 18 -1 2.652 -0.377 0.706 unchanged
#> 452 13 14 1 2.652 0.377 0.706 unchanged
#> 453 6 9 3 2.652 1.131 0.258 unchanged
#> 454 6 9 3 2.652 1.131 0.258 unchanged
#> 455 7 8 1 2.652 0.377 0.706 unchanged
#> 456 5 6 1 2.652 0.377 0.706 unchanged
#> 457 15 11 -4 2.652 -1.508 0.131 unchanged
#> 458 14 13 -1 2.652 -0.377 0.706 unchanged
#> 459 10 10 0 2.652 0.000 1 unchanged
#> 460 4 7 3 2.652 1.131 0.258 unchanged
#> 461 11 12 1 2.652 0.377 0.706 unchanged
#> 462 10 9 -1 2.652 -0.377 0.706 unchanged
#> 463 18 18 0 2.652 0.000 1 unchanged
#> 464 6 9 3 2.652 1.131 0.258 unchanged
#> 465 6 11 5 2.652 1.885 0.059 unchanged
#> 466 15 16 1 2.652 0.377 0.706 unchanged
#> 467 17 15 -2 2.652 -0.754 0.451 unchanged
#> 468 7 7 0 2.652 0.000 1 unchanged
#> 469 9 11 2 2.652 0.754 0.451 unchanged
#> 470 4 5 1 2.652 0.377 0.706 unchanged
#> 471 7 7 0 2.652 0.000 1 unchanged
#> 472 2 3 1 2.652 0.377 0.706 unchanged
#> 473 18 16 -2 2.652 -0.754 0.451 unchanged
#> 474 10 10 0 2.652 0.000 1 unchanged
#> 475 17 14 -3 2.652 -1.131 0.258 unchanged
#> 476 7 7 0 2.652 0.000 1 unchanged
#> 477 17 17 0 2.652 0.000 1 unchanged
#> 478 6 7 1 2.652 0.377 0.706 unchanged
#> 479 14 13 -1 2.652 -0.377 0.706 unchanged
#> 480 9 9 0 2.652 0.000 1 unchanged
#> 481 11 11 0 2.652 0.000 1 unchanged
#> 482 18 18 0 2.652 0.000 1 unchanged
#> 483 8 8 0 2.652 0.000 1 unchanged
#> 484 5 10 5 2.652 1.885 0.059 unchanged
#> 485 4 2 -2 2.652 -0.754 0.451 unchanged
#> 486 6 7 1 2.652 0.377 0.706 unchanged
#> 487 18 15 -3 2.652 -1.131 0.258 unchanged
#> 488 13 17 4 2.652 1.508 0.131 unchanged
#> 489 12 14 2 2.652 0.754 0.451 unchanged
#> 490 2 2 0 2.652 0.000 1 unchanged
#> 491 6 6 0 2.652 0.000 1 unchanged
#> 492 6 6 0 2.652 0.000 1 unchanged
#> 493 6 5 -1 2.652 -0.377 0.706 unchanged
#> 494 9 8 -1 2.652 -0.377 0.706 unchanged
#> 495 6 3 -3 2.652 -1.131 0.258 unchanged
#> 496 8 5 -3 2.652 -1.131 0.258 unchanged
#> 497 6 5 -1 2.652 -0.377 0.706 unchanged
#> 498 9 13 4 2.652 1.508 0.131 unchanged
#> 499 16 18 2 2.652 0.754 0.451 unchanged
#> 500 6 5 -1 2.652 -0.377 0.706 unchanged
#> 501 2 1 -1 2.652 -0.377 0.706 unchanged
#> 502 17 18 1 2.652 0.377 0.706 unchanged
#> 503 4 8 4 2.652 1.508 0.131 unchanged
#> 504 4 4 0 2.652 0.000 1 unchanged
#> 505 3 6 3 2.652 1.131 0.258 unchanged
#> 506 10 11 1 2.652 0.377 0.706 unchanged
#> 507 16 18 2 2.652 0.754 0.451 unchanged
#> 508 16 12 -4 2.652 -1.508 0.131 unchanged
#> 509 4 4 0 2.652 0.000 1 unchanged
#> 510 12 11 -1 2.652 -0.377 0.706 unchanged
#> 511 13 9 -4 2.652 -1.508 0.131 unchanged
#> 512 12 7 -5 2.652 -1.885 0.059 unchanged
#> 513 5 4 -1 2.652 -0.377 0.706 unchanged
#> 514 13 13 0 2.652 0.000 1 unchanged
#> 515 18 19 1 2.652 0.377 0.706 unchanged
#> 516 4 3 -1 2.652 -0.377 0.706 unchanged
#> 517 1 3 2 2.652 0.754 0.451 unchanged
#> 518 11 10 -1 2.652 -0.377 0.706 unchanged
#> 519 14 12 -2 2.652 -0.754 0.451 unchanged
#> 520 14 13 -1 2.652 -0.377 0.706 unchanged
#> 521 8 4 -4 2.652 -1.508 0.131 unchanged
#> 522 1 7 6 2.652 2.263 0.024 increased
#> 523 14 15 1 2.652 0.377 0.706 unchanged
#> 524 6 2 -4 2.652 -1.508 0.131 unchanged
#> 525 16 16 0 2.652 0.000 1 unchanged
#> 526 12 8 -4 2.652 -1.508 0.131 unchanged
#> 527 15 10 -5 2.652 -1.885 0.059 unchanged
#> 528 17 17 0 2.652 0.000 1 unchanged
#> 529 3 5 2 2.652 0.754 0.451 unchanged
#> 530 9 8 -1 2.652 -0.377 0.706 unchanged
#> 531 13 13 0 2.652 0.000 1 unchanged
#> 532 8 4 -4 2.652 -1.508 0.131 unchanged
#> 533 18 16 -2 2.652 -0.754 0.451 unchanged
#> 534 13 11 -2 2.652 -0.754 0.451 unchanged
#> 535 17 15 -2 2.652 -0.754 0.451 unchanged
#> 536 13 12 -1 2.652 -0.377 0.706 unchanged
#> 537 15 18 3 2.652 1.131 0.258 unchanged
#> 538 10 12 2 2.652 0.754 0.451 unchanged
#> 539 8 15 7 2.652 2.640 0.008 increased
#> 540 14 12 -2 2.652 -0.754 0.451 unchanged
#> 541 15 13 -2 2.652 -0.754 0.451 unchanged
#> 542 15 15 0 2.652 0.000 1 unchanged
#> 543 3 1 -2 2.652 -0.754 0.451 unchanged
#> 544 6 4 -2 2.652 -0.754 0.451 unchanged
#> 545 12 12 0 2.652 0.000 1 unchanged
#> 546 4 3 -1 2.652 -0.377 0.706 unchanged
#> 547 12 9 -3 2.652 -1.131 0.258 unchanged
#> 548 4 3 -1 2.652 -0.377 0.706 unchanged
#> 549 13 11 -2 2.652 -0.754 0.451 unchanged
#> 550 17 16 -1 2.652 -0.377 0.706 unchanged
#> 551 9 11 2 2.652 0.754 0.451 unchanged
#> 552 15 19 4 2.652 1.508 0.131 unchanged
#> 553 4 3 -1 2.652 -0.377 0.706 unchanged
#> 554 8 3 -5 2.652 -1.885 0.059 unchanged
#> 555 15 16 1 2.652 0.377 0.706 unchanged
#> 556 18 19 1 2.652 0.377 0.706 unchanged
#> 557 14 16 2 2.652 0.754 0.451 unchanged
#> 558 1 2 1 2.652 0.377 0.706 unchanged
#> 559 13 14 1 2.652 0.377 0.706 unchanged
#> 560 10 4 -6 2.652 -2.263 0.024 decreased
#> 561 1 3 2 2.652 0.754 0.451 unchanged
#> 562 19 19 0 2.652 0.000 1 unchanged
#> 563 6 4 -2 2.652 -0.754 0.451 unchanged
#> 564 12 8 -4 2.652 -1.508 0.131 unchanged
#> 565 8 10 2 2.652 0.754 0.451 unchanged
#> 566 13 16 3 2.652 1.131 0.258 unchanged
#> 567 11 13 2 2.652 0.754 0.451 unchanged
#> 568 9 7 -2 2.652 -0.754 0.451 unchanged
#> 569 5 4 -1 2.652 -0.377 0.706 unchanged
#> 570 3 1 -2 2.652 -0.754 0.451 unchanged
#> 571 17 19 2 2.652 0.754 0.451 unchanged
#> 572 13 18 5 2.652 1.885 0.059 unchanged
#> 573 16 15 -1 2.652 -0.377 0.706 unchanged
#> 574 17 12 -5 2.652 -1.885 0.059 unchanged
#> 575 14 14 0 2.652 0.000 1 unchanged
#> 576 5 9 4 2.652 1.508 0.131 unchanged
#> 577 9 6 -3 2.652 -1.131 0.258 unchanged
#> 578 19 16 -3 2.652 -1.131 0.258 unchanged
#> 579 4 8 4 2.652 1.508 0.131 unchanged
#> 580 3 4 1 2.652 0.377 0.706 unchanged
#> 581 15 14 -1 2.652 -0.377 0.706 unchanged
#> 582 9 9 0 2.652 0.000 1 unchanged
#> 583 9 8 -1 2.652 -0.377 0.706 unchanged
#> 584 19 20 1 2.652 0.377 0.706 unchanged
#> 585 7 6 -1 2.652 -0.377 0.706 unchanged
#> 586 1 1 0 2.652 0.000 1 unchanged
#> 587 15 16 1 2.652 0.377 0.706 unchanged
#> 588 16 16 0 2.652 0.000 1 unchanged
#> 589 11 11 0 2.652 0.000 1 unchanged
#> 590 8 10 2 2.652 0.754 0.451 unchanged
#> 591 16 19 3 2.652 1.131 0.258 unchanged
#> 592 10 11 1 2.652 0.377 0.706 unchanged
#> 593 13 15 2 2.652 0.754 0.451 unchanged
#> 594 17 16 -1 2.652 -0.377 0.706 unchanged
#> 595 12 14 2 2.652 0.754 0.451 unchanged
#> 596 10 11 1 2.652 0.377 0.706 unchanged
#> 597 5 4 -1 2.652 -0.377 0.706 unchanged
#> 598 11 11 0 2.652 0.000 1 unchanged
#> 599 12 12 0 2.652 0.000 1 unchanged
#> 600 17 19 2 2.652 0.754 0.451 unchanged
#> 601 4 11 7 2.652 2.640 0.008 increased
#> 602 19 19 0 2.652 0.000 1 unchanged
#> 603 7 6 -1 2.652 -0.377 0.706 unchanged
#> 604 18 15 -3 2.652 -1.131 0.258 unchanged
#> 605 10 10 0 2.652 0.000 1 unchanged
#> 606 11 11 0 2.652 0.000 1 unchanged
#> 607 4 10 6 2.652 2.263 0.024 increased
#> 608 10 10 0 2.652 0.000 1 unchanged
#> 609 8 6 -2 2.652 -0.754 0.451 unchanged
#> 610 8 8 0 2.652 0.000 1 unchanged
#> 611 9 14 5 2.652 1.885 0.059 unchanged
#> 612 12 13 1 2.652 0.377 0.706 unchanged
#> 613 12 12 0 2.652 0.000 1 unchanged
#> 614 2 0 -2 2.652 -0.754 0.451 unchanged
#> 615 5 6 1 2.652 0.377 0.706 unchanged
#> 616 2 3 1 2.652 0.377 0.706 unchanged
#> 617 9 13 4 2.652 1.508 0.131 unchanged
#> 618 18 16 -2 2.652 -0.754 0.451 unchanged
#> 619 14 16 2 2.652 0.754 0.451 unchanged
#> 620 9 8 -1 2.652 -0.377 0.706 unchanged
#> 621 11 6 -5 2.652 -1.885 0.059 unchanged
#> 622 10 6 -4 2.652 -1.508 0.131 unchanged
#> 623 8 8 0 2.652 0.000 1 unchanged
#> 624 5 3 -2 2.652 -0.754 0.451 unchanged
#> 625 8 10 2 2.652 0.754 0.451 unchanged
#> 626 12 12 0 2.652 0.000 1 unchanged
#> 627 18 17 -1 2.652 -0.377 0.706 unchanged
#> 628 12 11 -1 2.652 -0.377 0.706 unchanged
#> 629 10 14 4 2.652 1.508 0.131 unchanged
#> 630 15 16 1 2.652 0.377 0.706 unchanged
#> 631 6 8 2 2.652 0.754 0.451 unchanged
#> 632 15 14 -1 2.652 -0.377 0.706 unchanged
#> 633 7 5 -2 2.652 -0.754 0.451 unchanged
#> 634 18 15 -3 2.652 -1.131 0.258 unchanged
#> 635 15 12 -3 2.652 -1.131 0.258 unchanged
#> 636 15 15 0 2.652 0.000 1 unchanged
#> 637 14 20 6 2.652 2.263 0.024 increased
#> 638 16 14 -2 2.652 -0.754 0.451 unchanged
#> 639 16 16 0 2.652 0.000 1 unchanged
#> 640 13 15 2 2.652 0.754 0.451 unchanged
#> 641 9 10 1 2.652 0.377 0.706 unchanged
#> 642 8 11 3 2.652 1.131 0.258 unchanged
#> 643 16 18 2 2.652 0.754 0.451 unchanged
#> 644 17 15 -2 2.652 -0.754 0.451 unchanged
#> 645 11 9 -2 2.652 -0.754 0.451 unchanged
#> 646 20 18 -2 2.652 -0.754 0.451 unchanged
#> 647 14 11 -3 2.652 -1.131 0.258 unchanged
#> 648 14 15 1 2.652 0.377 0.706 unchanged
#> 649 11 5 -6 2.652 -2.263 0.024 decreased
#> 650 9 9 0 2.652 0.000 1 unchanged
#> 651 11 12 1 2.652 0.377 0.706 unchanged
#> 652 5 5 0 2.652 0.000 1 unchanged
#> 653 7 4 -3 2.652 -1.131 0.258 unchanged
#> 654 7 8 1 2.652 0.377 0.706 unchanged
#> 655 11 11 0 2.652 0.000 1 unchanged
#> 656 5 5 0 2.652 0.000 1 unchanged
#> 657 15 15 0 2.652 0.000 1 unchanged
#> 658 12 15 3 2.652 1.131 0.258 unchanged
#> 659 10 15 5 2.652 1.885 0.059 unchanged
#> 660 12 14 2 2.652 0.754 0.451 unchanged
#> 661 10 10 0 2.652 0.000 1 unchanged
#> 662 5 7 2 2.652 0.754 0.451 unchanged
#> 663 14 10 -4 2.652 -1.508 0.131 unchanged
#> 664 12 14 2 2.652 0.754 0.451 unchanged
#> 665 12 10 -2 2.652 -0.754 0.451 unchanged
#> 666 3 4 1 2.652 0.377 0.706 unchanged
#> 667 9 14 5 2.652 1.885 0.059 unchanged
#> 668 13 17 4 2.652 1.508 0.131 unchanged
#> 669 7 7 0 2.652 0.000 1 unchanged
#> 670 14 13 -1 2.652 -0.377 0.706 unchanged
#> 671 19 18 -1 2.652 -0.377 0.706 unchanged
#> 672 9 9 0 2.652 0.000 1 unchanged
#> 673 13 15 2 2.652 0.754 0.451 unchanged
#> 674 3 5 2 2.652 0.754 0.451 unchanged
#> 675 1 3 2 2.652 0.754 0.451 unchanged
#> 676 15 15 0 2.652 0.000 1 unchanged
#> 677 1 3 2 2.652 0.754 0.451 unchanged
#> 678 19 15 -4 2.652 -1.508 0.131 unchanged
#> 679 0 3 3 2.652 1.131 0.258 unchanged
#> 680 18 17 -1 2.652 -0.377 0.706 unchanged
#> 681 9 15 6 2.652 2.263 0.024 increased
#> 682 18 18 0 2.652 0.000 1 unchanged
#> 683 11 7 -4 2.652 -1.508 0.131 unchanged
#> 684 17 17 0 2.652 0.000 1 unchanged
#> 685 9 9 0 2.652 0.000 1 unchanged
#> 686 2 5 3 2.652 1.131 0.258 unchanged
#> 687 13 14 1 2.652 0.377 0.706 unchanged
#> 688 15 13 -2 2.652 -0.754 0.451 unchanged
#> 689 18 18 0 2.652 0.000 1 unchanged
#> 690 10 13 3 2.652 1.131 0.258 unchanged
#> 691 14 14 0 2.652 0.000 1 unchanged
#> 692 12 9 -3 2.652 -1.131 0.258 unchanged
#> 693 9 9 0 2.652 0.000 1 unchanged
#> 694 14 11 -3 2.652 -1.131 0.258 unchanged
#> 695 14 15 1 2.652 0.377 0.706 unchanged
#> 696 6 8 2 2.652 0.754 0.451 unchanged
#> 697 7 7 0 2.652 0.000 1 unchanged
#> 698 12 8 -4 2.652 -1.508 0.131 unchanged
#> 699 7 9 2 2.652 0.754 0.451 unchanged
#> 700 12 12 0 2.652 0.000 1 unchanged
#> 701 17 14 -3 2.652 -1.131 0.258 unchanged
#> 702 14 12 -2 2.652 -0.754 0.451 unchanged
#> 703 15 16 1 2.652 0.377 0.706 unchanged
#> 704 12 10 -2 2.652 -0.754 0.451 unchanged
#> 705 5 8 3 2.652 1.131 0.258 unchanged
#> 706 9 8 -1 2.652 -0.377 0.706 unchanged
#> 707 3 3 0 2.652 0.000 1 unchanged
#> 708 4 4 0 2.652 0.000 1 unchanged
#> 709 10 12 2 2.652 0.754 0.451 unchanged
#> 710 17 15 -2 2.652 -0.754 0.451 unchanged
#> 711 13 12 -1 2.652 -0.377 0.706 unchanged
#> 712 10 9 -1 2.652 -0.377 0.706 unchanged
#> 713 16 12 -4 2.652 -1.508 0.131 unchanged
#> 714 12 11 -1 2.652 -0.377 0.706 unchanged
#> 715 16 13 -3 2.652 -1.131 0.258 unchanged
#> 716 4 5 1 2.652 0.377 0.706 unchanged
#> 717 14 17 3 2.652 1.131 0.258 unchanged
#> 718 2 0 -2 2.652 -0.754 0.451 unchanged
#> 719 6 2 -4 2.652 -1.508 0.131 unchanged
#> 720 3 8 5 2.652 1.885 0.059 unchanged
#> 721 16 16 0 2.652 0.000 1 unchanged
#> 722 1 2 1 2.652 0.377 0.706 unchanged
#> 723 19 16 -3 2.652 -1.131 0.258 unchanged
#> 724 13 8 -5 2.652 -1.885 0.059 unchanged
#> 725 13 20 7 2.652 2.640 0.008 increased
#> 726 4 3 -1 2.652 -0.377 0.706 unchanged
#> 727 15 11 -4 2.652 -1.508 0.131 unchanged
#> 728 5 4 -1 2.652 -0.377 0.706 unchanged
#> 729 7 4 -3 2.652 -1.131 0.258 unchanged
#> 730 6 6 0 2.652 0.000 1 unchanged
#> 731 4 5 1 2.652 0.377 0.706 unchanged
#> 732 6 12 6 2.652 2.263 0.024 increased
#> 733 19 18 -1 2.652 -0.377 0.706 unchanged
#> 734 3 7 4 2.652 1.508 0.131 unchanged
#> 735 14 14 0 2.652 0.000 1 unchanged
#> 736 11 14 3 2.652 1.131 0.258 unchanged
#> 737 13 17 4 2.652 1.508 0.131 unchanged
#> 738 8 10 2 2.652 0.754 0.451 unchanged
#> 739 11 7 -4 2.652 -1.508 0.131 unchanged
#> 740 9 17 8 2.652 3.017 0.003 increased
#> 741 2 3 1 2.652 0.377 0.706 unchanged
#> 742 3 2 -1 2.652 -0.377 0.706 unchanged
#> 743 9 11 2 2.652 0.754 0.451 unchanged
#> 744 8 6 -2 2.652 -0.754 0.451 unchanged
#> 745 18 20 2 2.652 0.754 0.451 unchanged
#> 746 14 17 3 2.652 1.131 0.258 unchanged
#> 747 13 14 1 2.652 0.377 0.706 unchanged
#> 748 2 1 -1 2.652 -0.377 0.706 unchanged
#> 749 15 12 -3 2.652 -1.131 0.258 unchanged
#> 750 6 8 2 2.652 0.754 0.451 unchanged
#> 751 5 4 -1 2.652 -0.377 0.706 unchanged
#> 752 17 20 3 2.652 1.131 0.258 unchanged
#> 753 3 2 -1 2.652 -0.377 0.706 unchanged
#> 754 14 12 -2 2.652 -0.754 0.451 unchanged
#> 755 8 9 1 2.652 0.377 0.706 unchanged
#> 756 1 2 1 2.652 0.377 0.706 unchanged
#> 757 3 2 -1 2.652 -0.377 0.706 unchanged
#> 758 7 6 -1 2.652 -0.377 0.706 unchanged
#> 759 7 7 0 2.652 0.000 1 unchanged
#> 760 13 11 -2 2.652 -0.754 0.451 unchanged
#> 761 15 16 1 2.652 0.377 0.706 unchanged
#> 762 11 13 2 2.652 0.754 0.451 unchanged
#> 763 9 10 1 2.652 0.377 0.706 unchanged
#> 764 16 17 1 2.652 0.377 0.706 unchanged
#> 765 11 13 2 2.652 0.754 0.451 unchanged
#> 766 17 19 2 2.652 0.754 0.451 unchanged
#> 767 13 11 -2 2.652 -0.754 0.451 unchanged
#> 768 12 11 -1 2.652 -0.377 0.706 unchanged
#> 769 13 13 0 2.652 0.000 1 unchanged
#> 770 14 13 -1 2.652 -0.377 0.706 unchanged
#> 771 10 9 -1 2.652 -0.377 0.706 unchanged
#> 772 6 7 1 2.652 0.377 0.706 unchanged
#> 773 13 6 -7 2.652 -2.640 0.008 decreased
#> 774 9 7 -2 2.652 -0.754 0.451 unchanged
#> 775 13 13 0 2.652 0.000 1 unchanged
#> 776 15 14 -1 2.652 -0.377 0.706 unchanged
#> 777 6 7 1 2.652 0.377 0.706 unchanged
#> 778 2 7 5 2.652 1.885 0.059 unchanged
#> 779 11 15 4 2.652 1.508 0.131 unchanged
#> 780 7 13 6 2.652 2.263 0.024 increased
#> 781 10 10 0 2.652 0.000 1 unchanged
#> 782 17 16 -1 2.652 -0.377 0.706 unchanged
#> 783 20 19 -1 2.652 -0.377 0.706 unchanged
#> 784 10 5 -5 2.652 -1.885 0.059 unchanged
#> 785 16 18 2 2.652 0.754 0.451 unchanged
#> 786 6 3 -3 2.652 -1.131 0.258 unchanged
#> 787 6 8 2 2.652 0.754 0.451 unchanged
#> 788 17 15 -2 2.652 -0.754 0.451 unchanged
#> 789 12 7 -5 2.652 -1.885 0.059 unchanged
#> 790 3 4 1 2.652 0.377 0.706 unchanged
#> 791 3 3 0 2.652 0.000 1 unchanged
#> 792 13 16 3 2.652 1.131 0.258 unchanged
#> 793 8 5 -3 2.652 -1.131 0.258 unchanged
#> 794 9 5 -4 2.652 -1.508 0.131 unchanged
#> 795 5 8 3 2.652 1.131 0.258 unchanged
#> 796 12 16 4 2.652 1.508 0.131 unchanged
#> 797 16 15 -1 2.652 -0.377 0.706 unchanged
#> 798 11 14 3 2.652 1.131 0.258 unchanged
#> 799 7 6 -1 2.652 -0.377 0.706 unchanged
#> 800 5 3 -2 2.652 -0.754 0.451 unchanged
#> 801 2 5 3 2.652 1.131 0.258 unchanged
#> 802 11 14 3 2.652 1.131 0.258 unchanged
#> 803 4 2 -2 2.652 -0.754 0.451 unchanged
#> 804 6 11 5 2.652 1.885 0.059 unchanged
#> 805 10 10 0 2.652 0.000 1 unchanged
#> 806 11 11 0 2.652 0.000 1 unchanged
#> 807 16 19 3 2.652 1.131 0.258 unchanged
#> 808 16 19 3 2.652 1.131 0.258 unchanged
#> 809 3 1 -2 2.652 -0.754 0.451 unchanged
#> 810 14 14 0 2.652 0.000 1 unchanged
#> 811 16 18 2 2.652 0.754 0.451 unchanged
#> 812 5 5 0 2.652 0.000 1 unchanged
#> 813 18 17 -1 2.652 -0.377 0.706 unchanged
#> 814 7 5 -2 2.652 -0.754 0.451 unchanged
#> 815 13 10 -3 2.652 -1.131 0.258 unchanged
#> 816 5 2 -3 2.652 -1.131 0.258 unchanged
#> 817 3 3 0 2.652 0.000 1 unchanged
#> 818 18 15 -3 2.652 -1.131 0.258 unchanged
#> 819 9 8 -1 2.652 -0.377 0.706 unchanged
#> 820 11 9 -2 2.652 -0.754 0.451 unchanged
#> 821 14 16 2 2.652 0.754 0.451 unchanged
#> 822 4 4 0 2.652 0.000 1 unchanged
#> 823 5 8 3 2.652 1.131 0.258 unchanged
#> 824 6 8 2 2.652 0.754 0.451 unchanged
#> 825 18 19 1 2.652 0.377 0.706 unchanged
#> 826 12 12 0 2.652 0.000 1 unchanged
#> 827 7 7 0 2.652 0.000 1 unchanged
#> 828 7 5 -2 2.652 -0.754 0.451 unchanged
#> 829 1 1 0 2.652 0.000 1 unchanged
#> 830 8 9 1 2.652 0.377 0.706 unchanged
#> 831 10 6 -4 2.652 -1.508 0.131 unchanged
#> 832 12 9 -3 2.652 -1.131 0.258 unchanged
#> 833 14 18 4 2.652 1.508 0.131 unchanged
#> 834 4 4 0 2.652 0.000 1 unchanged
#> 835 7 12 5 2.652 1.885 0.059 unchanged
#> 836 16 11 -5 2.652 -1.885 0.059 unchanged
#> 837 11 13 2 2.652 0.754 0.451 unchanged
#> 838 10 11 1 2.652 0.377 0.706 unchanged
#> 839 16 15 -1 2.652 -0.377 0.706 unchanged
#> 840 19 12 -7 2.652 -2.640 0.008 decreased
#> 841 5 5 0 2.652 0.000 1 unchanged
#> 842 8 6 -2 2.652 -0.754 0.451 unchanged
#> 843 7 9 2 2.652 0.754 0.451 unchanged
#> 844 8 7 -1 2.652 -0.377 0.706 unchanged
#> 845 17 19 2 2.652 0.754 0.451 unchanged
#> 846 11 13 2 2.652 0.754 0.451 unchanged
#> 847 9 9 0 2.652 0.000 1 unchanged
#> 848 19 19 0 2.652 0.000 1 unchanged
#> 849 7 10 3 2.652 1.131 0.258 unchanged
#> 850 18 17 -1 2.652 -0.377 0.706 unchanged
#> 851 11 11 0 2.652 0.000 1 unchanged
#> 852 15 17 2 2.652 0.754 0.451 unchanged
#> 853 11 9 -2 2.652 -0.754 0.451 unchanged
#> 854 9 6 -3 2.652 -1.131 0.258 unchanged
#> 855 14 12 -2 2.652 -0.754 0.451 unchanged
#> 856 12 16 4 2.652 1.508 0.131 unchanged
#> 857 7 11 4 2.652 1.508 0.131 unchanged
#> 858 6 9 3 2.652 1.131 0.258 unchanged
#> 859 3 1 -2 2.652 -0.754 0.451 unchanged
#> 860 9 3 -6 2.652 -2.263 0.024 decreased
#> 861 18 16 -2 2.652 -0.754 0.451 unchanged
#> 862 14 17 3 2.652 1.131 0.258 unchanged
#> 863 6 7 1 2.652 0.377 0.706 unchanged
#> 864 11 9 -2 2.652 -0.754 0.451 unchanged
#> 865 14 13 -1 2.652 -0.377 0.706 unchanged
#> 866 15 14 -1 2.652 -0.377 0.706 unchanged
#> 867 14 14 0 2.652 0.000 1 unchanged
#> 868 11 9 -2 2.652 -0.754 0.451 unchanged
#> 869 11 14 3 2.652 1.131 0.258 unchanged
#> 870 3 2 -1 2.652 -0.377 0.706 unchanged
#> 871 16 15 -1 2.652 -0.377 0.706 unchanged
#> 872 19 18 -1 2.652 -0.377 0.706 unchanged
#> 873 3 3 0 2.652 0.000 1 unchanged
#> 874 12 12 0 2.652 0.000 1 unchanged
#> 875 16 17 1 2.652 0.377 0.706 unchanged
#> 876 14 15 1 2.652 0.377 0.706 unchanged
#> 877 3 1 -2 2.652 -0.754 0.451 unchanged
#> 878 12 18 6 2.652 2.263 0.024 increased
#> 879 16 15 -1 2.652 -0.377 0.706 unchanged
#> 880 12 17 5 2.652 1.885 0.059 unchanged
#> 881 5 6 1 2.652 0.377 0.706 unchanged
#> 882 8 6 -2 2.652 -0.754 0.451 unchanged
#> 883 19 17 -2 2.652 -0.754 0.451 unchanged
#> 884 12 8 -4 2.652 -1.508 0.131 unchanged
#> 885 0 1 1 2.652 0.377 0.706 unchanged
#> 886 9 8 -1 2.652 -0.377 0.706 unchanged
#> 887 19 18 -1 2.652 -0.377 0.706 unchanged
#> 888 13 12 -1 2.652 -0.377 0.706 unchanged
#> 889 16 12 -4 2.652 -1.508 0.131 unchanged
#> 890 15 15 0 2.652 0.000 1 unchanged
#> 891 11 11 0 2.652 0.000 1 unchanged
#> 892 13 11 -2 2.652 -0.754 0.451 unchanged
#> 893 10 7 -3 2.652 -1.131 0.258 unchanged
#> 894 12 13 1 2.652 0.377 0.706 unchanged
#> 895 12 12 0 2.652 0.000 1 unchanged
#> 896 17 16 -1 2.652 -0.377 0.706 unchanged
#> 897 16 13 -3 2.652 -1.131 0.258 unchanged
#> 898 12 9 -3 2.652 -1.131 0.258 unchanged
#> 899 6 10 4 2.652 1.508 0.131 unchanged
#> 900 4 5 1 2.652 0.377 0.706 unchanged
#> 901 4 7 3 2.652 1.131 0.258 unchanged
#> 902 3 8 5 2.652 1.885 0.059 unchanged
#> 903 16 14 -2 2.652 -0.754 0.451 unchanged
#> 904 3 4 1 2.652 0.377 0.706 unchanged
#> 905 15 16 1 2.652 0.377 0.706 unchanged
#> 906 16 15 -1 2.652 -0.377 0.706 unchanged
#> 907 13 11 -2 2.652 -0.754 0.451 unchanged
#> 908 6 7 1 2.652 0.377 0.706 unchanged
#> 909 2 4 2 2.652 0.754 0.451 unchanged
#> 910 6 14 8 2.652 3.017 0.003 increased
#> 911 15 9 -6 2.652 -2.263 0.024 decreased
#> 912 4 4 0 2.652 0.000 1 unchanged
#> 913 4 5 1 2.652 0.377 0.706 unchanged
#> 914 13 11 -2 2.652 -0.754 0.451 unchanged
#> 915 17 17 0 2.652 0.000 1 unchanged
#> 916 7 9 2 2.652 0.754 0.451 unchanged
#> 917 13 18 5 2.652 1.885 0.059 unchanged
#> 918 10 9 -1 2.652 -0.377 0.706 unchanged
#> 919 8 3 -5 2.652 -1.885 0.059 unchanged
#> 920 18 20 2 2.652 0.754 0.451 unchanged
#> 921 5 5 0 2.652 0.000 1 unchanged
#> 922 18 16 -2 2.652 -0.754 0.451 unchanged
#> 923 13 12 -1 2.652 -0.377 0.706 unchanged
#> 924 12 12 0 2.652 0.000 1 unchanged
#> 925 18 14 -4 2.652 -1.508 0.131 unchanged
#> 926 6 10 4 2.652 1.508 0.131 unchanged
#> 927 10 8 -2 2.652 -0.754 0.451 unchanged
#> 928 6 9 3 2.652 1.131 0.258 unchanged
#> 929 9 12 3 2.652 1.131 0.258 unchanged
#> 930 12 14 2 2.652 0.754 0.451 unchanged
#> 931 6 8 2 2.652 0.754 0.451 unchanged
#> 932 11 16 5 2.652 1.885 0.059 unchanged
#> 933 11 11 0 2.652 0.000 1 unchanged
#> 934 1 2 1 2.652 0.377 0.706 unchanged
#> 935 17 18 1 2.652 0.377 0.706 unchanged
#> 936 3 5 2 2.652 0.754 0.451 unchanged
#> 937 9 5 -4 2.652 -1.508 0.131 unchanged
#> 938 17 14 -3 2.652 -1.131 0.258 unchanged
#> 939 5 4 -1 2.652 -0.377 0.706 unchanged
#> 940 2 4 2 2.652 0.754 0.451 unchanged
#> 941 19 17 -2 2.652 -0.754 0.451 unchanged
#> 942 6 6 0 2.652 0.000 1 unchanged
#> 943 14 19 5 2.652 1.885 0.059 unchanged
#> 944 16 16 0 2.652 0.000 1 unchanged
#> 945 19 15 -4 2.652 -1.508 0.131 unchanged
#> 946 7 8 1 2.652 0.377 0.706 unchanged
#> 947 18 14 -4 2.652 -1.508 0.131 unchanged
#> 948 7 7 0 2.652 0.000 1 unchanged
#> 949 16 16 0 2.652 0.000 1 unchanged
#> 950 10 10 0 2.652 0.000 1 unchanged
#> 951 15 18 3 2.652 1.131 0.258 unchanged
#> 952 11 15 4 2.652 1.508 0.131 unchanged
#> 953 14 14 0 2.652 0.000 1 unchanged
#> 954 16 15 -1 2.652 -0.377 0.706 unchanged
#> 955 10 7 -3 2.652 -1.131 0.258 unchanged
#> 956 14 18 4 2.652 1.508 0.131 unchanged
#> 957 10 14 4 2.652 1.508 0.131 unchanged
#> 958 4 8 4 2.652 1.508 0.131 unchanged
#> 959 6 7 1 2.652 0.377 0.706 unchanged
#> 960 9 7 -2 2.652 -0.754 0.451 unchanged
#> 961 14 16 2 2.652 0.754 0.451 unchanged
#> 962 13 14 1 2.652 0.377 0.706 unchanged
#> 963 11 11 0 2.652 0.000 1 unchanged
#> 964 8 6 -2 2.652 -0.754 0.451 unchanged
#> 965 8 8 0 2.652 0.000 1 unchanged
#> 966 13 8 -5 2.652 -1.885 0.059 unchanged
#> 967 14 10 -4 2.652 -1.508 0.131 unchanged
#> 968 7 9 2 2.652 0.754 0.451 unchanged
#> 969 10 12 2 2.652 0.754 0.451 unchanged
#> 970 10 13 3 2.652 1.131 0.258 unchanged
#> 971 11 9 -2 2.652 -0.754 0.451 unchanged
#> 972 6 5 -1 2.652 -0.377 0.706 unchanged
#> 973 15 13 -2 2.652 -0.754 0.451 unchanged
#> 974 8 5 -3 2.652 -1.131 0.258 unchanged
#> 975 5 7 2 2.652 0.754 0.451 unchanged
#> 976 15 11 -4 2.652 -1.508 0.131 unchanged
#> 977 10 9 -1 2.652 -0.377 0.706 unchanged
#> 978 15 12 -3 2.652 -1.131 0.258 unchanged
#> 979 13 11 -2 2.652 -0.754 0.451 unchanged
#> 980 8 6 -2 2.652 -0.754 0.451 unchanged
#> 981 9 11 2 2.652 0.754 0.451 unchanged
#> 982 16 15 -1 2.652 -0.377 0.706 unchanged
#> 983 9 10 1 2.652 0.377 0.706 unchanged
#> 984 2 3 1 2.652 0.377 0.706 unchanged
#> 985 16 13 -3 2.652 -1.131 0.258 unchanged
#> 986 18 12 -6 2.652 -2.263 0.024 decreased
#> 987 10 12 2 2.652 0.754 0.451 unchanged
#> 988 20 20 0 2.652 0.000 1 unchanged
#> 989 13 13 0 2.652 0.000 1 unchanged
#> 990 10 10 0 2.652 0.000 1 unchanged
#> 991 7 7 0 2.652 0.000 1 unchanged
#> 992 6 3 -3 2.652 -1.131 0.258 unchanged
#> 993 9 8 -1 2.652 -0.377 0.706 unchanged
#> 994 12 11 -1 2.652 -0.377 0.706 unchanged
#> 995 5 5 0 2.652 0.000 1 unchanged
#> 996 16 19 3 2.652 1.131 0.258 unchanged
#> 997 6 7 1 2.652 0.377 0.706 unchanged
#> 998 8 9 1 2.652 0.377 0.706 unchanged
#> 999 15 11 -4 2.652 -1.508 0.131 unchanged
#> 1000 5 7 2 2.652 0.754 0.451 unchanged
# allows SEM.post != SEM.pre
(istats.post <- itemstats(dat_post)$overall)
#> N mean_total.score sd_total.score ave.r sd.r alpha SEM.alpha
#> 1000 10.3 5.018 0.231 0.082 0.858 1.889
SEM.alpha.post <- istats.post$SEM.alpha
RCI(predat = dat_pre, postdat = dat_post,
SEM.pre=SEM.alpha, SEM.post=SEM.alpha.post)
#> pre.score post.score diff SEM z p
#> 1 7 1 -6 2.662 -2.254 0.024
#> 2 16 9 -7 2.662 -2.630 0.009
#> 3 8 0 -8 2.662 -3.006 0.003
#> 4 2 6 4 2.662 1.503 0.133
#> 5 10 10 0 2.662 0.000 1
#> 6 10 10 0 2.662 0.000 1
#> 7 9 10 1 2.662 0.376 0.707
#> 8 16 19 3 2.662 1.127 0.26
#> 9 6 4 -2 2.662 -0.751 0.452
#> 10 12 11 -1 2.662 -0.376 0.707
#> 11 5 8 3 2.662 1.127 0.26
#> 12 15 15 0 2.662 0.000 1
#> 13 7 9 2 2.662 0.751 0.452
#> 14 8 13 5 2.662 1.879 0.06
#> 15 2 4 2 2.662 0.751 0.452
#> 16 2 2 0 2.662 0.000 1
#> 17 18 19 1 2.662 0.376 0.707
#> 18 14 17 3 2.662 1.127 0.26
#> 19 3 4 1 2.662 0.376 0.707
#> 20 9 9 0 2.662 0.000 1
#> 21 5 5 0 2.662 0.000 1
#> 22 3 8 5 2.662 1.879 0.06
#> 23 9 7 -2 2.662 -0.751 0.452
#> 24 15 13 -2 2.662 -0.751 0.452
#> 25 11 12 1 2.662 0.376 0.707
#> 26 10 11 1 2.662 0.376 0.707
#> 27 1 0 -1 2.662 -0.376 0.707
#> 28 11 8 -3 2.662 -1.127 0.26
#> 29 1 3 2 2.662 0.751 0.452
#> 30 9 14 5 2.662 1.879 0.06
#> 31 19 18 -1 2.662 -0.376 0.707
#> 32 14 13 -1 2.662 -0.376 0.707
#> 33 17 19 2 2.662 0.751 0.452
#> 34 10 9 -1 2.662 -0.376 0.707
#> 35 9 10 1 2.662 0.376 0.707
#> 36 14 18 4 2.662 1.503 0.133
#> 37 9 10 1 2.662 0.376 0.707
#> 38 1 1 0 2.662 0.000 1
#> 39 15 12 -3 2.662 -1.127 0.26
#> 40 11 10 -1 2.662 -0.376 0.707
#> 41 17 13 -4 2.662 -1.503 0.133
#> 42 14 15 1 2.662 0.376 0.707
#> 43 4 2 -2 2.662 -0.751 0.452
#> 44 10 9 -1 2.662 -0.376 0.707
#> 45 6 5 -1 2.662 -0.376 0.707
#> 46 8 4 -4 2.662 -1.503 0.133
#> 47 14 15 1 2.662 0.376 0.707
#> 48 6 6 0 2.662 0.000 1
#> 49 5 3 -2 2.662 -0.751 0.452
#> 50 17 16 -1 2.662 -0.376 0.707
#> 51 1 0 -1 2.662 -0.376 0.707
#> 52 1 2 1 2.662 0.376 0.707
#> 53 12 5 -7 2.662 -2.630 0.009
#> 54 6 4 -2 2.662 -0.751 0.452
#> 55 4 3 -1 2.662 -0.376 0.707
#> 56 14 15 1 2.662 0.376 0.707
#> 57 6 8 2 2.662 0.751 0.452
#> 58 11 13 2 2.662 0.751 0.452
#> 59 6 4 -2 2.662 -0.751 0.452
#> 60 7 10 3 2.662 1.127 0.26
#> 61 2 3 1 2.662 0.376 0.707
#> 62 10 13 3 2.662 1.127 0.26
#> 63 3 4 1 2.662 0.376 0.707
#> 64 16 17 1 2.662 0.376 0.707
#> 65 13 13 0 2.662 0.000 1
#> 66 5 7 2 2.662 0.751 0.452
#> 67 9 10 1 2.662 0.376 0.707
#> 68 10 8 -2 2.662 -0.751 0.452
#> 69 7 3 -4 2.662 -1.503 0.133
#> 70 15 14 -1 2.662 -0.376 0.707
#> 71 17 17 0 2.662 0.000 1
#> 72 7 5 -2 2.662 -0.751 0.452
#> 73 17 15 -2 2.662 -0.751 0.452
#> 74 18 16 -2 2.662 -0.751 0.452
#> 75 15 16 1 2.662 0.376 0.707
#> 76 5 4 -1 2.662 -0.376 0.707
#> 77 11 15 4 2.662 1.503 0.133
#> 78 9 12 3 2.662 1.127 0.26
#> 79 17 15 -2 2.662 -0.751 0.452
#> 80 17 14 -3 2.662 -1.127 0.26
#> 81 3 3 0 2.662 0.000 1
#> 82 9 7 -2 2.662 -0.751 0.452
#> 83 12 13 1 2.662 0.376 0.707
#> 84 5 12 7 2.662 2.630 0.009
#> 85 7 6 -1 2.662 -0.376 0.707
#> 86 11 8 -3 2.662 -1.127 0.26
#> 87 9 9 0 2.662 0.000 1
#> 88 3 5 2 2.662 0.751 0.452
#> 89 17 19 2 2.662 0.751 0.452
#> 90 15 16 1 2.662 0.376 0.707
#> 91 12 13 1 2.662 0.376 0.707
#> 92 12 13 1 2.662 0.376 0.707
#> 93 12 15 3 2.662 1.127 0.26
#> 94 12 17 5 2.662 1.879 0.06
#> 95 14 13 -1 2.662 -0.376 0.707
#> 96 12 14 2 2.662 0.751 0.452
#> 97 11 14 3 2.662 1.127 0.26
#> 98 5 4 -1 2.662 -0.376 0.707
#> 99 7 12 5 2.662 1.879 0.06
#> 100 12 14 2 2.662 0.751 0.452
#> 101 15 19 4 2.662 1.503 0.133
#> 102 9 12 3 2.662 1.127 0.26
#> 103 13 9 -4 2.662 -1.503 0.133
#> 104 3 3 0 2.662 0.000 1
#> 105 5 5 0 2.662 0.000 1
#> 106 7 3 -4 2.662 -1.503 0.133
#> 107 4 3 -1 2.662 -0.376 0.707
#> 108 3 2 -1 2.662 -0.376 0.707
#> 109 8 10 2 2.662 0.751 0.452
#> 110 9 10 1 2.662 0.376 0.707
#> 111 17 15 -2 2.662 -0.751 0.452
#> 112 19 19 0 2.662 0.000 1
#> 113 16 14 -2 2.662 -0.751 0.452
#> 114 15 14 -1 2.662 -0.376 0.707
#> 115 12 10 -2 2.662 -0.751 0.452
#> 116 4 8 4 2.662 1.503 0.133
#> 117 8 8 0 2.662 0.000 1
#> 118 13 11 -2 2.662 -0.751 0.452
#> 119 14 15 1 2.662 0.376 0.707
#> 120 1 3 2 2.662 0.751 0.452
#> 121 7 7 0 2.662 0.000 1
#> 122 3 1 -2 2.662 -0.751 0.452
#> 123 17 16 -1 2.662 -0.376 0.707
#> 124 13 13 0 2.662 0.000 1
#> 125 9 13 4 2.662 1.503 0.133
#> 126 18 16 -2 2.662 -0.751 0.452
#> 127 2 3 1 2.662 0.376 0.707
#> 128 11 17 6 2.662 2.254 0.024
#> 129 15 10 -5 2.662 -1.879 0.06
#> 130 17 15 -2 2.662 -0.751 0.452
#> 131 15 16 1 2.662 0.376 0.707
#> 132 13 8 -5 2.662 -1.879 0.06
#> 133 15 14 -1 2.662 -0.376 0.707
#> 134 4 2 -2 2.662 -0.751 0.452
#> 135 6 6 0 2.662 0.000 1
#> 136 14 17 3 2.662 1.127 0.26
#> 137 11 10 -1 2.662 -0.376 0.707
#> 138 19 17 -2 2.662 -0.751 0.452
#> 139 9 8 -1 2.662 -0.376 0.707
#> 140 17 16 -1 2.662 -0.376 0.707
#> 141 7 3 -4 2.662 -1.503 0.133
#> 142 1 0 -1 2.662 -0.376 0.707
#> 143 12 7 -5 2.662 -1.879 0.06
#> 144 18 18 0 2.662 0.000 1
#> 145 11 9 -2 2.662 -0.751 0.452
#> 146 1 4 3 2.662 1.127 0.26
#> 147 13 18 5 2.662 1.879 0.06
#> 148 13 12 -1 2.662 -0.376 0.707
#> 149 19 14 -5 2.662 -1.879 0.06
#> 150 17 12 -5 2.662 -1.879 0.06
#> 151 17 19 2 2.662 0.751 0.452
#> 152 10 7 -3 2.662 -1.127 0.26
#> 153 10 10 0 2.662 0.000 1
#> 154 5 5 0 2.662 0.000 1
#> 155 11 7 -4 2.662 -1.503 0.133
#> 156 13 10 -3 2.662 -1.127 0.26
#> 157 5 5 0 2.662 0.000 1
#> 158 7 6 -1 2.662 -0.376 0.707
#> 159 7 7 0 2.662 0.000 1
#> 160 4 4 0 2.662 0.000 1
#> 161 6 8 2 2.662 0.751 0.452
#> 162 17 12 -5 2.662 -1.879 0.06
#> 163 8 9 1 2.662 0.376 0.707
#> 164 17 16 -1 2.662 -0.376 0.707
#> 165 14 14 0 2.662 0.000 1
#> 166 10 7 -3 2.662 -1.127 0.26
#> 167 6 9 3 2.662 1.127 0.26
#> 168 3 5 2 2.662 0.751 0.452
#> 169 4 3 -1 2.662 -0.376 0.707
#> 170 9 15 6 2.662 2.254 0.024
#> 171 13 13 0 2.662 0.000 1
#> 172 10 14 4 2.662 1.503 0.133
#> 173 17 16 -1 2.662 -0.376 0.707
#> 174 16 15 -1 2.662 -0.376 0.707
#> 175 6 4 -2 2.662 -0.751 0.452
#> 176 6 7 1 2.662 0.376 0.707
#> 177 3 4 1 2.662 0.376 0.707
#> 178 20 18 -2 2.662 -0.751 0.452
#> 179 4 8 4 2.662 1.503 0.133
#> 180 11 9 -2 2.662 -0.751 0.452
#> 181 16 19 3 2.662 1.127 0.26
#> 182 10 12 2 2.662 0.751 0.452
#> 183 15 18 3 2.662 1.127 0.26
#> 184 11 11 0 2.662 0.000 1
#> 185 9 9 0 2.662 0.000 1
#> 186 15 12 -3 2.662 -1.127 0.26
#> 187 14 14 0 2.662 0.000 1
#> 188 4 6 2 2.662 0.751 0.452
#> 189 14 12 -2 2.662 -0.751 0.452
#> 190 17 15 -2 2.662 -0.751 0.452
#> 191 16 17 1 2.662 0.376 0.707
#> 192 9 10 1 2.662 0.376 0.707
#> 193 15 14 -1 2.662 -0.376 0.707
#> 194 13 13 0 2.662 0.000 1
#> 195 2 1 -1 2.662 -0.376 0.707
#> 196 11 11 0 2.662 0.000 1
#> 197 12 8 -4 2.662 -1.503 0.133
#> 198 10 4 -6 2.662 -2.254 0.024
#> 199 14 14 0 2.662 0.000 1
#> 200 8 14 6 2.662 2.254 0.024
#> 201 10 16 6 2.662 2.254 0.024
#> 202 4 5 1 2.662 0.376 0.707
#> 203 7 7 0 2.662 0.000 1
#> 204 6 4 -2 2.662 -0.751 0.452
#> 205 18 13 -5 2.662 -1.879 0.06
#> 206 19 17 -2 2.662 -0.751 0.452
#> 207 6 5 -1 2.662 -0.376 0.707
#> 208 9 4 -5 2.662 -1.879 0.06
#> 209 2 4 2 2.662 0.751 0.452
#> 210 12 10 -2 2.662 -0.751 0.452
#> 211 4 10 6 2.662 2.254 0.024
#> 212 12 10 -2 2.662 -0.751 0.452
#> 213 17 16 -1 2.662 -0.376 0.707
#> 214 9 8 -1 2.662 -0.376 0.707
#> 215 14 14 0 2.662 0.000 1
#> 216 1 0 -1 2.662 -0.376 0.707
#> 217 8 4 -4 2.662 -1.503 0.133
#> 218 18 9 -9 2.662 -3.381 0.001
#> 219 2 1 -1 2.662 -0.376 0.707
#> 220 17 16 -1 2.662 -0.376 0.707
#> 221 4 2 -2 2.662 -0.751 0.452
#> 222 16 15 -1 2.662 -0.376 0.707
#> 223 7 9 2 2.662 0.751 0.452
#> 224 18 16 -2 2.662 -0.751 0.452
#> 225 2 3 1 2.662 0.376 0.707
#> 226 13 12 -1 2.662 -0.376 0.707
#> 227 17 16 -1 2.662 -0.376 0.707
#> 228 5 7 2 2.662 0.751 0.452
#> 229 4 3 -1 2.662 -0.376 0.707
#> 230 14 13 -1 2.662 -0.376 0.707
#> 231 6 7 1 2.662 0.376 0.707
#> 232 12 14 2 2.662 0.751 0.452
#> 233 1 8 7 2.662 2.630 0.009
#> 234 11 8 -3 2.662 -1.127 0.26
#> 235 4 3 -1 2.662 -0.376 0.707
#> 236 12 13 1 2.662 0.376 0.707
#> 237 17 17 0 2.662 0.000 1
#> 238 14 16 2 2.662 0.751 0.452
#> 239 10 11 1 2.662 0.376 0.707
#> 240 15 13 -2 2.662 -0.751 0.452
#> 241 14 12 -2 2.662 -0.751 0.452
#> 242 14 9 -5 2.662 -1.879 0.06
#> 243 2 1 -1 2.662 -0.376 0.707
#> 244 13 16 3 2.662 1.127 0.26
#> 245 19 16 -3 2.662 -1.127 0.26
#> 246 3 6 3 2.662 1.127 0.26
#> 247 14 13 -1 2.662 -0.376 0.707
#> 248 16 12 -4 2.662 -1.503 0.133
#> 249 8 11 3 2.662 1.127 0.26
#> 250 11 15 4 2.662 1.503 0.133
#> 251 9 7 -2 2.662 -0.751 0.452
#> 252 16 18 2 2.662 0.751 0.452
#> 253 19 17 -2 2.662 -0.751 0.452
#> 254 6 6 0 2.662 0.000 1
#> 255 15 13 -2 2.662 -0.751 0.452
#> 256 7 7 0 2.662 0.000 1
#> 257 2 1 -1 2.662 -0.376 0.707
#> 258 5 6 1 2.662 0.376 0.707
#> 259 6 10 4 2.662 1.503 0.133
#> 260 16 15 -1 2.662 -0.376 0.707
#> 261 5 7 2 2.662 0.751 0.452
#> 262 13 3 -10 2.662 -3.757 0
#> 263 6 4 -2 2.662 -0.751 0.452
#> 264 6 5 -1 2.662 -0.376 0.707
#> 265 11 7 -4 2.662 -1.503 0.133
#> 266 15 17 2 2.662 0.751 0.452
#> 267 13 12 -1 2.662 -0.376 0.707
#> 268 15 17 2 2.662 0.751 0.452
#> 269 8 8 0 2.662 0.000 1
#> 270 12 8 -4 2.662 -1.503 0.133
#> 271 15 13 -2 2.662 -0.751 0.452
#> 272 7 11 4 2.662 1.503 0.133
#> 273 7 11 4 2.662 1.503 0.133
#> 274 3 6 3 2.662 1.127 0.26
#> 275 12 9 -3 2.662 -1.127 0.26
#> 276 6 9 3 2.662 1.127 0.26
#> 277 11 9 -2 2.662 -0.751 0.452
#> 278 16 17 1 2.662 0.376 0.707
#> 279 17 16 -1 2.662 -0.376 0.707
#> 280 2 4 2 2.662 0.751 0.452
#> 281 3 2 -1 2.662 -0.376 0.707
#> 282 2 1 -1 2.662 -0.376 0.707
#> 283 18 16 -2 2.662 -0.751 0.452
#> 284 9 11 2 2.662 0.751 0.452
#> 285 5 8 3 2.662 1.127 0.26
#> 286 10 13 3 2.662 1.127 0.26
#> 287 4 5 1 2.662 0.376 0.707
#> 288 16 16 0 2.662 0.000 1
#> 289 2 5 3 2.662 1.127 0.26
#> 290 19 19 0 2.662 0.000 1
#> 291 10 11 1 2.662 0.376 0.707
#> 292 6 4 -2 2.662 -0.751 0.452
#> 293 2 3 1 2.662 0.376 0.707
#> 294 9 9 0 2.662 0.000 1
#> 295 9 11 2 2.662 0.751 0.452
#> 296 3 5 2 2.662 0.751 0.452
#> 297 8 5 -3 2.662 -1.127 0.26
#> 298 5 3 -2 2.662 -0.751 0.452
#> 299 13 11 -2 2.662 -0.751 0.452
#> 300 18 16 -2 2.662 -0.751 0.452
#> 301 7 3 -4 2.662 -1.503 0.133
#> 302 14 14 0 2.662 0.000 1
#> 303 8 4 -4 2.662 -1.503 0.133
#> 304 13 13 0 2.662 0.000 1
#> 305 4 3 -1 2.662 -0.376 0.707
#> 306 6 1 -5 2.662 -1.879 0.06
#> 307 9 9 0 2.662 0.000 1
#> 308 3 10 7 2.662 2.630 0.009
#> 309 2 1 -1 2.662 -0.376 0.707
#> 310 16 20 4 2.662 1.503 0.133
#> 311 2 4 2 2.662 0.751 0.452
#> 312 14 16 2 2.662 0.751 0.452
#> 313 14 12 -2 2.662 -0.751 0.452
#> 314 1 3 2 2.662 0.751 0.452
#> 315 9 10 1 2.662 0.376 0.707
#> 316 10 11 1 2.662 0.376 0.707
#> 317 12 14 2 2.662 0.751 0.452
#> 318 16 17 1 2.662 0.376 0.707
#> 319 16 15 -1 2.662 -0.376 0.707
#> 320 20 20 0 2.662 0.000 1
#> 321 1 2 1 2.662 0.376 0.707
#> 322 9 11 2 2.662 0.751 0.452
#> 323 14 11 -3 2.662 -1.127 0.26
#> 324 17 17 0 2.662 0.000 1
#> 325 3 4 1 2.662 0.376 0.707
#> 326 2 4 2 2.662 0.751 0.452
#> 327 14 16 2 2.662 0.751 0.452
#> 328 11 14 3 2.662 1.127 0.26
#> 329 4 5 1 2.662 0.376 0.707
#> 330 8 8 0 2.662 0.000 1
#> 331 0 0 0 2.662 0.000 1
#> 332 15 13 -2 2.662 -0.751 0.452
#> 333 6 1 -5 2.662 -1.879 0.06
#> 334 3 4 1 2.662 0.376 0.707
#> 335 14 14 0 2.662 0.000 1
#> 336 16 13 -3 2.662 -1.127 0.26
#> 337 15 16 1 2.662 0.376 0.707
#> 338 12 10 -2 2.662 -0.751 0.452
#> 339 12 9 -3 2.662 -1.127 0.26
#> 340 18 16 -2 2.662 -0.751 0.452
#> 341 4 1 -3 2.662 -1.127 0.26
#> 342 8 5 -3 2.662 -1.127 0.26
#> 343 13 14 1 2.662 0.376 0.707
#> 344 13 13 0 2.662 0.000 1
#> 345 17 15 -2 2.662 -0.751 0.452
#> 346 11 13 2 2.662 0.751 0.452
#> 347 5 3 -2 2.662 -0.751 0.452
#> 348 9 8 -1 2.662 -0.376 0.707
#> 349 8 11 3 2.662 1.127 0.26
#> 350 11 13 2 2.662 0.751 0.452
#> 351 12 8 -4 2.662 -1.503 0.133
#> 352 14 19 5 2.662 1.879 0.06
#> 353 7 4 -3 2.662 -1.127 0.26
#> 354 1 1 0 2.662 0.000 1
#> 355 5 1 -4 2.662 -1.503 0.133
#> 356 12 8 -4 2.662 -1.503 0.133
#> 357 2 6 4 2.662 1.503 0.133
#> 358 18 16 -2 2.662 -0.751 0.452
#> 359 17 16 -1 2.662 -0.376 0.707
#> 360 10 5 -5 2.662 -1.879 0.06
#> 361 17 14 -3 2.662 -1.127 0.26
#> 362 12 16 4 2.662 1.503 0.133
#> 363 8 8 0 2.662 0.000 1
#> 364 8 8 0 2.662 0.000 1
#> 365 15 12 -3 2.662 -1.127 0.26
#> 366 18 17 -1 2.662 -0.376 0.707
#> 367 5 9 4 2.662 1.503 0.133
#> 368 18 17 -1 2.662 -0.376 0.707
#> 369 12 10 -2 2.662 -0.751 0.452
#> 370 8 8 0 2.662 0.000 1
#> 371 10 8 -2 2.662 -0.751 0.452
#> 372 16 13 -3 2.662 -1.127 0.26
#> 373 18 16 -2 2.662 -0.751 0.452
#> 374 19 18 -1 2.662 -0.376 0.707
#> 375 4 3 -1 2.662 -0.376 0.707
#> 376 16 19 3 2.662 1.127 0.26
#> 377 13 9 -4 2.662 -1.503 0.133
#> 378 6 10 4 2.662 1.503 0.133
#> 379 13 13 0 2.662 0.000 1
#> 380 12 7 -5 2.662 -1.879 0.06
#> 381 10 12 2 2.662 0.751 0.452
#> 382 3 1 -2 2.662 -0.751 0.452
#> 383 7 4 -3 2.662 -1.127 0.26
#> 384 4 9 5 2.662 1.879 0.06
#> 385 19 20 1 2.662 0.376 0.707
#> 386 13 9 -4 2.662 -1.503 0.133
#> 387 2 1 -1 2.662 -0.376 0.707
#> 388 7 6 -1 2.662 -0.376 0.707
#> 389 3 6 3 2.662 1.127 0.26
#> 390 12 11 -1 2.662 -0.376 0.707
#> 391 17 16 -1 2.662 -0.376 0.707
#> 392 15 18 3 2.662 1.127 0.26
#> 393 14 15 1 2.662 0.376 0.707
#> 394 20 15 -5 2.662 -1.879 0.06
#> 395 6 2 -4 2.662 -1.503 0.133
#> 396 19 18 -1 2.662 -0.376 0.707
#> 397 1 10 9 2.662 3.381 0.001
#> 398 18 19 1 2.662 0.376 0.707
#> 399 17 16 -1 2.662 -0.376 0.707
#> 400 16 17 1 2.662 0.376 0.707
#> 401 14 11 -3 2.662 -1.127 0.26
#> 402 17 16 -1 2.662 -0.376 0.707
#> 403 10 8 -2 2.662 -0.751 0.452
#> 404 3 7 4 2.662 1.503 0.133
#> 405 9 9 0 2.662 0.000 1
#> 406 4 4 0 2.662 0.000 1
#> 407 15 12 -3 2.662 -1.127 0.26
#> 408 20 14 -6 2.662 -2.254 0.024
#> 409 11 10 -1 2.662 -0.376 0.707
#> 410 16 18 2 2.662 0.751 0.452
#> 411 1 1 0 2.662 0.000 1
#> 412 7 7 0 2.662 0.000 1
#> 413 6 7 1 2.662 0.376 0.707
#> 414 5 4 -1 2.662 -0.376 0.707
#> 415 20 18 -2 2.662 -0.751 0.452
#> 416 6 12 6 2.662 2.254 0.024
#> 417 16 15 -1 2.662 -0.376 0.707
#> 418 14 12 -2 2.662 -0.751 0.452
#> 419 10 9 -1 2.662 -0.376 0.707
#> 420 12 9 -3 2.662 -1.127 0.26
#> 421 6 4 -2 2.662 -0.751 0.452
#> 422 17 19 2 2.662 0.751 0.452
#> 423 11 12 1 2.662 0.376 0.707
#> 424 6 4 -2 2.662 -0.751 0.452
#> 425 12 7 -5 2.662 -1.879 0.06
#> 426 8 9 1 2.662 0.376 0.707
#> 427 8 7 -1 2.662 -0.376 0.707
#> 428 9 9 0 2.662 0.000 1
#> 429 4 5 1 2.662 0.376 0.707
#> 430 9 9 0 2.662 0.000 1
#> 431 15 14 -1 2.662 -0.376 0.707
#> 432 12 13 1 2.662 0.376 0.707
#> 433 10 12 2 2.662 0.751 0.452
#> 434 1 3 2 2.662 0.751 0.452
#> 435 11 11 0 2.662 0.000 1
#> 436 15 13 -2 2.662 -0.751 0.452
#> 437 12 10 -2 2.662 -0.751 0.452
#> 438 8 8 0 2.662 0.000 1
#> 439 10 10 0 2.662 0.000 1
#> 440 12 13 1 2.662 0.376 0.707
#> 441 12 9 -3 2.662 -1.127 0.26
#> 442 10 16 6 2.662 2.254 0.024
#> 443 11 14 3 2.662 1.127 0.26
#> 444 17 13 -4 2.662 -1.503 0.133
#> 445 10 13 3 2.662 1.127 0.26
#> 446 7 15 8 2.662 3.006 0.003
#> 447 10 11 1 2.662 0.376 0.707
#> 448 13 12 -1 2.662 -0.376 0.707
#> 449 15 16 1 2.662 0.376 0.707
#> 450 9 8 -1 2.662 -0.376 0.707
#> 451 19 18 -1 2.662 -0.376 0.707
#> 452 13 14 1 2.662 0.376 0.707
#> 453 6 9 3 2.662 1.127 0.26
#> 454 6 9 3 2.662 1.127 0.26
#> 455 7 8 1 2.662 0.376 0.707
#> 456 5 6 1 2.662 0.376 0.707
#> 457 15 11 -4 2.662 -1.503 0.133
#> 458 14 13 -1 2.662 -0.376 0.707
#> 459 10 10 0 2.662 0.000 1
#> 460 4 7 3 2.662 1.127 0.26
#> 461 11 12 1 2.662 0.376 0.707
#> 462 10 9 -1 2.662 -0.376 0.707
#> 463 18 18 0 2.662 0.000 1
#> 464 6 9 3 2.662 1.127 0.26
#> 465 6 11 5 2.662 1.879 0.06
#> 466 15 16 1 2.662 0.376 0.707
#> 467 17 15 -2 2.662 -0.751 0.452
#> 468 7 7 0 2.662 0.000 1
#> 469 9 11 2 2.662 0.751 0.452
#> 470 4 5 1 2.662 0.376 0.707
#> 471 7 7 0 2.662 0.000 1
#> 472 2 3 1 2.662 0.376 0.707
#> 473 18 16 -2 2.662 -0.751 0.452
#> 474 10 10 0 2.662 0.000 1
#> 475 17 14 -3 2.662 -1.127 0.26
#> 476 7 7 0 2.662 0.000 1
#> 477 17 17 0 2.662 0.000 1
#> 478 6 7 1 2.662 0.376 0.707
#> 479 14 13 -1 2.662 -0.376 0.707
#> 480 9 9 0 2.662 0.000 1
#> 481 11 11 0 2.662 0.000 1
#> 482 18 18 0 2.662 0.000 1
#> 483 8 8 0 2.662 0.000 1
#> 484 5 10 5 2.662 1.879 0.06
#> 485 4 2 -2 2.662 -0.751 0.452
#> 486 6 7 1 2.662 0.376 0.707
#> 487 18 15 -3 2.662 -1.127 0.26
#> 488 13 17 4 2.662 1.503 0.133
#> 489 12 14 2 2.662 0.751 0.452
#> 490 2 2 0 2.662 0.000 1
#> 491 6 6 0 2.662 0.000 1
#> 492 6 6 0 2.662 0.000 1
#> 493 6 5 -1 2.662 -0.376 0.707
#> 494 9 8 -1 2.662 -0.376 0.707
#> 495 6 3 -3 2.662 -1.127 0.26
#> 496 8 5 -3 2.662 -1.127 0.26
#> 497 6 5 -1 2.662 -0.376 0.707
#> 498 9 13 4 2.662 1.503 0.133
#> 499 16 18 2 2.662 0.751 0.452
#> 500 6 5 -1 2.662 -0.376 0.707
#> 501 2 1 -1 2.662 -0.376 0.707
#> 502 17 18 1 2.662 0.376 0.707
#> 503 4 8 4 2.662 1.503 0.133
#> 504 4 4 0 2.662 0.000 1
#> 505 3 6 3 2.662 1.127 0.26
#> 506 10 11 1 2.662 0.376 0.707
#> 507 16 18 2 2.662 0.751 0.452
#> 508 16 12 -4 2.662 -1.503 0.133
#> 509 4 4 0 2.662 0.000 1
#> 510 12 11 -1 2.662 -0.376 0.707
#> 511 13 9 -4 2.662 -1.503 0.133
#> 512 12 7 -5 2.662 -1.879 0.06
#> 513 5 4 -1 2.662 -0.376 0.707
#> 514 13 13 0 2.662 0.000 1
#> 515 18 19 1 2.662 0.376 0.707
#> 516 4 3 -1 2.662 -0.376 0.707
#> 517 1 3 2 2.662 0.751 0.452
#> 518 11 10 -1 2.662 -0.376 0.707
#> 519 14 12 -2 2.662 -0.751 0.452
#> 520 14 13 -1 2.662 -0.376 0.707
#> 521 8 4 -4 2.662 -1.503 0.133
#> 522 1 7 6 2.662 2.254 0.024
#> 523 14 15 1 2.662 0.376 0.707
#> 524 6 2 -4 2.662 -1.503 0.133
#> 525 16 16 0 2.662 0.000 1
#> 526 12 8 -4 2.662 -1.503 0.133
#> 527 15 10 -5 2.662 -1.879 0.06
#> 528 17 17 0 2.662 0.000 1
#> 529 3 5 2 2.662 0.751 0.452
#> 530 9 8 -1 2.662 -0.376 0.707
#> 531 13 13 0 2.662 0.000 1
#> 532 8 4 -4 2.662 -1.503 0.133
#> 533 18 16 -2 2.662 -0.751 0.452
#> 534 13 11 -2 2.662 -0.751 0.452
#> 535 17 15 -2 2.662 -0.751 0.452
#> 536 13 12 -1 2.662 -0.376 0.707
#> 537 15 18 3 2.662 1.127 0.26
#> 538 10 12 2 2.662 0.751 0.452
#> 539 8 15 7 2.662 2.630 0.009
#> 540 14 12 -2 2.662 -0.751 0.452
#> 541 15 13 -2 2.662 -0.751 0.452
#> 542 15 15 0 2.662 0.000 1
#> 543 3 1 -2 2.662 -0.751 0.452
#> 544 6 4 -2 2.662 -0.751 0.452
#> 545 12 12 0 2.662 0.000 1
#> 546 4 3 -1 2.662 -0.376 0.707
#> 547 12 9 -3 2.662 -1.127 0.26
#> 548 4 3 -1 2.662 -0.376 0.707
#> 549 13 11 -2 2.662 -0.751 0.452
#> 550 17 16 -1 2.662 -0.376 0.707
#> 551 9 11 2 2.662 0.751 0.452
#> 552 15 19 4 2.662 1.503 0.133
#> 553 4 3 -1 2.662 -0.376 0.707
#> 554 8 3 -5 2.662 -1.879 0.06
#> 555 15 16 1 2.662 0.376 0.707
#> 556 18 19 1 2.662 0.376 0.707
#> 557 14 16 2 2.662 0.751 0.452
#> 558 1 2 1 2.662 0.376 0.707
#> 559 13 14 1 2.662 0.376 0.707
#> 560 10 4 -6 2.662 -2.254 0.024
#> 561 1 3 2 2.662 0.751 0.452
#> 562 19 19 0 2.662 0.000 1
#> 563 6 4 -2 2.662 -0.751 0.452
#> 564 12 8 -4 2.662 -1.503 0.133
#> 565 8 10 2 2.662 0.751 0.452
#> 566 13 16 3 2.662 1.127 0.26
#> 567 11 13 2 2.662 0.751 0.452
#> 568 9 7 -2 2.662 -0.751 0.452
#> 569 5 4 -1 2.662 -0.376 0.707
#> 570 3 1 -2 2.662 -0.751 0.452
#> 571 17 19 2 2.662 0.751 0.452
#> 572 13 18 5 2.662 1.879 0.06
#> 573 16 15 -1 2.662 -0.376 0.707
#> 574 17 12 -5 2.662 -1.879 0.06
#> 575 14 14 0 2.662 0.000 1
#> 576 5 9 4 2.662 1.503 0.133
#> 577 9 6 -3 2.662 -1.127 0.26
#> 578 19 16 -3 2.662 -1.127 0.26
#> 579 4 8 4 2.662 1.503 0.133
#> 580 3 4 1 2.662 0.376 0.707
#> 581 15 14 -1 2.662 -0.376 0.707
#> 582 9 9 0 2.662 0.000 1
#> 583 9 8 -1 2.662 -0.376 0.707
#> 584 19 20 1 2.662 0.376 0.707
#> 585 7 6 -1 2.662 -0.376 0.707
#> 586 1 1 0 2.662 0.000 1
#> 587 15 16 1 2.662 0.376 0.707
#> 588 16 16 0 2.662 0.000 1
#> 589 11 11 0 2.662 0.000 1
#> 590 8 10 2 2.662 0.751 0.452
#> 591 16 19 3 2.662 1.127 0.26
#> 592 10 11 1 2.662 0.376 0.707
#> 593 13 15 2 2.662 0.751 0.452
#> 594 17 16 -1 2.662 -0.376 0.707
#> 595 12 14 2 2.662 0.751 0.452
#> 596 10 11 1 2.662 0.376 0.707
#> 597 5 4 -1 2.662 -0.376 0.707
#> 598 11 11 0 2.662 0.000 1
#> 599 12 12 0 2.662 0.000 1
#> 600 17 19 2 2.662 0.751 0.452
#> 601 4 11 7 2.662 2.630 0.009
#> 602 19 19 0 2.662 0.000 1
#> 603 7 6 -1 2.662 -0.376 0.707
#> 604 18 15 -3 2.662 -1.127 0.26
#> 605 10 10 0 2.662 0.000 1
#> 606 11 11 0 2.662 0.000 1
#> 607 4 10 6 2.662 2.254 0.024
#> 608 10 10 0 2.662 0.000 1
#> 609 8 6 -2 2.662 -0.751 0.452
#> 610 8 8 0 2.662 0.000 1
#> 611 9 14 5 2.662 1.879 0.06
#> 612 12 13 1 2.662 0.376 0.707
#> 613 12 12 0 2.662 0.000 1
#> 614 2 0 -2 2.662 -0.751 0.452
#> 615 5 6 1 2.662 0.376 0.707
#> 616 2 3 1 2.662 0.376 0.707
#> 617 9 13 4 2.662 1.503 0.133
#> 618 18 16 -2 2.662 -0.751 0.452
#> 619 14 16 2 2.662 0.751 0.452
#> 620 9 8 -1 2.662 -0.376 0.707
#> 621 11 6 -5 2.662 -1.879 0.06
#> 622 10 6 -4 2.662 -1.503 0.133
#> 623 8 8 0 2.662 0.000 1
#> 624 5 3 -2 2.662 -0.751 0.452
#> 625 8 10 2 2.662 0.751 0.452
#> 626 12 12 0 2.662 0.000 1
#> 627 18 17 -1 2.662 -0.376 0.707
#> 628 12 11 -1 2.662 -0.376 0.707
#> 629 10 14 4 2.662 1.503 0.133
#> 630 15 16 1 2.662 0.376 0.707
#> 631 6 8 2 2.662 0.751 0.452
#> 632 15 14 -1 2.662 -0.376 0.707
#> 633 7 5 -2 2.662 -0.751 0.452
#> 634 18 15 -3 2.662 -1.127 0.26
#> 635 15 12 -3 2.662 -1.127 0.26
#> 636 15 15 0 2.662 0.000 1
#> 637 14 20 6 2.662 2.254 0.024
#> 638 16 14 -2 2.662 -0.751 0.452
#> 639 16 16 0 2.662 0.000 1
#> 640 13 15 2 2.662 0.751 0.452
#> 641 9 10 1 2.662 0.376 0.707
#> 642 8 11 3 2.662 1.127 0.26
#> 643 16 18 2 2.662 0.751 0.452
#> 644 17 15 -2 2.662 -0.751 0.452
#> 645 11 9 -2 2.662 -0.751 0.452
#> 646 20 18 -2 2.662 -0.751 0.452
#> 647 14 11 -3 2.662 -1.127 0.26
#> 648 14 15 1 2.662 0.376 0.707
#> 649 11 5 -6 2.662 -2.254 0.024
#> 650 9 9 0 2.662 0.000 1
#> 651 11 12 1 2.662 0.376 0.707
#> 652 5 5 0 2.662 0.000 1
#> 653 7 4 -3 2.662 -1.127 0.26
#> 654 7 8 1 2.662 0.376 0.707
#> 655 11 11 0 2.662 0.000 1
#> 656 5 5 0 2.662 0.000 1
#> 657 15 15 0 2.662 0.000 1
#> 658 12 15 3 2.662 1.127 0.26
#> 659 10 15 5 2.662 1.879 0.06
#> 660 12 14 2 2.662 0.751 0.452
#> 661 10 10 0 2.662 0.000 1
#> 662 5 7 2 2.662 0.751 0.452
#> 663 14 10 -4 2.662 -1.503 0.133
#> 664 12 14 2 2.662 0.751 0.452
#> 665 12 10 -2 2.662 -0.751 0.452
#> 666 3 4 1 2.662 0.376 0.707
#> 667 9 14 5 2.662 1.879 0.06
#> 668 13 17 4 2.662 1.503 0.133
#> 669 7 7 0 2.662 0.000 1
#> 670 14 13 -1 2.662 -0.376 0.707
#> 671 19 18 -1 2.662 -0.376 0.707
#> 672 9 9 0 2.662 0.000 1
#> 673 13 15 2 2.662 0.751 0.452
#> 674 3 5 2 2.662 0.751 0.452
#> 675 1 3 2 2.662 0.751 0.452
#> 676 15 15 0 2.662 0.000 1
#> 677 1 3 2 2.662 0.751 0.452
#> 678 19 15 -4 2.662 -1.503 0.133
#> 679 0 3 3 2.662 1.127 0.26
#> 680 18 17 -1 2.662 -0.376 0.707
#> 681 9 15 6 2.662 2.254 0.024
#> 682 18 18 0 2.662 0.000 1
#> 683 11 7 -4 2.662 -1.503 0.133
#> 684 17 17 0 2.662 0.000 1
#> 685 9 9 0 2.662 0.000 1
#> 686 2 5 3 2.662 1.127 0.26
#> 687 13 14 1 2.662 0.376 0.707
#> 688 15 13 -2 2.662 -0.751 0.452
#> 689 18 18 0 2.662 0.000 1
#> 690 10 13 3 2.662 1.127 0.26
#> 691 14 14 0 2.662 0.000 1
#> 692 12 9 -3 2.662 -1.127 0.26
#> 693 9 9 0 2.662 0.000 1
#> 694 14 11 -3 2.662 -1.127 0.26
#> 695 14 15 1 2.662 0.376 0.707
#> 696 6 8 2 2.662 0.751 0.452
#> 697 7 7 0 2.662 0.000 1
#> 698 12 8 -4 2.662 -1.503 0.133
#> 699 7 9 2 2.662 0.751 0.452
#> 700 12 12 0 2.662 0.000 1
#> 701 17 14 -3 2.662 -1.127 0.26
#> 702 14 12 -2 2.662 -0.751 0.452
#> 703 15 16 1 2.662 0.376 0.707
#> 704 12 10 -2 2.662 -0.751 0.452
#> 705 5 8 3 2.662 1.127 0.26
#> 706 9 8 -1 2.662 -0.376 0.707
#> 707 3 3 0 2.662 0.000 1
#> 708 4 4 0 2.662 0.000 1
#> 709 10 12 2 2.662 0.751 0.452
#> 710 17 15 -2 2.662 -0.751 0.452
#> 711 13 12 -1 2.662 -0.376 0.707
#> 712 10 9 -1 2.662 -0.376 0.707
#> 713 16 12 -4 2.662 -1.503 0.133
#> 714 12 11 -1 2.662 -0.376 0.707
#> 715 16 13 -3 2.662 -1.127 0.26
#> 716 4 5 1 2.662 0.376 0.707
#> 717 14 17 3 2.662 1.127 0.26
#> 718 2 0 -2 2.662 -0.751 0.452
#> 719 6 2 -4 2.662 -1.503 0.133
#> 720 3 8 5 2.662 1.879 0.06
#> 721 16 16 0 2.662 0.000 1
#> 722 1 2 1 2.662 0.376 0.707
#> 723 19 16 -3 2.662 -1.127 0.26
#> 724 13 8 -5 2.662 -1.879 0.06
#> 725 13 20 7 2.662 2.630 0.009
#> 726 4 3 -1 2.662 -0.376 0.707
#> 727 15 11 -4 2.662 -1.503 0.133
#> 728 5 4 -1 2.662 -0.376 0.707
#> 729 7 4 -3 2.662 -1.127 0.26
#> 730 6 6 0 2.662 0.000 1
#> 731 4 5 1 2.662 0.376 0.707
#> 732 6 12 6 2.662 2.254 0.024
#> 733 19 18 -1 2.662 -0.376 0.707
#> 734 3 7 4 2.662 1.503 0.133
#> 735 14 14 0 2.662 0.000 1
#> 736 11 14 3 2.662 1.127 0.26
#> 737 13 17 4 2.662 1.503 0.133
#> 738 8 10 2 2.662 0.751 0.452
#> 739 11 7 -4 2.662 -1.503 0.133
#> 740 9 17 8 2.662 3.006 0.003
#> 741 2 3 1 2.662 0.376 0.707
#> 742 3 2 -1 2.662 -0.376 0.707
#> 743 9 11 2 2.662 0.751 0.452
#> 744 8 6 -2 2.662 -0.751 0.452
#> 745 18 20 2 2.662 0.751 0.452
#> 746 14 17 3 2.662 1.127 0.26
#> 747 13 14 1 2.662 0.376 0.707
#> 748 2 1 -1 2.662 -0.376 0.707
#> 749 15 12 -3 2.662 -1.127 0.26
#> 750 6 8 2 2.662 0.751 0.452
#> 751 5 4 -1 2.662 -0.376 0.707
#> 752 17 20 3 2.662 1.127 0.26
#> 753 3 2 -1 2.662 -0.376 0.707
#> 754 14 12 -2 2.662 -0.751 0.452
#> 755 8 9 1 2.662 0.376 0.707
#> 756 1 2 1 2.662 0.376 0.707
#> 757 3 2 -1 2.662 -0.376 0.707
#> 758 7 6 -1 2.662 -0.376 0.707
#> 759 7 7 0 2.662 0.000 1
#> 760 13 11 -2 2.662 -0.751 0.452
#> 761 15 16 1 2.662 0.376 0.707
#> 762 11 13 2 2.662 0.751 0.452
#> 763 9 10 1 2.662 0.376 0.707
#> 764 16 17 1 2.662 0.376 0.707
#> 765 11 13 2 2.662 0.751 0.452
#> 766 17 19 2 2.662 0.751 0.452
#> 767 13 11 -2 2.662 -0.751 0.452
#> 768 12 11 -1 2.662 -0.376 0.707
#> 769 13 13 0 2.662 0.000 1
#> 770 14 13 -1 2.662 -0.376 0.707
#> 771 10 9 -1 2.662 -0.376 0.707
#> 772 6 7 1 2.662 0.376 0.707
#> 773 13 6 -7 2.662 -2.630 0.009
#> 774 9 7 -2 2.662 -0.751 0.452
#> 775 13 13 0 2.662 0.000 1
#> 776 15 14 -1 2.662 -0.376 0.707
#> 777 6 7 1 2.662 0.376 0.707
#> 778 2 7 5 2.662 1.879 0.06
#> 779 11 15 4 2.662 1.503 0.133
#> 780 7 13 6 2.662 2.254 0.024
#> 781 10 10 0 2.662 0.000 1
#> 782 17 16 -1 2.662 -0.376 0.707
#> 783 20 19 -1 2.662 -0.376 0.707
#> 784 10 5 -5 2.662 -1.879 0.06
#> 785 16 18 2 2.662 0.751 0.452
#> 786 6 3 -3 2.662 -1.127 0.26
#> 787 6 8 2 2.662 0.751 0.452
#> 788 17 15 -2 2.662 -0.751 0.452
#> 789 12 7 -5 2.662 -1.879 0.06
#> 790 3 4 1 2.662 0.376 0.707
#> 791 3 3 0 2.662 0.000 1
#> 792 13 16 3 2.662 1.127 0.26
#> 793 8 5 -3 2.662 -1.127 0.26
#> 794 9 5 -4 2.662 -1.503 0.133
#> 795 5 8 3 2.662 1.127 0.26
#> 796 12 16 4 2.662 1.503 0.133
#> 797 16 15 -1 2.662 -0.376 0.707
#> 798 11 14 3 2.662 1.127 0.26
#> 799 7 6 -1 2.662 -0.376 0.707
#> 800 5 3 -2 2.662 -0.751 0.452
#> 801 2 5 3 2.662 1.127 0.26
#> 802 11 14 3 2.662 1.127 0.26
#> 803 4 2 -2 2.662 -0.751 0.452
#> 804 6 11 5 2.662 1.879 0.06
#> 805 10 10 0 2.662 0.000 1
#> 806 11 11 0 2.662 0.000 1
#> 807 16 19 3 2.662 1.127 0.26
#> 808 16 19 3 2.662 1.127 0.26
#> 809 3 1 -2 2.662 -0.751 0.452
#> 810 14 14 0 2.662 0.000 1
#> 811 16 18 2 2.662 0.751 0.452
#> 812 5 5 0 2.662 0.000 1
#> 813 18 17 -1 2.662 -0.376 0.707
#> 814 7 5 -2 2.662 -0.751 0.452
#> 815 13 10 -3 2.662 -1.127 0.26
#> 816 5 2 -3 2.662 -1.127 0.26
#> 817 3 3 0 2.662 0.000 1
#> 818 18 15 -3 2.662 -1.127 0.26
#> 819 9 8 -1 2.662 -0.376 0.707
#> 820 11 9 -2 2.662 -0.751 0.452
#> 821 14 16 2 2.662 0.751 0.452
#> 822 4 4 0 2.662 0.000 1
#> 823 5 8 3 2.662 1.127 0.26
#> 824 6 8 2 2.662 0.751 0.452
#> 825 18 19 1 2.662 0.376 0.707
#> 826 12 12 0 2.662 0.000 1
#> 827 7 7 0 2.662 0.000 1
#> 828 7 5 -2 2.662 -0.751 0.452
#> 829 1 1 0 2.662 0.000 1
#> 830 8 9 1 2.662 0.376 0.707
#> 831 10 6 -4 2.662 -1.503 0.133
#> 832 12 9 -3 2.662 -1.127 0.26
#> 833 14 18 4 2.662 1.503 0.133
#> 834 4 4 0 2.662 0.000 1
#> 835 7 12 5 2.662 1.879 0.06
#> 836 16 11 -5 2.662 -1.879 0.06
#> 837 11 13 2 2.662 0.751 0.452
#> 838 10 11 1 2.662 0.376 0.707
#> 839 16 15 -1 2.662 -0.376 0.707
#> 840 19 12 -7 2.662 -2.630 0.009
#> 841 5 5 0 2.662 0.000 1
#> 842 8 6 -2 2.662 -0.751 0.452
#> 843 7 9 2 2.662 0.751 0.452
#> 844 8 7 -1 2.662 -0.376 0.707
#> 845 17 19 2 2.662 0.751 0.452
#> 846 11 13 2 2.662 0.751 0.452
#> 847 9 9 0 2.662 0.000 1
#> 848 19 19 0 2.662 0.000 1
#> 849 7 10 3 2.662 1.127 0.26
#> 850 18 17 -1 2.662 -0.376 0.707
#> 851 11 11 0 2.662 0.000 1
#> 852 15 17 2 2.662 0.751 0.452
#> 853 11 9 -2 2.662 -0.751 0.452
#> 854 9 6 -3 2.662 -1.127 0.26
#> 855 14 12 -2 2.662 -0.751 0.452
#> 856 12 16 4 2.662 1.503 0.133
#> 857 7 11 4 2.662 1.503 0.133
#> 858 6 9 3 2.662 1.127 0.26
#> 859 3 1 -2 2.662 -0.751 0.452
#> 860 9 3 -6 2.662 -2.254 0.024
#> 861 18 16 -2 2.662 -0.751 0.452
#> 862 14 17 3 2.662 1.127 0.26
#> 863 6 7 1 2.662 0.376 0.707
#> 864 11 9 -2 2.662 -0.751 0.452
#> 865 14 13 -1 2.662 -0.376 0.707
#> 866 15 14 -1 2.662 -0.376 0.707
#> 867 14 14 0 2.662 0.000 1
#> 868 11 9 -2 2.662 -0.751 0.452
#> 869 11 14 3 2.662 1.127 0.26
#> 870 3 2 -1 2.662 -0.376 0.707
#> 871 16 15 -1 2.662 -0.376 0.707
#> 872 19 18 -1 2.662 -0.376 0.707
#> 873 3 3 0 2.662 0.000 1
#> 874 12 12 0 2.662 0.000 1
#> 875 16 17 1 2.662 0.376 0.707
#> 876 14 15 1 2.662 0.376 0.707
#> 877 3 1 -2 2.662 -0.751 0.452
#> 878 12 18 6 2.662 2.254 0.024
#> 879 16 15 -1 2.662 -0.376 0.707
#> 880 12 17 5 2.662 1.879 0.06
#> 881 5 6 1 2.662 0.376 0.707
#> 882 8 6 -2 2.662 -0.751 0.452
#> 883 19 17 -2 2.662 -0.751 0.452
#> 884 12 8 -4 2.662 -1.503 0.133
#> 885 0 1 1 2.662 0.376 0.707
#> 886 9 8 -1 2.662 -0.376 0.707
#> 887 19 18 -1 2.662 -0.376 0.707
#> 888 13 12 -1 2.662 -0.376 0.707
#> 889 16 12 -4 2.662 -1.503 0.133
#> 890 15 15 0 2.662 0.000 1
#> 891 11 11 0 2.662 0.000 1
#> 892 13 11 -2 2.662 -0.751 0.452
#> 893 10 7 -3 2.662 -1.127 0.26
#> 894 12 13 1 2.662 0.376 0.707
#> 895 12 12 0 2.662 0.000 1
#> 896 17 16 -1 2.662 -0.376 0.707
#> 897 16 13 -3 2.662 -1.127 0.26
#> 898 12 9 -3 2.662 -1.127 0.26
#> 899 6 10 4 2.662 1.503 0.133
#> 900 4 5 1 2.662 0.376 0.707
#> 901 4 7 3 2.662 1.127 0.26
#> 902 3 8 5 2.662 1.879 0.06
#> 903 16 14 -2 2.662 -0.751 0.452
#> 904 3 4 1 2.662 0.376 0.707
#> 905 15 16 1 2.662 0.376 0.707
#> 906 16 15 -1 2.662 -0.376 0.707
#> 907 13 11 -2 2.662 -0.751 0.452
#> 908 6 7 1 2.662 0.376 0.707
#> 909 2 4 2 2.662 0.751 0.452
#> 910 6 14 8 2.662 3.006 0.003
#> 911 15 9 -6 2.662 -2.254 0.024
#> 912 4 4 0 2.662 0.000 1
#> 913 4 5 1 2.662 0.376 0.707
#> 914 13 11 -2 2.662 -0.751 0.452
#> 915 17 17 0 2.662 0.000 1
#> 916 7 9 2 2.662 0.751 0.452
#> 917 13 18 5 2.662 1.879 0.06
#> 918 10 9 -1 2.662 -0.376 0.707
#> 919 8 3 -5 2.662 -1.879 0.06
#> 920 18 20 2 2.662 0.751 0.452
#> 921 5 5 0 2.662 0.000 1
#> 922 18 16 -2 2.662 -0.751 0.452
#> 923 13 12 -1 2.662 -0.376 0.707
#> 924 12 12 0 2.662 0.000 1
#> 925 18 14 -4 2.662 -1.503 0.133
#> 926 6 10 4 2.662 1.503 0.133
#> 927 10 8 -2 2.662 -0.751 0.452
#> 928 6 9 3 2.662 1.127 0.26
#> 929 9 12 3 2.662 1.127 0.26
#> 930 12 14 2 2.662 0.751 0.452
#> 931 6 8 2 2.662 0.751 0.452
#> 932 11 16 5 2.662 1.879 0.06
#> 933 11 11 0 2.662 0.000 1
#> 934 1 2 1 2.662 0.376 0.707
#> 935 17 18 1 2.662 0.376 0.707
#> 936 3 5 2 2.662 0.751 0.452
#> 937 9 5 -4 2.662 -1.503 0.133
#> 938 17 14 -3 2.662 -1.127 0.26
#> 939 5 4 -1 2.662 -0.376 0.707
#> 940 2 4 2 2.662 0.751 0.452
#> 941 19 17 -2 2.662 -0.751 0.452
#> 942 6 6 0 2.662 0.000 1
#> 943 14 19 5 2.662 1.879 0.06
#> 944 16 16 0 2.662 0.000 1
#> 945 19 15 -4 2.662 -1.503 0.133
#> 946 7 8 1 2.662 0.376 0.707
#> 947 18 14 -4 2.662 -1.503 0.133
#> 948 7 7 0 2.662 0.000 1
#> 949 16 16 0 2.662 0.000 1
#> 950 10 10 0 2.662 0.000 1
#> 951 15 18 3 2.662 1.127 0.26
#> 952 11 15 4 2.662 1.503 0.133
#> 953 14 14 0 2.662 0.000 1
#> 954 16 15 -1 2.662 -0.376 0.707
#> 955 10 7 -3 2.662 -1.127 0.26
#> 956 14 18 4 2.662 1.503 0.133
#> 957 10 14 4 2.662 1.503 0.133
#> 958 4 8 4 2.662 1.503 0.133
#> 959 6 7 1 2.662 0.376 0.707
#> 960 9 7 -2 2.662 -0.751 0.452
#> 961 14 16 2 2.662 0.751 0.452
#> 962 13 14 1 2.662 0.376 0.707
#> 963 11 11 0 2.662 0.000 1
#> 964 8 6 -2 2.662 -0.751 0.452
#> 965 8 8 0 2.662 0.000 1
#> 966 13 8 -5 2.662 -1.879 0.06
#> 967 14 10 -4 2.662 -1.503 0.133
#> 968 7 9 2 2.662 0.751 0.452
#> 969 10 12 2 2.662 0.751 0.452
#> 970 10 13 3 2.662 1.127 0.26
#> 971 11 9 -2 2.662 -0.751 0.452
#> 972 6 5 -1 2.662 -0.376 0.707
#> 973 15 13 -2 2.662 -0.751 0.452
#> 974 8 5 -3 2.662 -1.127 0.26
#> 975 5 7 2 2.662 0.751 0.452
#> 976 15 11 -4 2.662 -1.503 0.133
#> 977 10 9 -1 2.662 -0.376 0.707
#> 978 15 12 -3 2.662 -1.127 0.26
#> 979 13 11 -2 2.662 -0.751 0.452
#> 980 8 6 -2 2.662 -0.751 0.452
#> 981 9 11 2 2.662 0.751 0.452
#> 982 16 15 -1 2.662 -0.376 0.707
#> 983 9 10 1 2.662 0.376 0.707
#> 984 2 3 1 2.662 0.376 0.707
#> 985 16 13 -3 2.662 -1.127 0.26
#> 986 18 12 -6 2.662 -2.254 0.024
#> 987 10 12 2 2.662 0.751 0.452
#> 988 20 20 0 2.662 0.000 1
#> 989 13 13 0 2.662 0.000 1
#> 990 10 10 0 2.662 0.000 1
#> 991 7 7 0 2.662 0.000 1
#> 992 6 3 -3 2.662 -1.127 0.26
#> 993 9 8 -1 2.662 -0.376 0.707
#> 994 12 11 -1 2.662 -0.376 0.707
#> 995 5 5 0 2.662 0.000 1
#> 996 16 19 3 2.662 1.127 0.26
#> 997 6 7 1 2.662 0.376 0.707
#> 998 8 9 1 2.662 0.376 0.707
#> 999 15 11 -4 2.662 -1.503 0.133
#> 1000 5 7 2 2.662 0.751 0.452
######
# interactive shiny interfaces for live scoring
mod_pre <- mirt(Science)
# (optional) setup mod_post to have medium effect size change (d = 0.5)
sv <- mod2values(mod_pre)
sv$value[sv$name == 'MEAN_1'] <- 0.5
mod_post <- mirt(Science, pars=sv, TOL=NA)
# only use pre-test model for scoring
if(interactive()){
RCI(mod_pre=mod_pre, shiny=TRUE)
# use both pre-test and post-test models for including empirical priors
RCI(mod_pre=mod_pre, mod_post=mod_post, shiny=TRUE,
main='Perceptions of Science and Technology')
}
############################
# Example where individuals take completely different item set pre-post
# but prior calibration has been performed to equate the items
dat <- key2binary(SAT12,
key = c(1,4,5,2,3,1,2,1,3,1,2,4,2,1,5,3,4,4,1,4,3,3,4,1,3,5,1,3,1,5,4,5))
mod <- mirt(dat)
# with N=5 individuals under investigation
predat <- postdat <- dat[1:5,]
predat[, 17:32] <- NA
postdat[, 1:16] <- NA
head(predat)
#> Item.1 Item.2 Item.3 Item.4 Item.5 Item.6 Item.7 Item.8 Item.9 Item.10
#> [1,] 1 1 1 1 1 1 1 1 1 1
#> [2,] 0 1 0 0 1 0 1 0 1 1
#> [3,] 1 1 1 0 1 0 1 0 1 0
#> [4,] 0 1 0 1 1 0 1 0 1 0
#> [5,] 0 1 1 1 1 0 1 1 0 0
#> Item.11 Item.12 Item.13 Item.14 Item.15 Item.16 Item.17 Item.18 Item.19
#> [1,] 1 1 1 1 1 1 NA NA NA
#> [2,] 1 0 1 1 1 0 NA NA NA
#> [3,] 1 0 0 1 1 0 NA NA NA
#> [4,] 1 1 1 1 1 0 NA NA NA
#> [5,] 1 1 1 1 1 0 NA NA NA
#> Item.20 Item.21 Item.22 Item.23 Item.24 Item.25 Item.26 Item.27 Item.28
#> [1,] NA NA NA NA NA NA NA NA NA
#> [2,] NA NA NA NA NA NA NA NA NA
#> [3,] NA NA NA NA NA NA NA NA NA
#> [4,] NA NA NA NA NA NA NA NA NA
#> [5,] NA NA NA NA NA NA NA NA NA
#> Item.29 Item.30 Item.31 Item.32
#> [1,] NA NA NA NA
#> [2,] NA NA NA NA
#> [3,] NA NA NA NA
#> [4,] NA NA NA NA
#> [5,] NA NA NA NA
head(postdat)
#> Item.1 Item.2 Item.3 Item.4 Item.5 Item.6 Item.7 Item.8 Item.9 Item.10
#> [1,] NA NA NA NA NA NA NA NA NA NA
#> [2,] NA NA NA NA NA NA NA NA NA NA
#> [3,] NA NA NA NA NA NA NA NA NA NA
#> [4,] NA NA NA NA NA NA NA NA NA NA
#> [5,] NA NA NA NA NA NA NA NA NA NA
#> Item.11 Item.12 Item.13 Item.14 Item.15 Item.16 Item.17 Item.18 Item.19
#> [1,] NA NA NA NA NA NA 1 1 1
#> [2,] NA NA NA NA NA NA 1 0 1
#> [3,] NA NA NA NA NA NA 1 0 0
#> [4,] NA NA NA NA NA NA 1 0 0
#> [5,] NA NA NA NA NA NA 1 0 1
#> Item.20 Item.21 Item.22 Item.23 Item.24 Item.25 Item.26 Item.27 Item.28
#> [1,] 1 1 1 1 1 1 1 1 1
#> [2,] 1 1 1 0 1 0 0 1 0
#> [3,] 1 1 1 0 1 1 0 1 1
#> [4,] 1 1 0 0 0 0 0 1 1
#> [5,] 1 1 1 0 1 0 1 1 1
#> Item.29 Item.30 Item.31 Item.32
#> [1,] 1 1 1 1
#> [2,] 0 0 1 0
#> [3,] 0 0 1 0
#> [4,] 0 0 1 0
#> [5,] 1 0 1 0
RCI(mod, predat, postdat)
#> pre.score post.score converged diff SEM z p
#> 1 2.206 1.808 TRUE -0.398 0.951 -0.419 0.675
#> 2 0.373 -0.344 TRUE -0.717 0.720 -0.995 0.32
#> 3 0.303 -0.115 TRUE -0.419 0.728 -0.575 0.566
#> 4 0.295 -0.864 TRUE -1.159 0.699 -1.658 0.097
#> 5 0.670 0.513 TRUE -0.157 0.772 -0.203 0.839
# }