RCI {mirt} | R Documentation |
Computes an IRT version of the "reliable change index" (RCI) proposed by Jacobson and Traux (1991) but modified to use IRT information about scores and measurement error (see Jabrayilov, Emons, and Sijtsma (2016). Main benefit of the IRT approach is the inclusion of response pattern information in the pre/post data score estimates, as well as conditional standard error of measurement information.
RCI(
mod_pre,
predat,
postdat,
mod_post = mod_pre,
cutoffs = NULL,
SEM.pre = NULL,
SEM.post = NULL,
Fisher = FALSE,
shiny = FALSE,
main = "Test Scores",
...
)
mod_pre |
single-group model fitted by |
predat |
a vector (if one individual) or matrix/data.frame of response data to be scored, where each individuals' responses are included in exactly one row |
postdat |
same as |
mod_post |
(optional) IRT model for post-test if different from pre-test; otherwise, the pre-test model will be used |
cutoffs |
optional vector of length 2 indicating the type of cut-offs to
report (e.g., |
SEM.pre |
standard error of measurement for the pretest. This can be used instead of
|
SEM.post |
(optional) standard error of measurement for the post-test.
Using this will create a pooled version of the SEM; otherwise, |
Fisher |
logical; use the Fisher/expected information function to compute the
SE terms? If |
shiny |
logical; launch an interactive shiny applications for real-time scoring
of supplied total-scores or response vectors? Only requires |
main |
main label to use when |
... |
additional arguments passed to |
Phil Chalmers rphilip.chalmers@gmail.com
Chalmers, R., P. (2012). mirt: A Multidimensional Item Response Theory Package for the R Environment. Journal of Statistical Software, 48(6), 1-29. doi:10.18637/jss.v048.i06
Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19.
Jabrayilov, R. , Emons, W. H. M., & Sijtsma, K. (2016). Comparison of Classical Test Theory and Item Response Theory in Individual Change Assessment. Applied Psychological Measurement, 40 (8), 559-572.
## No test:
# simulate some data
N <- 1000
J <- 20 # number of items
a <- matrix(rlnorm(J,.2,.3))
d <- rnorm(J)
theta <- matrix(rnorm(N))
dat_pre <- simdata(a, d, itemtype = '2PL', Theta = theta)
# first 3 cases decrease by 1/2
theta2 <- theta - c(1/2, 1/2, 1/2, numeric(N-3))
dat_post <- simdata(a, d, itemtype = '2PL', Theta = theta2)
mod <- mirt(dat_pre)
# all changes using fitted model from pre data
RCI(mod, predat=dat_pre, postdat=dat_post)
## pre.score post.score converged diff SEM z p
## 1 0.496 0.146 TRUE -0.349 0.522 -0.670 0.503
## 2 -0.793 -0.818 TRUE -0.025 0.592 -0.043 0.966
## 3 0.231 -0.389 TRUE -0.620 0.533 -1.164 0.244
## 4 -0.098 0.157 TRUE 0.255 0.523 0.488 0.626
## 5 1.467 1.159 TRUE -0.308 0.602 -0.511 0.61
## 6 0.741 0.497 TRUE -0.244 0.530 -0.460 0.646
## 7 0.411 0.572 TRUE 0.160 0.524 0.306 0.76
## 8 -0.628 -0.203 TRUE 0.425 0.552 0.771 0.441
## 9 0.341 0.925 TRUE 0.584 0.536 1.089 0.276
## 10 -0.134 0.052 TRUE 0.186 0.525 0.355 0.723
## 11 0.386 0.135 TRUE -0.251 0.520 -0.482 0.63
## 12 1.130 1.224 TRUE 0.094 0.582 0.161 0.872
## 13 1.228 0.691 TRUE -0.538 0.562 -0.958 0.338
## 14 -0.058 -0.464 TRUE -0.407 0.539 -0.755 0.45
## 15 -0.097 -0.425 TRUE -0.329 0.538 -0.611 0.541
## 16 0.211 0.160 TRUE -0.052 0.519 -0.100 0.921
## 17 -1.555 -1.599 TRUE -0.044 0.728 -0.061 0.951
## 18 -0.322 0.494 TRUE 0.816 0.532 1.533 0.125
## 19 -0.178 -0.204 TRUE -0.026 0.532 -0.049 0.961
## 20 0.930 1.335 TRUE 0.405 0.579 0.699 0.484
## 21 -1.376 -1.614 TRUE -0.238 0.712 -0.334 0.738
## 22 0.431 0.882 TRUE 0.451 0.535 0.842 0.4
## 23 -1.231 -1.558 TRUE -0.327 0.693 -0.472 0.637
## 24 -1.577 -1.554 TRUE 0.022 0.726 0.031 0.976
## 25 0.329 -0.233 TRUE -0.563 0.527 -1.068 0.286
## 26 -1.520 -1.304 TRUE 0.217 0.696 0.311 0.756
## 27 0.124 0.122 TRUE -0.001 0.520 -0.003 0.998
## 28 -1.788 -1.542 TRUE 0.247 0.747 0.330 0.741
## 29 -1.810 -1.872 TRUE -0.062 0.784 -0.079 0.937
## 30 0.915 -0.376 TRUE -1.291 0.548 -2.354 0.019
## 31 -0.943 -1.040 TRUE -0.097 0.620 -0.157 0.875
## 32 -1.391 -1.798 TRUE -0.407 0.734 -0.555 0.579
## 33 -1.026 -0.293 TRUE 0.733 0.584 1.256 0.209
## 34 -0.457 -1.041 TRUE -0.583 0.591 -0.987 0.324
## 35 -0.695 -1.084 TRUE -0.389 0.607 -0.641 0.522
## 36 -1.872 -0.321 TRUE 1.550 0.677 2.289 0.022
## 37 -0.139 -0.235 TRUE -0.097 0.532 -0.182 0.856
## 38 -0.839 -0.883 TRUE -0.044 0.600 -0.073 0.942
## 39 1.053 1.641 TRUE 0.588 0.612 0.961 0.337
## 40 0.810 0.638 TRUE -0.172 0.536 -0.320 0.749
## 41 0.433 0.421 TRUE -0.011 0.521 -0.022 0.983
## 42 0.942 0.896 TRUE -0.045 0.552 -0.082 0.934
## 43 0.477 0.729 TRUE 0.252 0.529 0.475 0.635
## 44 0.307 0.288 TRUE -0.018 0.519 -0.036 0.972
## 45 -0.711 -1.376 TRUE -0.665 0.636 -1.045 0.296
## 46 -1.856 -1.872 TRUE -0.016 0.789 -0.020 0.984
## 47 1.501 0.636 TRUE -0.865 0.583 -1.485 0.138
## 48 0.063 -0.338 TRUE -0.401 0.532 -0.755 0.45
## 49 0.777 1.025 TRUE 0.247 0.551 0.448 0.654
## 50 0.561 0.370 TRUE -0.192 0.523 -0.367 0.714
## 51 0.437 0.450 TRUE 0.013 0.522 0.024 0.981
## 52 1.989 2.103 TRUE 0.115 0.738 0.155 0.876
## 53 -0.202 -0.063 TRUE 0.140 0.529 0.264 0.792
## 54 -0.937 -1.810 TRUE -0.873 0.699 -1.249 0.212
## 55 -0.281 0.104 TRUE 0.385 0.529 0.728 0.467
## 56 -0.907 -0.493 TRUE 0.414 0.582 0.712 0.476
## 57 0.491 0.079 TRUE -0.413 0.522 -0.791 0.429
## 58 0.921 0.692 TRUE -0.229 0.543 -0.422 0.673
## 59 0.859 0.092 TRUE -0.767 0.534 -1.438 0.15
## 60 0.830 1.478 TRUE 0.648 0.587 1.104 0.269
## 61 -0.982 -0.892 TRUE 0.089 0.612 0.146 0.884
## 62 0.569 0.352 TRUE -0.218 0.523 -0.416 0.677
## 63 -0.637 -0.350 TRUE 0.287 0.557 0.515 0.607
## 64 -0.672 0.344 TRUE 1.016 0.548 1.854 0.064
## 65 -0.445 -1.078 TRUE -0.634 0.594 -1.067 0.286
## 66 -0.890 -1.748 TRUE -0.858 0.689 -1.245 0.213
## 67 1.186 1.761 TRUE 0.576 0.632 0.910 0.363
## 68 -0.150 1.109 TRUE 1.259 0.552 2.283 0.022
## 69 -1.244 -0.490 TRUE 0.753 0.611 1.232 0.218
## 70 0.393 1.101 TRUE 0.708 0.547 1.295 0.195
## 71 -0.594 -0.682 TRUE -0.088 0.571 -0.154 0.878
## 72 -0.850 -0.273 TRUE 0.577 0.569 1.015 0.31
## 73 0.681 0.258 TRUE -0.422 0.526 -0.803 0.422
## 74 0.205 -0.639 TRUE -0.844 0.546 -1.547 0.122
## 75 1.046 0.818 TRUE -0.229 0.554 -0.413 0.68
## 76 -0.274 0.539 TRUE 0.814 0.531 1.532 0.126
## 77 -1.123 -1.195 TRUE -0.072 0.648 -0.111 0.911
## 78 -0.609 -0.488 TRUE 0.121 0.561 0.216 0.829
## 79 -0.313 -0.770 TRUE -0.457 0.564 -0.810 0.418
## 80 -0.780 -1.872 TRUE -1.092 0.697 -1.566 0.117
## 81 -0.855 -1.009 TRUE -0.153 0.611 -0.251 0.802
## 82 0.388 0.330 TRUE -0.058 0.520 -0.111 0.911
## 83 -1.389 -0.900 TRUE 0.489 0.649 0.753 0.452
## 84 -0.363 0.043 TRUE 0.406 0.533 0.761 0.446
## 85 -0.716 -0.668 TRUE 0.049 0.578 0.084 0.933
## 86 0.825 0.864 TRUE 0.039 0.545 0.072 0.943
## 87 0.157 -0.332 TRUE -0.489 0.530 -0.921 0.357
## 88 1.103 1.681 TRUE 0.578 0.619 0.933 0.351
## 89 1.249 1.047 TRUE -0.202 0.579 -0.349 0.727
## 90 -0.769 0.708 TRUE 1.477 0.562 2.630 0.009
## 91 -0.733 -0.500 TRUE 0.232 0.570 0.408 0.684
## 92 0.488 0.596 TRUE 0.108 0.526 0.205 0.838
## 93 -1.520 -0.932 TRUE 0.588 0.666 0.883 0.377
## 94 -0.162 -1.026 TRUE -0.864 0.580 -1.490 0.136
## 95 -2.153 -1.507 TRUE 0.646 0.786 0.822 0.411
## 96 -1.748 -1.092 TRUE 0.657 0.703 0.934 0.35
## 97 0.076 0.933 TRUE 0.857 0.537 1.596 0.111
## 98 -0.310 -0.899 TRUE -0.589 0.574 -1.027 0.304
## 99 -0.516 0.375 TRUE 0.891 0.539 1.652 0.098
## 100 -0.392 -0.665 TRUE -0.273 0.560 -0.487 0.626
## 101 0.466 0.324 TRUE -0.143 0.521 -0.274 0.784
## 102 -0.267 0.443 TRUE 0.710 0.529 1.342 0.18
## 103 1.770 1.589 TRUE -0.181 0.663 -0.272 0.785
## 104 1.454 0.355 TRUE -1.099 0.574 -1.916 0.055
## 105 1.435 0.989 TRUE -0.446 0.590 -0.756 0.45
## 106 -1.629 -1.555 TRUE 0.074 0.731 0.101 0.919
## 107 -0.227 -0.013 TRUE 0.215 0.529 0.406 0.685
## 108 -0.831 -1.379 TRUE -0.547 0.644 -0.850 0.395
## 109 -1.872 -1.713 TRUE 0.159 0.774 0.206 0.837
## 110 -0.691 -0.911 TRUE -0.220 0.593 -0.371 0.71
## 111 -1.225 -1.000 TRUE 0.225 0.641 0.351 0.726
## 112 0.281 0.557 TRUE 0.276 0.523 0.528 0.597
## 113 0.421 0.503 TRUE 0.082 0.523 0.156 0.876
## 114 -0.485 -0.763 TRUE -0.278 0.571 -0.487 0.626
## 115 0.292 0.553 TRUE 0.261 0.522 0.500 0.617
## 116 0.516 0.801 TRUE 0.285 0.533 0.535 0.592
## 117 -1.112 -0.421 TRUE 0.690 0.596 1.158 0.247
## 118 -1.558 -1.265 TRUE 0.293 0.696 0.420 0.674
## 119 0.316 0.143 TRUE -0.172 0.519 -0.332 0.74
## 120 -0.776 0.262 TRUE 1.038 0.555 1.872 0.061
## 121 1.204 1.305 TRUE 0.101 0.592 0.171 0.865
## 122 -1.584 -1.255 TRUE 0.329 0.698 0.471 0.638
## 123 1.580 0.992 TRUE -0.588 0.603 -0.975 0.33
## 124 0.043 0.286 TRUE 0.243 0.520 0.467 0.641
## 125 0.902 0.162 TRUE -0.741 0.535 -1.384 0.166
## 126 1.335 1.686 TRUE 0.351 0.635 0.553 0.58
## 127 1.153 1.657 TRUE 0.503 0.620 0.812 0.417
## 128 -1.350 -0.222 TRUE 1.128 0.613 1.840 0.066
## 129 1.238 0.623 TRUE -0.615 0.560 -1.098 0.272
## 130 0.004 -0.648 TRUE -0.652 0.548 -1.190 0.234
## 131 0.992 1.456 TRUE 0.464 0.592 0.783 0.433
## 132 -0.123 -0.859 TRUE -0.735 0.565 -1.301 0.193
## 133 -1.004 -1.126 TRUE -0.122 0.632 -0.193 0.847
## 134 1.670 1.359 TRUE -0.311 0.635 -0.490 0.624
## 135 -0.337 0.061 TRUE 0.398 0.532 0.748 0.454
## 136 -0.556 -1.289 TRUE -0.733 0.619 -1.184 0.236
## 137 -1.086 -0.180 TRUE 0.907 0.586 1.548 0.122
## 138 -1.046 -0.192 TRUE 0.854 0.582 1.466 0.143
## 139 0.836 1.871 TRUE 1.035 0.627 1.651 0.099
## 140 0.057 -1.356 TRUE -1.413 0.608 -2.323 0.02
## 141 1.248 1.045 TRUE -0.203 0.578 -0.350 0.726
## 142 -0.017 -0.743 TRUE -0.725 0.555 -1.308 0.191
## 143 2.072 1.592 TRUE -0.480 0.696 -0.689 0.491
## 144 -0.065 0.130 TRUE 0.194 0.523 0.372 0.71
## 145 -0.341 -0.659 TRUE -0.318 0.558 -0.570 0.569
## 146 1.010 1.220 TRUE 0.209 0.575 0.365 0.715
## 147 0.075 -0.409 TRUE -0.484 0.534 -0.905 0.365
## 148 -0.496 -1.089 TRUE -0.593 0.597 -0.993 0.321
## 149 0.116 -0.115 TRUE -0.231 0.524 -0.441 0.659
## 150 -0.077 0.055 TRUE 0.132 0.524 0.253 0.8
## 151 0.110 -0.373 TRUE -0.482 0.532 -0.905 0.365
## 152 -0.372 0.026 TRUE 0.398 0.533 0.746 0.455
## 153 0.683 0.576 TRUE -0.107 0.530 -0.203 0.839
## 154 0.169 0.701 TRUE 0.532 0.527 1.010 0.313
## 155 0.839 0.033 TRUE -0.806 0.533 -1.512 0.131
## 156 0.138 -0.253 TRUE -0.391 0.528 -0.741 0.459
## 157 0.338 0.474 TRUE 0.136 0.521 0.261 0.794
## 158 0.848 0.299 TRUE -0.549 0.532 -1.032 0.302
## 159 -0.384 -0.505 TRUE -0.121 0.551 -0.220 0.826
## 160 -1.017 -1.193 TRUE -0.176 0.639 -0.276 0.783
## 161 -0.613 -0.843 TRUE -0.230 0.583 -0.394 0.693
## 162 -1.198 -1.489 TRUE -0.291 0.683 -0.426 0.67
## 163 -0.960 -0.862 TRUE 0.098 0.608 0.161 0.872
## 164 1.738 1.708 TRUE -0.030 0.671 -0.044 0.965
## 165 0.512 -0.029 TRUE -0.542 0.524 -1.034 0.301
## 166 -1.660 -1.599 TRUE 0.061 0.739 0.083 0.934
## 167 -0.529 -1.254 TRUE -0.725 0.614 -1.181 0.238
## 168 -1.274 -0.799 TRUE 0.475 0.631 0.753 0.451
## 169 0.027 0.346 TRUE 0.319 0.521 0.613 0.54
## 170 -0.675 -0.962 TRUE -0.286 0.596 -0.481 0.631
## 171 2.088 1.645 TRUE -0.443 0.703 -0.630 0.528
## 172 0.332 0.404 TRUE 0.072 0.520 0.138 0.89
## 173 0.083 -1.072 TRUE -1.155 0.580 -1.993 0.046
## 174 1.601 0.947 TRUE -0.655 0.603 -1.085 0.278
## 175 0.345 0.657 TRUE 0.313 0.526 0.595 0.552
## 176 1.248 1.751 TRUE 0.504 0.635 0.793 0.428
## 177 -0.240 -0.362 TRUE -0.123 0.539 -0.227 0.82
## 178 0.235 0.858 TRUE 0.624 0.533 1.171 0.242
## 179 0.699 -0.054 TRUE -0.752 0.529 -1.421 0.155
## 180 -1.246 -0.574 TRUE 0.672 0.616 1.091 0.275
## 181 0.292 0.413 TRUE 0.122 0.520 0.234 0.815
## 182 0.641 0.295 TRUE -0.346 0.525 -0.659 0.51
## 183 0.940 1.057 TRUE 0.117 0.560 0.209 0.835
## 184 1.058 1.221 TRUE 0.163 0.577 0.282 0.778
## 185 -0.633 -0.906 TRUE -0.273 0.589 -0.464 0.643
## 186 1.413 2.030 TRUE 0.618 0.678 0.912 0.362
## 187 2.036 2.088 TRUE 0.052 0.741 0.070 0.944
## 188 1.074 1.108 TRUE 0.034 0.571 0.060 0.952
## 189 -0.681 -0.353 TRUE 0.328 0.560 0.586 0.558
## 190 -0.837 -0.745 TRUE 0.092 0.591 0.155 0.877
## 191 0.303 -0.059 TRUE -0.362 0.522 -0.693 0.488
## 192 0.363 -0.151 TRUE -0.514 0.525 -0.980 0.327
## 193 -1.078 -1.041 TRUE 0.037 0.631 0.059 0.953
## 194 1.232 0.021 TRUE -1.211 0.557 -2.175 0.03
## 195 -0.494 -0.133 TRUE 0.362 0.542 0.667 0.505
## 196 0.636 -0.118 TRUE -0.755 0.529 -1.427 0.154
## 197 0.018 0.255 TRUE 0.237 0.521 0.456 0.649
## 198 -0.072 -0.494 TRUE -0.422 0.541 -0.780 0.435
## 199 1.158 1.565 TRUE 0.407 0.611 0.667 0.505
## 200 -0.514 0.190 TRUE 0.704 0.539 1.307 0.191
## 201 -1.040 -0.777 TRUE 0.263 0.608 0.433 0.665
## 202 0.760 0.956 TRUE 0.195 0.547 0.357 0.721
## 203 -0.980 -0.100 TRUE 0.880 0.574 1.532 0.126
## 204 -0.111 -0.559 TRUE -0.448 0.545 -0.822 0.411
## 205 -0.831 -1.558 TRUE -0.727 0.663 -1.096 0.273
## 206 1.601 1.146 TRUE -0.456 0.614 -0.742 0.458
## 207 -1.289 -1.326 TRUE -0.037 0.675 -0.055 0.956
## 208 1.629 1.627 TRUE -0.002 0.653 -0.003 0.998
## 209 -0.355 -0.506 TRUE -0.151 0.550 -0.274 0.784
## 210 0.439 -0.020 TRUE -0.459 0.523 -0.878 0.38
## 211 -1.545 -0.819 TRUE 0.726 0.661 1.098 0.272
## 212 0.301 0.660 TRUE 0.359 0.525 0.684 0.494
## 213 -0.594 -1.102 TRUE -0.508 0.603 -0.842 0.4
## 214 -0.652 -0.359 TRUE 0.293 0.558 0.524 0.6
## 215 -0.242 -0.519 TRUE -0.277 0.547 -0.507 0.612
## 216 0.950 1.129 TRUE 0.180 0.565 0.318 0.75
## 217 -1.123 -1.071 TRUE 0.052 0.637 0.081 0.935
## 218 0.951 0.401 TRUE -0.550 0.538 -1.023 0.306
## 219 0.150 -0.468 TRUE -0.618 0.537 -1.152 0.249
## 220 0.021 0.573 TRUE 0.553 0.525 1.053 0.292
## 221 -1.279 -0.655 TRUE 0.624 0.623 1.001 0.317
## 222 -0.570 0.184 TRUE 0.754 0.542 1.393 0.164
## 223 0.757 0.766 TRUE 0.009 0.538 0.017 0.987
## 224 1.793 1.751 TRUE -0.042 0.681 -0.062 0.951
## 225 1.612 0.800 TRUE -0.813 0.598 -1.359 0.174
## 226 -0.179 0.064 TRUE 0.243 0.526 0.462 0.644
## 227 -0.210 -0.162 TRUE 0.049 0.531 0.092 0.927
## 228 1.617 0.267 TRUE -1.350 0.589 -2.293 0.022
## 229 -1.122 -1.145 TRUE -0.023 0.643 -0.036 0.971
## 230 -0.425 -0.151 TRUE 0.273 0.539 0.507 0.612
## 231 -0.312 0.100 TRUE 0.412 0.530 0.776 0.437
## 232 -0.492 -0.028 TRUE 0.464 0.540 0.860 0.39
## 233 0.370 0.718 TRUE 0.348 0.528 0.659 0.51
## 234 1.491 0.715 TRUE -0.776 0.584 -1.329 0.184
## 235 1.436 0.781 TRUE -0.655 0.581 -1.127 0.26
## 236 -0.884 -1.062 TRUE -0.178 0.618 -0.289 0.773
## 237 0.564 0.229 TRUE -0.334 0.523 -0.640 0.522
## 238 -1.282 -0.232 TRUE 1.050 0.606 1.733 0.083
## 239 -1.517 -0.997 TRUE 0.520 0.670 0.776 0.438
## 240 -0.369 -0.470 TRUE -0.102 0.549 -0.185 0.853
## 241 0.081 0.707 TRUE 0.626 0.528 1.186 0.236
## 242 -1.305 -0.458 TRUE 0.847 0.616 1.375 0.169
## 243 1.722 2.072 TRUE 0.349 0.708 0.494 0.621
## 244 0.394 0.426 TRUE 0.032 0.521 0.061 0.951
## 245 0.222 0.359 TRUE 0.137 0.519 0.264 0.792
## 246 1.350 0.914 TRUE -0.436 0.579 -0.753 0.451
## 247 1.177 1.898 TRUE 0.721 0.647 1.115 0.265
## 248 0.876 -0.069 TRUE -0.946 0.537 -1.761 0.078
## 249 -0.061 -0.979 TRUE -0.918 0.573 -1.601 0.109
## 250 0.783 0.773 TRUE -0.010 0.540 -0.018 0.985
## 251 1.355 -0.092 TRUE -1.447 0.568 -2.546 0.011
## 252 1.040 0.889 TRUE -0.151 0.557 -0.272 0.786
## 253 0.398 0.371 TRUE -0.027 0.520 -0.052 0.959
## 254 -1.303 -1.070 TRUE 0.233 0.654 0.356 0.722
## 255 0.523 0.610 TRUE 0.087 0.527 0.165 0.869
## 256 -0.429 0.210 TRUE 0.640 0.534 1.197 0.231
## 257 -0.676 -0.930 TRUE -0.253 0.593 -0.427 0.669
## 258 -0.298 -0.225 TRUE 0.073 0.536 0.137 0.891
## 259 -0.435 -0.677 TRUE -0.242 0.563 -0.430 0.667
## 260 0.448 0.436 TRUE -0.011 0.522 -0.021 0.983
## 261 0.630 0.842 TRUE 0.213 0.537 0.396 0.692
## 262 -0.049 0.594 TRUE 0.644 0.526 1.223 0.221
## 263 0.779 -0.126 TRUE -0.905 0.534 -1.694 0.09
## 264 -0.667 0.010 TRUE 0.676 0.549 1.232 0.218
## 265 -0.073 0.370 TRUE 0.443 0.523 0.847 0.397
## 266 0.292 -0.033 TRUE -0.325 0.522 -0.623 0.533
## 267 0.096 0.629 TRUE 0.533 0.525 1.015 0.31
## 268 1.738 1.288 TRUE -0.451 0.637 -0.708 0.479
## 269 -0.885 -1.108 TRUE -0.223 0.622 -0.359 0.719
## 270 0.200 0.894 TRUE 0.694 0.535 1.299 0.194
## 271 1.031 1.357 TRUE 0.326 0.586 0.557 0.578
## 272 -0.277 -0.343 TRUE -0.066 0.540 -0.123 0.902
## 273 -0.349 -0.519 TRUE -0.170 0.550 -0.309 0.757
## 274 1.063 1.138 TRUE 0.075 0.572 0.131 0.895
## 275 0.104 1.182 TRUE 1.078 0.552 1.953 0.051
## 276 1.048 1.047 TRUE -0.001 0.566 -0.002 0.999
## 277 1.237 0.902 TRUE -0.335 0.570 -0.587 0.557
## 278 0.619 -0.147 TRUE -0.766 0.529 -1.447 0.148
## 279 -0.100 -0.128 TRUE -0.027 0.528 -0.052 0.958
## 280 -0.867 0.011 TRUE 0.877 0.563 1.558 0.119
## 281 0.687 -0.079 TRUE -0.765 0.530 -1.445 0.148
## 282 0.737 0.270 TRUE -0.467 0.528 -0.885 0.376
## 283 -0.198 0.550 TRUE 0.748 0.529 1.415 0.157
## 284 -0.673 -0.864 TRUE -0.191 0.588 -0.325 0.746
## 285 -1.078 -0.458 TRUE 0.620 0.594 1.042 0.297
## 286 -1.517 -0.465 TRUE 1.052 0.640 1.645 0.1
## 287 -1.376 -1.522 TRUE -0.147 0.703 -0.209 0.834
## 288 0.014 -0.231 TRUE -0.245 0.528 -0.463 0.643
## 289 -0.339 0.065 TRUE 0.404 0.532 0.760 0.447
## 290 -0.171 -0.812 TRUE -0.641 0.563 -1.140 0.254
## 291 -0.098 -0.399 TRUE -0.300 0.537 -0.560 0.576
## 292 -1.025 -1.280 TRUE -0.255 0.648 -0.393 0.694
## 293 1.045 1.300 TRUE 0.255 0.582 0.438 0.661
## 294 1.111 1.754 TRUE 0.643 0.627 1.025 0.305
## 295 -1.255 -1.013 TRUE 0.242 0.645 0.375 0.708
## 296 -1.908 -1.142 TRUE 0.766 0.726 1.055 0.292
## 297 0.662 0.071 TRUE -0.590 0.526 -1.122 0.262
## 298 -0.882 -0.137 TRUE 0.745 0.567 1.314 0.189
## 299 0.571 0.413 TRUE -0.158 0.524 -0.302 0.763
## 300 -0.141 0.033 TRUE 0.174 0.525 0.331 0.741
## 301 -0.607 -0.787 TRUE -0.179 0.579 -0.310 0.756
## 302 -0.774 -0.538 TRUE 0.236 0.574 0.411 0.681
## 303 0.887 1.014 TRUE 0.127 0.555 0.228 0.82
## 304 0.569 -0.135 TRUE -0.704 0.528 -1.334 0.182
## 305 -0.991 -1.305 TRUE -0.314 0.648 -0.484 0.628
## 306 0.157 0.277 TRUE 0.120 0.519 0.231 0.817
## 307 0.638 0.365 TRUE -0.273 0.525 -0.520 0.603
## 308 -0.039 0.609 TRUE 0.647 0.526 1.230 0.219
## 309 -0.861 -0.703 TRUE 0.158 0.590 0.268 0.789
## 310 0.609 0.336 TRUE -0.273 0.524 -0.521 0.603
## 311 0.082 0.407 TRUE 0.325 0.521 0.625 0.532
## 312 -0.254 -0.074 TRUE 0.180 0.531 0.339 0.735
## 313 1.335 0.557 TRUE -0.778 0.566 -1.374 0.169
## 314 -0.232 -0.050 TRUE 0.182 0.530 0.343 0.732
## 315 -1.555 -1.872 TRUE -0.317 0.758 -0.418 0.676
## 316 0.633 0.426 TRUE -0.206 0.526 -0.393 0.694
## 317 1.016 -0.219 TRUE -1.234 0.548 -2.253 0.024
## 318 -0.443 -1.027 TRUE -0.584 0.589 -0.991 0.322
## 319 1.288 0.909 TRUE -0.378 0.574 -0.659 0.51
## 320 0.507 0.316 TRUE -0.191 0.522 -0.367 0.714
## 321 -1.629 -1.792 TRUE -0.163 0.757 -0.215 0.83
## 322 0.938 1.139 TRUE 0.201 0.565 0.356 0.722
## 323 -1.838 -1.660 TRUE 0.178 0.765 0.233 0.816
## 324 0.054 0.424 TRUE 0.370 0.521 0.710 0.478
## 325 -0.211 0.159 TRUE 0.370 0.526 0.704 0.481
## 326 0.623 0.765 TRUE 0.142 0.534 0.266 0.79
## 327 1.075 1.144 TRUE 0.069 0.573 0.121 0.904
## 328 1.349 0.322 TRUE -1.027 0.564 -1.819 0.069
## 329 -0.356 -0.380 TRUE -0.024 0.544 -0.044 0.965
## 330 -0.310 -0.018 TRUE 0.292 0.532 0.549 0.583
## 331 0.778 0.101 TRUE -0.677 0.530 -1.277 0.201
## 332 -0.712 -0.306 TRUE 0.406 0.560 0.725 0.468
## 333 0.268 1.065 TRUE 0.796 0.544 1.464 0.143
## 334 -0.665 -0.402 TRUE 0.263 0.561 0.468 0.64
## 335 -2.153 -0.952 TRUE 1.201 0.743 1.616 0.106
## 336 -1.274 -0.845 TRUE 0.428 0.634 0.676 0.499
## 337 0.012 -0.964 TRUE -0.976 0.571 -1.709 0.087
## 338 0.156 0.111 TRUE -0.045 0.520 -0.087 0.931
## 339 0.456 1.382 TRUE 0.925 0.568 1.628 0.104
## 340 0.850 1.554 TRUE 0.704 0.595 1.184 0.236
## 341 0.060 -0.158 TRUE -0.218 0.526 -0.414 0.679
## 342 -0.525 -0.347 TRUE 0.177 0.551 0.322 0.747
## 343 -0.492 -1.185 TRUE -0.693 0.606 -1.144 0.253
## 344 1.303 1.816 TRUE 0.513 0.646 0.795 0.427
## 345 1.030 -0.148 TRUE -1.178 0.547 -2.155 0.031
## 346 0.435 -0.577 TRUE -1.013 0.543 -1.864 0.062
## 347 0.733 0.818 TRUE 0.084 0.540 0.156 0.876
## 348 1.314 1.191 TRUE -0.124 0.592 -0.209 0.835
## 349 -0.374 -1.184 TRUE -0.810 0.601 -1.348 0.178
## 350 -0.240 -0.002 TRUE 0.238 0.529 0.450 0.653
## 351 -0.662 -1.375 TRUE -0.713 0.633 -1.125 0.261
## 352 -0.312 -0.734 TRUE -0.422 0.562 -0.751 0.453
## 353 1.532 1.738 TRUE 0.206 0.655 0.315 0.753
## 354 -0.406 -0.095 TRUE 0.311 0.537 0.579 0.562
## 355 0.432 0.106 TRUE -0.327 0.521 -0.628 0.53
## 356 0.342 0.376 TRUE 0.033 0.520 0.064 0.949
## 357 1.145 0.576 TRUE -0.569 0.553 -1.029 0.303
## 358 -0.852 -0.500 TRUE 0.352 0.578 0.610 0.542
## 359 0.068 -0.159 TRUE -0.227 0.525 -0.432 0.665
## 360 1.008 0.941 TRUE -0.067 0.558 -0.120 0.904
## 361 0.227 0.466 TRUE 0.240 0.521 0.460 0.645
## 362 0.324 0.135 TRUE -0.189 0.520 -0.364 0.716
## 363 0.707 0.885 TRUE 0.177 0.542 0.327 0.743
## 364 1.485 1.126 TRUE -0.359 0.602 -0.597 0.551
## 365 0.034 -0.456 TRUE -0.490 0.537 -0.912 0.362
## 366 1.661 0.326 TRUE -1.335 0.593 -2.250 0.024
## 367 -0.953 -1.040 TRUE -0.087 0.621 -0.140 0.889
## 368 -1.503 -1.873 TRUE -0.370 0.753 -0.491 0.624
## 369 -1.450 -1.872 TRUE -0.422 0.748 -0.564 0.573
## 370 0.684 0.592 TRUE -0.092 0.530 -0.173 0.863
## 371 0.297 0.301 TRUE 0.004 0.519 0.007 0.994
## 372 -1.145 -0.399 TRUE 0.747 0.598 1.248 0.212
## 373 1.130 0.365 TRUE -0.765 0.548 -1.395 0.163
## 374 -1.085 -1.146 TRUE -0.062 0.640 -0.096 0.923
## 375 -0.661 -0.933 TRUE -0.272 0.593 -0.459 0.646
## 376 -0.630 -0.392 TRUE 0.238 0.558 0.427 0.669
## 377 0.566 0.399 TRUE -0.167 0.524 -0.319 0.749
## 378 0.570 1.416 TRUE 0.845 0.573 1.474 0.14
## 379 1.307 1.798 TRUE 0.491 0.644 0.762 0.446
## 380 0.745 0.428 TRUE -0.317 0.529 -0.598 0.55
## 381 -0.707 -0.834 TRUE -0.128 0.588 -0.217 0.828
## 382 0.148 0.403 TRUE 0.254 0.520 0.489 0.625
## 383 -0.230 0.322 TRUE 0.552 0.527 1.048 0.295
## 384 0.121 0.831 TRUE 0.710 0.532 1.334 0.182
## 385 -0.892 -0.668 TRUE 0.224 0.590 0.380 0.704
## 386 0.878 0.972 TRUE 0.094 0.553 0.170 0.865
## 387 -0.380 -0.430 TRUE -0.050 0.547 -0.091 0.928
## 388 0.381 0.259 TRUE -0.121 0.520 -0.233 0.816
## 389 -1.024 -0.921 TRUE 0.102 0.617 0.166 0.868
## 390 -0.192 -0.414 TRUE -0.223 0.540 -0.413 0.68
## 391 0.229 0.109 TRUE -0.120 0.520 -0.231 0.817
## 392 -0.763 -0.141 TRUE 0.622 0.559 1.114 0.265
## 393 0.368 0.135 TRUE -0.233 0.520 -0.448 0.654
## 394 -0.193 -0.362 TRUE -0.169 0.538 -0.314 0.754
## 395 0.244 -0.990 TRUE -1.234 0.571 -2.159 0.031
## 396 1.562 1.069 TRUE -0.492 0.606 -0.813 0.416
## 397 -1.095 -0.195 TRUE 0.899 0.587 1.533 0.125
## 398 0.556 0.613 TRUE 0.057 0.527 0.108 0.914
## 399 0.894 0.312 TRUE -0.581 0.535 -1.087 0.277
## 400 -1.038 -0.533 TRUE 0.505 0.594 0.850 0.395
## 401 0.994 1.335 TRUE 0.341 0.582 0.586 0.558
## 402 -1.080 -0.793 TRUE 0.287 0.613 0.468 0.64
## 403 -0.943 -0.695 TRUE 0.249 0.595 0.418 0.676
## 404 1.521 0.956 TRUE -0.565 0.596 -0.948 0.343
## 405 -0.187 -1.005 TRUE -0.818 0.578 -1.414 0.157
## 406 0.200 -0.441 TRUE -0.641 0.535 -1.197 0.231
## 407 -1.209 -1.453 TRUE -0.245 0.680 -0.360 0.719
## 408 -0.310 -0.340 TRUE -0.029 0.541 -0.054 0.957
## 409 -0.654 0.230 TRUE 0.884 0.547 1.616 0.106
## 410 0.477 0.433 TRUE -0.045 0.522 -0.086 0.932
## 411 -1.230 -1.274 TRUE -0.044 0.665 -0.067 0.947
## 412 0.805 0.058 TRUE -0.746 0.532 -1.404 0.16
## 413 0.033 -0.185 TRUE -0.217 0.527 -0.412 0.68
## 414 0.874 1.571 TRUE 0.696 0.597 1.166 0.244
## 415 0.691 -0.076 TRUE -0.767 0.530 -1.448 0.148
## 416 -1.348 -0.750 TRUE 0.599 0.636 0.942 0.346
## 417 -1.081 -1.305 TRUE -0.224 0.655 -0.342 0.732
## 418 1.708 1.670 TRUE -0.039 0.665 -0.058 0.954
## 419 -1.629 -1.872 TRUE -0.243 0.765 -0.317 0.751
## 420 1.030 0.643 TRUE -0.387 0.547 -0.707 0.48
## 421 0.938 0.444 TRUE -0.494 0.538 -0.918 0.359
## 422 -0.592 -0.322 TRUE 0.270 0.553 0.488 0.625
## 423 -0.813 -0.809 TRUE 0.003 0.593 0.005 0.996
## 424 -0.426 -0.915 TRUE -0.489 0.579 -0.845 0.398
## 425 -0.260 -0.147 TRUE 0.112 0.533 0.211 0.833
## 426 -0.614 -1.447 TRUE -0.833 0.639 -1.305 0.192
## 427 -0.773 -0.636 TRUE 0.137 0.579 0.237 0.813
## 428 -1.393 -0.565 TRUE 0.829 0.630 1.314 0.189
## 429 -0.036 0.730 TRUE 0.767 0.530 1.446 0.148
## 430 -0.556 -1.147 TRUE -0.591 0.605 -0.977 0.329
## 431 -0.788 0.476 TRUE 1.265 0.557 2.268 0.023
## 432 0.882 0.423 TRUE -0.459 0.535 -0.858 0.391
## 433 1.708 2.103 TRUE 0.395 0.710 0.556 0.578
## 434 -2.153 -2.153 TRUE 0.000 0.853 0.000 1
## 435 1.079 0.212 TRUE -0.867 0.545 -1.592 0.111
## 436 0.066 -0.034 TRUE -0.099 0.523 -0.190 0.849
## 437 1.148 1.066 TRUE -0.082 0.573 -0.144 0.886
## 438 -1.255 -1.660 TRUE -0.405 0.706 -0.573 0.567
## 439 0.878 0.457 TRUE -0.421 0.535 -0.787 0.432
## 440 -0.043 0.762 TRUE 0.805 0.531 1.514 0.13
## 441 0.174 0.282 TRUE 0.107 0.519 0.207 0.836
## 442 1.029 0.122 TRUE -0.907 0.542 -1.673 0.094
## 443 -0.796 -1.079 TRUE -0.283 0.613 -0.462 0.644
## 444 -0.948 -0.283 TRUE 0.665 0.577 1.154 0.249
## 445 -0.472 0.265 TRUE 0.737 0.536 1.374 0.169
## 446 0.469 0.712 TRUE 0.242 0.529 0.458 0.647
## 447 -1.255 -0.705 TRUE 0.550 0.624 0.883 0.377
## 448 -1.416 -1.788 TRUE -0.372 0.735 -0.507 0.612
## 449 1.229 1.133 TRUE -0.095 0.582 -0.164 0.87
## 450 -0.404 -1.055 TRUE -0.652 0.590 -1.105 0.269
## 451 1.406 0.969 TRUE -0.437 0.587 -0.745 0.457
## 452 -0.438 0.532 TRUE 0.969 0.538 1.802 0.071
## 453 -0.862 -0.513 TRUE 0.349 0.579 0.603 0.547
## 454 2.135 2.047 TRUE -0.088 0.747 -0.118 0.906
## 455 -0.045 -0.169 TRUE -0.124 0.528 -0.236 0.814
## 456 -0.383 -0.799 TRUE -0.416 0.569 -0.730 0.465
## 457 -0.432 -0.775 TRUE -0.343 0.569 -0.602 0.547
## 458 -1.872 -1.527 TRUE 0.345 0.755 0.457 0.648
## 459 -0.259 -0.487 TRUE -0.228 0.546 -0.419 0.675
## 460 -0.024 0.071 TRUE 0.095 0.522 0.182 0.855
## 461 1.020 0.563 TRUE -0.458 0.545 -0.840 0.401
## 462 -1.104 -1.084 TRUE 0.020 0.637 0.031 0.975
## 463 1.176 1.412 TRUE 0.236 0.599 0.395 0.693
## 464 0.133 0.424 TRUE 0.291 0.520 0.560 0.576
## 465 1.515 0.867 TRUE -0.648 0.592 -1.095 0.273
## 466 0.460 0.777 TRUE 0.317 0.531 0.598 0.55
## 467 0.319 -0.425 TRUE -0.744 0.534 -1.392 0.164
## 468 -0.056 -1.067 TRUE -1.010 0.581 -1.739 0.082
## 469 -0.597 -0.701 TRUE -0.104 0.573 -0.182 0.856
## 470 -0.029 0.506 TRUE 0.536 0.524 1.022 0.307
## 471 -0.320 -1.064 TRUE -0.743 0.588 -1.265 0.206
## 472 1.493 1.523 TRUE 0.029 0.632 0.047 0.963
## 473 -0.719 -0.206 TRUE 0.513 0.557 0.920 0.358
## 474 -0.342 0.202 TRUE 0.544 0.531 1.025 0.305
## 475 0.673 1.595 TRUE 0.922 0.593 1.556 0.12
## 476 -0.339 0.165 TRUE 0.504 0.531 0.950 0.342
## 477 0.859 0.588 TRUE -0.271 0.537 -0.505 0.614
## 478 0.672 1.143 TRUE 0.470 0.555 0.847 0.397
## 479 -0.233 -0.862 TRUE -0.630 0.568 -1.108 0.268
## 480 -0.259 -0.041 TRUE 0.219 0.530 0.413 0.68
## 481 -0.206 0.522 TRUE 0.728 0.529 1.377 0.169
## 482 -0.557 -1.059 TRUE -0.501 0.597 -0.839 0.401
## 483 1.751 1.310 TRUE -0.442 0.639 -0.691 0.49
## 484 -0.615 -0.960 TRUE -0.344 0.592 -0.582 0.561
## 485 -0.313 -0.581 TRUE -0.269 0.552 -0.486 0.627
## 486 0.235 0.032 TRUE -0.203 0.520 -0.391 0.696
## 487 -0.679 -1.872 TRUE -1.193 0.692 -1.724 0.085
## 488 -0.214 -0.206 TRUE 0.009 0.533 0.016 0.987
## 489 0.692 0.692 TRUE -0.001 0.534 -0.001 0.999
## 490 0.418 -0.057 TRUE -0.474 0.523 -0.907 0.365
## 491 -1.554 -1.263 TRUE 0.290 0.696 0.417 0.677
## 492 -0.731 -0.506 TRUE 0.225 0.570 0.395 0.693
## 493 -0.134 0.571 TRUE 0.705 0.528 1.336 0.182
## 494 -0.251 0.227 TRUE 0.479 0.527 0.908 0.364
## 495 -1.055 -0.658 TRUE 0.397 0.602 0.659 0.51
## 496 1.601 0.729 TRUE -0.872 0.595 -1.466 0.143
## 497 0.117 -0.128 TRUE -0.244 0.524 -0.466 0.641
## 498 1.727 1.444 TRUE -0.283 0.647 -0.437 0.662
## 499 -0.830 0.417 TRUE 1.247 0.560 2.228 0.026
## 500 0.518 1.205 TRUE 0.687 0.556 1.237 0.216
## 501 -1.113 -2.153 TRUE -1.040 0.754 -1.380 0.168
## 502 -0.752 -1.056 TRUE -0.304 0.608 -0.500 0.617
## 503 0.170 0.619 TRUE 0.448 0.524 0.855 0.392
## 504 0.118 -0.704 TRUE -0.822 0.550 -1.494 0.135
## 505 0.500 -0.114 TRUE -0.614 0.526 -1.169 0.242
## 506 -1.555 -0.883 TRUE 0.672 0.666 1.008 0.313
## 507 -1.030 -1.488 TRUE -0.458 0.669 -0.684 0.494
## 508 -1.078 -1.496 TRUE -0.418 0.674 -0.621 0.535
## 509 1.777 1.238 TRUE -0.539 0.637 -0.845 0.398
## 510 1.357 1.479 TRUE 0.123 0.617 0.199 0.843
## 511 0.222 -0.231 TRUE -0.453 0.527 -0.860 0.39
## 512 0.258 0.636 TRUE 0.378 0.525 0.721 0.471
## 513 -1.599 -0.687 TRUE 0.912 0.659 1.383 0.167
## 514 2.030 2.354 TRUE 0.324 0.771 0.420 0.674
## 515 -0.770 -0.826 TRUE -0.056 0.591 -0.094 0.925
## 516 -0.637 -1.285 TRUE -0.648 0.623 -1.041 0.298
## 517 -0.409 -0.333 TRUE 0.075 0.545 0.138 0.89
## 518 -1.124 -0.991 TRUE 0.133 0.631 0.211 0.833
## 519 1.649 1.069 TRUE -0.580 0.614 -0.944 0.345
## 520 -1.788 -0.583 TRUE 1.205 0.677 1.781 0.075
## 521 0.185 -0.356 TRUE -0.541 0.531 -1.018 0.309
## 522 -0.278 0.461 TRUE 0.739 0.530 1.395 0.163
## 523 1.666 1.613 TRUE -0.053 0.655 -0.081 0.936
## 524 -1.254 -1.691 TRUE -0.438 0.710 -0.616 0.538
## 525 -0.647 -0.147 TRUE 0.501 0.551 0.909 0.363
## 526 -0.412 -0.356 TRUE 0.056 0.546 0.103 0.918
## 527 0.894 0.965 TRUE 0.071 0.553 0.128 0.898
## 528 -0.199 -1.373 TRUE -1.174 0.615 -1.910 0.056
## 529 0.096 0.304 TRUE 0.208 0.520 0.400 0.689
## 530 0.322 1.236 TRUE 0.914 0.556 1.645 0.1
## 531 0.947 0.534 TRUE -0.413 0.540 -0.765 0.444
## 532 0.260 -0.068 TRUE -0.328 0.522 -0.628 0.53
## 533 0.979 0.572 TRUE -0.407 0.543 -0.750 0.453
## 534 -0.558 -1.071 TRUE -0.513 0.599 -0.856 0.392
## 535 -0.134 0.421 TRUE 0.555 0.525 1.057 0.29
## 536 -0.712 0.061 TRUE 0.773 0.551 1.401 0.161
## 537 -1.486 -1.196 TRUE 0.290 0.683 0.425 0.671
## 538 1.206 0.996 TRUE -0.210 0.573 -0.367 0.714
## 539 -0.155 -0.063 TRUE 0.092 0.528 0.175 0.861
## 540 0.771 0.441 TRUE -0.329 0.530 -0.620 0.535
## 541 0.313 0.228 TRUE -0.084 0.519 -0.162 0.871
## 542 -0.479 -1.288 TRUE -0.809 0.615 -1.314 0.189
## 543 -0.535 -1.316 TRUE -0.782 0.621 -1.259 0.208
## 544 -1.042 -0.134 TRUE 0.908 0.580 1.565 0.118
## 545 -0.974 -0.603 TRUE 0.371 0.593 0.626 0.531
## 546 0.003 -0.006 TRUE -0.010 0.523 -0.018 0.985
## 547 0.459 0.319 TRUE -0.140 0.521 -0.270 0.787
## 548 0.415 0.325 TRUE -0.090 0.520 -0.173 0.863
## 549 0.324 0.218 TRUE -0.106 0.519 -0.204 0.839
## 550 0.789 0.960 TRUE 0.170 0.548 0.310 0.756
## 551 0.612 0.012 TRUE -0.600 0.526 -1.141 0.254
## 552 0.818 0.522 TRUE -0.296 0.534 -0.554 0.58
## 553 -1.873 -1.226 TRUE 0.647 0.728 0.889 0.374
## 554 0.589 -0.157 TRUE -0.746 0.529 -1.411 0.158
## 555 0.667 0.368 TRUE -0.299 0.526 -0.568 0.57
## 556 0.981 1.124 TRUE 0.143 0.567 0.252 0.801
## 557 0.654 0.635 TRUE -0.019 0.531 -0.036 0.971
## 558 0.336 -0.790 TRUE -1.126 0.556 -2.025 0.043
## 559 0.624 0.056 TRUE -0.568 0.525 -1.081 0.28
## 560 -1.350 -1.629 TRUE -0.279 0.712 -0.392 0.695
## 561 -1.522 -1.872 TRUE -0.350 0.755 -0.463 0.643
## 562 1.994 2.047 TRUE 0.053 0.732 0.073 0.942
## 563 0.158 0.140 TRUE -0.018 0.519 -0.035 0.972
## 564 -0.225 -0.363 TRUE -0.138 0.539 -0.255 0.799
## 565 -1.044 -0.999 TRUE 0.046 0.625 0.073 0.942
## 566 -0.570 -0.404 TRUE 0.166 0.555 0.299 0.765
## 567 -0.331 0.538 TRUE 0.869 0.533 1.630 0.103
## 568 0.288 -0.485 TRUE -0.773 0.537 -1.439 0.15
## 569 0.486 -0.309 TRUE -0.795 0.531 -1.496 0.135
## 570 1.852 1.959 TRUE 0.108 0.708 0.152 0.879
## 571 -0.786 -0.563 TRUE 0.223 0.576 0.387 0.699
## 572 1.413 1.247 TRUE -0.166 0.604 -0.275 0.784
## 573 1.072 0.777 TRUE -0.296 0.554 -0.534 0.594
## 574 0.202 -0.905 TRUE -1.108 0.565 -1.962 0.05
## 575 -0.266 -0.517 TRUE -0.250 0.547 -0.457 0.648
## 576 -0.686 -1.289 TRUE -0.603 0.626 -0.964 0.335
## 577 0.953 0.571 TRUE -0.382 0.541 -0.706 0.48
## 578 -0.297 -0.593 TRUE -0.296 0.553 -0.536 0.592
## 579 -0.785 -0.935 TRUE -0.150 0.600 -0.250 0.803
## 580 -1.306 -1.146 TRUE 0.160 0.660 0.242 0.809
## 581 0.232 -0.123 TRUE -0.355 0.523 -0.677 0.498
## 582 -1.447 -1.810 TRUE -0.363 0.741 -0.490 0.624
## 583 0.642 0.911 TRUE 0.269 0.541 0.497 0.62
## 584 -0.851 -0.201 TRUE 0.649 0.566 1.146 0.252
## 585 0.428 0.709 TRUE 0.281 0.528 0.532 0.594
## 586 0.290 0.861 TRUE 0.571 0.533 1.071 0.284
## 587 -0.201 0.153 TRUE 0.354 0.526 0.674 0.501
## 588 -0.430 -0.961 TRUE -0.530 0.583 -0.909 0.363
## 589 0.311 -0.009 TRUE -0.320 0.521 -0.614 0.539
## 590 -0.984 -1.306 TRUE -0.323 0.647 -0.499 0.618
## 591 -1.166 -1.042 TRUE 0.123 0.639 0.193 0.847
## 592 0.303 0.462 TRUE 0.160 0.521 0.306 0.759
## 593 0.000 -0.476 TRUE -0.476 0.539 -0.884 0.377
## 594 -0.310 0.067 TRUE 0.377 0.530 0.711 0.477
## 595 0.164 -0.038 TRUE -0.202 0.522 -0.387 0.699
## 596 -0.939 -0.210 TRUE 0.729 0.574 1.271 0.204
## 597 -0.217 0.363 TRUE 0.580 0.527 1.100 0.271
## 598 1.044 0.301 TRUE -0.743 0.543 -1.368 0.171
## 599 -0.390 -0.773 TRUE -0.383 0.567 -0.675 0.5
## 600 -0.328 -0.331 TRUE -0.002 0.541 -0.005 0.996
## 601 -0.490 -0.752 TRUE -0.262 0.570 -0.459 0.646
## 602 0.553 -0.645 TRUE -1.197 0.549 -2.179 0.029
## 603 -1.025 -1.063 TRUE -0.038 0.628 -0.060 0.952
## 604 -0.014 -0.995 TRUE -0.981 0.574 -1.709 0.088
## 605 -0.028 -1.302 TRUE -1.274 0.604 -2.111 0.035
## 606 0.861 1.666 TRUE 0.805 0.606 1.328 0.184
## 607 0.362 0.136 TRUE -0.227 0.520 -0.436 0.663
## 608 0.752 0.929 TRUE 0.177 0.545 0.325 0.745
## 609 1.110 0.870 TRUE -0.240 0.560 -0.428 0.668
## 610 -0.560 -0.398 TRUE 0.161 0.555 0.291 0.771
## 611 0.915 0.211 TRUE -0.704 0.536 -1.315 0.188
## 612 -1.322 -0.163 TRUE 1.158 0.608 1.904 0.057
## 613 1.685 1.174 TRUE -0.511 0.624 -0.819 0.413
## 614 -0.436 -0.246 TRUE 0.190 0.543 0.350 0.727
## 615 -0.777 -0.132 TRUE 0.645 0.559 1.154 0.249
## 616 1.185 1.862 TRUE 0.677 0.643 1.053 0.292
## 617 0.094 0.456 TRUE 0.362 0.521 0.694 0.488
## 618 1.268 0.805 TRUE -0.462 0.569 -0.813 0.416
## 619 -0.717 -1.338 TRUE -0.621 0.633 -0.981 0.327
## 620 0.610 0.666 TRUE 0.055 0.530 0.104 0.917
## 621 0.485 0.382 TRUE -0.102 0.522 -0.196 0.844
## 622 0.470 1.188 TRUE 0.719 0.554 1.298 0.194
## 623 1.751 1.447 TRUE -0.304 0.650 -0.468 0.64
## 624 -0.458 -0.999 TRUE -0.542 0.588 -0.922 0.357
## 625 -1.257 -1.558 TRUE -0.301 0.696 -0.433 0.665
## 626 0.637 0.854 TRUE 0.216 0.538 0.402 0.688
## 627 0.708 0.531 TRUE -0.177 0.530 -0.334 0.738
## 628 -0.166 0.219 TRUE 0.385 0.525 0.734 0.463
## 629 -0.599 -0.519 TRUE 0.080 0.562 0.142 0.887
## 630 0.789 0.200 TRUE -0.589 0.530 -1.111 0.266
## 631 0.706 -0.291 TRUE -0.996 0.536 -1.857 0.063
## 632 -0.132 0.453 TRUE 0.585 0.525 1.114 0.265
## 633 0.714 -0.201 TRUE -0.914 0.534 -1.713 0.087
## 634 -0.398 -0.931 TRUE -0.533 0.579 -0.920 0.358
## 635 -0.763 -0.668 TRUE 0.095 0.581 0.164 0.87
## 636 0.761 0.062 TRUE -0.699 0.530 -1.320 0.187
## 637 0.442 0.043 TRUE -0.400 0.522 -0.766 0.444
## 638 0.763 0.971 TRUE 0.207 0.548 0.379 0.705
## 639 1.844 1.751 TRUE -0.092 0.686 -0.134 0.893
## 640 -0.607 -0.236 TRUE 0.370 0.551 0.672 0.502
## 641 -0.340 -0.495 TRUE -0.155 0.549 -0.282 0.778
## 642 0.724 0.727 TRUE 0.002 0.536 0.005 0.996
## 643 0.932 1.731 TRUE 0.799 0.616 1.298 0.194
## 644 -0.851 -0.305 TRUE 0.546 0.570 0.959 0.338
## 645 0.832 0.507 TRUE -0.325 0.534 -0.609 0.542
## 646 -0.484 -0.096 TRUE 0.387 0.541 0.716 0.474
## 647 0.532 0.821 TRUE 0.289 0.534 0.541 0.589
## 648 -0.065 0.494 TRUE 0.559 0.524 1.065 0.287
## 649 0.151 0.614 TRUE 0.463 0.524 0.882 0.378
## 650 -0.441 0.003 TRUE 0.444 0.537 0.827 0.408
## 651 -1.748 -1.131 TRUE 0.618 0.706 0.875 0.382
## 652 0.159 -0.165 TRUE -0.323 0.525 -0.616 0.538
## 653 0.954 0.368 TRUE -0.586 0.538 -1.090 0.276
## 654 0.483 0.408 TRUE -0.074 0.522 -0.142 0.887
## 655 -0.794 -0.814 TRUE -0.019 0.592 -0.033 0.974
## 656 -0.690 -0.827 TRUE -0.136 0.586 -0.232 0.816
## 657 0.181 0.320 TRUE 0.139 0.519 0.268 0.788
## 658 0.089 0.367 TRUE 0.277 0.520 0.533 0.594
## 659 -0.558 -1.299 TRUE -0.741 0.620 -1.194 0.232
## 660 -0.137 -0.359 TRUE -0.222 0.536 -0.414 0.679
## 661 -0.174 -0.080 TRUE 0.094 0.528 0.178 0.859
## 662 0.084 -0.265 TRUE -0.349 0.529 -0.660 0.51
## 663 0.801 0.187 TRUE -0.613 0.530 -1.156 0.248
## 664 0.288 0.119 TRUE -0.168 0.519 -0.324 0.746
## 665 -1.202 -0.692 TRUE 0.510 0.618 0.826 0.409
## 666 -0.754 -0.186 TRUE 0.568 0.559 1.016 0.31
## 667 0.058 -0.757 TRUE -0.814 0.554 -1.468 0.142
## 668 -0.185 -0.780 TRUE -0.596 0.561 -1.062 0.288
## 669 -1.574 -1.274 TRUE 0.300 0.699 0.429 0.668
## 670 -0.515 -0.543 TRUE -0.028 0.559 -0.051 0.959
## 671 -1.350 -0.269 TRUE 1.081 0.614 1.760 0.078
## 672 -0.275 -0.682 TRUE -0.407 0.557 -0.731 0.465
## 673 0.876 0.903 TRUE 0.027 0.549 0.050 0.96
## 674 -1.069 -1.057 TRUE 0.012 0.631 0.019 0.985
## 675 -0.716 -1.070 TRUE -0.354 0.607 -0.583 0.56
## 676 -1.872 -0.598 TRUE 1.274 0.688 1.852 0.064
## 677 -1.873 -1.577 TRUE 0.296 0.760 0.390 0.697
## 678 -0.137 -0.441 TRUE -0.304 0.540 -0.563 0.573
## 679 -0.184 -0.361 TRUE -0.177 0.538 -0.330 0.742
## 680 -1.294 -1.200 TRUE 0.094 0.664 0.141 0.888
## 681 0.054 -0.293 TRUE -0.346 0.530 -0.654 0.513
## 682 0.309 0.938 TRUE 0.629 0.537 1.171 0.241
## 683 0.332 0.434 TRUE 0.102 0.521 0.195 0.845
## 684 -1.056 -1.100 TRUE -0.045 0.634 -0.070 0.944
## 685 0.094 -0.212 TRUE -0.306 0.527 -0.581 0.561
## 686 -1.008 -0.380 TRUE 0.628 0.585 1.074 0.283
## 687 0.118 0.298 TRUE 0.180 0.520 0.347 0.729
## 688 1.046 0.259 TRUE -0.787 0.543 -1.449 0.147
## 689 0.430 0.747 TRUE 0.317 0.529 0.598 0.55
## 690 0.968 1.092 TRUE 0.124 0.564 0.219 0.826
## 691 -0.143 0.320 TRUE 0.464 0.524 0.884 0.377
## 692 -0.405 -0.836 TRUE -0.431 0.573 -0.753 0.452
## 693 -0.933 -0.855 TRUE 0.078 0.605 0.129 0.897
## 694 1.014 1.149 TRUE 0.135 0.570 0.236 0.813
## 695 -0.748 -0.661 TRUE 0.088 0.579 0.151 0.88
## 696 -0.382 -0.198 TRUE 0.185 0.539 0.343 0.732
## 697 0.098 -0.357 TRUE -0.455 0.532 -0.855 0.393
## 698 0.729 1.548 TRUE 0.819 0.590 1.389 0.165
## 699 0.667 1.141 TRUE 0.474 0.555 0.854 0.393
## 700 0.187 0.570 TRUE 0.382 0.523 0.731 0.465
## 701 -1.520 -1.872 TRUE -0.352 0.755 -0.466 0.641
## 702 -1.137 -1.170 TRUE -0.033 0.647 -0.051 0.959
## 703 -0.202 -0.303 TRUE -0.101 0.536 -0.189 0.85
## 704 1.331 1.094 TRUE -0.237 0.587 -0.403 0.687
## 705 -1.554 -0.909 TRUE 0.644 0.668 0.964 0.335
## 706 0.409 0.674 TRUE 0.265 0.527 0.502 0.615
## 707 0.437 -0.214 TRUE -0.651 0.527 -1.235 0.217
## 708 -0.004 -0.108 TRUE -0.104 0.525 -0.198 0.843
## 709 -0.249 -0.473 TRUE -0.224 0.545 -0.411 0.681
## 710 0.197 -0.053 TRUE -0.251 0.522 -0.480 0.631
## 711 1.169 1.104 TRUE -0.065 0.576 -0.114 0.91
## 712 0.936 0.879 TRUE -0.056 0.551 -0.102 0.919
## 713 -1.337 -1.872 TRUE -0.535 0.738 -0.725 0.469
## 714 -1.872 -2.153 TRUE -0.281 0.823 -0.342 0.732
## 715 1.333 0.566 TRUE -0.767 0.566 -1.354 0.176
## 716 -0.600 -0.011 TRUE 0.589 0.545 1.080 0.28
## 717 1.338 0.335 TRUE -1.003 0.564 -1.780 0.075
## 718 -0.637 -1.069 TRUE -0.432 0.602 -0.718 0.473
## 719 -0.058 -0.246 TRUE -0.189 0.530 -0.356 0.722
## 720 0.825 -0.058 TRUE -0.883 0.534 -1.652 0.098
## 721 -0.238 0.150 TRUE 0.387 0.527 0.735 0.462
## 722 -0.880 -0.557 TRUE 0.323 0.583 0.555 0.579
## 723 -0.327 -0.186 TRUE 0.141 0.536 0.263 0.793
## 724 0.946 1.032 TRUE 0.085 0.559 0.153 0.878
## 725 -0.667 -0.367 TRUE 0.300 0.560 0.537 0.592
## 726 -0.982 -0.382 TRUE 0.600 0.583 1.029 0.303
## 727 0.243 0.136 TRUE -0.106 0.519 -0.205 0.838
## 728 1.344 0.856 TRUE -0.488 0.576 -0.846 0.398
## 729 1.034 0.922 TRUE -0.112 0.558 -0.201 0.84
## 730 0.721 0.430 TRUE -0.291 0.528 -0.551 0.582
## 731 0.676 0.934 TRUE 0.258 0.543 0.474 0.635
## 732 0.384 0.145 TRUE -0.239 0.520 -0.460 0.646
## 733 0.447 0.656 TRUE 0.209 0.527 0.396 0.692
## 734 -0.489 0.354 TRUE 0.843 0.538 1.568 0.117
## 735 0.400 0.324 TRUE -0.076 0.520 -0.146 0.884
## 736 1.148 1.076 TRUE -0.072 0.573 -0.126 0.9
## 737 -2.153 -1.872 TRUE 0.281 0.823 0.342 0.732
## 738 0.472 -0.241 TRUE -0.714 0.529 -1.350 0.177
## 739 1.117 0.653 TRUE -0.464 0.553 -0.839 0.401
## 740 -1.488 -1.122 TRUE 0.365 0.677 0.540 0.589
## 741 -0.990 -0.564 TRUE 0.425 0.592 0.718 0.473
## 742 -2.153 -1.856 TRUE 0.297 0.821 0.362 0.717
## 743 -0.201 -0.058 TRUE 0.143 0.529 0.270 0.787
## 744 -1.873 -1.872 TRUE 0.001 0.791 0.001 0.999
## 745 0.899 0.376 TRUE -0.523 0.535 -0.978 0.328
## 746 -0.509 -0.593 TRUE -0.084 0.562 -0.149 0.881
## 747 0.485 0.375 TRUE -0.111 0.522 -0.212 0.832
## 748 -0.950 -0.550 TRUE 0.400 0.588 0.681 0.496
## 749 -0.075 -0.330 TRUE -0.254 0.534 -0.477 0.634
## 750 -1.247 0.740 TRUE 1.988 0.604 3.293 0.001
## 751 2.026 1.538 TRUE -0.488 0.687 -0.711 0.477
## 752 0.955 0.470 TRUE -0.485 0.539 -0.899 0.369
## 753 1.994 1.967 TRUE -0.027 0.723 -0.037 0.971
## 754 1.116 0.672 TRUE -0.444 0.553 -0.802 0.423
## 755 -0.892 -0.568 TRUE 0.325 0.584 0.555 0.579
## 756 -1.206 -1.021 TRUE 0.186 0.641 0.290 0.772
## 757 -0.713 -0.399 TRUE 0.314 0.564 0.558 0.577
## 758 0.186 1.016 TRUE 0.829 0.541 1.533 0.125
## 759 -0.332 -0.481 TRUE -0.149 0.548 -0.272 0.786
## 760 -0.881 -1.540 TRUE -0.659 0.664 -0.991 0.322
## 761 -1.788 -2.153 TRUE -0.365 0.814 -0.448 0.654
## 762 0.496 -0.200 TRUE -0.696 0.528 -1.318 0.187
## 763 -0.006 0.491 TRUE 0.497 0.523 0.950 0.342
## 764 -0.215 -0.527 TRUE -0.312 0.546 -0.571 0.568
## 765 1.336 1.221 TRUE -0.115 0.596 -0.193 0.847
## 766 0.158 -0.277 TRUE -0.435 0.528 -0.823 0.41
## 767 -1.094 -0.797 TRUE 0.296 0.614 0.483 0.629
## 768 -0.982 -0.490 TRUE 0.492 0.588 0.837 0.402
## 769 0.226 0.718 TRUE 0.491 0.527 0.932 0.351
## 770 -1.096 -1.056 TRUE 0.040 0.634 0.063 0.95
## 771 0.973 -0.325 TRUE -1.298 0.549 -2.364 0.018
## 772 1.147 1.297 TRUE 0.150 0.588 0.255 0.799
## 773 0.091 0.618 TRUE 0.527 0.525 1.004 0.315
## 774 -0.142 0.275 TRUE 0.418 0.524 0.797 0.425
## 775 -0.194 -0.067 TRUE 0.127 0.529 0.240 0.81
## 776 0.830 0.321 TRUE -0.510 0.532 -0.959 0.338
## 777 -0.374 -1.158 TRUE -0.784 0.598 -1.310 0.19
## 778 0.490 1.491 TRUE 1.001 0.579 1.731 0.083
## 779 -1.104 -1.518 TRUE -0.414 0.678 -0.611 0.541
## 780 -0.234 0.429 TRUE 0.662 0.528 1.254 0.21
## 781 0.187 -0.046 TRUE -0.232 0.522 -0.445 0.656
## 782 0.200 0.573 TRUE 0.373 0.523 0.714 0.475
## 783 -1.115 -1.213 TRUE -0.098 0.649 -0.151 0.88
## 784 -1.574 -1.285 TRUE 0.289 0.700 0.413 0.679
## 785 -1.013 -0.436 TRUE 0.577 0.588 0.981 0.326
## 786 1.213 1.472 TRUE 0.259 0.606 0.428 0.669
## 787 -0.914 -1.184 TRUE -0.271 0.630 -0.429 0.668
## 788 0.692 0.475 TRUE -0.216 0.528 -0.410 0.682
## 789 0.271 0.788 TRUE 0.517 0.530 0.976 0.329
## 790 1.959 1.086 TRUE -0.873 0.649 -1.346 0.178
## 791 0.289 -0.284 TRUE -0.573 0.529 -1.085 0.278
## 792 1.013 0.853 TRUE -0.160 0.554 -0.289 0.772
## 793 -0.616 -0.555 TRUE 0.061 0.565 0.107 0.915
## 794 -1.872 -1.098 TRUE 0.774 0.718 1.078 0.281
## 795 -0.174 0.021 TRUE 0.195 0.527 0.369 0.712
## 796 0.017 -0.039 TRUE -0.056 0.523 -0.106 0.916
## 797 -0.460 -0.103 TRUE 0.357 0.540 0.660 0.509
## 798 -0.275 0.620 TRUE 0.895 0.533 1.679 0.093
## 799 0.336 0.192 TRUE -0.143 0.519 -0.276 0.783
## 800 -0.396 -0.216 TRUE 0.180 0.540 0.333 0.739
## 801 0.786 0.929 TRUE 0.142 0.547 0.260 0.795
## 802 -0.164 0.264 TRUE 0.428 0.525 0.816 0.415
## 803 -0.675 -0.007 TRUE 0.668 0.550 1.215 0.224
## 804 1.261 0.925 TRUE -0.336 0.573 -0.586 0.558
## 805 1.502 1.657 TRUE 0.155 0.645 0.241 0.81
## 806 -1.317 -0.811 TRUE 0.506 0.636 0.795 0.427
## 807 0.641 0.662 TRUE 0.021 0.531 0.040 0.968
## 808 0.392 0.417 TRUE 0.025 0.521 0.049 0.961
## 809 -0.092 -0.180 TRUE -0.088 0.529 -0.166 0.868
## 810 -0.435 -0.754 TRUE -0.318 0.568 -0.560 0.575
## 811 1.549 0.928 TRUE -0.620 0.597 -1.038 0.299
## 812 1.015 0.330 TRUE -0.685 0.541 -1.266 0.206
## 813 1.558 0.599 TRUE -0.959 0.587 -1.634 0.102
## 814 -0.676 -0.897 TRUE -0.220 0.591 -0.373 0.709
## 815 -0.429 0.071 TRUE 0.500 0.535 0.933 0.351
## 816 -0.118 -0.631 TRUE -0.513 0.549 -0.933 0.351
## 817 -0.573 0.209 TRUE 0.782 0.542 1.444 0.149
## 818 -0.221 0.249 TRUE 0.469 0.526 0.892 0.372
## 819 -0.813 -0.718 TRUE 0.094 0.587 0.161 0.872
## 820 -0.398 -1.081 TRUE -0.683 0.592 -1.153 0.249
## 821 0.135 0.714 TRUE 0.579 0.527 1.098 0.272
## 822 1.303 1.704 TRUE 0.401 0.634 0.632 0.527
## 823 -1.389 -1.227 TRUE 0.162 0.675 0.240 0.811
## 824 -0.062 -0.136 TRUE -0.074 0.527 -0.141 0.888
## 825 -0.009 -0.004 TRUE 0.005 0.523 0.009 0.993
## 826 0.311 0.221 TRUE -0.091 0.519 -0.175 0.861
## 827 -1.142 -0.826 TRUE 0.316 0.621 0.509 0.611
## 828 -1.713 -0.696 TRUE 1.016 0.673 1.509 0.131
## 829 1.308 1.320 TRUE 0.012 0.601 0.020 0.984
## 830 -0.637 0.272 TRUE 0.909 0.546 1.666 0.096
## 831 -1.040 -1.029 TRUE 0.011 0.627 0.018 0.985
## 832 1.989 1.727 TRUE -0.262 0.699 -0.375 0.708
## 833 0.797 0.183 TRUE -0.615 0.530 -1.159 0.246
## 834 1.169 1.685 TRUE 0.516 0.624 0.827 0.408
## 835 0.471 0.182 TRUE -0.289 0.521 -0.554 0.579
## 836 1.031 0.742 TRUE -0.289 0.550 -0.525 0.6
## 837 0.358 0.085 TRUE -0.273 0.520 -0.524 0.6
## 838 -2.153 -1.522 TRUE 0.631 0.788 0.801 0.423
## 839 0.544 0.279 TRUE -0.265 0.522 -0.508 0.611
## 840 -0.112 0.820 TRUE 0.932 0.535 1.742 0.082
## 841 -0.518 0.793 TRUE 1.311 0.549 2.387 0.017
## 842 0.354 0.475 TRUE 0.121 0.521 0.232 0.817
## 843 -1.166 -0.984 TRUE 0.182 0.634 0.287 0.774
## 844 -0.682 -0.221 TRUE 0.462 0.555 0.831 0.406
## 845 0.019 0.454 TRUE 0.435 0.522 0.834 0.404
## 846 0.794 0.438 TRUE -0.357 0.531 -0.671 0.502
## 847 -0.338 0.099 TRUE 0.437 0.531 0.822 0.411
## 848 -0.448 -0.961 TRUE -0.513 0.584 -0.879 0.38
## 849 0.889 -0.180 TRUE -1.069 0.540 -1.979 0.048
## 850 0.690 1.812 TRUE 1.122 0.616 1.823 0.068
## 851 1.264 1.175 TRUE -0.089 0.587 -0.152 0.879
## 852 0.303 -0.447 TRUE -0.750 0.535 -1.400 0.161
## 853 0.264 -0.688 TRUE -0.952 0.549 -1.735 0.083
## 854 -1.872 -1.201 TRUE 0.671 0.726 0.923 0.356
## 855 0.211 0.174 TRUE -0.037 0.519 -0.071 0.943
## 856 -1.102 -1.555 TRUE -0.453 0.682 -0.665 0.506
## 857 -0.238 -0.440 TRUE -0.202 0.543 -0.372 0.71
## 858 -0.604 -0.612 TRUE -0.007 0.568 -0.013 0.99
## 859 0.171 -0.420 TRUE -0.591 0.534 -1.106 0.269
## 860 -0.897 -0.876 TRUE 0.021 0.604 0.035 0.972
## 861 -0.403 -0.858 TRUE -0.455 0.574 -0.793 0.428
## 862 -0.878 -0.902 TRUE -0.025 0.604 -0.041 0.967
## 863 1.533 1.101 TRUE -0.432 0.605 -0.715 0.475
## 864 0.708 0.980 TRUE 0.272 0.547 0.497 0.619
## 865 -0.090 -1.025 TRUE -0.935 0.578 -1.618 0.106
## 866 -1.184 -0.840 TRUE 0.345 0.625 0.551 0.582
## 867 -0.341 -0.715 TRUE -0.374 0.562 -0.667 0.505
## 868 -0.031 -0.384 TRUE -0.353 0.535 -0.661 0.509
## 869 -0.171 -0.445 TRUE -0.274 0.541 -0.506 0.613
## 870 -0.233 0.298 TRUE 0.531 0.527 1.007 0.314
## 871 0.484 0.773 TRUE 0.289 0.531 0.543 0.587
## 872 -0.643 -0.426 TRUE 0.217 0.561 0.386 0.699
## 873 0.596 0.513 TRUE -0.083 0.526 -0.157 0.875
## 874 0.186 0.205 TRUE 0.019 0.519 0.036 0.971
## 875 1.246 1.559 TRUE 0.313 0.616 0.508 0.611
## 876 0.960 1.623 TRUE 0.664 0.606 1.095 0.274
## 877 -0.639 -0.922 TRUE -0.284 0.591 -0.480 0.631
## 878 -0.069 -0.562 TRUE -0.493 0.544 -0.905 0.366
## 879 0.877 0.632 TRUE -0.245 0.539 -0.455 0.649
## 880 1.260 1.194 TRUE -0.066 0.588 -0.113 0.91
## 881 -0.525 -1.376 TRUE -0.851 0.627 -1.358 0.175
## 882 -0.534 -0.695 TRUE -0.161 0.569 -0.284 0.777
## 883 0.540 -0.109 TRUE -0.650 0.526 -1.234 0.217
## 884 -1.316 -2.153 TRUE -0.837 0.770 -1.087 0.277
## 885 -0.760 -0.580 TRUE 0.180 0.576 0.313 0.754
## 886 0.571 0.745 TRUE 0.174 0.532 0.327 0.744
## 887 0.392 0.048 TRUE -0.345 0.521 -0.662 0.508
## 888 0.554 0.789 TRUE 0.235 0.533 0.440 0.66
## 889 -2.153 -1.872 TRUE 0.281 0.823 0.342 0.732
## 890 1.251 1.606 TRUE 0.355 0.621 0.572 0.568
## 891 -0.696 -1.542 TRUE -0.846 0.653 -1.294 0.196
## 892 0.787 0.340 TRUE -0.448 0.530 -0.844 0.398
## 893 -0.532 -0.929 TRUE -0.397 0.585 -0.677 0.498
## 894 -1.039 -1.200 TRUE -0.161 0.641 -0.251 0.801
## 895 -1.574 -1.873 TRUE -0.298 0.760 -0.393 0.695
## 896 0.323 1.078 TRUE 0.755 0.545 1.385 0.166
## 897 0.758 0.445 TRUE -0.312 0.530 -0.589 0.556
## 898 0.754 0.162 TRUE -0.592 0.529 -1.120 0.263
## 899 2.354 2.072 TRUE -0.283 0.775 -0.364 0.716
## 900 -0.339 -0.536 TRUE -0.197 0.551 -0.357 0.721
## 901 1.406 0.988 TRUE -0.419 0.588 -0.713 0.476
## 902 -0.492 -1.141 TRUE -0.649 0.602 -1.079 0.281
## 903 0.554 0.294 TRUE -0.260 0.523 -0.498 0.619
## 904 -1.000 -1.236 TRUE -0.236 0.642 -0.367 0.713
## 905 -0.419 -0.751 TRUE -0.332 0.567 -0.585 0.559
## 906 -0.401 -0.564 TRUE -0.163 0.555 -0.293 0.769
## 907 0.364 0.291 TRUE -0.073 0.520 -0.140 0.888
## 908 0.037 -0.966 TRUE -1.003 0.571 -1.757 0.079
## 909 0.484 -0.093 TRUE -0.576 0.525 -1.098 0.272
## 910 -0.313 0.634 TRUE 0.947 0.535 1.771 0.077
## 911 -0.450 0.748 TRUE 1.198 0.544 2.201 0.028
## 912 0.349 -0.428 TRUE -0.776 0.535 -1.452 0.147
## 913 -1.384 -0.547 TRUE 0.837 0.628 1.331 0.183
## 914 -0.032 0.573 TRUE 0.605 0.525 1.152 0.249
## 915 1.852 1.736 TRUE -0.116 0.685 -0.169 0.866
## 916 1.835 1.852 TRUE 0.017 0.695 0.024 0.981
## 917 1.036 1.111 TRUE 0.075 0.569 0.132 0.895
## 918 0.340 0.310 TRUE -0.029 0.519 -0.056 0.955
## 919 -0.584 -0.303 TRUE 0.281 0.552 0.509 0.611
## 920 -0.048 -1.070 TRUE -1.022 0.581 -1.759 0.079
## 921 2.088 1.685 TRUE -0.403 0.706 -0.570 0.569
## 922 0.239 -0.165 TRUE -0.404 0.525 -0.770 0.441
## 923 -0.541 -0.309 TRUE 0.232 0.550 0.422 0.673
## 924 -0.880 -0.550 TRUE 0.330 0.583 0.567 0.571
## 925 -0.835 -1.035 TRUE -0.201 0.612 -0.328 0.743
## 926 0.636 0.107 TRUE -0.529 0.525 -1.008 0.313
## 927 -0.292 0.019 TRUE 0.312 0.530 0.587 0.557
## 928 0.288 -0.828 TRUE -1.116 0.559 -1.999 0.046
## 929 0.539 1.615 TRUE 1.077 0.591 1.821 0.069
## 930 0.580 0.053 TRUE -0.528 0.524 -1.006 0.314
## 931 0.877 0.179 TRUE -0.699 0.534 -1.309 0.191
## 932 -0.910 -1.254 TRUE -0.344 0.637 -0.540 0.589
## 933 0.747 0.378 TRUE -0.369 0.529 -0.698 0.485
## 934 0.381 -0.179 TRUE -0.561 0.526 -1.067 0.286
## 935 -0.019 -0.267 TRUE -0.249 0.530 -0.469 0.639
## 936 -1.112 -1.243 TRUE -0.131 0.651 -0.201 0.841
## 937 0.507 0.348 TRUE -0.159 0.522 -0.304 0.761
## 938 0.132 -1.002 TRUE -1.134 0.573 -1.980 0.048
## 939 -0.212 -0.691 TRUE -0.479 0.556 -0.862 0.389
## 940 -0.432 0.360 TRUE 0.791 0.535 1.479 0.139
## 941 0.555 1.355 TRUE 0.800 0.568 1.409 0.159
## 942 -2.153 -1.792 TRUE 0.362 0.814 0.444 0.657
## 943 0.027 -0.763 TRUE -0.790 0.555 -1.423 0.155
## 944 -0.931 -0.324 TRUE 0.607 0.577 1.052 0.293
## 945 -1.107 -0.849 TRUE 0.259 0.619 0.418 0.676
## 946 1.606 1.907 TRUE 0.302 0.679 0.444 0.657
## 947 0.485 -0.208 TRUE -0.693 0.528 -1.313 0.189
## 948 0.739 0.989 TRUE 0.251 0.548 0.458 0.647
## 949 -0.577 -0.053 TRUE 0.525 0.545 0.963 0.336
## 950 0.343 0.860 TRUE 0.517 0.533 0.969 0.332
## 951 -0.276 -0.241 TRUE 0.035 0.536 0.065 0.948
## 952 -0.657 -0.084 TRUE 0.573 0.550 1.041 0.298
## 953 -0.094 -1.713 TRUE -1.619 0.652 -2.483 0.013
## 954 0.293 -0.202 TRUE -0.495 0.526 -0.941 0.347
## 955 0.138 0.716 TRUE 0.578 0.527 1.096 0.273
## 956 -1.023 -1.148 TRUE -0.125 0.636 -0.197 0.844
## 957 -1.148 -1.042 TRUE 0.107 0.637 0.167 0.867
## 958 -0.426 0.232 TRUE 0.658 0.534 1.232 0.218
## 959 0.593 0.887 TRUE 0.294 0.538 0.546 0.585
## 960 1.720 1.555 TRUE -0.166 0.655 -0.253 0.801
## 961 0.651 0.608 TRUE -0.043 0.530 -0.082 0.935
## 962 2.354 1.989 TRUE -0.366 0.767 -0.477 0.633
## 963 -0.046 -0.875 TRUE -0.829 0.565 -1.469 0.142
## 964 1.048 0.824 TRUE -0.224 0.555 -0.404 0.686
## 965 0.419 -0.028 TRUE -0.446 0.523 -0.854 0.393
## 966 0.921 1.542 TRUE 0.621 0.596 1.041 0.298
## 967 0.937 -0.033 TRUE -0.970 0.539 -1.798 0.072
## 968 -0.029 0.299 TRUE 0.328 0.522 0.628 0.53
## 969 0.175 -0.436 TRUE -0.611 0.535 -1.142 0.253
## 970 1.214 1.230 TRUE 0.016 0.588 0.027 0.978
## 971 0.640 0.756 TRUE 0.117 0.534 0.218 0.827
## 972 -1.245 -1.302 TRUE -0.056 0.669 -0.084 0.933
## 973 0.640 0.694 TRUE 0.054 0.532 0.101 0.92
## 974 -0.137 -0.305 TRUE -0.168 0.534 -0.315 0.753
## 975 0.080 0.425 TRUE 0.345 0.521 0.662 0.508
## 976 0.064 0.251 TRUE 0.187 0.520 0.360 0.719
## 977 -1.096 -1.122 TRUE -0.026 0.639 -0.041 0.967
## 978 -0.161 -0.475 TRUE -0.314 0.542 -0.578 0.563
## 979 -0.060 0.230 TRUE 0.290 0.522 0.556 0.578
## 980 1.182 1.280 TRUE 0.097 0.589 0.165 0.869
## 981 0.171 -0.024 TRUE -0.196 0.522 -0.375 0.708
## 982 1.095 0.421 TRUE -0.674 0.547 -1.232 0.218
## 983 -0.469 0.176 TRUE 0.645 0.536 1.202 0.229
## 984 1.108 1.281 TRUE 0.173 0.585 0.296 0.767
## 985 0.684 0.762 TRUE 0.077 0.536 0.145 0.885
## 986 -1.660 -0.690 TRUE 0.970 0.667 1.455 0.146
## 987 -0.137 0.028 TRUE 0.165 0.525 0.315 0.753
## 988 -0.007 -0.172 TRUE -0.165 0.527 -0.313 0.754
## 989 1.251 0.469 TRUE -0.782 0.558 -1.401 0.161
## 990 0.821 0.229 TRUE -0.592 0.531 -1.115 0.265
## 991 -1.376 -0.918 TRUE 0.458 0.649 0.705 0.481
## 992 -1.872 -0.614 TRUE 1.258 0.689 1.826 0.068
## 993 0.204 0.420 TRUE 0.216 0.520 0.416 0.677
## 994 -0.705 -1.493 TRUE -0.788 0.648 -1.216 0.224
## 995 -0.941 -0.130 TRUE 0.811 0.572 1.419 0.156
## 996 0.508 -0.133 TRUE -0.641 0.526 -1.218 0.223
## 997 -1.518 -2.153 TRUE -0.635 0.787 -0.807 0.42
## 998 -1.660 -1.661 TRUE -0.001 0.746 -0.001 0.999
## 999 1.590 2.047 TRUE 0.457 0.693 0.659 0.51
## 1000 -1.259 -1.788 TRUE -0.529 0.721 -0.734 0.463
# single response pattern change using EAP information
RCI(mod, predat=dat_pre[1,], postdat=dat_post[1,])
## pre.score post.score converged diff SEM z p
## 1 0.496 0.146 TRUE -0.349 0.522 -0.67 0.503
# WLE estimator with Fisher information for SE (see Jabrayilov et al. 2016)
RCI(mod, predat = dat_pre[1,], postdat = dat_post[1,],
method = 'WLE', Fisher = TRUE)
## pre.score post.score converged diff SEM z p
## 1 0.546 0.176 TRUE -0.37 0.55 -0.672 0.501
# multiple respondents
RCI(mod, predat = dat_pre[1:6,], postdat = dat_post[1:6,])
## pre.score post.score converged diff SEM z p
## 1 0.496 0.146 TRUE -0.349 0.522 -0.670 0.503
## 2 -0.793 -0.818 TRUE -0.025 0.592 -0.043 0.966
## 3 0.231 -0.389 TRUE -0.620 0.533 -1.164 0.244
## 4 -0.098 0.157 TRUE 0.255 0.523 0.488 0.626
## 5 1.467 1.159 TRUE -0.308 0.602 -0.511 0.61
## 6 0.741 0.497 TRUE -0.244 0.530 -0.460 0.646
# include large-sample z-type cutoffs
RCI(mod, predat = dat_pre[1:6,], postdat = dat_post[1:6,],
cutoffs = c(-1.96, 1.96))
## pre.score post.score converged diff SEM z p cut_decision
## 1 0.496 0.146 TRUE -0.349 0.522 -0.670 0.503 unchanged
## 2 -0.793 -0.818 TRUE -0.025 0.592 -0.043 0.966 unchanged
## 3 0.231 -0.389 TRUE -0.620 0.533 -1.164 0.244 unchanged
## 4 -0.098 0.157 TRUE 0.255 0.523 0.488 0.626 unchanged
## 5 1.467 1.159 TRUE -0.308 0.602 -0.511 0.61 unchanged
## 6 0.741 0.497 TRUE -0.244 0.530 -0.460 0.646 unchanged
######
# CTT version by omitting IRT model
# Requires either sample or population SEM's as input
(istats <- itemstats(dat_pre)$overall)
## N mean_total.score sd_total.score ave.r sd.r alpha SEM.alpha
## 1000 9.275 4.625 0.197 0.055 0.832 1.898
SEM.alpha <- istats$SEM.alpha # SEM estimate of dat_pre
# assumes SEM.post = SEM.pre
RCI(predat = dat_pre, postdat = dat_post, SEM.pre=SEM.alpha)
## pre.score post.score diff SEM z p
## 1 12 10 -2 2.684 -0.745 0.456
## 2 5 5 0 2.684 0.000 1
## 3 10 6 -4 2.684 -1.490 0.136
## 4 9 10 1 2.684 0.373 0.709
## 5 17 15 -2 2.684 -0.745 0.456
## 6 14 12 -2 2.684 -0.745 0.456
## 7 11 13 2 2.684 0.745 0.456
## 8 6 8 2 2.684 0.745 0.456
## 9 11 14 3 2.684 1.118 0.264
## 10 8 10 2 2.684 0.745 0.456
## 11 11 9 -2 2.684 -0.745 0.456
## 12 15 16 1 2.684 0.373 0.709
## 13 16 13 -3 2.684 -1.118 0.264
## 14 9 6 -3 2.684 -1.118 0.264
## 15 8 6 -2 2.684 -0.745 0.456
## 16 10 10 0 2.684 0.000 1
## 17 2 2 0 2.684 0.000 1
## 18 8 11 3 2.684 1.118 0.264
## 19 9 8 -1 2.684 -0.373 0.709
## 20 14 16 2 2.684 0.745 0.456
## 21 3 2 -1 2.684 -0.373 0.709
## 22 11 13 2 2.684 0.745 0.456
## 23 2 2 0 2.684 0.000 1
## 24 1 2 1 2.684 0.373 0.709
## 25 10 8 -2 2.684 -0.745 0.456
## 26 2 2 0 2.684 0.000 1
## 27 10 10 0 2.684 0.000 1
## 28 1 2 1 2.684 0.373 0.709
## 29 1 1 0 2.684 0.000 1
## 30 14 7 -7 2.684 -2.608 0.009
## 31 5 3 -2 2.684 -0.745 0.456
## 32 2 1 -1 2.684 -0.373 0.709
## 33 4 7 3 2.684 1.118 0.264
## 34 7 4 -3 2.684 -1.118 0.264
## 35 5 3 -2 2.684 -0.745 0.456
## 36 1 7 6 2.684 2.236 0.025
## 37 8 7 -1 2.684 -0.373 0.709
## 38 4 4 0 2.684 0.000 1
## 39 15 17 2 2.684 0.745 0.456
## 40 13 12 -1 2.684 -0.373 0.709
## 41 12 11 -1 2.684 -0.373 0.709
## 42 14 14 0 2.684 0.000 1
## 43 12 15 3 2.684 1.118 0.264
## 44 11 11 0 2.684 0.000 1
## 45 6 3 -3 2.684 -1.118 0.264
## 46 1 1 0 2.684 0.000 1
## 47 17 12 -5 2.684 -1.863 0.062
## 48 9 8 -1 2.684 -0.373 0.709
## 49 13 15 2 2.684 0.745 0.456
## 50 13 11 -2 2.684 -0.745 0.456
## 51 12 11 -1 2.684 -0.373 0.709
## 52 19 19 0 2.684 0.000 1
## 53 8 8 0 2.684 0.000 1
## 54 4 1 -3 2.684 -1.118 0.264
## 55 7 9 2 2.684 0.745 0.456
## 56 5 6 1 2.684 0.373 0.709
## 57 12 10 -2 2.684 -0.745 0.456
## 58 14 13 -1 2.684 -0.373 0.709
## 59 13 10 -3 2.684 -1.118 0.264
## 60 14 17 3 2.684 1.118 0.264
## 61 4 5 1 2.684 0.373 0.709
## 62 13 11 -2 2.684 -0.745 0.456
## 63 6 7 1 2.684 0.373 0.709
## 64 6 11 5 2.684 1.863 0.062
## 65 6 3 -3 2.684 -1.118 0.264
## 66 5 1 -4 2.684 -1.490 0.136
## 67 15 18 3 2.684 1.118 0.264
## 68 8 15 7 2.684 2.608 0.009
## 69 3 7 4 2.684 1.490 0.136
## 70 11 15 4 2.684 1.490 0.136
## 71 6 6 0 2.684 0.000 1
## 72 5 7 2 2.684 0.745 0.456
## 73 13 11 -2 2.684 -0.745 0.456
## 74 10 6 -4 2.684 -1.490 0.136
## 75 15 15 0 2.684 0.000 1
## 76 8 13 5 2.684 1.863 0.062
## 77 4 3 -1 2.684 -0.373 0.709
## 78 5 6 1 2.684 0.373 0.709
## 79 7 5 -2 2.684 -0.745 0.456
## 80 6 1 -5 2.684 -1.863 0.062
## 81 4 4 0 2.684 0.000 1
## 82 11 12 1 2.684 0.373 0.709
## 83 3 4 1 2.684 0.373 0.709
## 84 7 9 2 2.684 0.745 0.456
## 85 5 6 1 2.684 0.373 0.709
## 86 14 13 -1 2.684 -0.373 0.709
## 87 10 7 -3 2.684 -1.118 0.264
## 88 15 18 3 2.684 1.118 0.264
## 89 16 15 -1 2.684 -0.373 0.709
## 90 5 12 7 2.684 2.608 0.009
## 91 5 7 2 2.684 0.745 0.456
## 92 12 13 1 2.684 0.373 0.709
## 93 2 5 3 2.684 1.118 0.264
## 94 9 4 -5 2.684 -1.863 0.062
## 95 0 2 2 2.684 0.745 0.456
## 96 1 3 2 2.684 0.745 0.456
## 97 10 15 5 2.684 1.863 0.062
## 98 8 5 -3 2.684 -1.118 0.264
## 99 7 11 4 2.684 1.490 0.136
## 100 7 5 -2 2.684 -0.745 0.456
## 101 12 10 -2 2.684 -0.745 0.456
## 102 8 11 3 2.684 1.118 0.264
## 103 18 18 0 2.684 0.000 1
## 104 17 12 -5 2.684 -1.863 0.062
## 105 16 15 -1 2.684 -0.373 0.709
## 106 2 2 0 2.684 0.000 1
## 107 8 9 1 2.684 0.373 0.709
## 108 5 3 -2 2.684 -0.745 0.456
## 109 1 1 0 2.684 0.000 1
## 110 6 5 -1 2.684 -0.373 0.709
## 111 3 4 1 2.684 0.373 0.709
## 112 11 12 1 2.684 0.373 0.709
## 113 12 12 0 2.684 0.000 1
## 114 6 5 -1 2.684 -0.373 0.709
## 115 11 13 2 2.684 0.745 0.456
## 116 13 13 0 2.684 0.000 1
## 117 4 7 3 2.684 1.118 0.264
## 118 2 3 1 2.684 0.373 0.709
## 119 11 9 -2 2.684 -0.745 0.456
## 120 5 10 5 2.684 1.863 0.062
## 121 16 17 1 2.684 0.373 0.709
## 122 2 3 1 2.684 0.373 0.709
## 123 18 15 -3 2.684 -1.118 0.264
## 124 9 10 1 2.684 0.373 0.709
## 125 15 10 -5 2.684 -1.863 0.062
## 126 17 18 1 2.684 0.373 0.709
## 127 15 18 3 2.684 1.118 0.264
## 128 3 8 5 2.684 1.863 0.062
## 129 16 13 -3 2.684 -1.118 0.264
## 130 10 6 -4 2.684 -1.490 0.136
## 131 15 17 2 2.684 0.745 0.456
## 132 8 4 -4 2.684 -1.490 0.136
## 133 4 4 0 2.684 0.000 1
## 134 17 17 0 2.684 0.000 1
## 135 6 9 3 2.684 1.118 0.264
## 136 7 3 -4 2.684 -1.490 0.136
## 137 3 8 5 2.684 1.863 0.062
## 138 4 8 4 2.684 1.490 0.136
## 139 14 18 4 2.684 1.490 0.136
## 140 9 2 -7 2.684 -2.608 0.009
## 141 16 15 -1 2.684 -0.373 0.709
## 142 9 5 -4 2.684 -1.490 0.136
## 143 19 17 -2 2.684 -0.745 0.456
## 144 9 10 1 2.684 0.373 0.709
## 145 7 5 -2 2.684 -0.745 0.456
## 146 15 15 0 2.684 0.000 1
## 147 10 7 -3 2.684 -1.118 0.264
## 148 6 4 -2 2.684 -0.745 0.456
## 149 11 8 -3 2.684 -1.118 0.264
## 150 9 9 0 2.684 0.000 1
## 151 10 7 -3 2.684 -1.118 0.264
## 152 7 9 2 2.684 0.745 0.456
## 153 14 12 -2 2.684 -0.745 0.456
## 154 10 13 3 2.684 1.118 0.264
## 155 13 10 -3 2.684 -1.118 0.264
## 156 10 7 -3 2.684 -1.118 0.264
## 157 12 12 0 2.684 0.000 1
## 158 14 11 -3 2.684 -1.118 0.264
## 159 6 6 0 2.684 0.000 1
## 160 4 4 0 2.684 0.000 1
## 161 6 5 -1 2.684 -0.373 0.709
## 162 3 2 -1 2.684 -0.373 0.709
## 163 4 4 0 2.684 0.000 1
## 164 18 18 0 2.684 0.000 1
## 165 12 8 -4 2.684 -1.490 0.136
## 166 2 2 0 2.684 0.000 1
## 167 6 3 -3 2.684 -1.118 0.264
## 168 2 5 3 2.684 1.118 0.264
## 169 9 11 2 2.684 0.745 0.456
## 170 5 4 -1 2.684 -0.373 0.709
## 171 19 18 -1 2.684 -0.373 0.709
## 172 11 12 1 2.684 0.373 0.709
## 173 9 3 -6 2.684 -2.236 0.025
## 174 18 14 -4 2.684 -1.490 0.136
## 175 11 13 2 2.684 0.745 0.456
## 176 16 18 2 2.684 0.745 0.456
## 177 9 7 -2 2.684 -0.745 0.456
## 178 10 14 4 2.684 1.490 0.136
## 179 13 9 -4 2.684 -1.490 0.136
## 180 3 5 2 2.684 0.745 0.456
## 181 11 12 1 2.684 0.373 0.709
## 182 13 11 -2 2.684 -0.745 0.456
## 183 14 15 1 2.684 0.373 0.709
## 184 15 16 1 2.684 0.373 0.709
## 185 6 4 -2 2.684 -0.745 0.456
## 186 16 19 3 2.684 1.118 0.264
## 187 19 19 0 2.684 0.000 1
## 188 14 15 1 2.684 0.373 0.709
## 189 5 7 2 2.684 0.745 0.456
## 190 5 6 1 2.684 0.373 0.709
## 191 11 9 -2 2.684 -0.745 0.456
## 192 11 8 -3 2.684 -1.118 0.264
## 193 4 4 0 2.684 0.000 1
## 194 15 9 -6 2.684 -2.236 0.025
## 195 6 8 2 2.684 0.745 0.456
## 196 13 8 -5 2.684 -1.863 0.062
## 197 9 11 2 2.684 0.745 0.456
## 198 8 6 -2 2.684 -0.745 0.456
## 199 16 17 1 2.684 0.373 0.709
## 200 5 10 5 2.684 1.863 0.062
## 201 3 5 2 2.684 0.745 0.456
## 202 14 15 1 2.684 0.373 0.709
## 203 4 8 4 2.684 1.490 0.136
## 204 9 7 -2 2.684 -0.745 0.456
## 205 5 2 -3 2.684 -1.118 0.264
## 206 18 15 -3 2.684 -1.118 0.264
## 207 3 3 0 2.684 0.000 1
## 208 17 17 0 2.684 0.000 1
## 209 7 7 0 2.684 0.000 1
## 210 11 9 -2 2.684 -0.745 0.456
## 211 2 5 3 2.684 1.118 0.264
## 212 11 12 1 2.684 0.373 0.709
## 213 6 4 -2 2.684 -0.745 0.456
## 214 6 7 1 2.684 0.373 0.709
## 215 8 6 -2 2.684 -0.745 0.456
## 216 15 15 0 2.684 0.000 1
## 217 3 3 0 2.684 0.000 1
## 218 14 12 -2 2.684 -0.745 0.456
## 219 10 7 -3 2.684 -1.118 0.264
## 220 9 13 4 2.684 1.490 0.136
## 221 3 5 2 2.684 0.745 0.456
## 222 6 10 4 2.684 1.490 0.136
## 223 14 13 -1 2.684 -0.373 0.709
## 224 18 18 0 2.684 0.000 1
## 225 17 14 -3 2.684 -1.118 0.264
## 226 8 9 1 2.684 0.373 0.709
## 227 8 9 1 2.684 0.373 0.709
## 228 17 11 -6 2.684 -2.236 0.025
## 229 3 4 1 2.684 0.373 0.709
## 230 7 8 1 2.684 0.373 0.709
## 231 7 10 3 2.684 1.118 0.264
## 232 7 9 2 2.684 0.745 0.456
## 233 12 14 2 2.684 0.745 0.456
## 234 17 13 -4 2.684 -1.490 0.136
## 235 16 13 -3 2.684 -1.118 0.264
## 236 4 3 -1 2.684 -0.373 0.709
## 237 12 11 -1 2.684 -0.373 0.709
## 238 3 9 6 2.684 2.236 0.025
## 239 2 4 2 2.684 0.745 0.456
## 240 8 7 -1 2.684 -0.373 0.709
## 241 10 13 3 2.684 1.118 0.264
## 242 2 6 4 2.684 1.490 0.136
## 243 18 19 1 2.684 0.373 0.709
## 244 11 11 0 2.684 0.000 1
## 245 11 11 0 2.684 0.000 1
## 246 17 15 -2 2.684 -0.745 0.456
## 247 15 18 3 2.684 1.118 0.264
## 248 14 9 -5 2.684 -1.863 0.062
## 249 9 4 -5 2.684 -1.863 0.062
## 250 14 13 -1 2.684 -0.373 0.709
## 251 16 7 -9 2.684 -3.354 0.001
## 252 15 14 -1 2.684 -0.373 0.709
## 253 12 11 -1 2.684 -0.373 0.709
## 254 3 4 1 2.684 0.373 0.709
## 255 12 12 0 2.684 0.000 1
## 256 7 11 4 2.684 1.490 0.136
## 257 5 5 0 2.684 0.000 1
## 258 8 8 0 2.684 0.000 1
## 259 6 6 0 2.684 0.000 1
## 260 12 12 0 2.684 0.000 1
## 261 13 15 2 2.684 0.745 0.456
## 262 9 13 4 2.684 1.490 0.136
## 263 13 8 -5 2.684 -1.863 0.062
## 264 6 9 3 2.684 1.118 0.264
## 265 8 11 3 2.684 1.118 0.264
## 266 11 9 -2 2.684 -0.745 0.456
## 267 10 12 2 2.684 0.745 0.456
## 268 18 16 -2 2.684 -0.745 0.456
## 269 4 4 0 2.684 0.000 1
## 270 9 14 5 2.684 1.863 0.062
## 271 14 16 2 2.684 0.745 0.456
## 272 8 7 -1 2.684 -0.373 0.709
## 273 7 6 -1 2.684 -0.373 0.709
## 274 16 15 -1 2.684 -0.373 0.709
## 275 8 15 7 2.684 2.608 0.009
## 276 15 16 1 2.684 0.373 0.709
## 277 15 14 -1 2.684 -0.373 0.709
## 278 13 9 -4 2.684 -1.490 0.136
## 279 8 9 1 2.684 0.373 0.709
## 280 5 9 4 2.684 1.490 0.136
## 281 13 9 -4 2.684 -1.490 0.136
## 282 13 10 -3 2.684 -1.118 0.264
## 283 9 13 4 2.684 1.490 0.136
## 284 5 4 -1 2.684 -0.373 0.709
## 285 4 6 2 2.684 0.745 0.456
## 286 2 6 4 2.684 1.490 0.136
## 287 3 2 -1 2.684 -0.373 0.709
## 288 9 7 -2 2.684 -0.745 0.456
## 289 7 10 3 2.684 1.118 0.264
## 290 8 5 -3 2.684 -1.118 0.264
## 291 9 6 -3 2.684 -1.118 0.264
## 292 4 3 -1 2.684 -0.373 0.709
## 293 14 17 3 2.684 1.118 0.264
## 294 15 18 3 2.684 1.118 0.264
## 295 3 4 1 2.684 0.373 0.709
## 296 1 4 3 2.684 1.118 0.264
## 297 12 10 -2 2.684 -0.745 0.456
## 298 5 8 3 2.684 1.118 0.264
## 299 12 12 0 2.684 0.000 1
## 300 8 10 2 2.684 0.745 0.456
## 301 6 5 -1 2.684 -0.373 0.709
## 302 5 7 2 2.684 0.745 0.456
## 303 14 15 1 2.684 0.373 0.709
## 304 11 8 -3 2.684 -1.118 0.264
## 305 4 2 -2 2.684 -0.745 0.456
## 306 11 11 0 2.684 0.000 1
## 307 13 11 -2 2.684 -0.745 0.456
## 308 9 13 4 2.684 1.490 0.136
## 309 4 6 2 2.684 0.745 0.456
## 310 13 11 -2 2.684 -0.745 0.456
## 311 10 12 2 2.684 0.745 0.456
## 312 8 9 1 2.684 0.373 0.709
## 313 16 12 -4 2.684 -1.490 0.136
## 314 8 9 1 2.684 0.373 0.709
## 315 2 1 -1 2.684 -0.373 0.709
## 316 13 11 -2 2.684 -0.745 0.456
## 317 15 8 -7 2.684 -2.608 0.009
## 318 7 4 -3 2.684 -1.118 0.264
## 319 16 15 -1 2.684 -0.373 0.709
## 320 12 11 -1 2.684 -0.373 0.709
## 321 2 1 -1 2.684 -0.373 0.709
## 322 14 15 1 2.684 0.373 0.709
## 323 1 2 1 2.684 0.373 0.709
## 324 10 11 1 2.684 0.373 0.709
## 325 8 9 1 2.684 0.373 0.709
## 326 13 14 1 2.684 0.373 0.709
## 327 15 16 1 2.684 0.373 0.709
## 328 16 11 -5 2.684 -1.863 0.062
## 329 7 7 0 2.684 0.000 1
## 330 8 9 1 2.684 0.373 0.709
## 331 14 10 -4 2.684 -1.490 0.136
## 332 5 8 3 2.684 1.118 0.264
## 333 11 15 4 2.684 1.490 0.136
## 334 5 7 2 2.684 0.745 0.456
## 335 0 4 4 2.684 1.490 0.136
## 336 3 4 1 2.684 0.373 0.709
## 337 9 4 -5 2.684 -1.863 0.062
## 338 10 9 -1 2.684 -0.373 0.709
## 339 12 16 4 2.684 1.490 0.136
## 340 14 17 3 2.684 1.118 0.264
## 341 9 8 -1 2.684 -0.373 0.709
## 342 6 8 2 2.684 0.745 0.456
## 343 7 3 -4 2.684 -1.490 0.136
## 344 16 18 2 2.684 0.745 0.456
## 345 14 7 -7 2.684 -2.608 0.009
## 346 12 6 -6 2.684 -2.236 0.025
## 347 14 14 0 2.684 0.000 1
## 348 15 15 0 2.684 0.000 1
## 349 7 3 -4 2.684 -1.490 0.136
## 350 8 9 1 2.684 0.373 0.709
## 351 5 2 -3 2.684 -1.118 0.264
## 352 8 6 -2 2.684 -0.745 0.456
## 353 17 18 1 2.684 0.373 0.709
## 354 7 8 1 2.684 0.373 0.709
## 355 12 10 -2 2.684 -0.745 0.456
## 356 11 12 1 2.684 0.373 0.709
## 357 15 12 -3 2.684 -1.118 0.264
## 358 5 7 2 2.684 0.745 0.456
## 359 10 8 -2 2.684 -0.745 0.456
## 360 14 14 0 2.684 0.000 1
## 361 10 11 1 2.684 0.373 0.709
## 362 10 9 -1 2.684 -0.373 0.709
## 363 14 14 0 2.684 0.000 1
## 364 17 15 -2 2.684 -0.745 0.456
## 365 8 7 -1 2.684 -0.373 0.709
## 366 17 11 -6 2.684 -2.236 0.025
## 367 5 3 -2 2.684 -0.745 0.456
## 368 2 1 -1 2.684 -0.373 0.709
## 369 2 1 -1 2.684 -0.373 0.709
## 370 12 12 0 2.684 0.000 1
## 371 11 11 0 2.684 0.000 1
## 372 4 7 3 2.684 1.118 0.264
## 373 16 11 -5 2.684 -1.863 0.062
## 374 4 4 0 2.684 0.000 1
## 375 6 4 -2 2.684 -0.745 0.456
## 376 5 7 2 2.684 0.745 0.456
## 377 12 11 -1 2.684 -0.373 0.709
## 378 12 16 4 2.684 1.490 0.136
## 379 16 18 2 2.684 0.745 0.456
## 380 14 12 -2 2.684 -0.745 0.456
## 381 6 5 -1 2.684 -0.373 0.709
## 382 10 12 2 2.684 0.745 0.456
## 383 8 11 3 2.684 1.118 0.264
## 384 10 14 4 2.684 1.490 0.136
## 385 4 5 1 2.684 0.373 0.709
## 386 14 14 0 2.684 0.000 1
## 387 7 7 0 2.684 0.000 1
## 388 11 10 -1 2.684 -0.373 0.709
## 389 4 4 0 2.684 0.000 1
## 390 8 7 -1 2.684 -0.373 0.709
## 391 10 9 -1 2.684 -0.373 0.709
## 392 5 8 3 2.684 1.118 0.264
## 393 12 10 -2 2.684 -0.745 0.456
## 394 8 7 -1 2.684 -0.373 0.709
## 395 10 4 -6 2.684 -2.236 0.025
## 396 18 15 -3 2.684 -1.118 0.264
## 397 4 7 3 2.684 1.118 0.264
## 398 13 13 0 2.684 0.000 1
## 399 14 11 -3 2.684 -1.118 0.264
## 400 4 6 2 2.684 0.745 0.456
## 401 15 16 1 2.684 0.373 0.709
## 402 4 4 0 2.684 0.000 1
## 403 5 6 1 2.684 0.373 0.709
## 404 17 15 -2 2.684 -0.745 0.456
## 405 8 4 -4 2.684 -1.490 0.136
## 406 10 6 -4 2.684 -1.490 0.136
## 407 3 2 -1 2.684 -0.373 0.709
## 408 8 7 -1 2.684 -0.373 0.709
## 409 6 10 4 2.684 1.490 0.136
## 410 11 12 1 2.684 0.373 0.709
## 411 3 2 -1 2.684 -0.373 0.709
## 412 14 9 -5 2.684 -1.863 0.062
## 413 9 8 -1 2.684 -0.373 0.709
## 414 15 17 2 2.684 0.745 0.456
## 415 13 9 -4 2.684 -1.490 0.136
## 416 3 5 2 2.684 0.745 0.456
## 417 4 2 -2 2.684 -0.745 0.456
## 418 18 18 0 2.684 0.000 1
## 419 2 1 -1 2.684 -0.373 0.709
## 420 15 13 -2 2.684 -0.745 0.456
## 421 15 11 -4 2.684 -1.490 0.136
## 422 6 7 1 2.684 0.373 0.709
## 423 4 5 1 2.684 0.373 0.709
## 424 7 4 -3 2.684 -1.118 0.264
## 425 8 9 1 2.684 0.373 0.709
## 426 6 2 -4 2.684 -1.490 0.136
## 427 5 6 1 2.684 0.373 0.709
## 428 3 7 4 2.684 1.490 0.136
## 429 9 13 4 2.684 1.490 0.136
## 430 6 4 -2 2.684 -0.745 0.456
## 431 5 11 6 2.684 2.236 0.025
## 432 14 12 -2 2.684 -0.745 0.456
## 433 18 19 1 2.684 0.373 0.709
## 434 0 0 0 2.684 0.000 1
## 435 15 9 -6 2.684 -2.236 0.025
## 436 10 8 -2 2.684 -0.745 0.456
## 437 15 16 1 2.684 0.373 0.709
## 438 3 2 -1 2.684 -0.373 0.709
## 439 14 13 -1 2.684 -0.373 0.709
## 440 9 13 4 2.684 1.490 0.136
## 441 10 11 1 2.684 0.373 0.709
## 442 15 10 -5 2.684 -1.863 0.062
## 443 4 4 0 2.684 0.000 1
## 444 5 8 3 2.684 1.118 0.264
## 445 6 11 5 2.684 1.863 0.062
## 446 12 13 1 2.684 0.373 0.709
## 447 3 5 2 2.684 0.745 0.456
## 448 2 1 -1 2.684 -0.373 0.709
## 449 16 15 -1 2.684 -0.373 0.709
## 450 6 4 -2 2.684 -0.745 0.456
## 451 17 15 -2 2.684 -0.745 0.456
## 452 6 12 6 2.684 2.236 0.025
## 453 4 6 2 2.684 0.745 0.456
## 454 19 19 0 2.684 0.000 1
## 455 9 8 -1 2.684 -0.373 0.709
## 456 7 5 -2 2.684 -0.745 0.456
## 457 6 5 -1 2.684 -0.373 0.709
## 458 1 2 1 2.684 0.373 0.709
## 459 8 7 -1 2.684 -0.373 0.709
## 460 8 10 2 2.684 0.745 0.456
## 461 15 13 -2 2.684 -0.745 0.456
## 462 4 3 -1 2.684 -0.373 0.709
## 463 16 17 1 2.684 0.373 0.709
## 464 10 12 2 2.684 0.745 0.456
## 465 17 13 -4 2.684 -1.490 0.136
## 466 11 13 2 2.684 0.745 0.456
## 467 10 6 -4 2.684 -1.490 0.136
## 468 9 4 -5 2.684 -1.863 0.062
## 469 6 5 -1 2.684 -0.373 0.709
## 470 9 12 3 2.684 1.118 0.264
## 471 7 4 -3 2.684 -1.118 0.264
## 472 17 17 0 2.684 0.000 1
## 473 5 7 2 2.684 0.745 0.456
## 474 8 10 2 2.684 0.745 0.456
## 475 12 18 6 2.684 2.236 0.025
## 476 7 10 3 2.684 1.118 0.264
## 477 14 13 -1 2.684 -0.373 0.709
## 478 13 15 2 2.684 0.745 0.456
## 479 8 5 -3 2.684 -1.118 0.264
## 480 8 8 0 2.684 0.000 1
## 481 8 12 4 2.684 1.490 0.136
## 482 6 4 -2 2.684 -0.745 0.456
## 483 18 16 -2 2.684 -0.745 0.456
## 484 6 4 -2 2.684 -0.745 0.456
## 485 8 6 -2 2.684 -0.745 0.456
## 486 9 10 1 2.684 0.373 0.709
## 487 6 1 -5 2.684 -1.863 0.062
## 488 8 8 0 2.684 0.000 1
## 489 13 13 0 2.684 0.000 1
## 490 11 9 -2 2.684 -0.745 0.456
## 491 2 3 1 2.684 0.373 0.709
## 492 5 5 0 2.684 0.000 1
## 493 9 12 3 2.684 1.118 0.264
## 494 7 11 4 2.684 1.490 0.136
## 495 3 5 2 2.684 0.745 0.456
## 496 17 14 -3 2.684 -1.118 0.264
## 497 10 8 -2 2.684 -0.745 0.456
## 498 18 17 -1 2.684 -0.373 0.709
## 499 5 11 6 2.684 2.236 0.025
## 500 13 15 2 2.684 0.745 0.456
## 501 3 0 -3 2.684 -1.118 0.264
## 502 5 4 -1 2.684 -0.373 0.709
## 503 11 13 2 2.684 0.745 0.456
## 504 10 5 -5 2.684 -1.863 0.062
## 505 11 8 -3 2.684 -1.118 0.264
## 506 2 5 3 2.684 1.118 0.264
## 507 4 2 -2 2.684 -0.745 0.456
## 508 3 2 -1 2.684 -0.373 0.709
## 509 18 16 -2 2.684 -0.745 0.456
## 510 16 17 1 2.684 0.373 0.709
## 511 10 8 -2 2.684 -0.745 0.456
## 512 11 13 2 2.684 0.745 0.456
## 513 2 6 4 2.684 1.490 0.136
## 514 19 20 1 2.684 0.373 0.709
## 515 5 5 0 2.684 0.000 1
## 516 6 3 -3 2.684 -1.118 0.264
## 517 7 7 0 2.684 0.000 1
## 518 3 4 1 2.684 0.373 0.709
## 519 17 15 -2 2.684 -0.745 0.456
## 520 1 6 5 2.684 1.863 0.062
## 521 10 7 -3 2.684 -1.118 0.264
## 522 7 12 5 2.684 1.863 0.062
## 523 18 17 -1 2.684 -0.373 0.709
## 524 3 1 -2 2.684 -0.745 0.456
## 525 6 8 2 2.684 0.745 0.456
## 526 7 6 -1 2.684 -0.373 0.709
## 527 14 15 1 2.684 0.373 0.709
## 528 7 2 -5 2.684 -1.863 0.062
## 529 9 11 2 2.684 0.745 0.456
## 530 10 16 6 2.684 2.236 0.025
## 531 14 12 -2 2.684 -0.745 0.456
## 532 10 9 -1 2.684 -0.373 0.709
## 533 14 13 -1 2.684 -0.373 0.709
## 534 6 4 -2 2.684 -0.745 0.456
## 535 8 12 4 2.684 1.490 0.136
## 536 6 9 3 2.684 1.118 0.264
## 537 2 2 0 2.684 0.000 1
## 538 16 16 0 2.684 0.000 1
## 539 8 9 1 2.684 0.373 0.709
## 540 14 11 -3 2.684 -1.118 0.264
## 541 10 10 0 2.684 0.000 1
## 542 7 3 -4 2.684 -1.490 0.136
## 543 7 3 -4 2.684 -1.490 0.136
## 544 4 8 4 2.684 1.490 0.136
## 545 4 6 2 2.684 0.745 0.456
## 546 9 9 0 2.684 0.000 1
## 547 12 11 -1 2.684 -0.373 0.709
## 548 12 11 -1 2.684 -0.373 0.709
## 549 11 11 0 2.684 0.000 1
## 550 14 14 0 2.684 0.000 1
## 551 12 9 -3 2.684 -1.118 0.264
## 552 13 12 -1 2.684 -0.373 0.709
## 553 1 3 2 2.684 0.745 0.456
## 554 12 9 -3 2.684 -1.118 0.264
## 555 13 11 -2 2.684 -0.745 0.456
## 556 15 15 0 2.684 0.000 1
## 557 13 13 0 2.684 0.000 1
## 558 12 4 -8 2.684 -2.981 0.003
## 559 13 9 -4 2.684 -1.490 0.136
## 560 3 2 -1 2.684 -0.373 0.709
## 561 2 1 -1 2.684 -0.373 0.709
## 562 19 19 0 2.684 0.000 1
## 563 10 10 0 2.684 0.000 1
## 564 8 7 -1 2.684 -0.373 0.709
## 565 3 4 1 2.684 0.373 0.709
## 566 6 7 1 2.684 0.373 0.709
## 567 7 12 5 2.684 1.863 0.062
## 568 10 7 -3 2.684 -1.118 0.264
## 569 11 7 -4 2.684 -1.490 0.136
## 570 18 19 1 2.684 0.373 0.709
## 571 5 7 2 2.684 0.745 0.456
## 572 16 16 0 2.684 0.000 1
## 573 15 14 -1 2.684 -0.373 0.709
## 574 11 4 -7 2.684 -2.608 0.009
## 575 7 7 0 2.684 0.000 1
## 576 6 3 -3 2.684 -1.118 0.264
## 577 14 11 -3 2.684 -1.118 0.264
## 578 8 5 -3 2.684 -1.118 0.264
## 579 5 4 -1 2.684 -0.373 0.709
## 580 3 3 0 2.684 0.000 1
## 581 10 8 -2 2.684 -0.745 0.456
## 582 2 1 -1 2.684 -0.373 0.709
## 583 14 15 1 2.684 0.373 0.709
## 584 4 9 5 2.684 1.863 0.062
## 585 11 14 3 2.684 1.118 0.264
## 586 11 13 2 2.684 0.745 0.456
## 587 9 10 1 2.684 0.373 0.709
## 588 6 4 -2 2.684 -0.745 0.456
## 589 10 9 -1 2.684 -0.373 0.709
## 590 4 3 -1 2.684 -0.373 0.709
## 591 4 3 -1 2.684 -0.373 0.709
## 592 11 12 1 2.684 0.373 0.709
## 593 9 7 -2 2.684 -0.745 0.456
## 594 8 9 1 2.684 0.373 0.709
## 595 9 9 0 2.684 0.000 1
## 596 5 8 3 2.684 1.118 0.264
## 597 8 11 3 2.684 1.118 0.264
## 598 15 11 -4 2.684 -1.490 0.136
## 599 7 5 -2 2.684 -0.745 0.456
## 600 8 8 0 2.684 0.000 1
## 601 7 5 -2 2.684 -0.745 0.456
## 602 12 6 -6 2.684 -2.236 0.025
## 603 4 4 0 2.684 0.000 1
## 604 9 4 -5 2.684 -1.863 0.062
## 605 9 3 -6 2.684 -2.236 0.025
## 606 13 18 5 2.684 1.863 0.062
## 607 11 10 -1 2.684 -0.373 0.709
## 608 14 14 0 2.684 0.000 1
## 609 16 14 -2 2.684 -0.745 0.456
## 610 6 8 2 2.684 0.745 0.456
## 611 14 11 -3 2.684 -1.118 0.264
## 612 2 8 6 2.684 2.236 0.025
## 613 18 16 -2 2.684 -0.745 0.456
## 614 7 8 1 2.684 0.373 0.709
## 615 5 8 3 2.684 1.118 0.264
## 616 16 18 2 2.684 0.745 0.456
## 617 9 12 3 2.684 1.118 0.264
## 618 16 14 -2 2.684 -0.745 0.456
## 619 5 3 -2 2.684 -0.745 0.456
## 620 13 13 0 2.684 0.000 1
## 621 12 12 0 2.684 0.000 1
## 622 12 15 3 2.684 1.118 0.264
## 623 18 16 -2 2.684 -0.745 0.456
## 624 7 3 -4 2.684 -1.490 0.136
## 625 3 2 -1 2.684 -0.373 0.709
## 626 13 13 0 2.684 0.000 1
## 627 13 11 -2 2.684 -0.745 0.456
## 628 9 9 0 2.684 0.000 1
## 629 5 6 1 2.684 0.373 0.709
## 630 13 10 -3 2.684 -1.118 0.264
## 631 13 8 -5 2.684 -1.863 0.062
## 632 8 11 3 2.684 1.118 0.264
## 633 13 8 -5 2.684 -1.863 0.062
## 634 7 5 -2 2.684 -0.745 0.456
## 635 5 5 0 2.684 0.000 1
## 636 13 9 -4 2.684 -1.490 0.136
## 637 11 9 -2 2.684 -0.745 0.456
## 638 13 14 1 2.684 0.373 0.709
## 639 18 18 0 2.684 0.000 1
## 640 6 8 2 2.684 0.745 0.456
## 641 7 7 0 2.684 0.000 1
## 642 14 13 -1 2.684 -0.373 0.709
## 643 15 18 3 2.684 1.118 0.264
## 644 5 7 2 2.684 0.745 0.456
## 645 13 11 -2 2.684 -0.745 0.456
## 646 6 9 3 2.684 1.118 0.264
## 647 12 14 2 2.684 0.745 0.456
## 648 8 12 4 2.684 1.490 0.136
## 649 10 13 3 2.684 1.118 0.264
## 650 7 9 2 2.684 0.745 0.456
## 651 1 4 3 2.684 1.118 0.264
## 652 9 7 -2 2.684 -0.745 0.456
## 653 14 10 -4 2.684 -1.490 0.136
## 654 12 11 -1 2.684 -0.373 0.709
## 655 5 5 0 2.684 0.000 1
## 656 5 5 0 2.684 0.000 1
## 657 9 12 3 2.684 1.118 0.264
## 658 10 12 2 2.684 0.745 0.456
## 659 6 3 -3 2.684 -1.118 0.264
## 660 9 8 -1 2.684 -0.373 0.709
## 661 8 9 1 2.684 0.373 0.709
## 662 10 8 -2 2.684 -0.745 0.456
## 663 13 10 -3 2.684 -1.118 0.264
## 664 10 10 0 2.684 0.000 1
## 665 3 5 2 2.684 0.745 0.456
## 666 5 8 3 2.684 1.118 0.264
## 667 10 5 -5 2.684 -1.863 0.062
## 668 8 6 -2 2.684 -0.745 0.456
## 669 2 2 0 2.684 0.000 1
## 670 6 6 0 2.684 0.000 1
## 671 3 7 4 2.684 1.490 0.136
## 672 8 5 -3 2.684 -1.118 0.264
## 673 14 14 0 2.684 0.000 1
## 674 4 3 -1 2.684 -0.373 0.709
## 675 5 4 -1 2.684 -0.373 0.709
## 676 1 6 5 2.684 1.863 0.062
## 677 1 1 0 2.684 0.000 1
## 678 8 6 -2 2.684 -0.745 0.456
## 679 8 8 0 2.684 0.000 1
## 680 3 3 0 2.684 0.000 1
## 681 10 7 -3 2.684 -1.118 0.264
## 682 11 14 3 2.684 1.118 0.264
## 683 11 11 0 2.684 0.000 1
## 684 4 4 0 2.684 0.000 1
## 685 9 8 -1 2.684 -0.373 0.709
## 686 4 8 4 2.684 1.490 0.136
## 687 10 11 1 2.684 0.373 0.709
## 688 15 10 -5 2.684 -1.863 0.062
## 689 11 14 3 2.684 1.118 0.264
## 690 14 16 2 2.684 0.745 0.456
## 691 8 11 3 2.684 1.118 0.264
## 692 7 4 -3 2.684 -1.118 0.264
## 693 4 4 0 2.684 0.000 1
## 694 15 16 1 2.684 0.373 0.709
## 695 6 6 0 2.684 0.000 1
## 696 7 8 1 2.684 0.373 0.709
## 697 10 8 -2 2.684 -0.745 0.456
## 698 14 17 3 2.684 1.118 0.264
## 699 13 16 3 2.684 1.118 0.264
## 700 10 13 3 2.684 1.118 0.264
## 701 2 1 -1 2.684 -0.373 0.709
## 702 3 4 1 2.684 0.373 0.709
## 703 8 8 0 2.684 0.000 1
## 704 17 15 -2 2.684 -0.745 0.456
## 705 2 5 3 2.684 1.118 0.264
## 706 11 13 2 2.684 0.745 0.456
## 707 11 8 -3 2.684 -1.118 0.264
## 708 9 9 0 2.684 0.000 1
## 709 8 6 -2 2.684 -0.745 0.456
## 710 11 9 -2 2.684 -0.745 0.456
## 711 16 16 0 2.684 0.000 1
## 712 14 14 0 2.684 0.000 1
## 713 3 1 -2 2.684 -0.745 0.456
## 714 1 0 -1 2.684 -0.373 0.709
## 715 16 12 -4 2.684 -1.490 0.136
## 716 6 9 3 2.684 1.118 0.264
## 717 16 11 -5 2.684 -1.863 0.062
## 718 5 4 -1 2.684 -0.373 0.709
## 719 9 8 -1 2.684 -0.373 0.709
## 720 14 8 -6 2.684 -2.236 0.025
## 721 8 9 1 2.684 0.373 0.709
## 722 5 6 1 2.684 0.373 0.709
## 723 7 8 1 2.684 0.373 0.709
## 724 14 15 1 2.684 0.373 0.709
## 725 5 7 2 2.684 0.745 0.456
## 726 4 8 4 2.684 1.490 0.136
## 727 11 10 -1 2.684 -0.373 0.709
## 728 16 14 -2 2.684 -0.745 0.456
## 729 16 15 -1 2.684 -0.373 0.709
## 730 14 12 -2 2.684 -0.745 0.456
## 731 13 14 1 2.684 0.373 0.709
## 732 11 10 -1 2.684 -0.373 0.709
## 733 12 13 1 2.684 0.373 0.709
## 734 7 10 3 2.684 1.118 0.264
## 735 12 12 0 2.684 0.000 1
## 736 15 15 0 2.684 0.000 1
## 737 0 1 1 2.684 0.373 0.709
## 738 12 7 -5 2.684 -1.863 0.062
## 739 15 13 -2 2.684 -0.745 0.456
## 740 2 4 2 2.684 0.745 0.456
## 741 4 5 1 2.684 0.373 0.709
## 742 0 1 1 2.684 0.373 0.709
## 743 8 9 1 2.684 0.373 0.709
## 744 1 1 0 2.684 0.000 1
## 745 14 11 -3 2.684 -1.118 0.264
## 746 6 6 0 2.684 0.000 1
## 747 12 11 -1 2.684 -0.373 0.709
## 748 4 6 2 2.684 0.745 0.456
## 749 9 7 -2 2.684 -0.745 0.456
## 750 2 13 11 2.684 4.099 0
## 751 19 17 -2 2.684 -0.745 0.456
## 752 14 12 -2 2.684 -0.745 0.456
## 753 19 19 0 2.684 0.000 1
## 754 16 14 -2 2.684 -0.745 0.456
## 755 5 6 1 2.684 0.373 0.709
## 756 3 4 1 2.684 0.373 0.709
## 757 5 8 3 2.684 1.118 0.264
## 758 11 15 4 2.684 1.490 0.136
## 759 7 7 0 2.684 0.000 1
## 760 5 2 -3 2.684 -1.118 0.264
## 761 1 0 -1 2.684 -0.373 0.709
## 762 12 8 -4 2.684 -1.490 0.136
## 763 9 12 3 2.684 1.118 0.264
## 764 8 6 -2 2.684 -0.745 0.456
## 765 16 16 0 2.684 0.000 1
## 766 9 7 -2 2.684 -0.745 0.456
## 767 4 5 1 2.684 0.373 0.709
## 768 4 7 3 2.684 1.118 0.264
## 769 11 14 3 2.684 1.118 0.264
## 770 4 4 0 2.684 0.000 1
## 771 14 8 -6 2.684 -2.236 0.025
## 772 16 16 0 2.684 0.000 1
## 773 10 12 2 2.684 0.745 0.456
## 774 8 10 2 2.684 0.745 0.456
## 775 8 9 1 2.684 0.373 0.709
## 776 13 12 -1 2.684 -0.373 0.709
## 777 6 4 -2 2.684 -0.745 0.456
## 778 12 17 5 2.684 1.863 0.062
## 779 4 2 -2 2.684 -0.745 0.456
## 780 9 12 3 2.684 1.118 0.264
## 781 11 9 -2 2.684 -0.745 0.456
## 782 11 13 2 2.684 0.745 0.456
## 783 4 3 -1 2.684 -0.373 0.709
## 784 2 3 1 2.684 0.373 0.709
## 785 4 7 3 2.684 1.118 0.264
## 786 15 17 2 2.684 0.745 0.456
## 787 5 3 -2 2.684 -0.745 0.456
## 788 14 12 -2 2.684 -0.745 0.456
## 789 10 14 4 2.684 1.490 0.136
## 790 19 15 -4 2.684 -1.490 0.136
## 791 11 8 -3 2.684 -1.118 0.264
## 792 15 13 -2 2.684 -0.745 0.456
## 793 6 5 -1 2.684 -0.373 0.709
## 794 1 3 2 2.684 0.745 0.456
## 795 9 9 0 2.684 0.000 1
## 796 9 9 0 2.684 0.000 1
## 797 7 8 1 2.684 0.373 0.709
## 798 8 13 5 2.684 1.863 0.062
## 799 11 10 -1 2.684 -0.373 0.709
## 800 6 8 2 2.684 0.745 0.456
## 801 14 15 1 2.684 0.373 0.709
## 802 8 10 2 2.684 0.745 0.456
## 803 5 10 5 2.684 1.863 0.062
## 804 16 14 -2 2.684 -0.745 0.456
## 805 17 18 1 2.684 0.373 0.709
## 806 3 5 2 2.684 0.745 0.456
## 807 12 13 1 2.684 0.373 0.709
## 808 12 12 0 2.684 0.000 1
## 809 8 8 0 2.684 0.000 1
## 810 8 5 -3 2.684 -1.118 0.264
## 811 17 14 -3 2.684 -1.118 0.264
## 812 14 11 -3 2.684 -1.118 0.264
## 813 17 13 -4 2.684 -1.490 0.136
## 814 6 5 -1 2.684 -0.373 0.709
## 815 7 10 3 2.684 1.118 0.264
## 816 8 6 -2 2.684 -0.745 0.456
## 817 6 11 5 2.684 1.863 0.062
## 818 8 11 3 2.684 1.118 0.264
## 819 5 5 0 2.684 0.000 1
## 820 6 4 -2 2.684 -0.745 0.456
## 821 10 13 3 2.684 1.118 0.264
## 822 16 18 2 2.684 0.745 0.456
## 823 2 3 1 2.684 0.373 0.709
## 824 9 8 -1 2.684 -0.373 0.709
## 825 9 10 1 2.684 0.373 0.709
## 826 11 11 0 2.684 0.000 1
## 827 4 5 1 2.684 0.373 0.709
## 828 1 5 4 2.684 1.490 0.136
## 829 16 16 0 2.684 0.000 1
## 830 5 10 5 2.684 1.863 0.062
## 831 3 4 1 2.684 0.373 0.709
## 832 19 18 -1 2.684 -0.373 0.709
## 833 13 10 -3 2.684 -1.118 0.264
## 834 15 18 3 2.684 1.118 0.264
## 835 12 11 -1 2.684 -0.373 0.709
## 836 15 13 -2 2.684 -0.745 0.456
## 837 12 10 -2 2.684 -0.745 0.456
## 838 0 2 2 2.684 0.745 0.456
## 839 12 10 -2 2.684 -0.745 0.456
## 840 9 14 5 2.684 1.863 0.062
## 841 6 13 7 2.684 2.608 0.009
## 842 11 11 0 2.684 0.000 1
## 843 3 4 1 2.684 0.373 0.709
## 844 5 8 3 2.684 1.118 0.264
## 845 10 12 2 2.684 0.745 0.456
## 846 14 11 -3 2.684 -1.118 0.264
## 847 7 9 2 2.684 0.745 0.456
## 848 6 4 -2 2.684 -0.745 0.456
## 849 14 9 -5 2.684 -1.863 0.062
## 850 13 18 5 2.684 1.863 0.062
## 851 16 16 0 2.684 0.000 1
## 852 11 6 -5 2.684 -1.863 0.062
## 853 11 6 -5 2.684 -1.863 0.062
## 854 1 3 2 2.684 0.745 0.456
## 855 11 9 -2 2.684 -0.745 0.456
## 856 4 2 -2 2.684 -0.745 0.456
## 857 8 6 -2 2.684 -0.745 0.456
## 858 6 6 0 2.684 0.000 1
## 859 11 7 -4 2.684 -1.490 0.136
## 860 5 4 -1 2.684 -0.373 0.709
## 861 7 4 -3 2.684 -1.118 0.264
## 862 4 4 0 2.684 0.000 1
## 863 17 15 -2 2.684 -0.745 0.456
## 864 13 15 2 2.684 0.745 0.456
## 865 9 4 -5 2.684 -1.863 0.062
## 866 3 5 2 2.684 0.745 0.456
## 867 7 5 -2 2.684 -0.745 0.456
## 868 9 7 -2 2.684 -0.745 0.456
## 869 8 7 -1 2.684 -0.373 0.709
## 870 8 11 3 2.684 1.118 0.264
## 871 12 14 2 2.684 0.745 0.456
## 872 6 7 1 2.684 0.373 0.709
## 873 13 12 -1 2.684 -0.373 0.709
## 874 10 10 0 2.684 0.000 1
## 875 16 17 1 2.684 0.373 0.709
## 876 15 17 2 2.684 0.745 0.456
## 877 6 4 -2 2.684 -0.745 0.456
## 878 8 6 -2 2.684 -0.745 0.456
## 879 14 13 -1 2.684 -0.373 0.709
## 880 16 15 -1 2.684 -0.373 0.709
## 881 7 3 -4 2.684 -1.490 0.136
## 882 6 5 -1 2.684 -0.373 0.709
## 883 11 9 -2 2.684 -0.745 0.456
## 884 3 0 -3 2.684 -1.118 0.264
## 885 5 6 1 2.684 0.373 0.709
## 886 13 13 0 2.684 0.000 1
## 887 11 9 -2 2.684 -0.745 0.456
## 888 12 13 1 2.684 0.373 0.709
## 889 0 1 1 2.684 0.373 0.709
## 890 16 17 1 2.684 0.373 0.709
## 891 5 2 -3 2.684 -1.118 0.264
## 892 13 11 -2 2.684 -0.745 0.456
## 893 7 4 -3 2.684 -1.118 0.264
## 894 4 3 -1 2.684 -0.373 0.709
## 895 2 1 -1 2.684 -0.373 0.709
## 896 10 15 5 2.684 1.863 0.062
## 897 13 12 -1 2.684 -0.373 0.709
## 898 13 9 -4 2.684 -1.490 0.136
## 899 20 19 -1 2.684 -0.373 0.709
## 900 7 6 -1 2.684 -0.373 0.709
## 901 16 14 -2 2.684 -0.745 0.456
## 902 6 4 -2 2.684 -0.745 0.456
## 903 13 11 -2 2.684 -0.745 0.456
## 904 4 3 -1 2.684 -0.373 0.709
## 905 7 5 -2 2.684 -0.745 0.456
## 906 7 7 0 2.684 0.000 1
## 907 11 11 0 2.684 0.000 1
## 908 9 5 -4 2.684 -1.490 0.136
## 909 12 9 -3 2.684 -1.118 0.264
## 910 8 13 5 2.684 1.863 0.062
## 911 6 13 7 2.684 2.608 0.009
## 912 11 7 -4 2.684 -1.490 0.136
## 913 3 6 3 2.684 1.118 0.264
## 914 9 12 3 2.684 1.118 0.264
## 915 18 18 0 2.684 0.000 1
## 916 18 18 0 2.684 0.000 1
## 917 14 15 1 2.684 0.373 0.709
## 918 11 11 0 2.684 0.000 1
## 919 7 7 0 2.684 0.000 1
## 920 10 4 -6 2.684 -2.236 0.025
## 921 19 18 -1 2.684 -0.373 0.709
## 922 12 8 -4 2.684 -1.490 0.136
## 923 6 7 1 2.684 0.373 0.709
## 924 5 6 1 2.684 0.373 0.709
## 925 5 4 -1 2.684 -0.373 0.709
## 926 12 10 -2 2.684 -0.745 0.456
## 927 8 9 1 2.684 0.373 0.709
## 928 10 5 -5 2.684 -1.863 0.062
## 929 12 17 5 2.684 1.863 0.062
## 930 13 10 -3 2.684 -1.118 0.264
## 931 14 10 -4 2.684 -1.490 0.136
## 932 4 2 -2 2.684 -0.745 0.456
## 933 13 12 -1 2.684 -0.373 0.709
## 934 12 8 -4 2.684 -1.490 0.136
## 935 9 8 -1 2.684 -0.373 0.709
## 936 4 3 -1 2.684 -0.373 0.709
## 937 13 12 -1 2.684 -0.373 0.709
## 938 10 4 -6 2.684 -2.236 0.025
## 939 7 5 -2 2.684 -0.745 0.456
## 940 6 12 6 2.684 2.236 0.025
## 941 12 17 5 2.684 1.863 0.062
## 942 0 1 1 2.684 0.373 0.709
## 943 9 5 -4 2.684 -1.490 0.136
## 944 5 8 3 2.684 1.118 0.264
## 945 4 5 1 2.684 0.373 0.709
## 946 17 19 2 2.684 0.745 0.456
## 947 11 9 -2 2.684 -0.745 0.456
## 948 13 14 1 2.684 0.373 0.709
## 949 5 9 4 2.684 1.490 0.136
## 950 11 14 3 2.684 1.118 0.264
## 951 8 7 -1 2.684 -0.373 0.709
## 952 6 9 3 2.684 1.118 0.264
## 953 9 1 -8 2.684 -2.981 0.003
## 954 11 8 -3 2.684 -1.118 0.264
## 955 10 13 3 2.684 1.118 0.264
## 956 4 3 -1 2.684 -0.373 0.709
## 957 3 4 1 2.684 0.373 0.709
## 958 7 11 4 2.684 1.490 0.136
## 959 13 14 1 2.684 0.373 0.709
## 960 18 17 -1 2.684 -0.373 0.709
## 961 13 13 0 2.684 0.000 1
## 962 20 19 -1 2.684 -0.373 0.709
## 963 8 4 -4 2.684 -1.490 0.136
## 964 15 15 0 2.684 0.000 1
## 965 11 8 -3 2.684 -1.118 0.264
## 966 14 17 3 2.684 1.118 0.264
## 967 14 9 -5 2.684 -1.863 0.062
## 968 9 10 1 2.684 0.373 0.709
## 969 10 8 -2 2.684 -0.745 0.456
## 970 16 15 -1 2.684 -0.373 0.709
## 971 13 14 1 2.684 0.373 0.709
## 972 3 3 0 2.684 0.000 1
## 973 12 13 1 2.684 0.373 0.709
## 974 8 6 -2 2.684 -0.745 0.456
## 975 9 11 2 2.684 0.745 0.456
## 976 9 11 2 2.684 0.745 0.456
## 977 4 4 0 2.684 0.000 1
## 978 8 7 -1 2.684 -0.373 0.709
## 979 9 10 1 2.684 0.373 0.709
## 980 15 17 2 2.684 0.745 0.456
## 981 10 9 -1 2.684 -0.373 0.709
## 982 15 12 -3 2.684 -1.118 0.264
## 983 7 10 3 2.684 1.118 0.264
## 984 15 16 1 2.684 0.373 0.709
## 985 13 13 0 2.684 0.000 1
## 986 2 6 4 2.684 1.490 0.136
## 987 8 9 1 2.684 0.373 0.709
## 988 9 9 0 2.684 0.000 1
## 989 16 11 -5 2.684 -1.863 0.062
## 990 13 10 -3 2.684 -1.118 0.264
## 991 3 4 1 2.684 0.373 0.709
## 992 1 6 5 2.684 1.863 0.062
## 993 11 12 1 2.684 0.373 0.709
## 994 5 2 -3 2.684 -1.118 0.264
## 995 5 9 4 2.684 1.490 0.136
## 996 12 8 -4 2.684 -1.490 0.136
## 997 2 0 -2 2.684 -0.745 0.456
## 998 2 2 0 2.684 0.000 1
## 999 17 19 2 2.684 0.745 0.456
## 1000 3 1 -2 2.684 -0.745 0.456
# include cutoffs
RCI(predat = dat_pre, postdat = dat_post, SEM.pre=SEM.alpha,
cutoffs=c(-1.96, 1.96))
## pre.score post.score diff SEM z p cut_decision
## 1 12 10 -2 2.684 -0.745 0.456 unchanged
## 2 5 5 0 2.684 0.000 1 unchanged
## 3 10 6 -4 2.684 -1.490 0.136 unchanged
## 4 9 10 1 2.684 0.373 0.709 unchanged
## 5 17 15 -2 2.684 -0.745 0.456 unchanged
## 6 14 12 -2 2.684 -0.745 0.456 unchanged
## 7 11 13 2 2.684 0.745 0.456 unchanged
## 8 6 8 2 2.684 0.745 0.456 unchanged
## 9 11 14 3 2.684 1.118 0.264 unchanged
## 10 8 10 2 2.684 0.745 0.456 unchanged
## 11 11 9 -2 2.684 -0.745 0.456 unchanged
## 12 15 16 1 2.684 0.373 0.709 unchanged
## 13 16 13 -3 2.684 -1.118 0.264 unchanged
## 14 9 6 -3 2.684 -1.118 0.264 unchanged
## 15 8 6 -2 2.684 -0.745 0.456 unchanged
## 16 10 10 0 2.684 0.000 1 unchanged
## 17 2 2 0 2.684 0.000 1 unchanged
## 18 8 11 3 2.684 1.118 0.264 unchanged
## 19 9 8 -1 2.684 -0.373 0.709 unchanged
## 20 14 16 2 2.684 0.745 0.456 unchanged
## 21 3 2 -1 2.684 -0.373 0.709 unchanged
## 22 11 13 2 2.684 0.745 0.456 unchanged
## 23 2 2 0 2.684 0.000 1 unchanged
## 24 1 2 1 2.684 0.373 0.709 unchanged
## 25 10 8 -2 2.684 -0.745 0.456 unchanged
## 26 2 2 0 2.684 0.000 1 unchanged
## 27 10 10 0 2.684 0.000 1 unchanged
## 28 1 2 1 2.684 0.373 0.709 unchanged
## 29 1 1 0 2.684 0.000 1 unchanged
## 30 14 7 -7 2.684 -2.608 0.009 decreased
## 31 5 3 -2 2.684 -0.745 0.456 unchanged
## 32 2 1 -1 2.684 -0.373 0.709 unchanged
## 33 4 7 3 2.684 1.118 0.264 unchanged
## 34 7 4 -3 2.684 -1.118 0.264 unchanged
## 35 5 3 -2 2.684 -0.745 0.456 unchanged
## 36 1 7 6 2.684 2.236 0.025 increased
## 37 8 7 -1 2.684 -0.373 0.709 unchanged
## 38 4 4 0 2.684 0.000 1 unchanged
## 39 15 17 2 2.684 0.745 0.456 unchanged
## 40 13 12 -1 2.684 -0.373 0.709 unchanged
## 41 12 11 -1 2.684 -0.373 0.709 unchanged
## 42 14 14 0 2.684 0.000 1 unchanged
## 43 12 15 3 2.684 1.118 0.264 unchanged
## 44 11 11 0 2.684 0.000 1 unchanged
## 45 6 3 -3 2.684 -1.118 0.264 unchanged
## 46 1 1 0 2.684 0.000 1 unchanged
## 47 17 12 -5 2.684 -1.863 0.062 unchanged
## 48 9 8 -1 2.684 -0.373 0.709 unchanged
## 49 13 15 2 2.684 0.745 0.456 unchanged
## 50 13 11 -2 2.684 -0.745 0.456 unchanged
## 51 12 11 -1 2.684 -0.373 0.709 unchanged
## 52 19 19 0 2.684 0.000 1 unchanged
## 53 8 8 0 2.684 0.000 1 unchanged
## 54 4 1 -3 2.684 -1.118 0.264 unchanged
## 55 7 9 2 2.684 0.745 0.456 unchanged
## 56 5 6 1 2.684 0.373 0.709 unchanged
## 57 12 10 -2 2.684 -0.745 0.456 unchanged
## 58 14 13 -1 2.684 -0.373 0.709 unchanged
## 59 13 10 -3 2.684 -1.118 0.264 unchanged
## 60 14 17 3 2.684 1.118 0.264 unchanged
## 61 4 5 1 2.684 0.373 0.709 unchanged
## 62 13 11 -2 2.684 -0.745 0.456 unchanged
## 63 6 7 1 2.684 0.373 0.709 unchanged
## 64 6 11 5 2.684 1.863 0.062 unchanged
## 65 6 3 -3 2.684 -1.118 0.264 unchanged
## 66 5 1 -4 2.684 -1.490 0.136 unchanged
## 67 15 18 3 2.684 1.118 0.264 unchanged
## 68 8 15 7 2.684 2.608 0.009 increased
## 69 3 7 4 2.684 1.490 0.136 unchanged
## 70 11 15 4 2.684 1.490 0.136 unchanged
## 71 6 6 0 2.684 0.000 1 unchanged
## 72 5 7 2 2.684 0.745 0.456 unchanged
## 73 13 11 -2 2.684 -0.745 0.456 unchanged
## 74 10 6 -4 2.684 -1.490 0.136 unchanged
## 75 15 15 0 2.684 0.000 1 unchanged
## 76 8 13 5 2.684 1.863 0.062 unchanged
## 77 4 3 -1 2.684 -0.373 0.709 unchanged
## 78 5 6 1 2.684 0.373 0.709 unchanged
## 79 7 5 -2 2.684 -0.745 0.456 unchanged
## 80 6 1 -5 2.684 -1.863 0.062 unchanged
## 81 4 4 0 2.684 0.000 1 unchanged
## 82 11 12 1 2.684 0.373 0.709 unchanged
## 83 3 4 1 2.684 0.373 0.709 unchanged
## 84 7 9 2 2.684 0.745 0.456 unchanged
## 85 5 6 1 2.684 0.373 0.709 unchanged
## 86 14 13 -1 2.684 -0.373 0.709 unchanged
## 87 10 7 -3 2.684 -1.118 0.264 unchanged
## 88 15 18 3 2.684 1.118 0.264 unchanged
## 89 16 15 -1 2.684 -0.373 0.709 unchanged
## 90 5 12 7 2.684 2.608 0.009 increased
## 91 5 7 2 2.684 0.745 0.456 unchanged
## 92 12 13 1 2.684 0.373 0.709 unchanged
## 93 2 5 3 2.684 1.118 0.264 unchanged
## 94 9 4 -5 2.684 -1.863 0.062 unchanged
## 95 0 2 2 2.684 0.745 0.456 unchanged
## 96 1 3 2 2.684 0.745 0.456 unchanged
## 97 10 15 5 2.684 1.863 0.062 unchanged
## 98 8 5 -3 2.684 -1.118 0.264 unchanged
## 99 7 11 4 2.684 1.490 0.136 unchanged
## 100 7 5 -2 2.684 -0.745 0.456 unchanged
## 101 12 10 -2 2.684 -0.745 0.456 unchanged
## 102 8 11 3 2.684 1.118 0.264 unchanged
## 103 18 18 0 2.684 0.000 1 unchanged
## 104 17 12 -5 2.684 -1.863 0.062 unchanged
## 105 16 15 -1 2.684 -0.373 0.709 unchanged
## 106 2 2 0 2.684 0.000 1 unchanged
## 107 8 9 1 2.684 0.373 0.709 unchanged
## 108 5 3 -2 2.684 -0.745 0.456 unchanged
## 109 1 1 0 2.684 0.000 1 unchanged
## 110 6 5 -1 2.684 -0.373 0.709 unchanged
## 111 3 4 1 2.684 0.373 0.709 unchanged
## 112 11 12 1 2.684 0.373 0.709 unchanged
## 113 12 12 0 2.684 0.000 1 unchanged
## 114 6 5 -1 2.684 -0.373 0.709 unchanged
## 115 11 13 2 2.684 0.745 0.456 unchanged
## 116 13 13 0 2.684 0.000 1 unchanged
## 117 4 7 3 2.684 1.118 0.264 unchanged
## 118 2 3 1 2.684 0.373 0.709 unchanged
## 119 11 9 -2 2.684 -0.745 0.456 unchanged
## 120 5 10 5 2.684 1.863 0.062 unchanged
## 121 16 17 1 2.684 0.373 0.709 unchanged
## 122 2 3 1 2.684 0.373 0.709 unchanged
## 123 18 15 -3 2.684 -1.118 0.264 unchanged
## 124 9 10 1 2.684 0.373 0.709 unchanged
## 125 15 10 -5 2.684 -1.863 0.062 unchanged
## 126 17 18 1 2.684 0.373 0.709 unchanged
## 127 15 18 3 2.684 1.118 0.264 unchanged
## 128 3 8 5 2.684 1.863 0.062 unchanged
## 129 16 13 -3 2.684 -1.118 0.264 unchanged
## 130 10 6 -4 2.684 -1.490 0.136 unchanged
## 131 15 17 2 2.684 0.745 0.456 unchanged
## 132 8 4 -4 2.684 -1.490 0.136 unchanged
## 133 4 4 0 2.684 0.000 1 unchanged
## 134 17 17 0 2.684 0.000 1 unchanged
## 135 6 9 3 2.684 1.118 0.264 unchanged
## 136 7 3 -4 2.684 -1.490 0.136 unchanged
## 137 3 8 5 2.684 1.863 0.062 unchanged
## 138 4 8 4 2.684 1.490 0.136 unchanged
## 139 14 18 4 2.684 1.490 0.136 unchanged
## 140 9 2 -7 2.684 -2.608 0.009 decreased
## 141 16 15 -1 2.684 -0.373 0.709 unchanged
## 142 9 5 -4 2.684 -1.490 0.136 unchanged
## 143 19 17 -2 2.684 -0.745 0.456 unchanged
## 144 9 10 1 2.684 0.373 0.709 unchanged
## 145 7 5 -2 2.684 -0.745 0.456 unchanged
## 146 15 15 0 2.684 0.000 1 unchanged
## 147 10 7 -3 2.684 -1.118 0.264 unchanged
## 148 6 4 -2 2.684 -0.745 0.456 unchanged
## 149 11 8 -3 2.684 -1.118 0.264 unchanged
## 150 9 9 0 2.684 0.000 1 unchanged
## 151 10 7 -3 2.684 -1.118 0.264 unchanged
## 152 7 9 2 2.684 0.745 0.456 unchanged
## 153 14 12 -2 2.684 -0.745 0.456 unchanged
## 154 10 13 3 2.684 1.118 0.264 unchanged
## 155 13 10 -3 2.684 -1.118 0.264 unchanged
## 156 10 7 -3 2.684 -1.118 0.264 unchanged
## 157 12 12 0 2.684 0.000 1 unchanged
## 158 14 11 -3 2.684 -1.118 0.264 unchanged
## 159 6 6 0 2.684 0.000 1 unchanged
## 160 4 4 0 2.684 0.000 1 unchanged
## 161 6 5 -1 2.684 -0.373 0.709 unchanged
## 162 3 2 -1 2.684 -0.373 0.709 unchanged
## 163 4 4 0 2.684 0.000 1 unchanged
## 164 18 18 0 2.684 0.000 1 unchanged
## 165 12 8 -4 2.684 -1.490 0.136 unchanged
## 166 2 2 0 2.684 0.000 1 unchanged
## 167 6 3 -3 2.684 -1.118 0.264 unchanged
## 168 2 5 3 2.684 1.118 0.264 unchanged
## 169 9 11 2 2.684 0.745 0.456 unchanged
## 170 5 4 -1 2.684 -0.373 0.709 unchanged
## 171 19 18 -1 2.684 -0.373 0.709 unchanged
## 172 11 12 1 2.684 0.373 0.709 unchanged
## 173 9 3 -6 2.684 -2.236 0.025 decreased
## 174 18 14 -4 2.684 -1.490 0.136 unchanged
## 175 11 13 2 2.684 0.745 0.456 unchanged
## 176 16 18 2 2.684 0.745 0.456 unchanged
## 177 9 7 -2 2.684 -0.745 0.456 unchanged
## 178 10 14 4 2.684 1.490 0.136 unchanged
## 179 13 9 -4 2.684 -1.490 0.136 unchanged
## 180 3 5 2 2.684 0.745 0.456 unchanged
## 181 11 12 1 2.684 0.373 0.709 unchanged
## 182 13 11 -2 2.684 -0.745 0.456 unchanged
## 183 14 15 1 2.684 0.373 0.709 unchanged
## 184 15 16 1 2.684 0.373 0.709 unchanged
## 185 6 4 -2 2.684 -0.745 0.456 unchanged
## 186 16 19 3 2.684 1.118 0.264 unchanged
## 187 19 19 0 2.684 0.000 1 unchanged
## 188 14 15 1 2.684 0.373 0.709 unchanged
## 189 5 7 2 2.684 0.745 0.456 unchanged
## 190 5 6 1 2.684 0.373 0.709 unchanged
## 191 11 9 -2 2.684 -0.745 0.456 unchanged
## 192 11 8 -3 2.684 -1.118 0.264 unchanged
## 193 4 4 0 2.684 0.000 1 unchanged
## 194 15 9 -6 2.684 -2.236 0.025 decreased
## 195 6 8 2 2.684 0.745 0.456 unchanged
## 196 13 8 -5 2.684 -1.863 0.062 unchanged
## 197 9 11 2 2.684 0.745 0.456 unchanged
## 198 8 6 -2 2.684 -0.745 0.456 unchanged
## 199 16 17 1 2.684 0.373 0.709 unchanged
## 200 5 10 5 2.684 1.863 0.062 unchanged
## 201 3 5 2 2.684 0.745 0.456 unchanged
## 202 14 15 1 2.684 0.373 0.709 unchanged
## 203 4 8 4 2.684 1.490 0.136 unchanged
## 204 9 7 -2 2.684 -0.745 0.456 unchanged
## 205 5 2 -3 2.684 -1.118 0.264 unchanged
## 206 18 15 -3 2.684 -1.118 0.264 unchanged
## 207 3 3 0 2.684 0.000 1 unchanged
## 208 17 17 0 2.684 0.000 1 unchanged
## 209 7 7 0 2.684 0.000 1 unchanged
## 210 11 9 -2 2.684 -0.745 0.456 unchanged
## 211 2 5 3 2.684 1.118 0.264 unchanged
## 212 11 12 1 2.684 0.373 0.709 unchanged
## 213 6 4 -2 2.684 -0.745 0.456 unchanged
## 214 6 7 1 2.684 0.373 0.709 unchanged
## 215 8 6 -2 2.684 -0.745 0.456 unchanged
## 216 15 15 0 2.684 0.000 1 unchanged
## 217 3 3 0 2.684 0.000 1 unchanged
## 218 14 12 -2 2.684 -0.745 0.456 unchanged
## 219 10 7 -3 2.684 -1.118 0.264 unchanged
## 220 9 13 4 2.684 1.490 0.136 unchanged
## 221 3 5 2 2.684 0.745 0.456 unchanged
## 222 6 10 4 2.684 1.490 0.136 unchanged
## 223 14 13 -1 2.684 -0.373 0.709 unchanged
## 224 18 18 0 2.684 0.000 1 unchanged
## 225 17 14 -3 2.684 -1.118 0.264 unchanged
## 226 8 9 1 2.684 0.373 0.709 unchanged
## 227 8 9 1 2.684 0.373 0.709 unchanged
## 228 17 11 -6 2.684 -2.236 0.025 decreased
## 229 3 4 1 2.684 0.373 0.709 unchanged
## 230 7 8 1 2.684 0.373 0.709 unchanged
## 231 7 10 3 2.684 1.118 0.264 unchanged
## 232 7 9 2 2.684 0.745 0.456 unchanged
## 233 12 14 2 2.684 0.745 0.456 unchanged
## 234 17 13 -4 2.684 -1.490 0.136 unchanged
## 235 16 13 -3 2.684 -1.118 0.264 unchanged
## 236 4 3 -1 2.684 -0.373 0.709 unchanged
## 237 12 11 -1 2.684 -0.373 0.709 unchanged
## 238 3 9 6 2.684 2.236 0.025 increased
## 239 2 4 2 2.684 0.745 0.456 unchanged
## 240 8 7 -1 2.684 -0.373 0.709 unchanged
## 241 10 13 3 2.684 1.118 0.264 unchanged
## 242 2 6 4 2.684 1.490 0.136 unchanged
## 243 18 19 1 2.684 0.373 0.709 unchanged
## 244 11 11 0 2.684 0.000 1 unchanged
## 245 11 11 0 2.684 0.000 1 unchanged
## 246 17 15 -2 2.684 -0.745 0.456 unchanged
## 247 15 18 3 2.684 1.118 0.264 unchanged
## 248 14 9 -5 2.684 -1.863 0.062 unchanged
## 249 9 4 -5 2.684 -1.863 0.062 unchanged
## 250 14 13 -1 2.684 -0.373 0.709 unchanged
## 251 16 7 -9 2.684 -3.354 0.001 decreased
## 252 15 14 -1 2.684 -0.373 0.709 unchanged
## 253 12 11 -1 2.684 -0.373 0.709 unchanged
## 254 3 4 1 2.684 0.373 0.709 unchanged
## 255 12 12 0 2.684 0.000 1 unchanged
## 256 7 11 4 2.684 1.490 0.136 unchanged
## 257 5 5 0 2.684 0.000 1 unchanged
## 258 8 8 0 2.684 0.000 1 unchanged
## 259 6 6 0 2.684 0.000 1 unchanged
## 260 12 12 0 2.684 0.000 1 unchanged
## 261 13 15 2 2.684 0.745 0.456 unchanged
## 262 9 13 4 2.684 1.490 0.136 unchanged
## 263 13 8 -5 2.684 -1.863 0.062 unchanged
## 264 6 9 3 2.684 1.118 0.264 unchanged
## 265 8 11 3 2.684 1.118 0.264 unchanged
## 266 11 9 -2 2.684 -0.745 0.456 unchanged
## 267 10 12 2 2.684 0.745 0.456 unchanged
## 268 18 16 -2 2.684 -0.745 0.456 unchanged
## 269 4 4 0 2.684 0.000 1 unchanged
## 270 9 14 5 2.684 1.863 0.062 unchanged
## 271 14 16 2 2.684 0.745 0.456 unchanged
## 272 8 7 -1 2.684 -0.373 0.709 unchanged
## 273 7 6 -1 2.684 -0.373 0.709 unchanged
## 274 16 15 -1 2.684 -0.373 0.709 unchanged
## 275 8 15 7 2.684 2.608 0.009 increased
## 276 15 16 1 2.684 0.373 0.709 unchanged
## 277 15 14 -1 2.684 -0.373 0.709 unchanged
## 278 13 9 -4 2.684 -1.490 0.136 unchanged
## 279 8 9 1 2.684 0.373 0.709 unchanged
## 280 5 9 4 2.684 1.490 0.136 unchanged
## 281 13 9 -4 2.684 -1.490 0.136 unchanged
## 282 13 10 -3 2.684 -1.118 0.264 unchanged
## 283 9 13 4 2.684 1.490 0.136 unchanged
## 284 5 4 -1 2.684 -0.373 0.709 unchanged
## 285 4 6 2 2.684 0.745 0.456 unchanged
## 286 2 6 4 2.684 1.490 0.136 unchanged
## 287 3 2 -1 2.684 -0.373 0.709 unchanged
## 288 9 7 -2 2.684 -0.745 0.456 unchanged
## 289 7 10 3 2.684 1.118 0.264 unchanged
## 290 8 5 -3 2.684 -1.118 0.264 unchanged
## 291 9 6 -3 2.684 -1.118 0.264 unchanged
## 292 4 3 -1 2.684 -0.373 0.709 unchanged
## 293 14 17 3 2.684 1.118 0.264 unchanged
## 294 15 18 3 2.684 1.118 0.264 unchanged
## 295 3 4 1 2.684 0.373 0.709 unchanged
## 296 1 4 3 2.684 1.118 0.264 unchanged
## 297 12 10 -2 2.684 -0.745 0.456 unchanged
## 298 5 8 3 2.684 1.118 0.264 unchanged
## 299 12 12 0 2.684 0.000 1 unchanged
## 300 8 10 2 2.684 0.745 0.456 unchanged
## 301 6 5 -1 2.684 -0.373 0.709 unchanged
## 302 5 7 2 2.684 0.745 0.456 unchanged
## 303 14 15 1 2.684 0.373 0.709 unchanged
## 304 11 8 -3 2.684 -1.118 0.264 unchanged
## 305 4 2 -2 2.684 -0.745 0.456 unchanged
## 306 11 11 0 2.684 0.000 1 unchanged
## 307 13 11 -2 2.684 -0.745 0.456 unchanged
## 308 9 13 4 2.684 1.490 0.136 unchanged
## 309 4 6 2 2.684 0.745 0.456 unchanged
## 310 13 11 -2 2.684 -0.745 0.456 unchanged
## 311 10 12 2 2.684 0.745 0.456 unchanged
## 312 8 9 1 2.684 0.373 0.709 unchanged
## 313 16 12 -4 2.684 -1.490 0.136 unchanged
## 314 8 9 1 2.684 0.373 0.709 unchanged
## 315 2 1 -1 2.684 -0.373 0.709 unchanged
## 316 13 11 -2 2.684 -0.745 0.456 unchanged
## 317 15 8 -7 2.684 -2.608 0.009 decreased
## 318 7 4 -3 2.684 -1.118 0.264 unchanged
## 319 16 15 -1 2.684 -0.373 0.709 unchanged
## 320 12 11 -1 2.684 -0.373 0.709 unchanged
## 321 2 1 -1 2.684 -0.373 0.709 unchanged
## 322 14 15 1 2.684 0.373 0.709 unchanged
## 323 1 2 1 2.684 0.373 0.709 unchanged
## 324 10 11 1 2.684 0.373 0.709 unchanged
## 325 8 9 1 2.684 0.373 0.709 unchanged
## 326 13 14 1 2.684 0.373 0.709 unchanged
## 327 15 16 1 2.684 0.373 0.709 unchanged
## 328 16 11 -5 2.684 -1.863 0.062 unchanged
## 329 7 7 0 2.684 0.000 1 unchanged
## 330 8 9 1 2.684 0.373 0.709 unchanged
## 331 14 10 -4 2.684 -1.490 0.136 unchanged
## 332 5 8 3 2.684 1.118 0.264 unchanged
## 333 11 15 4 2.684 1.490 0.136 unchanged
## 334 5 7 2 2.684 0.745 0.456 unchanged
## 335 0 4 4 2.684 1.490 0.136 unchanged
## 336 3 4 1 2.684 0.373 0.709 unchanged
## 337 9 4 -5 2.684 -1.863 0.062 unchanged
## 338 10 9 -1 2.684 -0.373 0.709 unchanged
## 339 12 16 4 2.684 1.490 0.136 unchanged
## 340 14 17 3 2.684 1.118 0.264 unchanged
## 341 9 8 -1 2.684 -0.373 0.709 unchanged
## 342 6 8 2 2.684 0.745 0.456 unchanged
## 343 7 3 -4 2.684 -1.490 0.136 unchanged
## 344 16 18 2 2.684 0.745 0.456 unchanged
## 345 14 7 -7 2.684 -2.608 0.009 decreased
## 346 12 6 -6 2.684 -2.236 0.025 decreased
## 347 14 14 0 2.684 0.000 1 unchanged
## 348 15 15 0 2.684 0.000 1 unchanged
## 349 7 3 -4 2.684 -1.490 0.136 unchanged
## 350 8 9 1 2.684 0.373 0.709 unchanged
## 351 5 2 -3 2.684 -1.118 0.264 unchanged
## 352 8 6 -2 2.684 -0.745 0.456 unchanged
## 353 17 18 1 2.684 0.373 0.709 unchanged
## 354 7 8 1 2.684 0.373 0.709 unchanged
## 355 12 10 -2 2.684 -0.745 0.456 unchanged
## 356 11 12 1 2.684 0.373 0.709 unchanged
## 357 15 12 -3 2.684 -1.118 0.264 unchanged
## 358 5 7 2 2.684 0.745 0.456 unchanged
## 359 10 8 -2 2.684 -0.745 0.456 unchanged
## 360 14 14 0 2.684 0.000 1 unchanged
## 361 10 11 1 2.684 0.373 0.709 unchanged
## 362 10 9 -1 2.684 -0.373 0.709 unchanged
## 363 14 14 0 2.684 0.000 1 unchanged
## 364 17 15 -2 2.684 -0.745 0.456 unchanged
## 365 8 7 -1 2.684 -0.373 0.709 unchanged
## 366 17 11 -6 2.684 -2.236 0.025 decreased
## 367 5 3 -2 2.684 -0.745 0.456 unchanged
## 368 2 1 -1 2.684 -0.373 0.709 unchanged
## 369 2 1 -1 2.684 -0.373 0.709 unchanged
## 370 12 12 0 2.684 0.000 1 unchanged
## 371 11 11 0 2.684 0.000 1 unchanged
## 372 4 7 3 2.684 1.118 0.264 unchanged
## 373 16 11 -5 2.684 -1.863 0.062 unchanged
## 374 4 4 0 2.684 0.000 1 unchanged
## 375 6 4 -2 2.684 -0.745 0.456 unchanged
## 376 5 7 2 2.684 0.745 0.456 unchanged
## 377 12 11 -1 2.684 -0.373 0.709 unchanged
## 378 12 16 4 2.684 1.490 0.136 unchanged
## 379 16 18 2 2.684 0.745 0.456 unchanged
## 380 14 12 -2 2.684 -0.745 0.456 unchanged
## 381 6 5 -1 2.684 -0.373 0.709 unchanged
## 382 10 12 2 2.684 0.745 0.456 unchanged
## 383 8 11 3 2.684 1.118 0.264 unchanged
## 384 10 14 4 2.684 1.490 0.136 unchanged
## 385 4 5 1 2.684 0.373 0.709 unchanged
## 386 14 14 0 2.684 0.000 1 unchanged
## 387 7 7 0 2.684 0.000 1 unchanged
## 388 11 10 -1 2.684 -0.373 0.709 unchanged
## 389 4 4 0 2.684 0.000 1 unchanged
## 390 8 7 -1 2.684 -0.373 0.709 unchanged
## 391 10 9 -1 2.684 -0.373 0.709 unchanged
## 392 5 8 3 2.684 1.118 0.264 unchanged
## 393 12 10 -2 2.684 -0.745 0.456 unchanged
## 394 8 7 -1 2.684 -0.373 0.709 unchanged
## 395 10 4 -6 2.684 -2.236 0.025 decreased
## 396 18 15 -3 2.684 -1.118 0.264 unchanged
## 397 4 7 3 2.684 1.118 0.264 unchanged
## 398 13 13 0 2.684 0.000 1 unchanged
## 399 14 11 -3 2.684 -1.118 0.264 unchanged
## 400 4 6 2 2.684 0.745 0.456 unchanged
## 401 15 16 1 2.684 0.373 0.709 unchanged
## 402 4 4 0 2.684 0.000 1 unchanged
## 403 5 6 1 2.684 0.373 0.709 unchanged
## 404 17 15 -2 2.684 -0.745 0.456 unchanged
## 405 8 4 -4 2.684 -1.490 0.136 unchanged
## 406 10 6 -4 2.684 -1.490 0.136 unchanged
## 407 3 2 -1 2.684 -0.373 0.709 unchanged
## 408 8 7 -1 2.684 -0.373 0.709 unchanged
## 409 6 10 4 2.684 1.490 0.136 unchanged
## 410 11 12 1 2.684 0.373 0.709 unchanged
## 411 3 2 -1 2.684 -0.373 0.709 unchanged
## 412 14 9 -5 2.684 -1.863 0.062 unchanged
## 413 9 8 -1 2.684 -0.373 0.709 unchanged
## 414 15 17 2 2.684 0.745 0.456 unchanged
## 415 13 9 -4 2.684 -1.490 0.136 unchanged
## 416 3 5 2 2.684 0.745 0.456 unchanged
## 417 4 2 -2 2.684 -0.745 0.456 unchanged
## 418 18 18 0 2.684 0.000 1 unchanged
## 419 2 1 -1 2.684 -0.373 0.709 unchanged
## 420 15 13 -2 2.684 -0.745 0.456 unchanged
## 421 15 11 -4 2.684 -1.490 0.136 unchanged
## 422 6 7 1 2.684 0.373 0.709 unchanged
## 423 4 5 1 2.684 0.373 0.709 unchanged
## 424 7 4 -3 2.684 -1.118 0.264 unchanged
## 425 8 9 1 2.684 0.373 0.709 unchanged
## 426 6 2 -4 2.684 -1.490 0.136 unchanged
## 427 5 6 1 2.684 0.373 0.709 unchanged
## 428 3 7 4 2.684 1.490 0.136 unchanged
## 429 9 13 4 2.684 1.490 0.136 unchanged
## 430 6 4 -2 2.684 -0.745 0.456 unchanged
## 431 5 11 6 2.684 2.236 0.025 increased
## 432 14 12 -2 2.684 -0.745 0.456 unchanged
## 433 18 19 1 2.684 0.373 0.709 unchanged
## 434 0 0 0 2.684 0.000 1 unchanged
## 435 15 9 -6 2.684 -2.236 0.025 decreased
## 436 10 8 -2 2.684 -0.745 0.456 unchanged
## 437 15 16 1 2.684 0.373 0.709 unchanged
## 438 3 2 -1 2.684 -0.373 0.709 unchanged
## 439 14 13 -1 2.684 -0.373 0.709 unchanged
## 440 9 13 4 2.684 1.490 0.136 unchanged
## 441 10 11 1 2.684 0.373 0.709 unchanged
## 442 15 10 -5 2.684 -1.863 0.062 unchanged
## 443 4 4 0 2.684 0.000 1 unchanged
## 444 5 8 3 2.684 1.118 0.264 unchanged
## 445 6 11 5 2.684 1.863 0.062 unchanged
## 446 12 13 1 2.684 0.373 0.709 unchanged
## 447 3 5 2 2.684 0.745 0.456 unchanged
## 448 2 1 -1 2.684 -0.373 0.709 unchanged
## 449 16 15 -1 2.684 -0.373 0.709 unchanged
## 450 6 4 -2 2.684 -0.745 0.456 unchanged
## 451 17 15 -2 2.684 -0.745 0.456 unchanged
## 452 6 12 6 2.684 2.236 0.025 increased
## 453 4 6 2 2.684 0.745 0.456 unchanged
## 454 19 19 0 2.684 0.000 1 unchanged
## 455 9 8 -1 2.684 -0.373 0.709 unchanged
## 456 7 5 -2 2.684 -0.745 0.456 unchanged
## 457 6 5 -1 2.684 -0.373 0.709 unchanged
## 458 1 2 1 2.684 0.373 0.709 unchanged
## 459 8 7 -1 2.684 -0.373 0.709 unchanged
## 460 8 10 2 2.684 0.745 0.456 unchanged
## 461 15 13 -2 2.684 -0.745 0.456 unchanged
## 462 4 3 -1 2.684 -0.373 0.709 unchanged
## 463 16 17 1 2.684 0.373 0.709 unchanged
## 464 10 12 2 2.684 0.745 0.456 unchanged
## 465 17 13 -4 2.684 -1.490 0.136 unchanged
## 466 11 13 2 2.684 0.745 0.456 unchanged
## 467 10 6 -4 2.684 -1.490 0.136 unchanged
## 468 9 4 -5 2.684 -1.863 0.062 unchanged
## 469 6 5 -1 2.684 -0.373 0.709 unchanged
## 470 9 12 3 2.684 1.118 0.264 unchanged
## 471 7 4 -3 2.684 -1.118 0.264 unchanged
## 472 17 17 0 2.684 0.000 1 unchanged
## 473 5 7 2 2.684 0.745 0.456 unchanged
## 474 8 10 2 2.684 0.745 0.456 unchanged
## 475 12 18 6 2.684 2.236 0.025 increased
## 476 7 10 3 2.684 1.118 0.264 unchanged
## 477 14 13 -1 2.684 -0.373 0.709 unchanged
## 478 13 15 2 2.684 0.745 0.456 unchanged
## 479 8 5 -3 2.684 -1.118 0.264 unchanged
## 480 8 8 0 2.684 0.000 1 unchanged
## 481 8 12 4 2.684 1.490 0.136 unchanged
## 482 6 4 -2 2.684 -0.745 0.456 unchanged
## 483 18 16 -2 2.684 -0.745 0.456 unchanged
## 484 6 4 -2 2.684 -0.745 0.456 unchanged
## 485 8 6 -2 2.684 -0.745 0.456 unchanged
## 486 9 10 1 2.684 0.373 0.709 unchanged
## 487 6 1 -5 2.684 -1.863 0.062 unchanged
## 488 8 8 0 2.684 0.000 1 unchanged
## 489 13 13 0 2.684 0.000 1 unchanged
## 490 11 9 -2 2.684 -0.745 0.456 unchanged
## 491 2 3 1 2.684 0.373 0.709 unchanged
## 492 5 5 0 2.684 0.000 1 unchanged
## 493 9 12 3 2.684 1.118 0.264 unchanged
## 494 7 11 4 2.684 1.490 0.136 unchanged
## 495 3 5 2 2.684 0.745 0.456 unchanged
## 496 17 14 -3 2.684 -1.118 0.264 unchanged
## 497 10 8 -2 2.684 -0.745 0.456 unchanged
## 498 18 17 -1 2.684 -0.373 0.709 unchanged
## 499 5 11 6 2.684 2.236 0.025 increased
## 500 13 15 2 2.684 0.745 0.456 unchanged
## 501 3 0 -3 2.684 -1.118 0.264 unchanged
## 502 5 4 -1 2.684 -0.373 0.709 unchanged
## 503 11 13 2 2.684 0.745 0.456 unchanged
## 504 10 5 -5 2.684 -1.863 0.062 unchanged
## 505 11 8 -3 2.684 -1.118 0.264 unchanged
## 506 2 5 3 2.684 1.118 0.264 unchanged
## 507 4 2 -2 2.684 -0.745 0.456 unchanged
## 508 3 2 -1 2.684 -0.373 0.709 unchanged
## 509 18 16 -2 2.684 -0.745 0.456 unchanged
## 510 16 17 1 2.684 0.373 0.709 unchanged
## 511 10 8 -2 2.684 -0.745 0.456 unchanged
## 512 11 13 2 2.684 0.745 0.456 unchanged
## 513 2 6 4 2.684 1.490 0.136 unchanged
## 514 19 20 1 2.684 0.373 0.709 unchanged
## 515 5 5 0 2.684 0.000 1 unchanged
## 516 6 3 -3 2.684 -1.118 0.264 unchanged
## 517 7 7 0 2.684 0.000 1 unchanged
## 518 3 4 1 2.684 0.373 0.709 unchanged
## 519 17 15 -2 2.684 -0.745 0.456 unchanged
## 520 1 6 5 2.684 1.863 0.062 unchanged
## 521 10 7 -3 2.684 -1.118 0.264 unchanged
## 522 7 12 5 2.684 1.863 0.062 unchanged
## 523 18 17 -1 2.684 -0.373 0.709 unchanged
## 524 3 1 -2 2.684 -0.745 0.456 unchanged
## 525 6 8 2 2.684 0.745 0.456 unchanged
## 526 7 6 -1 2.684 -0.373 0.709 unchanged
## 527 14 15 1 2.684 0.373 0.709 unchanged
## 528 7 2 -5 2.684 -1.863 0.062 unchanged
## 529 9 11 2 2.684 0.745 0.456 unchanged
## 530 10 16 6 2.684 2.236 0.025 increased
## 531 14 12 -2 2.684 -0.745 0.456 unchanged
## 532 10 9 -1 2.684 -0.373 0.709 unchanged
## 533 14 13 -1 2.684 -0.373 0.709 unchanged
## 534 6 4 -2 2.684 -0.745 0.456 unchanged
## 535 8 12 4 2.684 1.490 0.136 unchanged
## 536 6 9 3 2.684 1.118 0.264 unchanged
## 537 2 2 0 2.684 0.000 1 unchanged
## 538 16 16 0 2.684 0.000 1 unchanged
## 539 8 9 1 2.684 0.373 0.709 unchanged
## 540 14 11 -3 2.684 -1.118 0.264 unchanged
## 541 10 10 0 2.684 0.000 1 unchanged
## 542 7 3 -4 2.684 -1.490 0.136 unchanged
## 543 7 3 -4 2.684 -1.490 0.136 unchanged
## 544 4 8 4 2.684 1.490 0.136 unchanged
## 545 4 6 2 2.684 0.745 0.456 unchanged
## 546 9 9 0 2.684 0.000 1 unchanged
## 547 12 11 -1 2.684 -0.373 0.709 unchanged
## 548 12 11 -1 2.684 -0.373 0.709 unchanged
## 549 11 11 0 2.684 0.000 1 unchanged
## 550 14 14 0 2.684 0.000 1 unchanged
## 551 12 9 -3 2.684 -1.118 0.264 unchanged
## 552 13 12 -1 2.684 -0.373 0.709 unchanged
## 553 1 3 2 2.684 0.745 0.456 unchanged
## 554 12 9 -3 2.684 -1.118 0.264 unchanged
## 555 13 11 -2 2.684 -0.745 0.456 unchanged
## 556 15 15 0 2.684 0.000 1 unchanged
## 557 13 13 0 2.684 0.000 1 unchanged
## 558 12 4 -8 2.684 -2.981 0.003 decreased
## 559 13 9 -4 2.684 -1.490 0.136 unchanged
## 560 3 2 -1 2.684 -0.373 0.709 unchanged
## 561 2 1 -1 2.684 -0.373 0.709 unchanged
## 562 19 19 0 2.684 0.000 1 unchanged
## 563 10 10 0 2.684 0.000 1 unchanged
## 564 8 7 -1 2.684 -0.373 0.709 unchanged
## 565 3 4 1 2.684 0.373 0.709 unchanged
## 566 6 7 1 2.684 0.373 0.709 unchanged
## 567 7 12 5 2.684 1.863 0.062 unchanged
## 568 10 7 -3 2.684 -1.118 0.264 unchanged
## 569 11 7 -4 2.684 -1.490 0.136 unchanged
## 570 18 19 1 2.684 0.373 0.709 unchanged
## 571 5 7 2 2.684 0.745 0.456 unchanged
## 572 16 16 0 2.684 0.000 1 unchanged
## 573 15 14 -1 2.684 -0.373 0.709 unchanged
## 574 11 4 -7 2.684 -2.608 0.009 decreased
## 575 7 7 0 2.684 0.000 1 unchanged
## 576 6 3 -3 2.684 -1.118 0.264 unchanged
## 577 14 11 -3 2.684 -1.118 0.264 unchanged
## 578 8 5 -3 2.684 -1.118 0.264 unchanged
## 579 5 4 -1 2.684 -0.373 0.709 unchanged
## 580 3 3 0 2.684 0.000 1 unchanged
## 581 10 8 -2 2.684 -0.745 0.456 unchanged
## 582 2 1 -1 2.684 -0.373 0.709 unchanged
## 583 14 15 1 2.684 0.373 0.709 unchanged
## 584 4 9 5 2.684 1.863 0.062 unchanged
## 585 11 14 3 2.684 1.118 0.264 unchanged
## 586 11 13 2 2.684 0.745 0.456 unchanged
## 587 9 10 1 2.684 0.373 0.709 unchanged
## 588 6 4 -2 2.684 -0.745 0.456 unchanged
## 589 10 9 -1 2.684 -0.373 0.709 unchanged
## 590 4 3 -1 2.684 -0.373 0.709 unchanged
## 591 4 3 -1 2.684 -0.373 0.709 unchanged
## 592 11 12 1 2.684 0.373 0.709 unchanged
## 593 9 7 -2 2.684 -0.745 0.456 unchanged
## 594 8 9 1 2.684 0.373 0.709 unchanged
## 595 9 9 0 2.684 0.000 1 unchanged
## 596 5 8 3 2.684 1.118 0.264 unchanged
## 597 8 11 3 2.684 1.118 0.264 unchanged
## 598 15 11 -4 2.684 -1.490 0.136 unchanged
## 599 7 5 -2 2.684 -0.745 0.456 unchanged
## 600 8 8 0 2.684 0.000 1 unchanged
## 601 7 5 -2 2.684 -0.745 0.456 unchanged
## 602 12 6 -6 2.684 -2.236 0.025 decreased
## 603 4 4 0 2.684 0.000 1 unchanged
## 604 9 4 -5 2.684 -1.863 0.062 unchanged
## 605 9 3 -6 2.684 -2.236 0.025 decreased
## 606 13 18 5 2.684 1.863 0.062 unchanged
## 607 11 10 -1 2.684 -0.373 0.709 unchanged
## 608 14 14 0 2.684 0.000 1 unchanged
## 609 16 14 -2 2.684 -0.745 0.456 unchanged
## 610 6 8 2 2.684 0.745 0.456 unchanged
## 611 14 11 -3 2.684 -1.118 0.264 unchanged
## 612 2 8 6 2.684 2.236 0.025 increased
## 613 18 16 -2 2.684 -0.745 0.456 unchanged
## 614 7 8 1 2.684 0.373 0.709 unchanged
## 615 5 8 3 2.684 1.118 0.264 unchanged
## 616 16 18 2 2.684 0.745 0.456 unchanged
## 617 9 12 3 2.684 1.118 0.264 unchanged
## 618 16 14 -2 2.684 -0.745 0.456 unchanged
## 619 5 3 -2 2.684 -0.745 0.456 unchanged
## 620 13 13 0 2.684 0.000 1 unchanged
## 621 12 12 0 2.684 0.000 1 unchanged
## 622 12 15 3 2.684 1.118 0.264 unchanged
## 623 18 16 -2 2.684 -0.745 0.456 unchanged
## 624 7 3 -4 2.684 -1.490 0.136 unchanged
## 625 3 2 -1 2.684 -0.373 0.709 unchanged
## 626 13 13 0 2.684 0.000 1 unchanged
## 627 13 11 -2 2.684 -0.745 0.456 unchanged
## 628 9 9 0 2.684 0.000 1 unchanged
## 629 5 6 1 2.684 0.373 0.709 unchanged
## 630 13 10 -3 2.684 -1.118 0.264 unchanged
## 631 13 8 -5 2.684 -1.863 0.062 unchanged
## 632 8 11 3 2.684 1.118 0.264 unchanged
## 633 13 8 -5 2.684 -1.863 0.062 unchanged
## 634 7 5 -2 2.684 -0.745 0.456 unchanged
## 635 5 5 0 2.684 0.000 1 unchanged
## 636 13 9 -4 2.684 -1.490 0.136 unchanged
## 637 11 9 -2 2.684 -0.745 0.456 unchanged
## 638 13 14 1 2.684 0.373 0.709 unchanged
## 639 18 18 0 2.684 0.000 1 unchanged
## 640 6 8 2 2.684 0.745 0.456 unchanged
## 641 7 7 0 2.684 0.000 1 unchanged
## 642 14 13 -1 2.684 -0.373 0.709 unchanged
## 643 15 18 3 2.684 1.118 0.264 unchanged
## 644 5 7 2 2.684 0.745 0.456 unchanged
## 645 13 11 -2 2.684 -0.745 0.456 unchanged
## 646 6 9 3 2.684 1.118 0.264 unchanged
## 647 12 14 2 2.684 0.745 0.456 unchanged
## 648 8 12 4 2.684 1.490 0.136 unchanged
## 649 10 13 3 2.684 1.118 0.264 unchanged
## 650 7 9 2 2.684 0.745 0.456 unchanged
## 651 1 4 3 2.684 1.118 0.264 unchanged
## 652 9 7 -2 2.684 -0.745 0.456 unchanged
## 653 14 10 -4 2.684 -1.490 0.136 unchanged
## 654 12 11 -1 2.684 -0.373 0.709 unchanged
## 655 5 5 0 2.684 0.000 1 unchanged
## 656 5 5 0 2.684 0.000 1 unchanged
## 657 9 12 3 2.684 1.118 0.264 unchanged
## 658 10 12 2 2.684 0.745 0.456 unchanged
## 659 6 3 -3 2.684 -1.118 0.264 unchanged
## 660 9 8 -1 2.684 -0.373 0.709 unchanged
## 661 8 9 1 2.684 0.373 0.709 unchanged
## 662 10 8 -2 2.684 -0.745 0.456 unchanged
## 663 13 10 -3 2.684 -1.118 0.264 unchanged
## 664 10 10 0 2.684 0.000 1 unchanged
## 665 3 5 2 2.684 0.745 0.456 unchanged
## 666 5 8 3 2.684 1.118 0.264 unchanged
## 667 10 5 -5 2.684 -1.863 0.062 unchanged
## 668 8 6 -2 2.684 -0.745 0.456 unchanged
## 669 2 2 0 2.684 0.000 1 unchanged
## 670 6 6 0 2.684 0.000 1 unchanged
## 671 3 7 4 2.684 1.490 0.136 unchanged
## 672 8 5 -3 2.684 -1.118 0.264 unchanged
## 673 14 14 0 2.684 0.000 1 unchanged
## 674 4 3 -1 2.684 -0.373 0.709 unchanged
## 675 5 4 -1 2.684 -0.373 0.709 unchanged
## 676 1 6 5 2.684 1.863 0.062 unchanged
## 677 1 1 0 2.684 0.000 1 unchanged
## 678 8 6 -2 2.684 -0.745 0.456 unchanged
## 679 8 8 0 2.684 0.000 1 unchanged
## 680 3 3 0 2.684 0.000 1 unchanged
## 681 10 7 -3 2.684 -1.118 0.264 unchanged
## 682 11 14 3 2.684 1.118 0.264 unchanged
## 683 11 11 0 2.684 0.000 1 unchanged
## 684 4 4 0 2.684 0.000 1 unchanged
## 685 9 8 -1 2.684 -0.373 0.709 unchanged
## 686 4 8 4 2.684 1.490 0.136 unchanged
## 687 10 11 1 2.684 0.373 0.709 unchanged
## 688 15 10 -5 2.684 -1.863 0.062 unchanged
## 689 11 14 3 2.684 1.118 0.264 unchanged
## 690 14 16 2 2.684 0.745 0.456 unchanged
## 691 8 11 3 2.684 1.118 0.264 unchanged
## 692 7 4 -3 2.684 -1.118 0.264 unchanged
## 693 4 4 0 2.684 0.000 1 unchanged
## 694 15 16 1 2.684 0.373 0.709 unchanged
## 695 6 6 0 2.684 0.000 1 unchanged
## 696 7 8 1 2.684 0.373 0.709 unchanged
## 697 10 8 -2 2.684 -0.745 0.456 unchanged
## 698 14 17 3 2.684 1.118 0.264 unchanged
## 699 13 16 3 2.684 1.118 0.264 unchanged
## 700 10 13 3 2.684 1.118 0.264 unchanged
## 701 2 1 -1 2.684 -0.373 0.709 unchanged
## 702 3 4 1 2.684 0.373 0.709 unchanged
## 703 8 8 0 2.684 0.000 1 unchanged
## 704 17 15 -2 2.684 -0.745 0.456 unchanged
## 705 2 5 3 2.684 1.118 0.264 unchanged
## 706 11 13 2 2.684 0.745 0.456 unchanged
## 707 11 8 -3 2.684 -1.118 0.264 unchanged
## 708 9 9 0 2.684 0.000 1 unchanged
## 709 8 6 -2 2.684 -0.745 0.456 unchanged
## 710 11 9 -2 2.684 -0.745 0.456 unchanged
## 711 16 16 0 2.684 0.000 1 unchanged
## 712 14 14 0 2.684 0.000 1 unchanged
## 713 3 1 -2 2.684 -0.745 0.456 unchanged
## 714 1 0 -1 2.684 -0.373 0.709 unchanged
## 715 16 12 -4 2.684 -1.490 0.136 unchanged
## 716 6 9 3 2.684 1.118 0.264 unchanged
## 717 16 11 -5 2.684 -1.863 0.062 unchanged
## 718 5 4 -1 2.684 -0.373 0.709 unchanged
## 719 9 8 -1 2.684 -0.373 0.709 unchanged
## 720 14 8 -6 2.684 -2.236 0.025 decreased
## 721 8 9 1 2.684 0.373 0.709 unchanged
## 722 5 6 1 2.684 0.373 0.709 unchanged
## 723 7 8 1 2.684 0.373 0.709 unchanged
## 724 14 15 1 2.684 0.373 0.709 unchanged
## 725 5 7 2 2.684 0.745 0.456 unchanged
## 726 4 8 4 2.684 1.490 0.136 unchanged
## 727 11 10 -1 2.684 -0.373 0.709 unchanged
## 728 16 14 -2 2.684 -0.745 0.456 unchanged
## 729 16 15 -1 2.684 -0.373 0.709 unchanged
## 730 14 12 -2 2.684 -0.745 0.456 unchanged
## 731 13 14 1 2.684 0.373 0.709 unchanged
## 732 11 10 -1 2.684 -0.373 0.709 unchanged
## 733 12 13 1 2.684 0.373 0.709 unchanged
## 734 7 10 3 2.684 1.118 0.264 unchanged
## 735 12 12 0 2.684 0.000 1 unchanged
## 736 15 15 0 2.684 0.000 1 unchanged
## 737 0 1 1 2.684 0.373 0.709 unchanged
## 738 12 7 -5 2.684 -1.863 0.062 unchanged
## 739 15 13 -2 2.684 -0.745 0.456 unchanged
## 740 2 4 2 2.684 0.745 0.456 unchanged
## 741 4 5 1 2.684 0.373 0.709 unchanged
## 742 0 1 1 2.684 0.373 0.709 unchanged
## 743 8 9 1 2.684 0.373 0.709 unchanged
## 744 1 1 0 2.684 0.000 1 unchanged
## 745 14 11 -3 2.684 -1.118 0.264 unchanged
## 746 6 6 0 2.684 0.000 1 unchanged
## 747 12 11 -1 2.684 -0.373 0.709 unchanged
## 748 4 6 2 2.684 0.745 0.456 unchanged
## 749 9 7 -2 2.684 -0.745 0.456 unchanged
## 750 2 13 11 2.684 4.099 0 increased
## 751 19 17 -2 2.684 -0.745 0.456 unchanged
## 752 14 12 -2 2.684 -0.745 0.456 unchanged
## 753 19 19 0 2.684 0.000 1 unchanged
## 754 16 14 -2 2.684 -0.745 0.456 unchanged
## 755 5 6 1 2.684 0.373 0.709 unchanged
## 756 3 4 1 2.684 0.373 0.709 unchanged
## 757 5 8 3 2.684 1.118 0.264 unchanged
## 758 11 15 4 2.684 1.490 0.136 unchanged
## 759 7 7 0 2.684 0.000 1 unchanged
## 760 5 2 -3 2.684 -1.118 0.264 unchanged
## 761 1 0 -1 2.684 -0.373 0.709 unchanged
## 762 12 8 -4 2.684 -1.490 0.136 unchanged
## 763 9 12 3 2.684 1.118 0.264 unchanged
## 764 8 6 -2 2.684 -0.745 0.456 unchanged
## 765 16 16 0 2.684 0.000 1 unchanged
## 766 9 7 -2 2.684 -0.745 0.456 unchanged
## 767 4 5 1 2.684 0.373 0.709 unchanged
## 768 4 7 3 2.684 1.118 0.264 unchanged
## 769 11 14 3 2.684 1.118 0.264 unchanged
## 770 4 4 0 2.684 0.000 1 unchanged
## 771 14 8 -6 2.684 -2.236 0.025 decreased
## 772 16 16 0 2.684 0.000 1 unchanged
## 773 10 12 2 2.684 0.745 0.456 unchanged
## 774 8 10 2 2.684 0.745 0.456 unchanged
## 775 8 9 1 2.684 0.373 0.709 unchanged
## 776 13 12 -1 2.684 -0.373 0.709 unchanged
## 777 6 4 -2 2.684 -0.745 0.456 unchanged
## 778 12 17 5 2.684 1.863 0.062 unchanged
## 779 4 2 -2 2.684 -0.745 0.456 unchanged
## 780 9 12 3 2.684 1.118 0.264 unchanged
## 781 11 9 -2 2.684 -0.745 0.456 unchanged
## 782 11 13 2 2.684 0.745 0.456 unchanged
## 783 4 3 -1 2.684 -0.373 0.709 unchanged
## 784 2 3 1 2.684 0.373 0.709 unchanged
## 785 4 7 3 2.684 1.118 0.264 unchanged
## 786 15 17 2 2.684 0.745 0.456 unchanged
## 787 5 3 -2 2.684 -0.745 0.456 unchanged
## 788 14 12 -2 2.684 -0.745 0.456 unchanged
## 789 10 14 4 2.684 1.490 0.136 unchanged
## 790 19 15 -4 2.684 -1.490 0.136 unchanged
## 791 11 8 -3 2.684 -1.118 0.264 unchanged
## 792 15 13 -2 2.684 -0.745 0.456 unchanged
## 793 6 5 -1 2.684 -0.373 0.709 unchanged
## 794 1 3 2 2.684 0.745 0.456 unchanged
## 795 9 9 0 2.684 0.000 1 unchanged
## 796 9 9 0 2.684 0.000 1 unchanged
## 797 7 8 1 2.684 0.373 0.709 unchanged
## 798 8 13 5 2.684 1.863 0.062 unchanged
## 799 11 10 -1 2.684 -0.373 0.709 unchanged
## 800 6 8 2 2.684 0.745 0.456 unchanged
## 801 14 15 1 2.684 0.373 0.709 unchanged
## 802 8 10 2 2.684 0.745 0.456 unchanged
## 803 5 10 5 2.684 1.863 0.062 unchanged
## 804 16 14 -2 2.684 -0.745 0.456 unchanged
## 805 17 18 1 2.684 0.373 0.709 unchanged
## 806 3 5 2 2.684 0.745 0.456 unchanged
## 807 12 13 1 2.684 0.373 0.709 unchanged
## 808 12 12 0 2.684 0.000 1 unchanged
## 809 8 8 0 2.684 0.000 1 unchanged
## 810 8 5 -3 2.684 -1.118 0.264 unchanged
## 811 17 14 -3 2.684 -1.118 0.264 unchanged
## 812 14 11 -3 2.684 -1.118 0.264 unchanged
## 813 17 13 -4 2.684 -1.490 0.136 unchanged
## 814 6 5 -1 2.684 -0.373 0.709 unchanged
## 815 7 10 3 2.684 1.118 0.264 unchanged
## 816 8 6 -2 2.684 -0.745 0.456 unchanged
## 817 6 11 5 2.684 1.863 0.062 unchanged
## 818 8 11 3 2.684 1.118 0.264 unchanged
## 819 5 5 0 2.684 0.000 1 unchanged
## 820 6 4 -2 2.684 -0.745 0.456 unchanged
## 821 10 13 3 2.684 1.118 0.264 unchanged
## 822 16 18 2 2.684 0.745 0.456 unchanged
## 823 2 3 1 2.684 0.373 0.709 unchanged
## 824 9 8 -1 2.684 -0.373 0.709 unchanged
## 825 9 10 1 2.684 0.373 0.709 unchanged
## 826 11 11 0 2.684 0.000 1 unchanged
## 827 4 5 1 2.684 0.373 0.709 unchanged
## 828 1 5 4 2.684 1.490 0.136 unchanged
## 829 16 16 0 2.684 0.000 1 unchanged
## 830 5 10 5 2.684 1.863 0.062 unchanged
## 831 3 4 1 2.684 0.373 0.709 unchanged
## 832 19 18 -1 2.684 -0.373 0.709 unchanged
## 833 13 10 -3 2.684 -1.118 0.264 unchanged
## 834 15 18 3 2.684 1.118 0.264 unchanged
## 835 12 11 -1 2.684 -0.373 0.709 unchanged
## 836 15 13 -2 2.684 -0.745 0.456 unchanged
## 837 12 10 -2 2.684 -0.745 0.456 unchanged
## 838 0 2 2 2.684 0.745 0.456 unchanged
## 839 12 10 -2 2.684 -0.745 0.456 unchanged
## 840 9 14 5 2.684 1.863 0.062 unchanged
## 841 6 13 7 2.684 2.608 0.009 increased
## 842 11 11 0 2.684 0.000 1 unchanged
## 843 3 4 1 2.684 0.373 0.709 unchanged
## 844 5 8 3 2.684 1.118 0.264 unchanged
## 845 10 12 2 2.684 0.745 0.456 unchanged
## 846 14 11 -3 2.684 -1.118 0.264 unchanged
## 847 7 9 2 2.684 0.745 0.456 unchanged
## 848 6 4 -2 2.684 -0.745 0.456 unchanged
## 849 14 9 -5 2.684 -1.863 0.062 unchanged
## 850 13 18 5 2.684 1.863 0.062 unchanged
## 851 16 16 0 2.684 0.000 1 unchanged
## 852 11 6 -5 2.684 -1.863 0.062 unchanged
## 853 11 6 -5 2.684 -1.863 0.062 unchanged
## 854 1 3 2 2.684 0.745 0.456 unchanged
## 855 11 9 -2 2.684 -0.745 0.456 unchanged
## 856 4 2 -2 2.684 -0.745 0.456 unchanged
## 857 8 6 -2 2.684 -0.745 0.456 unchanged
## 858 6 6 0 2.684 0.000 1 unchanged
## 859 11 7 -4 2.684 -1.490 0.136 unchanged
## 860 5 4 -1 2.684 -0.373 0.709 unchanged
## 861 7 4 -3 2.684 -1.118 0.264 unchanged
## 862 4 4 0 2.684 0.000 1 unchanged
## 863 17 15 -2 2.684 -0.745 0.456 unchanged
## 864 13 15 2 2.684 0.745 0.456 unchanged
## 865 9 4 -5 2.684 -1.863 0.062 unchanged
## 866 3 5 2 2.684 0.745 0.456 unchanged
## 867 7 5 -2 2.684 -0.745 0.456 unchanged
## 868 9 7 -2 2.684 -0.745 0.456 unchanged
## 869 8 7 -1 2.684 -0.373 0.709 unchanged
## 870 8 11 3 2.684 1.118 0.264 unchanged
## 871 12 14 2 2.684 0.745 0.456 unchanged
## 872 6 7 1 2.684 0.373 0.709 unchanged
## 873 13 12 -1 2.684 -0.373 0.709 unchanged
## 874 10 10 0 2.684 0.000 1 unchanged
## 875 16 17 1 2.684 0.373 0.709 unchanged
## 876 15 17 2 2.684 0.745 0.456 unchanged
## 877 6 4 -2 2.684 -0.745 0.456 unchanged
## 878 8 6 -2 2.684 -0.745 0.456 unchanged
## 879 14 13 -1 2.684 -0.373 0.709 unchanged
## 880 16 15 -1 2.684 -0.373 0.709 unchanged
## 881 7 3 -4 2.684 -1.490 0.136 unchanged
## 882 6 5 -1 2.684 -0.373 0.709 unchanged
## 883 11 9 -2 2.684 -0.745 0.456 unchanged
## 884 3 0 -3 2.684 -1.118 0.264 unchanged
## 885 5 6 1 2.684 0.373 0.709 unchanged
## 886 13 13 0 2.684 0.000 1 unchanged
## 887 11 9 -2 2.684 -0.745 0.456 unchanged
## 888 12 13 1 2.684 0.373 0.709 unchanged
## 889 0 1 1 2.684 0.373 0.709 unchanged
## 890 16 17 1 2.684 0.373 0.709 unchanged
## 891 5 2 -3 2.684 -1.118 0.264 unchanged
## 892 13 11 -2 2.684 -0.745 0.456 unchanged
## 893 7 4 -3 2.684 -1.118 0.264 unchanged
## 894 4 3 -1 2.684 -0.373 0.709 unchanged
## 895 2 1 -1 2.684 -0.373 0.709 unchanged
## 896 10 15 5 2.684 1.863 0.062 unchanged
## 897 13 12 -1 2.684 -0.373 0.709 unchanged
## 898 13 9 -4 2.684 -1.490 0.136 unchanged
## 899 20 19 -1 2.684 -0.373 0.709 unchanged
## 900 7 6 -1 2.684 -0.373 0.709 unchanged
## 901 16 14 -2 2.684 -0.745 0.456 unchanged
## 902 6 4 -2 2.684 -0.745 0.456 unchanged
## 903 13 11 -2 2.684 -0.745 0.456 unchanged
## 904 4 3 -1 2.684 -0.373 0.709 unchanged
## 905 7 5 -2 2.684 -0.745 0.456 unchanged
## 906 7 7 0 2.684 0.000 1 unchanged
## 907 11 11 0 2.684 0.000 1 unchanged
## 908 9 5 -4 2.684 -1.490 0.136 unchanged
## 909 12 9 -3 2.684 -1.118 0.264 unchanged
## 910 8 13 5 2.684 1.863 0.062 unchanged
## 911 6 13 7 2.684 2.608 0.009 increased
## 912 11 7 -4 2.684 -1.490 0.136 unchanged
## 913 3 6 3 2.684 1.118 0.264 unchanged
## 914 9 12 3 2.684 1.118 0.264 unchanged
## 915 18 18 0 2.684 0.000 1 unchanged
## 916 18 18 0 2.684 0.000 1 unchanged
## 917 14 15 1 2.684 0.373 0.709 unchanged
## 918 11 11 0 2.684 0.000 1 unchanged
## 919 7 7 0 2.684 0.000 1 unchanged
## 920 10 4 -6 2.684 -2.236 0.025 decreased
## 921 19 18 -1 2.684 -0.373 0.709 unchanged
## 922 12 8 -4 2.684 -1.490 0.136 unchanged
## 923 6 7 1 2.684 0.373 0.709 unchanged
## 924 5 6 1 2.684 0.373 0.709 unchanged
## 925 5 4 -1 2.684 -0.373 0.709 unchanged
## 926 12 10 -2 2.684 -0.745 0.456 unchanged
## 927 8 9 1 2.684 0.373 0.709 unchanged
## 928 10 5 -5 2.684 -1.863 0.062 unchanged
## 929 12 17 5 2.684 1.863 0.062 unchanged
## 930 13 10 -3 2.684 -1.118 0.264 unchanged
## 931 14 10 -4 2.684 -1.490 0.136 unchanged
## 932 4 2 -2 2.684 -0.745 0.456 unchanged
## 933 13 12 -1 2.684 -0.373 0.709 unchanged
## 934 12 8 -4 2.684 -1.490 0.136 unchanged
## 935 9 8 -1 2.684 -0.373 0.709 unchanged
## 936 4 3 -1 2.684 -0.373 0.709 unchanged
## 937 13 12 -1 2.684 -0.373 0.709 unchanged
## 938 10 4 -6 2.684 -2.236 0.025 decreased
## 939 7 5 -2 2.684 -0.745 0.456 unchanged
## 940 6 12 6 2.684 2.236 0.025 increased
## 941 12 17 5 2.684 1.863 0.062 unchanged
## 942 0 1 1 2.684 0.373 0.709 unchanged
## 943 9 5 -4 2.684 -1.490 0.136 unchanged
## 944 5 8 3 2.684 1.118 0.264 unchanged
## 945 4 5 1 2.684 0.373 0.709 unchanged
## 946 17 19 2 2.684 0.745 0.456 unchanged
## 947 11 9 -2 2.684 -0.745 0.456 unchanged
## 948 13 14 1 2.684 0.373 0.709 unchanged
## 949 5 9 4 2.684 1.490 0.136 unchanged
## 950 11 14 3 2.684 1.118 0.264 unchanged
## 951 8 7 -1 2.684 -0.373 0.709 unchanged
## 952 6 9 3 2.684 1.118 0.264 unchanged
## 953 9 1 -8 2.684 -2.981 0.003 decreased
## 954 11 8 -3 2.684 -1.118 0.264 unchanged
## 955 10 13 3 2.684 1.118 0.264 unchanged
## 956 4 3 -1 2.684 -0.373 0.709 unchanged
## 957 3 4 1 2.684 0.373 0.709 unchanged
## 958 7 11 4 2.684 1.490 0.136 unchanged
## 959 13 14 1 2.684 0.373 0.709 unchanged
## 960 18 17 -1 2.684 -0.373 0.709 unchanged
## 961 13 13 0 2.684 0.000 1 unchanged
## 962 20 19 -1 2.684 -0.373 0.709 unchanged
## 963 8 4 -4 2.684 -1.490 0.136 unchanged
## 964 15 15 0 2.684 0.000 1 unchanged
## 965 11 8 -3 2.684 -1.118 0.264 unchanged
## 966 14 17 3 2.684 1.118 0.264 unchanged
## 967 14 9 -5 2.684 -1.863 0.062 unchanged
## 968 9 10 1 2.684 0.373 0.709 unchanged
## 969 10 8 -2 2.684 -0.745 0.456 unchanged
## 970 16 15 -1 2.684 -0.373 0.709 unchanged
## 971 13 14 1 2.684 0.373 0.709 unchanged
## 972 3 3 0 2.684 0.000 1 unchanged
## 973 12 13 1 2.684 0.373 0.709 unchanged
## 974 8 6 -2 2.684 -0.745 0.456 unchanged
## 975 9 11 2 2.684 0.745 0.456 unchanged
## 976 9 11 2 2.684 0.745 0.456 unchanged
## 977 4 4 0 2.684 0.000 1 unchanged
## 978 8 7 -1 2.684 -0.373 0.709 unchanged
## 979 9 10 1 2.684 0.373 0.709 unchanged
## 980 15 17 2 2.684 0.745 0.456 unchanged
## 981 10 9 -1 2.684 -0.373 0.709 unchanged
## 982 15 12 -3 2.684 -1.118 0.264 unchanged
## 983 7 10 3 2.684 1.118 0.264 unchanged
## 984 15 16 1 2.684 0.373 0.709 unchanged
## 985 13 13 0 2.684 0.000 1 unchanged
## 986 2 6 4 2.684 1.490 0.136 unchanged
## 987 8 9 1 2.684 0.373 0.709 unchanged
## 988 9 9 0 2.684 0.000 1 unchanged
## 989 16 11 -5 2.684 -1.863 0.062 unchanged
## 990 13 10 -3 2.684 -1.118 0.264 unchanged
## 991 3 4 1 2.684 0.373 0.709 unchanged
## 992 1 6 5 2.684 1.863 0.062 unchanged
## 993 11 12 1 2.684 0.373 0.709 unchanged
## 994 5 2 -3 2.684 -1.118 0.264 unchanged
## 995 5 9 4 2.684 1.490 0.136 unchanged
## 996 12 8 -4 2.684 -1.490 0.136 unchanged
## 997 2 0 -2 2.684 -0.745 0.456 unchanged
## 998 2 2 0 2.684 0.000 1 unchanged
## 999 17 19 2 2.684 0.745 0.456 unchanged
## 1000 3 1 -2 2.684 -0.745 0.456 unchanged
# allows SEM.post != SEM.pre
(istats.post <- itemstats(dat_post)$overall)
## N mean_total.score sd_total.score ave.r sd.r alpha SEM.alpha
## 1000 9.125 4.628 0.199 0.053 0.833 1.889
SEM.alpha.post <- istats.post$SEM.alpha
RCI(predat = dat_pre, postdat = dat_post,
SEM.pre=SEM.alpha, SEM.post=SEM.alpha.post)
## pre.score post.score diff SEM z p
## 1 12 10 -2 2.678 -0.747 0.455
## 2 5 5 0 2.678 0.000 1
## 3 10 6 -4 2.678 -1.494 0.135
## 4 9 10 1 2.678 0.373 0.709
## 5 17 15 -2 2.678 -0.747 0.455
## 6 14 12 -2 2.678 -0.747 0.455
## 7 11 13 2 2.678 0.747 0.455
## 8 6 8 2 2.678 0.747 0.455
## 9 11 14 3 2.678 1.120 0.263
## 10 8 10 2 2.678 0.747 0.455
## 11 11 9 -2 2.678 -0.747 0.455
## 12 15 16 1 2.678 0.373 0.709
## 13 16 13 -3 2.678 -1.120 0.263
## 14 9 6 -3 2.678 -1.120 0.263
## 15 8 6 -2 2.678 -0.747 0.455
## 16 10 10 0 2.678 0.000 1
## 17 2 2 0 2.678 0.000 1
## 18 8 11 3 2.678 1.120 0.263
## 19 9 8 -1 2.678 -0.373 0.709
## 20 14 16 2 2.678 0.747 0.455
## 21 3 2 -1 2.678 -0.373 0.709
## 22 11 13 2 2.678 0.747 0.455
## 23 2 2 0 2.678 0.000 1
## 24 1 2 1 2.678 0.373 0.709
## 25 10 8 -2 2.678 -0.747 0.455
## 26 2 2 0 2.678 0.000 1
## 27 10 10 0 2.678 0.000 1
## 28 1 2 1 2.678 0.373 0.709
## 29 1 1 0 2.678 0.000 1
## 30 14 7 -7 2.678 -2.614 0.009
## 31 5 3 -2 2.678 -0.747 0.455
## 32 2 1 -1 2.678 -0.373 0.709
## 33 4 7 3 2.678 1.120 0.263
## 34 7 4 -3 2.678 -1.120 0.263
## 35 5 3 -2 2.678 -0.747 0.455
## 36 1 7 6 2.678 2.241 0.025
## 37 8 7 -1 2.678 -0.373 0.709
## 38 4 4 0 2.678 0.000 1
## 39 15 17 2 2.678 0.747 0.455
## 40 13 12 -1 2.678 -0.373 0.709
## 41 12 11 -1 2.678 -0.373 0.709
## 42 14 14 0 2.678 0.000 1
## 43 12 15 3 2.678 1.120 0.263
## 44 11 11 0 2.678 0.000 1
## 45 6 3 -3 2.678 -1.120 0.263
## 46 1 1 0 2.678 0.000 1
## 47 17 12 -5 2.678 -1.867 0.062
## 48 9 8 -1 2.678 -0.373 0.709
## 49 13 15 2 2.678 0.747 0.455
## 50 13 11 -2 2.678 -0.747 0.455
## 51 12 11 -1 2.678 -0.373 0.709
## 52 19 19 0 2.678 0.000 1
## 53 8 8 0 2.678 0.000 1
## 54 4 1 -3 2.678 -1.120 0.263
## 55 7 9 2 2.678 0.747 0.455
## 56 5 6 1 2.678 0.373 0.709
## 57 12 10 -2 2.678 -0.747 0.455
## 58 14 13 -1 2.678 -0.373 0.709
## 59 13 10 -3 2.678 -1.120 0.263
## 60 14 17 3 2.678 1.120 0.263
## 61 4 5 1 2.678 0.373 0.709
## 62 13 11 -2 2.678 -0.747 0.455
## 63 6 7 1 2.678 0.373 0.709
## 64 6 11 5 2.678 1.867 0.062
## 65 6 3 -3 2.678 -1.120 0.263
## 66 5 1 -4 2.678 -1.494 0.135
## 67 15 18 3 2.678 1.120 0.263
## 68 8 15 7 2.678 2.614 0.009
## 69 3 7 4 2.678 1.494 0.135
## 70 11 15 4 2.678 1.494 0.135
## 71 6 6 0 2.678 0.000 1
## 72 5 7 2 2.678 0.747 0.455
## 73 13 11 -2 2.678 -0.747 0.455
## 74 10 6 -4 2.678 -1.494 0.135
## 75 15 15 0 2.678 0.000 1
## 76 8 13 5 2.678 1.867 0.062
## 77 4 3 -1 2.678 -0.373 0.709
## 78 5 6 1 2.678 0.373 0.709
## 79 7 5 -2 2.678 -0.747 0.455
## 80 6 1 -5 2.678 -1.867 0.062
## 81 4 4 0 2.678 0.000 1
## 82 11 12 1 2.678 0.373 0.709
## 83 3 4 1 2.678 0.373 0.709
## 84 7 9 2 2.678 0.747 0.455
## 85 5 6 1 2.678 0.373 0.709
## 86 14 13 -1 2.678 -0.373 0.709
## 87 10 7 -3 2.678 -1.120 0.263
## 88 15 18 3 2.678 1.120 0.263
## 89 16 15 -1 2.678 -0.373 0.709
## 90 5 12 7 2.678 2.614 0.009
## 91 5 7 2 2.678 0.747 0.455
## 92 12 13 1 2.678 0.373 0.709
## 93 2 5 3 2.678 1.120 0.263
## 94 9 4 -5 2.678 -1.867 0.062
## 95 0 2 2 2.678 0.747 0.455
## 96 1 3 2 2.678 0.747 0.455
## 97 10 15 5 2.678 1.867 0.062
## 98 8 5 -3 2.678 -1.120 0.263
## 99 7 11 4 2.678 1.494 0.135
## 100 7 5 -2 2.678 -0.747 0.455
## 101 12 10 -2 2.678 -0.747 0.455
## 102 8 11 3 2.678 1.120 0.263
## 103 18 18 0 2.678 0.000 1
## 104 17 12 -5 2.678 -1.867 0.062
## 105 16 15 -1 2.678 -0.373 0.709
## 106 2 2 0 2.678 0.000 1
## 107 8 9 1 2.678 0.373 0.709
## 108 5 3 -2 2.678 -0.747 0.455
## 109 1 1 0 2.678 0.000 1
## 110 6 5 -1 2.678 -0.373 0.709
## 111 3 4 1 2.678 0.373 0.709
## 112 11 12 1 2.678 0.373 0.709
## 113 12 12 0 2.678 0.000 1
## 114 6 5 -1 2.678 -0.373 0.709
## 115 11 13 2 2.678 0.747 0.455
## 116 13 13 0 2.678 0.000 1
## 117 4 7 3 2.678 1.120 0.263
## 118 2 3 1 2.678 0.373 0.709
## 119 11 9 -2 2.678 -0.747 0.455
## 120 5 10 5 2.678 1.867 0.062
## 121 16 17 1 2.678 0.373 0.709
## 122 2 3 1 2.678 0.373 0.709
## 123 18 15 -3 2.678 -1.120 0.263
## 124 9 10 1 2.678 0.373 0.709
## 125 15 10 -5 2.678 -1.867 0.062
## 126 17 18 1 2.678 0.373 0.709
## 127 15 18 3 2.678 1.120 0.263
## 128 3 8 5 2.678 1.867 0.062
## 129 16 13 -3 2.678 -1.120 0.263
## 130 10 6 -4 2.678 -1.494 0.135
## 131 15 17 2 2.678 0.747 0.455
## 132 8 4 -4 2.678 -1.494 0.135
## 133 4 4 0 2.678 0.000 1
## 134 17 17 0 2.678 0.000 1
## 135 6 9 3 2.678 1.120 0.263
## 136 7 3 -4 2.678 -1.494 0.135
## 137 3 8 5 2.678 1.867 0.062
## 138 4 8 4 2.678 1.494 0.135
## 139 14 18 4 2.678 1.494 0.135
## 140 9 2 -7 2.678 -2.614 0.009
## 141 16 15 -1 2.678 -0.373 0.709
## 142 9 5 -4 2.678 -1.494 0.135
## 143 19 17 -2 2.678 -0.747 0.455
## 144 9 10 1 2.678 0.373 0.709
## 145 7 5 -2 2.678 -0.747 0.455
## 146 15 15 0 2.678 0.000 1
## 147 10 7 -3 2.678 -1.120 0.263
## 148 6 4 -2 2.678 -0.747 0.455
## 149 11 8 -3 2.678 -1.120 0.263
## 150 9 9 0 2.678 0.000 1
## 151 10 7 -3 2.678 -1.120 0.263
## 152 7 9 2 2.678 0.747 0.455
## 153 14 12 -2 2.678 -0.747 0.455
## 154 10 13 3 2.678 1.120 0.263
## 155 13 10 -3 2.678 -1.120 0.263
## 156 10 7 -3 2.678 -1.120 0.263
## 157 12 12 0 2.678 0.000 1
## 158 14 11 -3 2.678 -1.120 0.263
## 159 6 6 0 2.678 0.000 1
## 160 4 4 0 2.678 0.000 1
## 161 6 5 -1 2.678 -0.373 0.709
## 162 3 2 -1 2.678 -0.373 0.709
## 163 4 4 0 2.678 0.000 1
## 164 18 18 0 2.678 0.000 1
## 165 12 8 -4 2.678 -1.494 0.135
## 166 2 2 0 2.678 0.000 1
## 167 6 3 -3 2.678 -1.120 0.263
## 168 2 5 3 2.678 1.120 0.263
## 169 9 11 2 2.678 0.747 0.455
## 170 5 4 -1 2.678 -0.373 0.709
## 171 19 18 -1 2.678 -0.373 0.709
## 172 11 12 1 2.678 0.373 0.709
## 173 9 3 -6 2.678 -2.241 0.025
## 174 18 14 -4 2.678 -1.494 0.135
## 175 11 13 2 2.678 0.747 0.455
## 176 16 18 2 2.678 0.747 0.455
## 177 9 7 -2 2.678 -0.747 0.455
## 178 10 14 4 2.678 1.494 0.135
## 179 13 9 -4 2.678 -1.494 0.135
## 180 3 5 2 2.678 0.747 0.455
## 181 11 12 1 2.678 0.373 0.709
## 182 13 11 -2 2.678 -0.747 0.455
## 183 14 15 1 2.678 0.373 0.709
## 184 15 16 1 2.678 0.373 0.709
## 185 6 4 -2 2.678 -0.747 0.455
## 186 16 19 3 2.678 1.120 0.263
## 187 19 19 0 2.678 0.000 1
## 188 14 15 1 2.678 0.373 0.709
## 189 5 7 2 2.678 0.747 0.455
## 190 5 6 1 2.678 0.373 0.709
## 191 11 9 -2 2.678 -0.747 0.455
## 192 11 8 -3 2.678 -1.120 0.263
## 193 4 4 0 2.678 0.000 1
## 194 15 9 -6 2.678 -2.241 0.025
## 195 6 8 2 2.678 0.747 0.455
## 196 13 8 -5 2.678 -1.867 0.062
## 197 9 11 2 2.678 0.747 0.455
## 198 8 6 -2 2.678 -0.747 0.455
## 199 16 17 1 2.678 0.373 0.709
## 200 5 10 5 2.678 1.867 0.062
## 201 3 5 2 2.678 0.747 0.455
## 202 14 15 1 2.678 0.373 0.709
## 203 4 8 4 2.678 1.494 0.135
## 204 9 7 -2 2.678 -0.747 0.455
## 205 5 2 -3 2.678 -1.120 0.263
## 206 18 15 -3 2.678 -1.120 0.263
## 207 3 3 0 2.678 0.000 1
## 208 17 17 0 2.678 0.000 1
## 209 7 7 0 2.678 0.000 1
## 210 11 9 -2 2.678 -0.747 0.455
## 211 2 5 3 2.678 1.120 0.263
## 212 11 12 1 2.678 0.373 0.709
## 213 6 4 -2 2.678 -0.747 0.455
## 214 6 7 1 2.678 0.373 0.709
## 215 8 6 -2 2.678 -0.747 0.455
## 216 15 15 0 2.678 0.000 1
## 217 3 3 0 2.678 0.000 1
## 218 14 12 -2 2.678 -0.747 0.455
## 219 10 7 -3 2.678 -1.120 0.263
## 220 9 13 4 2.678 1.494 0.135
## 221 3 5 2 2.678 0.747 0.455
## 222 6 10 4 2.678 1.494 0.135
## 223 14 13 -1 2.678 -0.373 0.709
## 224 18 18 0 2.678 0.000 1
## 225 17 14 -3 2.678 -1.120 0.263
## 226 8 9 1 2.678 0.373 0.709
## 227 8 9 1 2.678 0.373 0.709
## 228 17 11 -6 2.678 -2.241 0.025
## 229 3 4 1 2.678 0.373 0.709
## 230 7 8 1 2.678 0.373 0.709
## 231 7 10 3 2.678 1.120 0.263
## 232 7 9 2 2.678 0.747 0.455
## 233 12 14 2 2.678 0.747 0.455
## 234 17 13 -4 2.678 -1.494 0.135
## 235 16 13 -3 2.678 -1.120 0.263
## 236 4 3 -1 2.678 -0.373 0.709
## 237 12 11 -1 2.678 -0.373 0.709
## 238 3 9 6 2.678 2.241 0.025
## 239 2 4 2 2.678 0.747 0.455
## 240 8 7 -1 2.678 -0.373 0.709
## 241 10 13 3 2.678 1.120 0.263
## 242 2 6 4 2.678 1.494 0.135
## 243 18 19 1 2.678 0.373 0.709
## 244 11 11 0 2.678 0.000 1
## 245 11 11 0 2.678 0.000 1
## 246 17 15 -2 2.678 -0.747 0.455
## 247 15 18 3 2.678 1.120 0.263
## 248 14 9 -5 2.678 -1.867 0.062
## 249 9 4 -5 2.678 -1.867 0.062
## 250 14 13 -1 2.678 -0.373 0.709
## 251 16 7 -9 2.678 -3.361 0.001
## 252 15 14 -1 2.678 -0.373 0.709
## 253 12 11 -1 2.678 -0.373 0.709
## 254 3 4 1 2.678 0.373 0.709
## 255 12 12 0 2.678 0.000 1
## 256 7 11 4 2.678 1.494 0.135
## 257 5 5 0 2.678 0.000 1
## 258 8 8 0 2.678 0.000 1
## 259 6 6 0 2.678 0.000 1
## 260 12 12 0 2.678 0.000 1
## 261 13 15 2 2.678 0.747 0.455
## 262 9 13 4 2.678 1.494 0.135
## 263 13 8 -5 2.678 -1.867 0.062
## 264 6 9 3 2.678 1.120 0.263
## 265 8 11 3 2.678 1.120 0.263
## 266 11 9 -2 2.678 -0.747 0.455
## 267 10 12 2 2.678 0.747 0.455
## 268 18 16 -2 2.678 -0.747 0.455
## 269 4 4 0 2.678 0.000 1
## 270 9 14 5 2.678 1.867 0.062
## 271 14 16 2 2.678 0.747 0.455
## 272 8 7 -1 2.678 -0.373 0.709
## 273 7 6 -1 2.678 -0.373 0.709
## 274 16 15 -1 2.678 -0.373 0.709
## 275 8 15 7 2.678 2.614 0.009
## 276 15 16 1 2.678 0.373 0.709
## 277 15 14 -1 2.678 -0.373 0.709
## 278 13 9 -4 2.678 -1.494 0.135
## 279 8 9 1 2.678 0.373 0.709
## 280 5 9 4 2.678 1.494 0.135
## 281 13 9 -4 2.678 -1.494 0.135
## 282 13 10 -3 2.678 -1.120 0.263
## 283 9 13 4 2.678 1.494 0.135
## 284 5 4 -1 2.678 -0.373 0.709
## 285 4 6 2 2.678 0.747 0.455
## 286 2 6 4 2.678 1.494 0.135
## 287 3 2 -1 2.678 -0.373 0.709
## 288 9 7 -2 2.678 -0.747 0.455
## 289 7 10 3 2.678 1.120 0.263
## 290 8 5 -3 2.678 -1.120 0.263
## 291 9 6 -3 2.678 -1.120 0.263
## 292 4 3 -1 2.678 -0.373 0.709
## 293 14 17 3 2.678 1.120 0.263
## 294 15 18 3 2.678 1.120 0.263
## 295 3 4 1 2.678 0.373 0.709
## 296 1 4 3 2.678 1.120 0.263
## 297 12 10 -2 2.678 -0.747 0.455
## 298 5 8 3 2.678 1.120 0.263
## 299 12 12 0 2.678 0.000 1
## 300 8 10 2 2.678 0.747 0.455
## 301 6 5 -1 2.678 -0.373 0.709
## 302 5 7 2 2.678 0.747 0.455
## 303 14 15 1 2.678 0.373 0.709
## 304 11 8 -3 2.678 -1.120 0.263
## 305 4 2 -2 2.678 -0.747 0.455
## 306 11 11 0 2.678 0.000 1
## 307 13 11 -2 2.678 -0.747 0.455
## 308 9 13 4 2.678 1.494 0.135
## 309 4 6 2 2.678 0.747 0.455
## 310 13 11 -2 2.678 -0.747 0.455
## 311 10 12 2 2.678 0.747 0.455
## 312 8 9 1 2.678 0.373 0.709
## 313 16 12 -4 2.678 -1.494 0.135
## 314 8 9 1 2.678 0.373 0.709
## 315 2 1 -1 2.678 -0.373 0.709
## 316 13 11 -2 2.678 -0.747 0.455
## 317 15 8 -7 2.678 -2.614 0.009
## 318 7 4 -3 2.678 -1.120 0.263
## 319 16 15 -1 2.678 -0.373 0.709
## 320 12 11 -1 2.678 -0.373 0.709
## 321 2 1 -1 2.678 -0.373 0.709
## 322 14 15 1 2.678 0.373 0.709
## 323 1 2 1 2.678 0.373 0.709
## 324 10 11 1 2.678 0.373 0.709
## 325 8 9 1 2.678 0.373 0.709
## 326 13 14 1 2.678 0.373 0.709
## 327 15 16 1 2.678 0.373 0.709
## 328 16 11 -5 2.678 -1.867 0.062
## 329 7 7 0 2.678 0.000 1
## 330 8 9 1 2.678 0.373 0.709
## 331 14 10 -4 2.678 -1.494 0.135
## 332 5 8 3 2.678 1.120 0.263
## 333 11 15 4 2.678 1.494 0.135
## 334 5 7 2 2.678 0.747 0.455
## 335 0 4 4 2.678 1.494 0.135
## 336 3 4 1 2.678 0.373 0.709
## 337 9 4 -5 2.678 -1.867 0.062
## 338 10 9 -1 2.678 -0.373 0.709
## 339 12 16 4 2.678 1.494 0.135
## 340 14 17 3 2.678 1.120 0.263
## 341 9 8 -1 2.678 -0.373 0.709
## 342 6 8 2 2.678 0.747 0.455
## 343 7 3 -4 2.678 -1.494 0.135
## 344 16 18 2 2.678 0.747 0.455
## 345 14 7 -7 2.678 -2.614 0.009
## 346 12 6 -6 2.678 -2.241 0.025
## 347 14 14 0 2.678 0.000 1
## 348 15 15 0 2.678 0.000 1
## 349 7 3 -4 2.678 -1.494 0.135
## 350 8 9 1 2.678 0.373 0.709
## 351 5 2 -3 2.678 -1.120 0.263
## 352 8 6 -2 2.678 -0.747 0.455
## 353 17 18 1 2.678 0.373 0.709
## 354 7 8 1 2.678 0.373 0.709
## 355 12 10 -2 2.678 -0.747 0.455
## 356 11 12 1 2.678 0.373 0.709
## 357 15 12 -3 2.678 -1.120 0.263
## 358 5 7 2 2.678 0.747 0.455
## 359 10 8 -2 2.678 -0.747 0.455
## 360 14 14 0 2.678 0.000 1
## 361 10 11 1 2.678 0.373 0.709
## 362 10 9 -1 2.678 -0.373 0.709
## 363 14 14 0 2.678 0.000 1
## 364 17 15 -2 2.678 -0.747 0.455
## 365 8 7 -1 2.678 -0.373 0.709
## 366 17 11 -6 2.678 -2.241 0.025
## 367 5 3 -2 2.678 -0.747 0.455
## 368 2 1 -1 2.678 -0.373 0.709
## 369 2 1 -1 2.678 -0.373 0.709
## 370 12 12 0 2.678 0.000 1
## 371 11 11 0 2.678 0.000 1
## 372 4 7 3 2.678 1.120 0.263
## 373 16 11 -5 2.678 -1.867 0.062
## 374 4 4 0 2.678 0.000 1
## 375 6 4 -2 2.678 -0.747 0.455
## 376 5 7 2 2.678 0.747 0.455
## 377 12 11 -1 2.678 -0.373 0.709
## 378 12 16 4 2.678 1.494 0.135
## 379 16 18 2 2.678 0.747 0.455
## 380 14 12 -2 2.678 -0.747 0.455
## 381 6 5 -1 2.678 -0.373 0.709
## 382 10 12 2 2.678 0.747 0.455
## 383 8 11 3 2.678 1.120 0.263
## 384 10 14 4 2.678 1.494 0.135
## 385 4 5 1 2.678 0.373 0.709
## 386 14 14 0 2.678 0.000 1
## 387 7 7 0 2.678 0.000 1
## 388 11 10 -1 2.678 -0.373 0.709
## 389 4 4 0 2.678 0.000 1
## 390 8 7 -1 2.678 -0.373 0.709
## 391 10 9 -1 2.678 -0.373 0.709
## 392 5 8 3 2.678 1.120 0.263
## 393 12 10 -2 2.678 -0.747 0.455
## 394 8 7 -1 2.678 -0.373 0.709
## 395 10 4 -6 2.678 -2.241 0.025
## 396 18 15 -3 2.678 -1.120 0.263
## 397 4 7 3 2.678 1.120 0.263
## 398 13 13 0 2.678 0.000 1
## 399 14 11 -3 2.678 -1.120 0.263
## 400 4 6 2 2.678 0.747 0.455
## 401 15 16 1 2.678 0.373 0.709
## 402 4 4 0 2.678 0.000 1
## 403 5 6 1 2.678 0.373 0.709
## 404 17 15 -2 2.678 -0.747 0.455
## 405 8 4 -4 2.678 -1.494 0.135
## 406 10 6 -4 2.678 -1.494 0.135
## 407 3 2 -1 2.678 -0.373 0.709
## 408 8 7 -1 2.678 -0.373 0.709
## 409 6 10 4 2.678 1.494 0.135
## 410 11 12 1 2.678 0.373 0.709
## 411 3 2 -1 2.678 -0.373 0.709
## 412 14 9 -5 2.678 -1.867 0.062
## 413 9 8 -1 2.678 -0.373 0.709
## 414 15 17 2 2.678 0.747 0.455
## 415 13 9 -4 2.678 -1.494 0.135
## 416 3 5 2 2.678 0.747 0.455
## 417 4 2 -2 2.678 -0.747 0.455
## 418 18 18 0 2.678 0.000 1
## 419 2 1 -1 2.678 -0.373 0.709
## 420 15 13 -2 2.678 -0.747 0.455
## 421 15 11 -4 2.678 -1.494 0.135
## 422 6 7 1 2.678 0.373 0.709
## 423 4 5 1 2.678 0.373 0.709
## 424 7 4 -3 2.678 -1.120 0.263
## 425 8 9 1 2.678 0.373 0.709
## 426 6 2 -4 2.678 -1.494 0.135
## 427 5 6 1 2.678 0.373 0.709
## 428 3 7 4 2.678 1.494 0.135
## 429 9 13 4 2.678 1.494 0.135
## 430 6 4 -2 2.678 -0.747 0.455
## 431 5 11 6 2.678 2.241 0.025
## 432 14 12 -2 2.678 -0.747 0.455
## 433 18 19 1 2.678 0.373 0.709
## 434 0 0 0 2.678 0.000 1
## 435 15 9 -6 2.678 -2.241 0.025
## 436 10 8 -2 2.678 -0.747 0.455
## 437 15 16 1 2.678 0.373 0.709
## 438 3 2 -1 2.678 -0.373 0.709
## 439 14 13 -1 2.678 -0.373 0.709
## 440 9 13 4 2.678 1.494 0.135
## 441 10 11 1 2.678 0.373 0.709
## 442 15 10 -5 2.678 -1.867 0.062
## 443 4 4 0 2.678 0.000 1
## 444 5 8 3 2.678 1.120 0.263
## 445 6 11 5 2.678 1.867 0.062
## 446 12 13 1 2.678 0.373 0.709
## 447 3 5 2 2.678 0.747 0.455
## 448 2 1 -1 2.678 -0.373 0.709
## 449 16 15 -1 2.678 -0.373 0.709
## 450 6 4 -2 2.678 -0.747 0.455
## 451 17 15 -2 2.678 -0.747 0.455
## 452 6 12 6 2.678 2.241 0.025
## 453 4 6 2 2.678 0.747 0.455
## 454 19 19 0 2.678 0.000 1
## 455 9 8 -1 2.678 -0.373 0.709
## 456 7 5 -2 2.678 -0.747 0.455
## 457 6 5 -1 2.678 -0.373 0.709
## 458 1 2 1 2.678 0.373 0.709
## 459 8 7 -1 2.678 -0.373 0.709
## 460 8 10 2 2.678 0.747 0.455
## 461 15 13 -2 2.678 -0.747 0.455
## 462 4 3 -1 2.678 -0.373 0.709
## 463 16 17 1 2.678 0.373 0.709
## 464 10 12 2 2.678 0.747 0.455
## 465 17 13 -4 2.678 -1.494 0.135
## 466 11 13 2 2.678 0.747 0.455
## 467 10 6 -4 2.678 -1.494 0.135
## 468 9 4 -5 2.678 -1.867 0.062
## 469 6 5 -1 2.678 -0.373 0.709
## 470 9 12 3 2.678 1.120 0.263
## 471 7 4 -3 2.678 -1.120 0.263
## 472 17 17 0 2.678 0.000 1
## 473 5 7 2 2.678 0.747 0.455
## 474 8 10 2 2.678 0.747 0.455
## 475 12 18 6 2.678 2.241 0.025
## 476 7 10 3 2.678 1.120 0.263
## 477 14 13 -1 2.678 -0.373 0.709
## 478 13 15 2 2.678 0.747 0.455
## 479 8 5 -3 2.678 -1.120 0.263
## 480 8 8 0 2.678 0.000 1
## 481 8 12 4 2.678 1.494 0.135
## 482 6 4 -2 2.678 -0.747 0.455
## 483 18 16 -2 2.678 -0.747 0.455
## 484 6 4 -2 2.678 -0.747 0.455
## 485 8 6 -2 2.678 -0.747 0.455
## 486 9 10 1 2.678 0.373 0.709
## 487 6 1 -5 2.678 -1.867 0.062
## 488 8 8 0 2.678 0.000 1
## 489 13 13 0 2.678 0.000 1
## 490 11 9 -2 2.678 -0.747 0.455
## 491 2 3 1 2.678 0.373 0.709
## 492 5 5 0 2.678 0.000 1
## 493 9 12 3 2.678 1.120 0.263
## 494 7 11 4 2.678 1.494 0.135
## 495 3 5 2 2.678 0.747 0.455
## 496 17 14 -3 2.678 -1.120 0.263
## 497 10 8 -2 2.678 -0.747 0.455
## 498 18 17 -1 2.678 -0.373 0.709
## 499 5 11 6 2.678 2.241 0.025
## 500 13 15 2 2.678 0.747 0.455
## 501 3 0 -3 2.678 -1.120 0.263
## 502 5 4 -1 2.678 -0.373 0.709
## 503 11 13 2 2.678 0.747 0.455
## 504 10 5 -5 2.678 -1.867 0.062
## 505 11 8 -3 2.678 -1.120 0.263
## 506 2 5 3 2.678 1.120 0.263
## 507 4 2 -2 2.678 -0.747 0.455
## 508 3 2 -1 2.678 -0.373 0.709
## 509 18 16 -2 2.678 -0.747 0.455
## 510 16 17 1 2.678 0.373 0.709
## 511 10 8 -2 2.678 -0.747 0.455
## 512 11 13 2 2.678 0.747 0.455
## 513 2 6 4 2.678 1.494 0.135
## 514 19 20 1 2.678 0.373 0.709
## 515 5 5 0 2.678 0.000 1
## 516 6 3 -3 2.678 -1.120 0.263
## 517 7 7 0 2.678 0.000 1
## 518 3 4 1 2.678 0.373 0.709
## 519 17 15 -2 2.678 -0.747 0.455
## 520 1 6 5 2.678 1.867 0.062
## 521 10 7 -3 2.678 -1.120 0.263
## 522 7 12 5 2.678 1.867 0.062
## 523 18 17 -1 2.678 -0.373 0.709
## 524 3 1 -2 2.678 -0.747 0.455
## 525 6 8 2 2.678 0.747 0.455
## 526 7 6 -1 2.678 -0.373 0.709
## 527 14 15 1 2.678 0.373 0.709
## 528 7 2 -5 2.678 -1.867 0.062
## 529 9 11 2 2.678 0.747 0.455
## 530 10 16 6 2.678 2.241 0.025
## 531 14 12 -2 2.678 -0.747 0.455
## 532 10 9 -1 2.678 -0.373 0.709
## 533 14 13 -1 2.678 -0.373 0.709
## 534 6 4 -2 2.678 -0.747 0.455
## 535 8 12 4 2.678 1.494 0.135
## 536 6 9 3 2.678 1.120 0.263
## 537 2 2 0 2.678 0.000 1
## 538 16 16 0 2.678 0.000 1
## 539 8 9 1 2.678 0.373 0.709
## 540 14 11 -3 2.678 -1.120 0.263
## 541 10 10 0 2.678 0.000 1
## 542 7 3 -4 2.678 -1.494 0.135
## 543 7 3 -4 2.678 -1.494 0.135
## 544 4 8 4 2.678 1.494 0.135
## 545 4 6 2 2.678 0.747 0.455
## 546 9 9 0 2.678 0.000 1
## 547 12 11 -1 2.678 -0.373 0.709
## 548 12 11 -1 2.678 -0.373 0.709
## 549 11 11 0 2.678 0.000 1
## 550 14 14 0 2.678 0.000 1
## 551 12 9 -3 2.678 -1.120 0.263
## 552 13 12 -1 2.678 -0.373 0.709
## 553 1 3 2 2.678 0.747 0.455
## 554 12 9 -3 2.678 -1.120 0.263
## 555 13 11 -2 2.678 -0.747 0.455
## 556 15 15 0 2.678 0.000 1
## 557 13 13 0 2.678 0.000 1
## 558 12 4 -8 2.678 -2.988 0.003
## 559 13 9 -4 2.678 -1.494 0.135
## 560 3 2 -1 2.678 -0.373 0.709
## 561 2 1 -1 2.678 -0.373 0.709
## 562 19 19 0 2.678 0.000 1
## 563 10 10 0 2.678 0.000 1
## 564 8 7 -1 2.678 -0.373 0.709
## 565 3 4 1 2.678 0.373 0.709
## 566 6 7 1 2.678 0.373 0.709
## 567 7 12 5 2.678 1.867 0.062
## 568 10 7 -3 2.678 -1.120 0.263
## 569 11 7 -4 2.678 -1.494 0.135
## 570 18 19 1 2.678 0.373 0.709
## 571 5 7 2 2.678 0.747 0.455
## 572 16 16 0 2.678 0.000 1
## 573 15 14 -1 2.678 -0.373 0.709
## 574 11 4 -7 2.678 -2.614 0.009
## 575 7 7 0 2.678 0.000 1
## 576 6 3 -3 2.678 -1.120 0.263
## 577 14 11 -3 2.678 -1.120 0.263
## 578 8 5 -3 2.678 -1.120 0.263
## 579 5 4 -1 2.678 -0.373 0.709
## 580 3 3 0 2.678 0.000 1
## 581 10 8 -2 2.678 -0.747 0.455
## 582 2 1 -1 2.678 -0.373 0.709
## 583 14 15 1 2.678 0.373 0.709
## 584 4 9 5 2.678 1.867 0.062
## 585 11 14 3 2.678 1.120 0.263
## 586 11 13 2 2.678 0.747 0.455
## 587 9 10 1 2.678 0.373 0.709
## 588 6 4 -2 2.678 -0.747 0.455
## 589 10 9 -1 2.678 -0.373 0.709
## 590 4 3 -1 2.678 -0.373 0.709
## 591 4 3 -1 2.678 -0.373 0.709
## 592 11 12 1 2.678 0.373 0.709
## 593 9 7 -2 2.678 -0.747 0.455
## 594 8 9 1 2.678 0.373 0.709
## 595 9 9 0 2.678 0.000 1
## 596 5 8 3 2.678 1.120 0.263
## 597 8 11 3 2.678 1.120 0.263
## 598 15 11 -4 2.678 -1.494 0.135
## 599 7 5 -2 2.678 -0.747 0.455
## 600 8 8 0 2.678 0.000 1
## 601 7 5 -2 2.678 -0.747 0.455
## 602 12 6 -6 2.678 -2.241 0.025
## 603 4 4 0 2.678 0.000 1
## 604 9 4 -5 2.678 -1.867 0.062
## 605 9 3 -6 2.678 -2.241 0.025
## 606 13 18 5 2.678 1.867 0.062
## 607 11 10 -1 2.678 -0.373 0.709
## 608 14 14 0 2.678 0.000 1
## 609 16 14 -2 2.678 -0.747 0.455
## 610 6 8 2 2.678 0.747 0.455
## 611 14 11 -3 2.678 -1.120 0.263
## 612 2 8 6 2.678 2.241 0.025
## 613 18 16 -2 2.678 -0.747 0.455
## 614 7 8 1 2.678 0.373 0.709
## 615 5 8 3 2.678 1.120 0.263
## 616 16 18 2 2.678 0.747 0.455
## 617 9 12 3 2.678 1.120 0.263
## 618 16 14 -2 2.678 -0.747 0.455
## 619 5 3 -2 2.678 -0.747 0.455
## 620 13 13 0 2.678 0.000 1
## 621 12 12 0 2.678 0.000 1
## 622 12 15 3 2.678 1.120 0.263
## 623 18 16 -2 2.678 -0.747 0.455
## 624 7 3 -4 2.678 -1.494 0.135
## 625 3 2 -1 2.678 -0.373 0.709
## 626 13 13 0 2.678 0.000 1
## 627 13 11 -2 2.678 -0.747 0.455
## 628 9 9 0 2.678 0.000 1
## 629 5 6 1 2.678 0.373 0.709
## 630 13 10 -3 2.678 -1.120 0.263
## 631 13 8 -5 2.678 -1.867 0.062
## 632 8 11 3 2.678 1.120 0.263
## 633 13 8 -5 2.678 -1.867 0.062
## 634 7 5 -2 2.678 -0.747 0.455
## 635 5 5 0 2.678 0.000 1
## 636 13 9 -4 2.678 -1.494 0.135
## 637 11 9 -2 2.678 -0.747 0.455
## 638 13 14 1 2.678 0.373 0.709
## 639 18 18 0 2.678 0.000 1
## 640 6 8 2 2.678 0.747 0.455
## 641 7 7 0 2.678 0.000 1
## 642 14 13 -1 2.678 -0.373 0.709
## 643 15 18 3 2.678 1.120 0.263
## 644 5 7 2 2.678 0.747 0.455
## 645 13 11 -2 2.678 -0.747 0.455
## 646 6 9 3 2.678 1.120 0.263
## 647 12 14 2 2.678 0.747 0.455
## 648 8 12 4 2.678 1.494 0.135
## 649 10 13 3 2.678 1.120 0.263
## 650 7 9 2 2.678 0.747 0.455
## 651 1 4 3 2.678 1.120 0.263
## 652 9 7 -2 2.678 -0.747 0.455
## 653 14 10 -4 2.678 -1.494 0.135
## 654 12 11 -1 2.678 -0.373 0.709
## 655 5 5 0 2.678 0.000 1
## 656 5 5 0 2.678 0.000 1
## 657 9 12 3 2.678 1.120 0.263
## 658 10 12 2 2.678 0.747 0.455
## 659 6 3 -3 2.678 -1.120 0.263
## 660 9 8 -1 2.678 -0.373 0.709
## 661 8 9 1 2.678 0.373 0.709
## 662 10 8 -2 2.678 -0.747 0.455
## 663 13 10 -3 2.678 -1.120 0.263
## 664 10 10 0 2.678 0.000 1
## 665 3 5 2 2.678 0.747 0.455
## 666 5 8 3 2.678 1.120 0.263
## 667 10 5 -5 2.678 -1.867 0.062
## 668 8 6 -2 2.678 -0.747 0.455
## 669 2 2 0 2.678 0.000 1
## 670 6 6 0 2.678 0.000 1
## 671 3 7 4 2.678 1.494 0.135
## 672 8 5 -3 2.678 -1.120 0.263
## 673 14 14 0 2.678 0.000 1
## 674 4 3 -1 2.678 -0.373 0.709
## 675 5 4 -1 2.678 -0.373 0.709
## 676 1 6 5 2.678 1.867 0.062
## 677 1 1 0 2.678 0.000 1
## 678 8 6 -2 2.678 -0.747 0.455
## 679 8 8 0 2.678 0.000 1
## 680 3 3 0 2.678 0.000 1
## 681 10 7 -3 2.678 -1.120 0.263
## 682 11 14 3 2.678 1.120 0.263
## 683 11 11 0 2.678 0.000 1
## 684 4 4 0 2.678 0.000 1
## 685 9 8 -1 2.678 -0.373 0.709
## 686 4 8 4 2.678 1.494 0.135
## 687 10 11 1 2.678 0.373 0.709
## 688 15 10 -5 2.678 -1.867 0.062
## 689 11 14 3 2.678 1.120 0.263
## 690 14 16 2 2.678 0.747 0.455
## 691 8 11 3 2.678 1.120 0.263
## 692 7 4 -3 2.678 -1.120 0.263
## 693 4 4 0 2.678 0.000 1
## 694 15 16 1 2.678 0.373 0.709
## 695 6 6 0 2.678 0.000 1
## 696 7 8 1 2.678 0.373 0.709
## 697 10 8 -2 2.678 -0.747 0.455
## 698 14 17 3 2.678 1.120 0.263
## 699 13 16 3 2.678 1.120 0.263
## 700 10 13 3 2.678 1.120 0.263
## 701 2 1 -1 2.678 -0.373 0.709
## 702 3 4 1 2.678 0.373 0.709
## 703 8 8 0 2.678 0.000 1
## 704 17 15 -2 2.678 -0.747 0.455
## 705 2 5 3 2.678 1.120 0.263
## 706 11 13 2 2.678 0.747 0.455
## 707 11 8 -3 2.678 -1.120 0.263
## 708 9 9 0 2.678 0.000 1
## 709 8 6 -2 2.678 -0.747 0.455
## 710 11 9 -2 2.678 -0.747 0.455
## 711 16 16 0 2.678 0.000 1
## 712 14 14 0 2.678 0.000 1
## 713 3 1 -2 2.678 -0.747 0.455
## 714 1 0 -1 2.678 -0.373 0.709
## 715 16 12 -4 2.678 -1.494 0.135
## 716 6 9 3 2.678 1.120 0.263
## 717 16 11 -5 2.678 -1.867 0.062
## 718 5 4 -1 2.678 -0.373 0.709
## 719 9 8 -1 2.678 -0.373 0.709
## 720 14 8 -6 2.678 -2.241 0.025
## 721 8 9 1 2.678 0.373 0.709
## 722 5 6 1 2.678 0.373 0.709
## 723 7 8 1 2.678 0.373 0.709
## 724 14 15 1 2.678 0.373 0.709
## 725 5 7 2 2.678 0.747 0.455
## 726 4 8 4 2.678 1.494 0.135
## 727 11 10 -1 2.678 -0.373 0.709
## 728 16 14 -2 2.678 -0.747 0.455
## 729 16 15 -1 2.678 -0.373 0.709
## 730 14 12 -2 2.678 -0.747 0.455
## 731 13 14 1 2.678 0.373 0.709
## 732 11 10 -1 2.678 -0.373 0.709
## 733 12 13 1 2.678 0.373 0.709
## 734 7 10 3 2.678 1.120 0.263
## 735 12 12 0 2.678 0.000 1
## 736 15 15 0 2.678 0.000 1
## 737 0 1 1 2.678 0.373 0.709
## 738 12 7 -5 2.678 -1.867 0.062
## 739 15 13 -2 2.678 -0.747 0.455
## 740 2 4 2 2.678 0.747 0.455
## 741 4 5 1 2.678 0.373 0.709
## 742 0 1 1 2.678 0.373 0.709
## 743 8 9 1 2.678 0.373 0.709
## 744 1 1 0 2.678 0.000 1
## 745 14 11 -3 2.678 -1.120 0.263
## 746 6 6 0 2.678 0.000 1
## 747 12 11 -1 2.678 -0.373 0.709
## 748 4 6 2 2.678 0.747 0.455
## 749 9 7 -2 2.678 -0.747 0.455
## 750 2 13 11 2.678 4.108 0
## 751 19 17 -2 2.678 -0.747 0.455
## 752 14 12 -2 2.678 -0.747 0.455
## 753 19 19 0 2.678 0.000 1
## 754 16 14 -2 2.678 -0.747 0.455
## 755 5 6 1 2.678 0.373 0.709
## 756 3 4 1 2.678 0.373 0.709
## 757 5 8 3 2.678 1.120 0.263
## 758 11 15 4 2.678 1.494 0.135
## 759 7 7 0 2.678 0.000 1
## 760 5 2 -3 2.678 -1.120 0.263
## 761 1 0 -1 2.678 -0.373 0.709
## 762 12 8 -4 2.678 -1.494 0.135
## 763 9 12 3 2.678 1.120 0.263
## 764 8 6 -2 2.678 -0.747 0.455
## 765 16 16 0 2.678 0.000 1
## 766 9 7 -2 2.678 -0.747 0.455
## 767 4 5 1 2.678 0.373 0.709
## 768 4 7 3 2.678 1.120 0.263
## 769 11 14 3 2.678 1.120 0.263
## 770 4 4 0 2.678 0.000 1
## 771 14 8 -6 2.678 -2.241 0.025
## 772 16 16 0 2.678 0.000 1
## 773 10 12 2 2.678 0.747 0.455
## 774 8 10 2 2.678 0.747 0.455
## 775 8 9 1 2.678 0.373 0.709
## 776 13 12 -1 2.678 -0.373 0.709
## 777 6 4 -2 2.678 -0.747 0.455
## 778 12 17 5 2.678 1.867 0.062
## 779 4 2 -2 2.678 -0.747 0.455
## 780 9 12 3 2.678 1.120 0.263
## 781 11 9 -2 2.678 -0.747 0.455
## 782 11 13 2 2.678 0.747 0.455
## 783 4 3 -1 2.678 -0.373 0.709
## 784 2 3 1 2.678 0.373 0.709
## 785 4 7 3 2.678 1.120 0.263
## 786 15 17 2 2.678 0.747 0.455
## 787 5 3 -2 2.678 -0.747 0.455
## 788 14 12 -2 2.678 -0.747 0.455
## 789 10 14 4 2.678 1.494 0.135
## 790 19 15 -4 2.678 -1.494 0.135
## 791 11 8 -3 2.678 -1.120 0.263
## 792 15 13 -2 2.678 -0.747 0.455
## 793 6 5 -1 2.678 -0.373 0.709
## 794 1 3 2 2.678 0.747 0.455
## 795 9 9 0 2.678 0.000 1
## 796 9 9 0 2.678 0.000 1
## 797 7 8 1 2.678 0.373 0.709
## 798 8 13 5 2.678 1.867 0.062
## 799 11 10 -1 2.678 -0.373 0.709
## 800 6 8 2 2.678 0.747 0.455
## 801 14 15 1 2.678 0.373 0.709
## 802 8 10 2 2.678 0.747 0.455
## 803 5 10 5 2.678 1.867 0.062
## 804 16 14 -2 2.678 -0.747 0.455
## 805 17 18 1 2.678 0.373 0.709
## 806 3 5 2 2.678 0.747 0.455
## 807 12 13 1 2.678 0.373 0.709
## 808 12 12 0 2.678 0.000 1
## 809 8 8 0 2.678 0.000 1
## 810 8 5 -3 2.678 -1.120 0.263
## 811 17 14 -3 2.678 -1.120 0.263
## 812 14 11 -3 2.678 -1.120 0.263
## 813 17 13 -4 2.678 -1.494 0.135
## 814 6 5 -1 2.678 -0.373 0.709
## 815 7 10 3 2.678 1.120 0.263
## 816 8 6 -2 2.678 -0.747 0.455
## 817 6 11 5 2.678 1.867 0.062
## 818 8 11 3 2.678 1.120 0.263
## 819 5 5 0 2.678 0.000 1
## 820 6 4 -2 2.678 -0.747 0.455
## 821 10 13 3 2.678 1.120 0.263
## 822 16 18 2 2.678 0.747 0.455
## 823 2 3 1 2.678 0.373 0.709
## 824 9 8 -1 2.678 -0.373 0.709
## 825 9 10 1 2.678 0.373 0.709
## 826 11 11 0 2.678 0.000 1
## 827 4 5 1 2.678 0.373 0.709
## 828 1 5 4 2.678 1.494 0.135
## 829 16 16 0 2.678 0.000 1
## 830 5 10 5 2.678 1.867 0.062
## 831 3 4 1 2.678 0.373 0.709
## 832 19 18 -1 2.678 -0.373 0.709
## 833 13 10 -3 2.678 -1.120 0.263
## 834 15 18 3 2.678 1.120 0.263
## 835 12 11 -1 2.678 -0.373 0.709
## 836 15 13 -2 2.678 -0.747 0.455
## 837 12 10 -2 2.678 -0.747 0.455
## 838 0 2 2 2.678 0.747 0.455
## 839 12 10 -2 2.678 -0.747 0.455
## 840 9 14 5 2.678 1.867 0.062
## 841 6 13 7 2.678 2.614 0.009
## 842 11 11 0 2.678 0.000 1
## 843 3 4 1 2.678 0.373 0.709
## 844 5 8 3 2.678 1.120 0.263
## 845 10 12 2 2.678 0.747 0.455
## 846 14 11 -3 2.678 -1.120 0.263
## 847 7 9 2 2.678 0.747 0.455
## 848 6 4 -2 2.678 -0.747 0.455
## 849 14 9 -5 2.678 -1.867 0.062
## 850 13 18 5 2.678 1.867 0.062
## 851 16 16 0 2.678 0.000 1
## 852 11 6 -5 2.678 -1.867 0.062
## 853 11 6 -5 2.678 -1.867 0.062
## 854 1 3 2 2.678 0.747 0.455
## 855 11 9 -2 2.678 -0.747 0.455
## 856 4 2 -2 2.678 -0.747 0.455
## 857 8 6 -2 2.678 -0.747 0.455
## 858 6 6 0 2.678 0.000 1
## 859 11 7 -4 2.678 -1.494 0.135
## 860 5 4 -1 2.678 -0.373 0.709
## 861 7 4 -3 2.678 -1.120 0.263
## 862 4 4 0 2.678 0.000 1
## 863 17 15 -2 2.678 -0.747 0.455
## 864 13 15 2 2.678 0.747 0.455
## 865 9 4 -5 2.678 -1.867 0.062
## 866 3 5 2 2.678 0.747 0.455
## 867 7 5 -2 2.678 -0.747 0.455
## 868 9 7 -2 2.678 -0.747 0.455
## 869 8 7 -1 2.678 -0.373 0.709
## 870 8 11 3 2.678 1.120 0.263
## 871 12 14 2 2.678 0.747 0.455
## 872 6 7 1 2.678 0.373 0.709
## 873 13 12 -1 2.678 -0.373 0.709
## 874 10 10 0 2.678 0.000 1
## 875 16 17 1 2.678 0.373 0.709
## 876 15 17 2 2.678 0.747 0.455
## 877 6 4 -2 2.678 -0.747 0.455
## 878 8 6 -2 2.678 -0.747 0.455
## 879 14 13 -1 2.678 -0.373 0.709
## 880 16 15 -1 2.678 -0.373 0.709
## 881 7 3 -4 2.678 -1.494 0.135
## 882 6 5 -1 2.678 -0.373 0.709
## 883 11 9 -2 2.678 -0.747 0.455
## 884 3 0 -3 2.678 -1.120 0.263
## 885 5 6 1 2.678 0.373 0.709
## 886 13 13 0 2.678 0.000 1
## 887 11 9 -2 2.678 -0.747 0.455
## 888 12 13 1 2.678 0.373 0.709
## 889 0 1 1 2.678 0.373 0.709
## 890 16 17 1 2.678 0.373 0.709
## 891 5 2 -3 2.678 -1.120 0.263
## 892 13 11 -2 2.678 -0.747 0.455
## 893 7 4 -3 2.678 -1.120 0.263
## 894 4 3 -1 2.678 -0.373 0.709
## 895 2 1 -1 2.678 -0.373 0.709
## 896 10 15 5 2.678 1.867 0.062
## 897 13 12 -1 2.678 -0.373 0.709
## 898 13 9 -4 2.678 -1.494 0.135
## 899 20 19 -1 2.678 -0.373 0.709
## 900 7 6 -1 2.678 -0.373 0.709
## 901 16 14 -2 2.678 -0.747 0.455
## 902 6 4 -2 2.678 -0.747 0.455
## 903 13 11 -2 2.678 -0.747 0.455
## 904 4 3 -1 2.678 -0.373 0.709
## 905 7 5 -2 2.678 -0.747 0.455
## 906 7 7 0 2.678 0.000 1
## 907 11 11 0 2.678 0.000 1
## 908 9 5 -4 2.678 -1.494 0.135
## 909 12 9 -3 2.678 -1.120 0.263
## 910 8 13 5 2.678 1.867 0.062
## 911 6 13 7 2.678 2.614 0.009
## 912 11 7 -4 2.678 -1.494 0.135
## 913 3 6 3 2.678 1.120 0.263
## 914 9 12 3 2.678 1.120 0.263
## 915 18 18 0 2.678 0.000 1
## 916 18 18 0 2.678 0.000 1
## 917 14 15 1 2.678 0.373 0.709
## 918 11 11 0 2.678 0.000 1
## 919 7 7 0 2.678 0.000 1
## 920 10 4 -6 2.678 -2.241 0.025
## 921 19 18 -1 2.678 -0.373 0.709
## 922 12 8 -4 2.678 -1.494 0.135
## 923 6 7 1 2.678 0.373 0.709
## 924 5 6 1 2.678 0.373 0.709
## 925 5 4 -1 2.678 -0.373 0.709
## 926 12 10 -2 2.678 -0.747 0.455
## 927 8 9 1 2.678 0.373 0.709
## 928 10 5 -5 2.678 -1.867 0.062
## 929 12 17 5 2.678 1.867 0.062
## 930 13 10 -3 2.678 -1.120 0.263
## 931 14 10 -4 2.678 -1.494 0.135
## 932 4 2 -2 2.678 -0.747 0.455
## 933 13 12 -1 2.678 -0.373 0.709
## 934 12 8 -4 2.678 -1.494 0.135
## 935 9 8 -1 2.678 -0.373 0.709
## 936 4 3 -1 2.678 -0.373 0.709
## 937 13 12 -1 2.678 -0.373 0.709
## 938 10 4 -6 2.678 -2.241 0.025
## 939 7 5 -2 2.678 -0.747 0.455
## 940 6 12 6 2.678 2.241 0.025
## 941 12 17 5 2.678 1.867 0.062
## 942 0 1 1 2.678 0.373 0.709
## 943 9 5 -4 2.678 -1.494 0.135
## 944 5 8 3 2.678 1.120 0.263
## 945 4 5 1 2.678 0.373 0.709
## 946 17 19 2 2.678 0.747 0.455
## 947 11 9 -2 2.678 -0.747 0.455
## 948 13 14 1 2.678 0.373 0.709
## 949 5 9 4 2.678 1.494 0.135
## 950 11 14 3 2.678 1.120 0.263
## 951 8 7 -1 2.678 -0.373 0.709
## 952 6 9 3 2.678 1.120 0.263
## 953 9 1 -8 2.678 -2.988 0.003
## 954 11 8 -3 2.678 -1.120 0.263
## 955 10 13 3 2.678 1.120 0.263
## 956 4 3 -1 2.678 -0.373 0.709
## 957 3 4 1 2.678 0.373 0.709
## 958 7 11 4 2.678 1.494 0.135
## 959 13 14 1 2.678 0.373 0.709
## 960 18 17 -1 2.678 -0.373 0.709
## 961 13 13 0 2.678 0.000 1
## 962 20 19 -1 2.678 -0.373 0.709
## 963 8 4 -4 2.678 -1.494 0.135
## 964 15 15 0 2.678 0.000 1
## 965 11 8 -3 2.678 -1.120 0.263
## 966 14 17 3 2.678 1.120 0.263
## 967 14 9 -5 2.678 -1.867 0.062
## 968 9 10 1 2.678 0.373 0.709
## 969 10 8 -2 2.678 -0.747 0.455
## 970 16 15 -1 2.678 -0.373 0.709
## 971 13 14 1 2.678 0.373 0.709
## 972 3 3 0 2.678 0.000 1
## 973 12 13 1 2.678 0.373 0.709
## 974 8 6 -2 2.678 -0.747 0.455
## 975 9 11 2 2.678 0.747 0.455
## 976 9 11 2 2.678 0.747 0.455
## 977 4 4 0 2.678 0.000 1
## 978 8 7 -1 2.678 -0.373 0.709
## 979 9 10 1 2.678 0.373 0.709
## 980 15 17 2 2.678 0.747 0.455
## 981 10 9 -1 2.678 -0.373 0.709
## 982 15 12 -3 2.678 -1.120 0.263
## 983 7 10 3 2.678 1.120 0.263
## 984 15 16 1 2.678 0.373 0.709
## 985 13 13 0 2.678 0.000 1
## 986 2 6 4 2.678 1.494 0.135
## 987 8 9 1 2.678 0.373 0.709
## 988 9 9 0 2.678 0.000 1
## 989 16 11 -5 2.678 -1.867 0.062
## 990 13 10 -3 2.678 -1.120 0.263
## 991 3 4 1 2.678 0.373 0.709
## 992 1 6 5 2.678 1.867 0.062
## 993 11 12 1 2.678 0.373 0.709
## 994 5 2 -3 2.678 -1.120 0.263
## 995 5 9 4 2.678 1.494 0.135
## 996 12 8 -4 2.678 -1.494 0.135
## 997 2 0 -2 2.678 -0.747 0.455
## 998 2 2 0 2.678 0.000 1
## 999 17 19 2 2.678 0.747 0.455
## 1000 3 1 -2 2.678 -0.747 0.455
######
# interactive shiny interfaces for live scoring
mod_pre <- mirt(Science)
# (optional) setup mod_post to have medium effect size change (d = 0.5)
sv <- mod2values(mod_pre)
sv$value[sv$name == 'MEAN_1'] <- 0.5
mod_post <- mirt(Science, pars=sv, TOL=NA)
# only use pre-test model for scoring
if(interactive()){
RCI(mod_pre=mod_pre, shiny=TRUE)
# use both pre-test and post-test models for including empirical priors
RCI(mod_pre=mod_pre, mod_post=mod_post, shiny=TRUE,
main='Perceptions of Science and Technology')
}
############################
# Example where individuals take completely different item set pre-post
# but prior calibration has been performed to equate the items
dat <- key2binary(SAT12,
key = c(1,4,5,2,3,1,2,1,3,1,2,4,2,1,5,3,4,4,1,4,3,3,4,1,3,5,1,3,1,5,4,5))
mod <- mirt(dat)
# with N=5 individuals under investigation
predat <- postdat <- dat[1:5,]
predat[, 17:32] <- NA
postdat[, 1:16] <- NA
head(predat)
## Item.1 Item.2 Item.3 Item.4 Item.5 Item.6 Item.7 Item.8 Item.9 Item.10
## [1,] 1 1 1 1 1 1 1 1 1 1
## [2,] 0 1 0 0 1 0 1 0 1 1
## [3,] 1 1 1 0 1 0 1 0 1 0
## [4,] 0 1 0 1 1 0 1 0 1 0
## [5,] 0 1 1 1 1 0 1 1 0 0
## Item.11 Item.12 Item.13 Item.14 Item.15 Item.16 Item.17 Item.18 Item.19
## [1,] 1 1 1 1 1 1 NA NA NA
## [2,] 1 0 1 1 1 0 NA NA NA
## [3,] 1 0 0 1 1 0 NA NA NA
## [4,] 1 1 1 1 1 0 NA NA NA
## [5,] 1 1 1 1 1 0 NA NA NA
## Item.20 Item.21 Item.22 Item.23 Item.24 Item.25 Item.26 Item.27 Item.28
## [1,] NA NA NA NA NA NA NA NA NA
## [2,] NA NA NA NA NA NA NA NA NA
## [3,] NA NA NA NA NA NA NA NA NA
## [4,] NA NA NA NA NA NA NA NA NA
## [5,] NA NA NA NA NA NA NA NA NA
## Item.29 Item.30 Item.31 Item.32
## [1,] NA NA NA NA
## [2,] NA NA NA NA
## [3,] NA NA NA NA
## [4,] NA NA NA NA
## [5,] NA NA NA NA
head(postdat)
## Item.1 Item.2 Item.3 Item.4 Item.5 Item.6 Item.7 Item.8 Item.9 Item.10
## [1,] NA NA NA NA NA NA NA NA NA NA
## [2,] NA NA NA NA NA NA NA NA NA NA
## [3,] NA NA NA NA NA NA NA NA NA NA
## [4,] NA NA NA NA NA NA NA NA NA NA
## [5,] NA NA NA NA NA NA NA NA NA NA
## Item.11 Item.12 Item.13 Item.14 Item.15 Item.16 Item.17 Item.18 Item.19
## [1,] NA NA NA NA NA NA 1 1 1
## [2,] NA NA NA NA NA NA 1 0 1
## [3,] NA NA NA NA NA NA 1 0 0
## [4,] NA NA NA NA NA NA 1 0 0
## [5,] NA NA NA NA NA NA 1 0 1
## Item.20 Item.21 Item.22 Item.23 Item.24 Item.25 Item.26 Item.27 Item.28
## [1,] 1 1 1 1 1 1 1 1 1
## [2,] 1 1 1 0 1 0 0 1 0
## [3,] 1 1 1 0 1 1 0 1 1
## [4,] 1 1 0 0 0 0 0 1 1
## [5,] 1 1 1 0 1 0 1 1 1
## Item.29 Item.30 Item.31 Item.32
## [1,] 1 1 1 1
## [2,] 0 0 1 0
## [3,] 0 0 1 0
## [4,] 0 0 1 0
## [5,] 1 0 1 0
RCI(mod, predat, postdat)
## pre.score post.score converged diff SEM z p
## 1 2.206 1.808 TRUE -0.398 0.951 -0.419 0.675
## 2 0.373 -0.344 TRUE -0.717 0.720 -0.995 0.32
## 3 0.303 -0.115 TRUE -0.419 0.728 -0.575 0.566
## 4 0.295 -0.864 TRUE -1.159 0.699 -1.658 0.097
## 5 0.670 0.513 TRUE -0.157 0.772 -0.203 0.839
## End(No test)