RCI {mirt}R Documentation

Model-based Reliable Change Index

Description

Computes an IRT version of the "reliable change index" (RCI) proposed by Jacobson and Traux (1991) but modified to use IRT information about scores and measurement error (see Jabrayilov, Emons, and Sijtsma (2016). Main benefit of the IRT approach is the inclusion of response pattern information in the pre/post data score estimates, as well as conditional standard error of measurement information.

Usage

RCI(
  mod_pre,
  predat,
  postdat,
  mod_post = mod_pre,
  cutoffs = NULL,
  SEM.pre = NULL,
  SEM.post = NULL,
  Fisher = FALSE,
  shiny = FALSE,
  main = "Test Scores",
  ...
)

Arguments

mod_pre

single-group model fitted by mirt. If not supplied the information will be extracted from the data input objects to compute the classical test theory version of the RCI statistics

predat

a vector (if one individual) or matrix/data.frame of response data to be scored, where each individuals' responses are included in exactly one row

postdat

same as predat, but with respect to the post/follow-up measurement

mod_post

(optional) IRT model for post-test if different from pre-test; otherwise, the pre-test model will be used

cutoffs

optional vector of length 2 indicating the type of cut-offs to report (e.g., c(-1.96, 1.96) reflects the 95 percent z-score type cut-off)

SEM.pre

standard error of measurement for the pretest. This can be used instead of rxx.pre and SD.pre

SEM.post

(optional) standard error of measurement for the post-test. Using this will create a pooled version of the SEM; otherwise, SEM.post = SEM.pre

Fisher

logical; use the Fisher/expected information function to compute the SE terms? If FALSE the SE information will be extracted from the select fscores method (default). Only applicable for unidimensional models

shiny

logical; launch an interactive shiny applications for real-time scoring of supplied total-scores or response vectors? Only requires mod_pre and (optional) mod_post inputs

main

main label to use when shiny=TRUE

...

additional arguments passed to fscores

Author(s)

Phil Chalmers rphilip.chalmers@gmail.com

References

Chalmers, R., P. (2012). mirt: A Multidimensional Item Response Theory Package for the R Environment. Journal of Statistical Software, 48(6), 1-29. doi:10.18637/jss.v048.i06

Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19.

Jabrayilov, R. , Emons, W. H. M., & Sijtsma, K. (2016). Comparison of Classical Test Theory and Item Response Theory in Individual Change Assessment. Applied Psychological Measurement, 40 (8), 559-572.

Examples

## No test: 

# simulate some data
N <- 1000
J <- 20     # number of items
a <- matrix(rlnorm(J,.2,.3))
d <- rnorm(J)

theta <- matrix(rnorm(N))
dat_pre <- simdata(a, d, itemtype = '2PL', Theta = theta)

# first 3 cases decrease by 1/2
theta2 <- theta - c(1/2, 1/2, 1/2, numeric(N-3))
dat_post <- simdata(a, d, itemtype = '2PL', Theta = theta2)

mod <- mirt(dat_pre)

# all changes using fitted model from pre data
RCI(mod, predat=dat_pre, postdat=dat_post)
##      pre.score post.score converged   diff   SEM      z     p
## 1        0.496      0.146      TRUE -0.349 0.522 -0.670 0.503
## 2       -0.793     -0.818      TRUE -0.025 0.592 -0.043 0.966
## 3        0.231     -0.389      TRUE -0.620 0.533 -1.164 0.244
## 4       -0.098      0.157      TRUE  0.255 0.523  0.488 0.626
## 5        1.467      1.159      TRUE -0.308 0.602 -0.511  0.61
## 6        0.741      0.497      TRUE -0.244 0.530 -0.460 0.646
## 7        0.411      0.572      TRUE  0.160 0.524  0.306  0.76
## 8       -0.628     -0.203      TRUE  0.425 0.552  0.771 0.441
## 9        0.341      0.925      TRUE  0.584 0.536  1.089 0.276
## 10      -0.134      0.052      TRUE  0.186 0.525  0.355 0.723
## 11       0.386      0.135      TRUE -0.251 0.520 -0.482  0.63
## 12       1.130      1.224      TRUE  0.094 0.582  0.161 0.872
## 13       1.228      0.691      TRUE -0.538 0.562 -0.958 0.338
## 14      -0.058     -0.464      TRUE -0.407 0.539 -0.755  0.45
## 15      -0.097     -0.425      TRUE -0.329 0.538 -0.611 0.541
## 16       0.211      0.160      TRUE -0.052 0.519 -0.100 0.921
## 17      -1.555     -1.599      TRUE -0.044 0.728 -0.061 0.951
## 18      -0.322      0.494      TRUE  0.816 0.532  1.533 0.125
## 19      -0.178     -0.204      TRUE -0.026 0.532 -0.049 0.961
## 20       0.930      1.335      TRUE  0.405 0.579  0.699 0.484
## 21      -1.376     -1.614      TRUE -0.238 0.712 -0.334 0.738
## 22       0.431      0.882      TRUE  0.451 0.535  0.842   0.4
## 23      -1.231     -1.558      TRUE -0.327 0.693 -0.472 0.637
## 24      -1.577     -1.554      TRUE  0.022 0.726  0.031 0.976
## 25       0.329     -0.233      TRUE -0.563 0.527 -1.068 0.286
## 26      -1.520     -1.304      TRUE  0.217 0.696  0.311 0.756
## 27       0.124      0.122      TRUE -0.001 0.520 -0.003 0.998
## 28      -1.788     -1.542      TRUE  0.247 0.747  0.330 0.741
## 29      -1.810     -1.872      TRUE -0.062 0.784 -0.079 0.937
## 30       0.915     -0.376      TRUE -1.291 0.548 -2.354 0.019
## 31      -0.943     -1.040      TRUE -0.097 0.620 -0.157 0.875
## 32      -1.391     -1.798      TRUE -0.407 0.734 -0.555 0.579
## 33      -1.026     -0.293      TRUE  0.733 0.584  1.256 0.209
## 34      -0.457     -1.041      TRUE -0.583 0.591 -0.987 0.324
## 35      -0.695     -1.084      TRUE -0.389 0.607 -0.641 0.522
## 36      -1.872     -0.321      TRUE  1.550 0.677  2.289 0.022
## 37      -0.139     -0.235      TRUE -0.097 0.532 -0.182 0.856
## 38      -0.839     -0.883      TRUE -0.044 0.600 -0.073 0.942
## 39       1.053      1.641      TRUE  0.588 0.612  0.961 0.337
## 40       0.810      0.638      TRUE -0.172 0.536 -0.320 0.749
## 41       0.433      0.421      TRUE -0.011 0.521 -0.022 0.983
## 42       0.942      0.896      TRUE -0.045 0.552 -0.082 0.934
## 43       0.477      0.729      TRUE  0.252 0.529  0.475 0.635
## 44       0.307      0.288      TRUE -0.018 0.519 -0.036 0.972
## 45      -0.711     -1.376      TRUE -0.665 0.636 -1.045 0.296
## 46      -1.856     -1.872      TRUE -0.016 0.789 -0.020 0.984
## 47       1.501      0.636      TRUE -0.865 0.583 -1.485 0.138
## 48       0.063     -0.338      TRUE -0.401 0.532 -0.755  0.45
## 49       0.777      1.025      TRUE  0.247 0.551  0.448 0.654
## 50       0.561      0.370      TRUE -0.192 0.523 -0.367 0.714
## 51       0.437      0.450      TRUE  0.013 0.522  0.024 0.981
## 52       1.989      2.103      TRUE  0.115 0.738  0.155 0.876
## 53      -0.202     -0.063      TRUE  0.140 0.529  0.264 0.792
## 54      -0.937     -1.810      TRUE -0.873 0.699 -1.249 0.212
## 55      -0.281      0.104      TRUE  0.385 0.529  0.728 0.467
## 56      -0.907     -0.493      TRUE  0.414 0.582  0.712 0.476
## 57       0.491      0.079      TRUE -0.413 0.522 -0.791 0.429
## 58       0.921      0.692      TRUE -0.229 0.543 -0.422 0.673
## 59       0.859      0.092      TRUE -0.767 0.534 -1.438  0.15
## 60       0.830      1.478      TRUE  0.648 0.587  1.104 0.269
## 61      -0.982     -0.892      TRUE  0.089 0.612  0.146 0.884
## 62       0.569      0.352      TRUE -0.218 0.523 -0.416 0.677
## 63      -0.637     -0.350      TRUE  0.287 0.557  0.515 0.607
## 64      -0.672      0.344      TRUE  1.016 0.548  1.854 0.064
## 65      -0.445     -1.078      TRUE -0.634 0.594 -1.067 0.286
## 66      -0.890     -1.748      TRUE -0.858 0.689 -1.245 0.213
## 67       1.186      1.761      TRUE  0.576 0.632  0.910 0.363
## 68      -0.150      1.109      TRUE  1.259 0.552  2.283 0.022
## 69      -1.244     -0.490      TRUE  0.753 0.611  1.232 0.218
## 70       0.393      1.101      TRUE  0.708 0.547  1.295 0.195
## 71      -0.594     -0.682      TRUE -0.088 0.571 -0.154 0.878
## 72      -0.850     -0.273      TRUE  0.577 0.569  1.015  0.31
## 73       0.681      0.258      TRUE -0.422 0.526 -0.803 0.422
## 74       0.205     -0.639      TRUE -0.844 0.546 -1.547 0.122
## 75       1.046      0.818      TRUE -0.229 0.554 -0.413  0.68
## 76      -0.274      0.539      TRUE  0.814 0.531  1.532 0.126
## 77      -1.123     -1.195      TRUE -0.072 0.648 -0.111 0.911
## 78      -0.609     -0.488      TRUE  0.121 0.561  0.216 0.829
## 79      -0.313     -0.770      TRUE -0.457 0.564 -0.810 0.418
## 80      -0.780     -1.872      TRUE -1.092 0.697 -1.566 0.117
## 81      -0.855     -1.009      TRUE -0.153 0.611 -0.251 0.802
## 82       0.388      0.330      TRUE -0.058 0.520 -0.111 0.911
## 83      -1.389     -0.900      TRUE  0.489 0.649  0.753 0.452
## 84      -0.363      0.043      TRUE  0.406 0.533  0.761 0.446
## 85      -0.716     -0.668      TRUE  0.049 0.578  0.084 0.933
## 86       0.825      0.864      TRUE  0.039 0.545  0.072 0.943
## 87       0.157     -0.332      TRUE -0.489 0.530 -0.921 0.357
## 88       1.103      1.681      TRUE  0.578 0.619  0.933 0.351
## 89       1.249      1.047      TRUE -0.202 0.579 -0.349 0.727
## 90      -0.769      0.708      TRUE  1.477 0.562  2.630 0.009
## 91      -0.733     -0.500      TRUE  0.232 0.570  0.408 0.684
## 92       0.488      0.596      TRUE  0.108 0.526  0.205 0.838
## 93      -1.520     -0.932      TRUE  0.588 0.666  0.883 0.377
## 94      -0.162     -1.026      TRUE -0.864 0.580 -1.490 0.136
## 95      -2.153     -1.507      TRUE  0.646 0.786  0.822 0.411
## 96      -1.748     -1.092      TRUE  0.657 0.703  0.934  0.35
## 97       0.076      0.933      TRUE  0.857 0.537  1.596 0.111
## 98      -0.310     -0.899      TRUE -0.589 0.574 -1.027 0.304
## 99      -0.516      0.375      TRUE  0.891 0.539  1.652 0.098
## 100     -0.392     -0.665      TRUE -0.273 0.560 -0.487 0.626
## 101      0.466      0.324      TRUE -0.143 0.521 -0.274 0.784
## 102     -0.267      0.443      TRUE  0.710 0.529  1.342  0.18
## 103      1.770      1.589      TRUE -0.181 0.663 -0.272 0.785
## 104      1.454      0.355      TRUE -1.099 0.574 -1.916 0.055
## 105      1.435      0.989      TRUE -0.446 0.590 -0.756  0.45
## 106     -1.629     -1.555      TRUE  0.074 0.731  0.101 0.919
## 107     -0.227     -0.013      TRUE  0.215 0.529  0.406 0.685
## 108     -0.831     -1.379      TRUE -0.547 0.644 -0.850 0.395
## 109     -1.872     -1.713      TRUE  0.159 0.774  0.206 0.837
## 110     -0.691     -0.911      TRUE -0.220 0.593 -0.371  0.71
## 111     -1.225     -1.000      TRUE  0.225 0.641  0.351 0.726
## 112      0.281      0.557      TRUE  0.276 0.523  0.528 0.597
## 113      0.421      0.503      TRUE  0.082 0.523  0.156 0.876
## 114     -0.485     -0.763      TRUE -0.278 0.571 -0.487 0.626
## 115      0.292      0.553      TRUE  0.261 0.522  0.500 0.617
## 116      0.516      0.801      TRUE  0.285 0.533  0.535 0.592
## 117     -1.112     -0.421      TRUE  0.690 0.596  1.158 0.247
## 118     -1.558     -1.265      TRUE  0.293 0.696  0.420 0.674
## 119      0.316      0.143      TRUE -0.172 0.519 -0.332  0.74
## 120     -0.776      0.262      TRUE  1.038 0.555  1.872 0.061
## 121      1.204      1.305      TRUE  0.101 0.592  0.171 0.865
## 122     -1.584     -1.255      TRUE  0.329 0.698  0.471 0.638
## 123      1.580      0.992      TRUE -0.588 0.603 -0.975  0.33
## 124      0.043      0.286      TRUE  0.243 0.520  0.467 0.641
## 125      0.902      0.162      TRUE -0.741 0.535 -1.384 0.166
## 126      1.335      1.686      TRUE  0.351 0.635  0.553  0.58
## 127      1.153      1.657      TRUE  0.503 0.620  0.812 0.417
## 128     -1.350     -0.222      TRUE  1.128 0.613  1.840 0.066
## 129      1.238      0.623      TRUE -0.615 0.560 -1.098 0.272
## 130      0.004     -0.648      TRUE -0.652 0.548 -1.190 0.234
## 131      0.992      1.456      TRUE  0.464 0.592  0.783 0.433
## 132     -0.123     -0.859      TRUE -0.735 0.565 -1.301 0.193
## 133     -1.004     -1.126      TRUE -0.122 0.632 -0.193 0.847
## 134      1.670      1.359      TRUE -0.311 0.635 -0.490 0.624
## 135     -0.337      0.061      TRUE  0.398 0.532  0.748 0.454
## 136     -0.556     -1.289      TRUE -0.733 0.619 -1.184 0.236
## 137     -1.086     -0.180      TRUE  0.907 0.586  1.548 0.122
## 138     -1.046     -0.192      TRUE  0.854 0.582  1.466 0.143
## 139      0.836      1.871      TRUE  1.035 0.627  1.651 0.099
## 140      0.057     -1.356      TRUE -1.413 0.608 -2.323  0.02
## 141      1.248      1.045      TRUE -0.203 0.578 -0.350 0.726
## 142     -0.017     -0.743      TRUE -0.725 0.555 -1.308 0.191
## 143      2.072      1.592      TRUE -0.480 0.696 -0.689 0.491
## 144     -0.065      0.130      TRUE  0.194 0.523  0.372  0.71
## 145     -0.341     -0.659      TRUE -0.318 0.558 -0.570 0.569
## 146      1.010      1.220      TRUE  0.209 0.575  0.365 0.715
## 147      0.075     -0.409      TRUE -0.484 0.534 -0.905 0.365
## 148     -0.496     -1.089      TRUE -0.593 0.597 -0.993 0.321
## 149      0.116     -0.115      TRUE -0.231 0.524 -0.441 0.659
## 150     -0.077      0.055      TRUE  0.132 0.524  0.253   0.8
## 151      0.110     -0.373      TRUE -0.482 0.532 -0.905 0.365
## 152     -0.372      0.026      TRUE  0.398 0.533  0.746 0.455
## 153      0.683      0.576      TRUE -0.107 0.530 -0.203 0.839
## 154      0.169      0.701      TRUE  0.532 0.527  1.010 0.313
## 155      0.839      0.033      TRUE -0.806 0.533 -1.512 0.131
## 156      0.138     -0.253      TRUE -0.391 0.528 -0.741 0.459
## 157      0.338      0.474      TRUE  0.136 0.521  0.261 0.794
## 158      0.848      0.299      TRUE -0.549 0.532 -1.032 0.302
## 159     -0.384     -0.505      TRUE -0.121 0.551 -0.220 0.826
## 160     -1.017     -1.193      TRUE -0.176 0.639 -0.276 0.783
## 161     -0.613     -0.843      TRUE -0.230 0.583 -0.394 0.693
## 162     -1.198     -1.489      TRUE -0.291 0.683 -0.426  0.67
## 163     -0.960     -0.862      TRUE  0.098 0.608  0.161 0.872
## 164      1.738      1.708      TRUE -0.030 0.671 -0.044 0.965
## 165      0.512     -0.029      TRUE -0.542 0.524 -1.034 0.301
## 166     -1.660     -1.599      TRUE  0.061 0.739  0.083 0.934
## 167     -0.529     -1.254      TRUE -0.725 0.614 -1.181 0.238
## 168     -1.274     -0.799      TRUE  0.475 0.631  0.753 0.451
## 169      0.027      0.346      TRUE  0.319 0.521  0.613  0.54
## 170     -0.675     -0.962      TRUE -0.286 0.596 -0.481 0.631
## 171      2.088      1.645      TRUE -0.443 0.703 -0.630 0.528
## 172      0.332      0.404      TRUE  0.072 0.520  0.138  0.89
## 173      0.083     -1.072      TRUE -1.155 0.580 -1.993 0.046
## 174      1.601      0.947      TRUE -0.655 0.603 -1.085 0.278
## 175      0.345      0.657      TRUE  0.313 0.526  0.595 0.552
## 176      1.248      1.751      TRUE  0.504 0.635  0.793 0.428
## 177     -0.240     -0.362      TRUE -0.123 0.539 -0.227  0.82
## 178      0.235      0.858      TRUE  0.624 0.533  1.171 0.242
## 179      0.699     -0.054      TRUE -0.752 0.529 -1.421 0.155
## 180     -1.246     -0.574      TRUE  0.672 0.616  1.091 0.275
## 181      0.292      0.413      TRUE  0.122 0.520  0.234 0.815
## 182      0.641      0.295      TRUE -0.346 0.525 -0.659  0.51
## 183      0.940      1.057      TRUE  0.117 0.560  0.209 0.835
## 184      1.058      1.221      TRUE  0.163 0.577  0.282 0.778
## 185     -0.633     -0.906      TRUE -0.273 0.589 -0.464 0.643
## 186      1.413      2.030      TRUE  0.618 0.678  0.912 0.362
## 187      2.036      2.088      TRUE  0.052 0.741  0.070 0.944
## 188      1.074      1.108      TRUE  0.034 0.571  0.060 0.952
## 189     -0.681     -0.353      TRUE  0.328 0.560  0.586 0.558
## 190     -0.837     -0.745      TRUE  0.092 0.591  0.155 0.877
## 191      0.303     -0.059      TRUE -0.362 0.522 -0.693 0.488
## 192      0.363     -0.151      TRUE -0.514 0.525 -0.980 0.327
## 193     -1.078     -1.041      TRUE  0.037 0.631  0.059 0.953
## 194      1.232      0.021      TRUE -1.211 0.557 -2.175  0.03
## 195     -0.494     -0.133      TRUE  0.362 0.542  0.667 0.505
## 196      0.636     -0.118      TRUE -0.755 0.529 -1.427 0.154
## 197      0.018      0.255      TRUE  0.237 0.521  0.456 0.649
## 198     -0.072     -0.494      TRUE -0.422 0.541 -0.780 0.435
## 199      1.158      1.565      TRUE  0.407 0.611  0.667 0.505
## 200     -0.514      0.190      TRUE  0.704 0.539  1.307 0.191
## 201     -1.040     -0.777      TRUE  0.263 0.608  0.433 0.665
## 202      0.760      0.956      TRUE  0.195 0.547  0.357 0.721
## 203     -0.980     -0.100      TRUE  0.880 0.574  1.532 0.126
## 204     -0.111     -0.559      TRUE -0.448 0.545 -0.822 0.411
## 205     -0.831     -1.558      TRUE -0.727 0.663 -1.096 0.273
## 206      1.601      1.146      TRUE -0.456 0.614 -0.742 0.458
## 207     -1.289     -1.326      TRUE -0.037 0.675 -0.055 0.956
## 208      1.629      1.627      TRUE -0.002 0.653 -0.003 0.998
## 209     -0.355     -0.506      TRUE -0.151 0.550 -0.274 0.784
## 210      0.439     -0.020      TRUE -0.459 0.523 -0.878  0.38
## 211     -1.545     -0.819      TRUE  0.726 0.661  1.098 0.272
## 212      0.301      0.660      TRUE  0.359 0.525  0.684 0.494
## 213     -0.594     -1.102      TRUE -0.508 0.603 -0.842   0.4
## 214     -0.652     -0.359      TRUE  0.293 0.558  0.524   0.6
## 215     -0.242     -0.519      TRUE -0.277 0.547 -0.507 0.612
## 216      0.950      1.129      TRUE  0.180 0.565  0.318  0.75
## 217     -1.123     -1.071      TRUE  0.052 0.637  0.081 0.935
## 218      0.951      0.401      TRUE -0.550 0.538 -1.023 0.306
## 219      0.150     -0.468      TRUE -0.618 0.537 -1.152 0.249
## 220      0.021      0.573      TRUE  0.553 0.525  1.053 0.292
## 221     -1.279     -0.655      TRUE  0.624 0.623  1.001 0.317
## 222     -0.570      0.184      TRUE  0.754 0.542  1.393 0.164
## 223      0.757      0.766      TRUE  0.009 0.538  0.017 0.987
## 224      1.793      1.751      TRUE -0.042 0.681 -0.062 0.951
## 225      1.612      0.800      TRUE -0.813 0.598 -1.359 0.174
## 226     -0.179      0.064      TRUE  0.243 0.526  0.462 0.644
## 227     -0.210     -0.162      TRUE  0.049 0.531  0.092 0.927
## 228      1.617      0.267      TRUE -1.350 0.589 -2.293 0.022
## 229     -1.122     -1.145      TRUE -0.023 0.643 -0.036 0.971
## 230     -0.425     -0.151      TRUE  0.273 0.539  0.507 0.612
## 231     -0.312      0.100      TRUE  0.412 0.530  0.776 0.437
## 232     -0.492     -0.028      TRUE  0.464 0.540  0.860  0.39
## 233      0.370      0.718      TRUE  0.348 0.528  0.659  0.51
## 234      1.491      0.715      TRUE -0.776 0.584 -1.329 0.184
## 235      1.436      0.781      TRUE -0.655 0.581 -1.127  0.26
## 236     -0.884     -1.062      TRUE -0.178 0.618 -0.289 0.773
## 237      0.564      0.229      TRUE -0.334 0.523 -0.640 0.522
## 238     -1.282     -0.232      TRUE  1.050 0.606  1.733 0.083
## 239     -1.517     -0.997      TRUE  0.520 0.670  0.776 0.438
## 240     -0.369     -0.470      TRUE -0.102 0.549 -0.185 0.853
## 241      0.081      0.707      TRUE  0.626 0.528  1.186 0.236
## 242     -1.305     -0.458      TRUE  0.847 0.616  1.375 0.169
## 243      1.722      2.072      TRUE  0.349 0.708  0.494 0.621
## 244      0.394      0.426      TRUE  0.032 0.521  0.061 0.951
## 245      0.222      0.359      TRUE  0.137 0.519  0.264 0.792
## 246      1.350      0.914      TRUE -0.436 0.579 -0.753 0.451
## 247      1.177      1.898      TRUE  0.721 0.647  1.115 0.265
## 248      0.876     -0.069      TRUE -0.946 0.537 -1.761 0.078
## 249     -0.061     -0.979      TRUE -0.918 0.573 -1.601 0.109
## 250      0.783      0.773      TRUE -0.010 0.540 -0.018 0.985
## 251      1.355     -0.092      TRUE -1.447 0.568 -2.546 0.011
## 252      1.040      0.889      TRUE -0.151 0.557 -0.272 0.786
## 253      0.398      0.371      TRUE -0.027 0.520 -0.052 0.959
## 254     -1.303     -1.070      TRUE  0.233 0.654  0.356 0.722
## 255      0.523      0.610      TRUE  0.087 0.527  0.165 0.869
## 256     -0.429      0.210      TRUE  0.640 0.534  1.197 0.231
## 257     -0.676     -0.930      TRUE -0.253 0.593 -0.427 0.669
## 258     -0.298     -0.225      TRUE  0.073 0.536  0.137 0.891
## 259     -0.435     -0.677      TRUE -0.242 0.563 -0.430 0.667
## 260      0.448      0.436      TRUE -0.011 0.522 -0.021 0.983
## 261      0.630      0.842      TRUE  0.213 0.537  0.396 0.692
## 262     -0.049      0.594      TRUE  0.644 0.526  1.223 0.221
## 263      0.779     -0.126      TRUE -0.905 0.534 -1.694  0.09
## 264     -0.667      0.010      TRUE  0.676 0.549  1.232 0.218
## 265     -0.073      0.370      TRUE  0.443 0.523  0.847 0.397
## 266      0.292     -0.033      TRUE -0.325 0.522 -0.623 0.533
## 267      0.096      0.629      TRUE  0.533 0.525  1.015  0.31
## 268      1.738      1.288      TRUE -0.451 0.637 -0.708 0.479
## 269     -0.885     -1.108      TRUE -0.223 0.622 -0.359 0.719
## 270      0.200      0.894      TRUE  0.694 0.535  1.299 0.194
## 271      1.031      1.357      TRUE  0.326 0.586  0.557 0.578
## 272     -0.277     -0.343      TRUE -0.066 0.540 -0.123 0.902
## 273     -0.349     -0.519      TRUE -0.170 0.550 -0.309 0.757
## 274      1.063      1.138      TRUE  0.075 0.572  0.131 0.895
## 275      0.104      1.182      TRUE  1.078 0.552  1.953 0.051
## 276      1.048      1.047      TRUE -0.001 0.566 -0.002 0.999
## 277      1.237      0.902      TRUE -0.335 0.570 -0.587 0.557
## 278      0.619     -0.147      TRUE -0.766 0.529 -1.447 0.148
## 279     -0.100     -0.128      TRUE -0.027 0.528 -0.052 0.958
## 280     -0.867      0.011      TRUE  0.877 0.563  1.558 0.119
## 281      0.687     -0.079      TRUE -0.765 0.530 -1.445 0.148
## 282      0.737      0.270      TRUE -0.467 0.528 -0.885 0.376
## 283     -0.198      0.550      TRUE  0.748 0.529  1.415 0.157
## 284     -0.673     -0.864      TRUE -0.191 0.588 -0.325 0.746
## 285     -1.078     -0.458      TRUE  0.620 0.594  1.042 0.297
## 286     -1.517     -0.465      TRUE  1.052 0.640  1.645   0.1
## 287     -1.376     -1.522      TRUE -0.147 0.703 -0.209 0.834
## 288      0.014     -0.231      TRUE -0.245 0.528 -0.463 0.643
## 289     -0.339      0.065      TRUE  0.404 0.532  0.760 0.447
## 290     -0.171     -0.812      TRUE -0.641 0.563 -1.140 0.254
## 291     -0.098     -0.399      TRUE -0.300 0.537 -0.560 0.576
## 292     -1.025     -1.280      TRUE -0.255 0.648 -0.393 0.694
## 293      1.045      1.300      TRUE  0.255 0.582  0.438 0.661
## 294      1.111      1.754      TRUE  0.643 0.627  1.025 0.305
## 295     -1.255     -1.013      TRUE  0.242 0.645  0.375 0.708
## 296     -1.908     -1.142      TRUE  0.766 0.726  1.055 0.292
## 297      0.662      0.071      TRUE -0.590 0.526 -1.122 0.262
## 298     -0.882     -0.137      TRUE  0.745 0.567  1.314 0.189
## 299      0.571      0.413      TRUE -0.158 0.524 -0.302 0.763
## 300     -0.141      0.033      TRUE  0.174 0.525  0.331 0.741
## 301     -0.607     -0.787      TRUE -0.179 0.579 -0.310 0.756
## 302     -0.774     -0.538      TRUE  0.236 0.574  0.411 0.681
## 303      0.887      1.014      TRUE  0.127 0.555  0.228  0.82
## 304      0.569     -0.135      TRUE -0.704 0.528 -1.334 0.182
## 305     -0.991     -1.305      TRUE -0.314 0.648 -0.484 0.628
## 306      0.157      0.277      TRUE  0.120 0.519  0.231 0.817
## 307      0.638      0.365      TRUE -0.273 0.525 -0.520 0.603
## 308     -0.039      0.609      TRUE  0.647 0.526  1.230 0.219
## 309     -0.861     -0.703      TRUE  0.158 0.590  0.268 0.789
## 310      0.609      0.336      TRUE -0.273 0.524 -0.521 0.603
## 311      0.082      0.407      TRUE  0.325 0.521  0.625 0.532
## 312     -0.254     -0.074      TRUE  0.180 0.531  0.339 0.735
## 313      1.335      0.557      TRUE -0.778 0.566 -1.374 0.169
## 314     -0.232     -0.050      TRUE  0.182 0.530  0.343 0.732
## 315     -1.555     -1.872      TRUE -0.317 0.758 -0.418 0.676
## 316      0.633      0.426      TRUE -0.206 0.526 -0.393 0.694
## 317      1.016     -0.219      TRUE -1.234 0.548 -2.253 0.024
## 318     -0.443     -1.027      TRUE -0.584 0.589 -0.991 0.322
## 319      1.288      0.909      TRUE -0.378 0.574 -0.659  0.51
## 320      0.507      0.316      TRUE -0.191 0.522 -0.367 0.714
## 321     -1.629     -1.792      TRUE -0.163 0.757 -0.215  0.83
## 322      0.938      1.139      TRUE  0.201 0.565  0.356 0.722
## 323     -1.838     -1.660      TRUE  0.178 0.765  0.233 0.816
## 324      0.054      0.424      TRUE  0.370 0.521  0.710 0.478
## 325     -0.211      0.159      TRUE  0.370 0.526  0.704 0.481
## 326      0.623      0.765      TRUE  0.142 0.534  0.266  0.79
## 327      1.075      1.144      TRUE  0.069 0.573  0.121 0.904
## 328      1.349      0.322      TRUE -1.027 0.564 -1.819 0.069
## 329     -0.356     -0.380      TRUE -0.024 0.544 -0.044 0.965
## 330     -0.310     -0.018      TRUE  0.292 0.532  0.549 0.583
## 331      0.778      0.101      TRUE -0.677 0.530 -1.277 0.201
## 332     -0.712     -0.306      TRUE  0.406 0.560  0.725 0.468
## 333      0.268      1.065      TRUE  0.796 0.544  1.464 0.143
## 334     -0.665     -0.402      TRUE  0.263 0.561  0.468  0.64
## 335     -2.153     -0.952      TRUE  1.201 0.743  1.616 0.106
## 336     -1.274     -0.845      TRUE  0.428 0.634  0.676 0.499
## 337      0.012     -0.964      TRUE -0.976 0.571 -1.709 0.087
## 338      0.156      0.111      TRUE -0.045 0.520 -0.087 0.931
## 339      0.456      1.382      TRUE  0.925 0.568  1.628 0.104
## 340      0.850      1.554      TRUE  0.704 0.595  1.184 0.236
## 341      0.060     -0.158      TRUE -0.218 0.526 -0.414 0.679
## 342     -0.525     -0.347      TRUE  0.177 0.551  0.322 0.747
## 343     -0.492     -1.185      TRUE -0.693 0.606 -1.144 0.253
## 344      1.303      1.816      TRUE  0.513 0.646  0.795 0.427
## 345      1.030     -0.148      TRUE -1.178 0.547 -2.155 0.031
## 346      0.435     -0.577      TRUE -1.013 0.543 -1.864 0.062
## 347      0.733      0.818      TRUE  0.084 0.540  0.156 0.876
## 348      1.314      1.191      TRUE -0.124 0.592 -0.209 0.835
## 349     -0.374     -1.184      TRUE -0.810 0.601 -1.348 0.178
## 350     -0.240     -0.002      TRUE  0.238 0.529  0.450 0.653
## 351     -0.662     -1.375      TRUE -0.713 0.633 -1.125 0.261
## 352     -0.312     -0.734      TRUE -0.422 0.562 -0.751 0.453
## 353      1.532      1.738      TRUE  0.206 0.655  0.315 0.753
## 354     -0.406     -0.095      TRUE  0.311 0.537  0.579 0.562
## 355      0.432      0.106      TRUE -0.327 0.521 -0.628  0.53
## 356      0.342      0.376      TRUE  0.033 0.520  0.064 0.949
## 357      1.145      0.576      TRUE -0.569 0.553 -1.029 0.303
## 358     -0.852     -0.500      TRUE  0.352 0.578  0.610 0.542
## 359      0.068     -0.159      TRUE -0.227 0.525 -0.432 0.665
## 360      1.008      0.941      TRUE -0.067 0.558 -0.120 0.904
## 361      0.227      0.466      TRUE  0.240 0.521  0.460 0.645
## 362      0.324      0.135      TRUE -0.189 0.520 -0.364 0.716
## 363      0.707      0.885      TRUE  0.177 0.542  0.327 0.743
## 364      1.485      1.126      TRUE -0.359 0.602 -0.597 0.551
## 365      0.034     -0.456      TRUE -0.490 0.537 -0.912 0.362
## 366      1.661      0.326      TRUE -1.335 0.593 -2.250 0.024
## 367     -0.953     -1.040      TRUE -0.087 0.621 -0.140 0.889
## 368     -1.503     -1.873      TRUE -0.370 0.753 -0.491 0.624
## 369     -1.450     -1.872      TRUE -0.422 0.748 -0.564 0.573
## 370      0.684      0.592      TRUE -0.092 0.530 -0.173 0.863
## 371      0.297      0.301      TRUE  0.004 0.519  0.007 0.994
## 372     -1.145     -0.399      TRUE  0.747 0.598  1.248 0.212
## 373      1.130      0.365      TRUE -0.765 0.548 -1.395 0.163
## 374     -1.085     -1.146      TRUE -0.062 0.640 -0.096 0.923
## 375     -0.661     -0.933      TRUE -0.272 0.593 -0.459 0.646
## 376     -0.630     -0.392      TRUE  0.238 0.558  0.427 0.669
## 377      0.566      0.399      TRUE -0.167 0.524 -0.319 0.749
## 378      0.570      1.416      TRUE  0.845 0.573  1.474  0.14
## 379      1.307      1.798      TRUE  0.491 0.644  0.762 0.446
## 380      0.745      0.428      TRUE -0.317 0.529 -0.598  0.55
## 381     -0.707     -0.834      TRUE -0.128 0.588 -0.217 0.828
## 382      0.148      0.403      TRUE  0.254 0.520  0.489 0.625
## 383     -0.230      0.322      TRUE  0.552 0.527  1.048 0.295
## 384      0.121      0.831      TRUE  0.710 0.532  1.334 0.182
## 385     -0.892     -0.668      TRUE  0.224 0.590  0.380 0.704
## 386      0.878      0.972      TRUE  0.094 0.553  0.170 0.865
## 387     -0.380     -0.430      TRUE -0.050 0.547 -0.091 0.928
## 388      0.381      0.259      TRUE -0.121 0.520 -0.233 0.816
## 389     -1.024     -0.921      TRUE  0.102 0.617  0.166 0.868
## 390     -0.192     -0.414      TRUE -0.223 0.540 -0.413  0.68
## 391      0.229      0.109      TRUE -0.120 0.520 -0.231 0.817
## 392     -0.763     -0.141      TRUE  0.622 0.559  1.114 0.265
## 393      0.368      0.135      TRUE -0.233 0.520 -0.448 0.654
## 394     -0.193     -0.362      TRUE -0.169 0.538 -0.314 0.754
## 395      0.244     -0.990      TRUE -1.234 0.571 -2.159 0.031
## 396      1.562      1.069      TRUE -0.492 0.606 -0.813 0.416
## 397     -1.095     -0.195      TRUE  0.899 0.587  1.533 0.125
## 398      0.556      0.613      TRUE  0.057 0.527  0.108 0.914
## 399      0.894      0.312      TRUE -0.581 0.535 -1.087 0.277
## 400     -1.038     -0.533      TRUE  0.505 0.594  0.850 0.395
## 401      0.994      1.335      TRUE  0.341 0.582  0.586 0.558
## 402     -1.080     -0.793      TRUE  0.287 0.613  0.468  0.64
## 403     -0.943     -0.695      TRUE  0.249 0.595  0.418 0.676
## 404      1.521      0.956      TRUE -0.565 0.596 -0.948 0.343
## 405     -0.187     -1.005      TRUE -0.818 0.578 -1.414 0.157
## 406      0.200     -0.441      TRUE -0.641 0.535 -1.197 0.231
## 407     -1.209     -1.453      TRUE -0.245 0.680 -0.360 0.719
## 408     -0.310     -0.340      TRUE -0.029 0.541 -0.054 0.957
## 409     -0.654      0.230      TRUE  0.884 0.547  1.616 0.106
## 410      0.477      0.433      TRUE -0.045 0.522 -0.086 0.932
## 411     -1.230     -1.274      TRUE -0.044 0.665 -0.067 0.947
## 412      0.805      0.058      TRUE -0.746 0.532 -1.404  0.16
## 413      0.033     -0.185      TRUE -0.217 0.527 -0.412  0.68
## 414      0.874      1.571      TRUE  0.696 0.597  1.166 0.244
## 415      0.691     -0.076      TRUE -0.767 0.530 -1.448 0.148
## 416     -1.348     -0.750      TRUE  0.599 0.636  0.942 0.346
## 417     -1.081     -1.305      TRUE -0.224 0.655 -0.342 0.732
## 418      1.708      1.670      TRUE -0.039 0.665 -0.058 0.954
## 419     -1.629     -1.872      TRUE -0.243 0.765 -0.317 0.751
## 420      1.030      0.643      TRUE -0.387 0.547 -0.707  0.48
## 421      0.938      0.444      TRUE -0.494 0.538 -0.918 0.359
## 422     -0.592     -0.322      TRUE  0.270 0.553  0.488 0.625
## 423     -0.813     -0.809      TRUE  0.003 0.593  0.005 0.996
## 424     -0.426     -0.915      TRUE -0.489 0.579 -0.845 0.398
## 425     -0.260     -0.147      TRUE  0.112 0.533  0.211 0.833
## 426     -0.614     -1.447      TRUE -0.833 0.639 -1.305 0.192
## 427     -0.773     -0.636      TRUE  0.137 0.579  0.237 0.813
## 428     -1.393     -0.565      TRUE  0.829 0.630  1.314 0.189
## 429     -0.036      0.730      TRUE  0.767 0.530  1.446 0.148
## 430     -0.556     -1.147      TRUE -0.591 0.605 -0.977 0.329
## 431     -0.788      0.476      TRUE  1.265 0.557  2.268 0.023
## 432      0.882      0.423      TRUE -0.459 0.535 -0.858 0.391
## 433      1.708      2.103      TRUE  0.395 0.710  0.556 0.578
## 434     -2.153     -2.153      TRUE  0.000 0.853  0.000     1
## 435      1.079      0.212      TRUE -0.867 0.545 -1.592 0.111
## 436      0.066     -0.034      TRUE -0.099 0.523 -0.190 0.849
## 437      1.148      1.066      TRUE -0.082 0.573 -0.144 0.886
## 438     -1.255     -1.660      TRUE -0.405 0.706 -0.573 0.567
## 439      0.878      0.457      TRUE -0.421 0.535 -0.787 0.432
## 440     -0.043      0.762      TRUE  0.805 0.531  1.514  0.13
## 441      0.174      0.282      TRUE  0.107 0.519  0.207 0.836
## 442      1.029      0.122      TRUE -0.907 0.542 -1.673 0.094
## 443     -0.796     -1.079      TRUE -0.283 0.613 -0.462 0.644
## 444     -0.948     -0.283      TRUE  0.665 0.577  1.154 0.249
## 445     -0.472      0.265      TRUE  0.737 0.536  1.374 0.169
## 446      0.469      0.712      TRUE  0.242 0.529  0.458 0.647
## 447     -1.255     -0.705      TRUE  0.550 0.624  0.883 0.377
## 448     -1.416     -1.788      TRUE -0.372 0.735 -0.507 0.612
## 449      1.229      1.133      TRUE -0.095 0.582 -0.164  0.87
## 450     -0.404     -1.055      TRUE -0.652 0.590 -1.105 0.269
## 451      1.406      0.969      TRUE -0.437 0.587 -0.745 0.457
## 452     -0.438      0.532      TRUE  0.969 0.538  1.802 0.071
## 453     -0.862     -0.513      TRUE  0.349 0.579  0.603 0.547
## 454      2.135      2.047      TRUE -0.088 0.747 -0.118 0.906
## 455     -0.045     -0.169      TRUE -0.124 0.528 -0.236 0.814
## 456     -0.383     -0.799      TRUE -0.416 0.569 -0.730 0.465
## 457     -0.432     -0.775      TRUE -0.343 0.569 -0.602 0.547
## 458     -1.872     -1.527      TRUE  0.345 0.755  0.457 0.648
## 459     -0.259     -0.487      TRUE -0.228 0.546 -0.419 0.675
## 460     -0.024      0.071      TRUE  0.095 0.522  0.182 0.855
## 461      1.020      0.563      TRUE -0.458 0.545 -0.840 0.401
## 462     -1.104     -1.084      TRUE  0.020 0.637  0.031 0.975
## 463      1.176      1.412      TRUE  0.236 0.599  0.395 0.693
## 464      0.133      0.424      TRUE  0.291 0.520  0.560 0.576
## 465      1.515      0.867      TRUE -0.648 0.592 -1.095 0.273
## 466      0.460      0.777      TRUE  0.317 0.531  0.598  0.55
## 467      0.319     -0.425      TRUE -0.744 0.534 -1.392 0.164
## 468     -0.056     -1.067      TRUE -1.010 0.581 -1.739 0.082
## 469     -0.597     -0.701      TRUE -0.104 0.573 -0.182 0.856
## 470     -0.029      0.506      TRUE  0.536 0.524  1.022 0.307
## 471     -0.320     -1.064      TRUE -0.743 0.588 -1.265 0.206
## 472      1.493      1.523      TRUE  0.029 0.632  0.047 0.963
## 473     -0.719     -0.206      TRUE  0.513 0.557  0.920 0.358
## 474     -0.342      0.202      TRUE  0.544 0.531  1.025 0.305
## 475      0.673      1.595      TRUE  0.922 0.593  1.556  0.12
## 476     -0.339      0.165      TRUE  0.504 0.531  0.950 0.342
## 477      0.859      0.588      TRUE -0.271 0.537 -0.505 0.614
## 478      0.672      1.143      TRUE  0.470 0.555  0.847 0.397
## 479     -0.233     -0.862      TRUE -0.630 0.568 -1.108 0.268
## 480     -0.259     -0.041      TRUE  0.219 0.530  0.413  0.68
## 481     -0.206      0.522      TRUE  0.728 0.529  1.377 0.169
## 482     -0.557     -1.059      TRUE -0.501 0.597 -0.839 0.401
## 483      1.751      1.310      TRUE -0.442 0.639 -0.691  0.49
## 484     -0.615     -0.960      TRUE -0.344 0.592 -0.582 0.561
## 485     -0.313     -0.581      TRUE -0.269 0.552 -0.486 0.627
## 486      0.235      0.032      TRUE -0.203 0.520 -0.391 0.696
## 487     -0.679     -1.872      TRUE -1.193 0.692 -1.724 0.085
## 488     -0.214     -0.206      TRUE  0.009 0.533  0.016 0.987
## 489      0.692      0.692      TRUE -0.001 0.534 -0.001 0.999
## 490      0.418     -0.057      TRUE -0.474 0.523 -0.907 0.365
## 491     -1.554     -1.263      TRUE  0.290 0.696  0.417 0.677
## 492     -0.731     -0.506      TRUE  0.225 0.570  0.395 0.693
## 493     -0.134      0.571      TRUE  0.705 0.528  1.336 0.182
## 494     -0.251      0.227      TRUE  0.479 0.527  0.908 0.364
## 495     -1.055     -0.658      TRUE  0.397 0.602  0.659  0.51
## 496      1.601      0.729      TRUE -0.872 0.595 -1.466 0.143
## 497      0.117     -0.128      TRUE -0.244 0.524 -0.466 0.641
## 498      1.727      1.444      TRUE -0.283 0.647 -0.437 0.662
## 499     -0.830      0.417      TRUE  1.247 0.560  2.228 0.026
## 500      0.518      1.205      TRUE  0.687 0.556  1.237 0.216
## 501     -1.113     -2.153      TRUE -1.040 0.754 -1.380 0.168
## 502     -0.752     -1.056      TRUE -0.304 0.608 -0.500 0.617
## 503      0.170      0.619      TRUE  0.448 0.524  0.855 0.392
## 504      0.118     -0.704      TRUE -0.822 0.550 -1.494 0.135
## 505      0.500     -0.114      TRUE -0.614 0.526 -1.169 0.242
## 506     -1.555     -0.883      TRUE  0.672 0.666  1.008 0.313
## 507     -1.030     -1.488      TRUE -0.458 0.669 -0.684 0.494
## 508     -1.078     -1.496      TRUE -0.418 0.674 -0.621 0.535
## 509      1.777      1.238      TRUE -0.539 0.637 -0.845 0.398
## 510      1.357      1.479      TRUE  0.123 0.617  0.199 0.843
## 511      0.222     -0.231      TRUE -0.453 0.527 -0.860  0.39
## 512      0.258      0.636      TRUE  0.378 0.525  0.721 0.471
## 513     -1.599     -0.687      TRUE  0.912 0.659  1.383 0.167
## 514      2.030      2.354      TRUE  0.324 0.771  0.420 0.674
## 515     -0.770     -0.826      TRUE -0.056 0.591 -0.094 0.925
## 516     -0.637     -1.285      TRUE -0.648 0.623 -1.041 0.298
## 517     -0.409     -0.333      TRUE  0.075 0.545  0.138  0.89
## 518     -1.124     -0.991      TRUE  0.133 0.631  0.211 0.833
## 519      1.649      1.069      TRUE -0.580 0.614 -0.944 0.345
## 520     -1.788     -0.583      TRUE  1.205 0.677  1.781 0.075
## 521      0.185     -0.356      TRUE -0.541 0.531 -1.018 0.309
## 522     -0.278      0.461      TRUE  0.739 0.530  1.395 0.163
## 523      1.666      1.613      TRUE -0.053 0.655 -0.081 0.936
## 524     -1.254     -1.691      TRUE -0.438 0.710 -0.616 0.538
## 525     -0.647     -0.147      TRUE  0.501 0.551  0.909 0.363
## 526     -0.412     -0.356      TRUE  0.056 0.546  0.103 0.918
## 527      0.894      0.965      TRUE  0.071 0.553  0.128 0.898
## 528     -0.199     -1.373      TRUE -1.174 0.615 -1.910 0.056
## 529      0.096      0.304      TRUE  0.208 0.520  0.400 0.689
## 530      0.322      1.236      TRUE  0.914 0.556  1.645   0.1
## 531      0.947      0.534      TRUE -0.413 0.540 -0.765 0.444
## 532      0.260     -0.068      TRUE -0.328 0.522 -0.628  0.53
## 533      0.979      0.572      TRUE -0.407 0.543 -0.750 0.453
## 534     -0.558     -1.071      TRUE -0.513 0.599 -0.856 0.392
## 535     -0.134      0.421      TRUE  0.555 0.525  1.057  0.29
## 536     -0.712      0.061      TRUE  0.773 0.551  1.401 0.161
## 537     -1.486     -1.196      TRUE  0.290 0.683  0.425 0.671
## 538      1.206      0.996      TRUE -0.210 0.573 -0.367 0.714
## 539     -0.155     -0.063      TRUE  0.092 0.528  0.175 0.861
## 540      0.771      0.441      TRUE -0.329 0.530 -0.620 0.535
## 541      0.313      0.228      TRUE -0.084 0.519 -0.162 0.871
## 542     -0.479     -1.288      TRUE -0.809 0.615 -1.314 0.189
## 543     -0.535     -1.316      TRUE -0.782 0.621 -1.259 0.208
## 544     -1.042     -0.134      TRUE  0.908 0.580  1.565 0.118
## 545     -0.974     -0.603      TRUE  0.371 0.593  0.626 0.531
## 546      0.003     -0.006      TRUE -0.010 0.523 -0.018 0.985
## 547      0.459      0.319      TRUE -0.140 0.521 -0.270 0.787
## 548      0.415      0.325      TRUE -0.090 0.520 -0.173 0.863
## 549      0.324      0.218      TRUE -0.106 0.519 -0.204 0.839
## 550      0.789      0.960      TRUE  0.170 0.548  0.310 0.756
## 551      0.612      0.012      TRUE -0.600 0.526 -1.141 0.254
## 552      0.818      0.522      TRUE -0.296 0.534 -0.554  0.58
## 553     -1.873     -1.226      TRUE  0.647 0.728  0.889 0.374
## 554      0.589     -0.157      TRUE -0.746 0.529 -1.411 0.158
## 555      0.667      0.368      TRUE -0.299 0.526 -0.568  0.57
## 556      0.981      1.124      TRUE  0.143 0.567  0.252 0.801
## 557      0.654      0.635      TRUE -0.019 0.531 -0.036 0.971
## 558      0.336     -0.790      TRUE -1.126 0.556 -2.025 0.043
## 559      0.624      0.056      TRUE -0.568 0.525 -1.081  0.28
## 560     -1.350     -1.629      TRUE -0.279 0.712 -0.392 0.695
## 561     -1.522     -1.872      TRUE -0.350 0.755 -0.463 0.643
## 562      1.994      2.047      TRUE  0.053 0.732  0.073 0.942
## 563      0.158      0.140      TRUE -0.018 0.519 -0.035 0.972
## 564     -0.225     -0.363      TRUE -0.138 0.539 -0.255 0.799
## 565     -1.044     -0.999      TRUE  0.046 0.625  0.073 0.942
## 566     -0.570     -0.404      TRUE  0.166 0.555  0.299 0.765
## 567     -0.331      0.538      TRUE  0.869 0.533  1.630 0.103
## 568      0.288     -0.485      TRUE -0.773 0.537 -1.439  0.15
## 569      0.486     -0.309      TRUE -0.795 0.531 -1.496 0.135
## 570      1.852      1.959      TRUE  0.108 0.708  0.152 0.879
## 571     -0.786     -0.563      TRUE  0.223 0.576  0.387 0.699
## 572      1.413      1.247      TRUE -0.166 0.604 -0.275 0.784
## 573      1.072      0.777      TRUE -0.296 0.554 -0.534 0.594
## 574      0.202     -0.905      TRUE -1.108 0.565 -1.962  0.05
## 575     -0.266     -0.517      TRUE -0.250 0.547 -0.457 0.648
## 576     -0.686     -1.289      TRUE -0.603 0.626 -0.964 0.335
## 577      0.953      0.571      TRUE -0.382 0.541 -0.706  0.48
## 578     -0.297     -0.593      TRUE -0.296 0.553 -0.536 0.592
## 579     -0.785     -0.935      TRUE -0.150 0.600 -0.250 0.803
## 580     -1.306     -1.146      TRUE  0.160 0.660  0.242 0.809
## 581      0.232     -0.123      TRUE -0.355 0.523 -0.677 0.498
## 582     -1.447     -1.810      TRUE -0.363 0.741 -0.490 0.624
## 583      0.642      0.911      TRUE  0.269 0.541  0.497  0.62
## 584     -0.851     -0.201      TRUE  0.649 0.566  1.146 0.252
## 585      0.428      0.709      TRUE  0.281 0.528  0.532 0.594
## 586      0.290      0.861      TRUE  0.571 0.533  1.071 0.284
## 587     -0.201      0.153      TRUE  0.354 0.526  0.674 0.501
## 588     -0.430     -0.961      TRUE -0.530 0.583 -0.909 0.363
## 589      0.311     -0.009      TRUE -0.320 0.521 -0.614 0.539
## 590     -0.984     -1.306      TRUE -0.323 0.647 -0.499 0.618
## 591     -1.166     -1.042      TRUE  0.123 0.639  0.193 0.847
## 592      0.303      0.462      TRUE  0.160 0.521  0.306 0.759
## 593      0.000     -0.476      TRUE -0.476 0.539 -0.884 0.377
## 594     -0.310      0.067      TRUE  0.377 0.530  0.711 0.477
## 595      0.164     -0.038      TRUE -0.202 0.522 -0.387 0.699
## 596     -0.939     -0.210      TRUE  0.729 0.574  1.271 0.204
## 597     -0.217      0.363      TRUE  0.580 0.527  1.100 0.271
## 598      1.044      0.301      TRUE -0.743 0.543 -1.368 0.171
## 599     -0.390     -0.773      TRUE -0.383 0.567 -0.675   0.5
## 600     -0.328     -0.331      TRUE -0.002 0.541 -0.005 0.996
## 601     -0.490     -0.752      TRUE -0.262 0.570 -0.459 0.646
## 602      0.553     -0.645      TRUE -1.197 0.549 -2.179 0.029
## 603     -1.025     -1.063      TRUE -0.038 0.628 -0.060 0.952
## 604     -0.014     -0.995      TRUE -0.981 0.574 -1.709 0.088
## 605     -0.028     -1.302      TRUE -1.274 0.604 -2.111 0.035
## 606      0.861      1.666      TRUE  0.805 0.606  1.328 0.184
## 607      0.362      0.136      TRUE -0.227 0.520 -0.436 0.663
## 608      0.752      0.929      TRUE  0.177 0.545  0.325 0.745
## 609      1.110      0.870      TRUE -0.240 0.560 -0.428 0.668
## 610     -0.560     -0.398      TRUE  0.161 0.555  0.291 0.771
## 611      0.915      0.211      TRUE -0.704 0.536 -1.315 0.188
## 612     -1.322     -0.163      TRUE  1.158 0.608  1.904 0.057
## 613      1.685      1.174      TRUE -0.511 0.624 -0.819 0.413
## 614     -0.436     -0.246      TRUE  0.190 0.543  0.350 0.727
## 615     -0.777     -0.132      TRUE  0.645 0.559  1.154 0.249
## 616      1.185      1.862      TRUE  0.677 0.643  1.053 0.292
## 617      0.094      0.456      TRUE  0.362 0.521  0.694 0.488
## 618      1.268      0.805      TRUE -0.462 0.569 -0.813 0.416
## 619     -0.717     -1.338      TRUE -0.621 0.633 -0.981 0.327
## 620      0.610      0.666      TRUE  0.055 0.530  0.104 0.917
## 621      0.485      0.382      TRUE -0.102 0.522 -0.196 0.844
## 622      0.470      1.188      TRUE  0.719 0.554  1.298 0.194
## 623      1.751      1.447      TRUE -0.304 0.650 -0.468  0.64
## 624     -0.458     -0.999      TRUE -0.542 0.588 -0.922 0.357
## 625     -1.257     -1.558      TRUE -0.301 0.696 -0.433 0.665
## 626      0.637      0.854      TRUE  0.216 0.538  0.402 0.688
## 627      0.708      0.531      TRUE -0.177 0.530 -0.334 0.738
## 628     -0.166      0.219      TRUE  0.385 0.525  0.734 0.463
## 629     -0.599     -0.519      TRUE  0.080 0.562  0.142 0.887
## 630      0.789      0.200      TRUE -0.589 0.530 -1.111 0.266
## 631      0.706     -0.291      TRUE -0.996 0.536 -1.857 0.063
## 632     -0.132      0.453      TRUE  0.585 0.525  1.114 0.265
## 633      0.714     -0.201      TRUE -0.914 0.534 -1.713 0.087
## 634     -0.398     -0.931      TRUE -0.533 0.579 -0.920 0.358
## 635     -0.763     -0.668      TRUE  0.095 0.581  0.164  0.87
## 636      0.761      0.062      TRUE -0.699 0.530 -1.320 0.187
## 637      0.442      0.043      TRUE -0.400 0.522 -0.766 0.444
## 638      0.763      0.971      TRUE  0.207 0.548  0.379 0.705
## 639      1.844      1.751      TRUE -0.092 0.686 -0.134 0.893
## 640     -0.607     -0.236      TRUE  0.370 0.551  0.672 0.502
## 641     -0.340     -0.495      TRUE -0.155 0.549 -0.282 0.778
## 642      0.724      0.727      TRUE  0.002 0.536  0.005 0.996
## 643      0.932      1.731      TRUE  0.799 0.616  1.298 0.194
## 644     -0.851     -0.305      TRUE  0.546 0.570  0.959 0.338
## 645      0.832      0.507      TRUE -0.325 0.534 -0.609 0.542
## 646     -0.484     -0.096      TRUE  0.387 0.541  0.716 0.474
## 647      0.532      0.821      TRUE  0.289 0.534  0.541 0.589
## 648     -0.065      0.494      TRUE  0.559 0.524  1.065 0.287
## 649      0.151      0.614      TRUE  0.463 0.524  0.882 0.378
## 650     -0.441      0.003      TRUE  0.444 0.537  0.827 0.408
## 651     -1.748     -1.131      TRUE  0.618 0.706  0.875 0.382
## 652      0.159     -0.165      TRUE -0.323 0.525 -0.616 0.538
## 653      0.954      0.368      TRUE -0.586 0.538 -1.090 0.276
## 654      0.483      0.408      TRUE -0.074 0.522 -0.142 0.887
## 655     -0.794     -0.814      TRUE -0.019 0.592 -0.033 0.974
## 656     -0.690     -0.827      TRUE -0.136 0.586 -0.232 0.816
## 657      0.181      0.320      TRUE  0.139 0.519  0.268 0.788
## 658      0.089      0.367      TRUE  0.277 0.520  0.533 0.594
## 659     -0.558     -1.299      TRUE -0.741 0.620 -1.194 0.232
## 660     -0.137     -0.359      TRUE -0.222 0.536 -0.414 0.679
## 661     -0.174     -0.080      TRUE  0.094 0.528  0.178 0.859
## 662      0.084     -0.265      TRUE -0.349 0.529 -0.660  0.51
## 663      0.801      0.187      TRUE -0.613 0.530 -1.156 0.248
## 664      0.288      0.119      TRUE -0.168 0.519 -0.324 0.746
## 665     -1.202     -0.692      TRUE  0.510 0.618  0.826 0.409
## 666     -0.754     -0.186      TRUE  0.568 0.559  1.016  0.31
## 667      0.058     -0.757      TRUE -0.814 0.554 -1.468 0.142
## 668     -0.185     -0.780      TRUE -0.596 0.561 -1.062 0.288
## 669     -1.574     -1.274      TRUE  0.300 0.699  0.429 0.668
## 670     -0.515     -0.543      TRUE -0.028 0.559 -0.051 0.959
## 671     -1.350     -0.269      TRUE  1.081 0.614  1.760 0.078
## 672     -0.275     -0.682      TRUE -0.407 0.557 -0.731 0.465
## 673      0.876      0.903      TRUE  0.027 0.549  0.050  0.96
## 674     -1.069     -1.057      TRUE  0.012 0.631  0.019 0.985
## 675     -0.716     -1.070      TRUE -0.354 0.607 -0.583  0.56
## 676     -1.872     -0.598      TRUE  1.274 0.688  1.852 0.064
## 677     -1.873     -1.577      TRUE  0.296 0.760  0.390 0.697
## 678     -0.137     -0.441      TRUE -0.304 0.540 -0.563 0.573
## 679     -0.184     -0.361      TRUE -0.177 0.538 -0.330 0.742
## 680     -1.294     -1.200      TRUE  0.094 0.664  0.141 0.888
## 681      0.054     -0.293      TRUE -0.346 0.530 -0.654 0.513
## 682      0.309      0.938      TRUE  0.629 0.537  1.171 0.241
## 683      0.332      0.434      TRUE  0.102 0.521  0.195 0.845
## 684     -1.056     -1.100      TRUE -0.045 0.634 -0.070 0.944
## 685      0.094     -0.212      TRUE -0.306 0.527 -0.581 0.561
## 686     -1.008     -0.380      TRUE  0.628 0.585  1.074 0.283
## 687      0.118      0.298      TRUE  0.180 0.520  0.347 0.729
## 688      1.046      0.259      TRUE -0.787 0.543 -1.449 0.147
## 689      0.430      0.747      TRUE  0.317 0.529  0.598  0.55
## 690      0.968      1.092      TRUE  0.124 0.564  0.219 0.826
## 691     -0.143      0.320      TRUE  0.464 0.524  0.884 0.377
## 692     -0.405     -0.836      TRUE -0.431 0.573 -0.753 0.452
## 693     -0.933     -0.855      TRUE  0.078 0.605  0.129 0.897
## 694      1.014      1.149      TRUE  0.135 0.570  0.236 0.813
## 695     -0.748     -0.661      TRUE  0.088 0.579  0.151  0.88
## 696     -0.382     -0.198      TRUE  0.185 0.539  0.343 0.732
## 697      0.098     -0.357      TRUE -0.455 0.532 -0.855 0.393
## 698      0.729      1.548      TRUE  0.819 0.590  1.389 0.165
## 699      0.667      1.141      TRUE  0.474 0.555  0.854 0.393
## 700      0.187      0.570      TRUE  0.382 0.523  0.731 0.465
## 701     -1.520     -1.872      TRUE -0.352 0.755 -0.466 0.641
## 702     -1.137     -1.170      TRUE -0.033 0.647 -0.051 0.959
## 703     -0.202     -0.303      TRUE -0.101 0.536 -0.189  0.85
## 704      1.331      1.094      TRUE -0.237 0.587 -0.403 0.687
## 705     -1.554     -0.909      TRUE  0.644 0.668  0.964 0.335
## 706      0.409      0.674      TRUE  0.265 0.527  0.502 0.615
## 707      0.437     -0.214      TRUE -0.651 0.527 -1.235 0.217
## 708     -0.004     -0.108      TRUE -0.104 0.525 -0.198 0.843
## 709     -0.249     -0.473      TRUE -0.224 0.545 -0.411 0.681
## 710      0.197     -0.053      TRUE -0.251 0.522 -0.480 0.631
## 711      1.169      1.104      TRUE -0.065 0.576 -0.114  0.91
## 712      0.936      0.879      TRUE -0.056 0.551 -0.102 0.919
## 713     -1.337     -1.872      TRUE -0.535 0.738 -0.725 0.469
## 714     -1.872     -2.153      TRUE -0.281 0.823 -0.342 0.732
## 715      1.333      0.566      TRUE -0.767 0.566 -1.354 0.176
## 716     -0.600     -0.011      TRUE  0.589 0.545  1.080  0.28
## 717      1.338      0.335      TRUE -1.003 0.564 -1.780 0.075
## 718     -0.637     -1.069      TRUE -0.432 0.602 -0.718 0.473
## 719     -0.058     -0.246      TRUE -0.189 0.530 -0.356 0.722
## 720      0.825     -0.058      TRUE -0.883 0.534 -1.652 0.098
## 721     -0.238      0.150      TRUE  0.387 0.527  0.735 0.462
## 722     -0.880     -0.557      TRUE  0.323 0.583  0.555 0.579
## 723     -0.327     -0.186      TRUE  0.141 0.536  0.263 0.793
## 724      0.946      1.032      TRUE  0.085 0.559  0.153 0.878
## 725     -0.667     -0.367      TRUE  0.300 0.560  0.537 0.592
## 726     -0.982     -0.382      TRUE  0.600 0.583  1.029 0.303
## 727      0.243      0.136      TRUE -0.106 0.519 -0.205 0.838
## 728      1.344      0.856      TRUE -0.488 0.576 -0.846 0.398
## 729      1.034      0.922      TRUE -0.112 0.558 -0.201  0.84
## 730      0.721      0.430      TRUE -0.291 0.528 -0.551 0.582
## 731      0.676      0.934      TRUE  0.258 0.543  0.474 0.635
## 732      0.384      0.145      TRUE -0.239 0.520 -0.460 0.646
## 733      0.447      0.656      TRUE  0.209 0.527  0.396 0.692
## 734     -0.489      0.354      TRUE  0.843 0.538  1.568 0.117
## 735      0.400      0.324      TRUE -0.076 0.520 -0.146 0.884
## 736      1.148      1.076      TRUE -0.072 0.573 -0.126   0.9
## 737     -2.153     -1.872      TRUE  0.281 0.823  0.342 0.732
## 738      0.472     -0.241      TRUE -0.714 0.529 -1.350 0.177
## 739      1.117      0.653      TRUE -0.464 0.553 -0.839 0.401
## 740     -1.488     -1.122      TRUE  0.365 0.677  0.540 0.589
## 741     -0.990     -0.564      TRUE  0.425 0.592  0.718 0.473
## 742     -2.153     -1.856      TRUE  0.297 0.821  0.362 0.717
## 743     -0.201     -0.058      TRUE  0.143 0.529  0.270 0.787
## 744     -1.873     -1.872      TRUE  0.001 0.791  0.001 0.999
## 745      0.899      0.376      TRUE -0.523 0.535 -0.978 0.328
## 746     -0.509     -0.593      TRUE -0.084 0.562 -0.149 0.881
## 747      0.485      0.375      TRUE -0.111 0.522 -0.212 0.832
## 748     -0.950     -0.550      TRUE  0.400 0.588  0.681 0.496
## 749     -0.075     -0.330      TRUE -0.254 0.534 -0.477 0.634
## 750     -1.247      0.740      TRUE  1.988 0.604  3.293 0.001
## 751      2.026      1.538      TRUE -0.488 0.687 -0.711 0.477
## 752      0.955      0.470      TRUE -0.485 0.539 -0.899 0.369
## 753      1.994      1.967      TRUE -0.027 0.723 -0.037 0.971
## 754      1.116      0.672      TRUE -0.444 0.553 -0.802 0.423
## 755     -0.892     -0.568      TRUE  0.325 0.584  0.555 0.579
## 756     -1.206     -1.021      TRUE  0.186 0.641  0.290 0.772
## 757     -0.713     -0.399      TRUE  0.314 0.564  0.558 0.577
## 758      0.186      1.016      TRUE  0.829 0.541  1.533 0.125
## 759     -0.332     -0.481      TRUE -0.149 0.548 -0.272 0.786
## 760     -0.881     -1.540      TRUE -0.659 0.664 -0.991 0.322
## 761     -1.788     -2.153      TRUE -0.365 0.814 -0.448 0.654
## 762      0.496     -0.200      TRUE -0.696 0.528 -1.318 0.187
## 763     -0.006      0.491      TRUE  0.497 0.523  0.950 0.342
## 764     -0.215     -0.527      TRUE -0.312 0.546 -0.571 0.568
## 765      1.336      1.221      TRUE -0.115 0.596 -0.193 0.847
## 766      0.158     -0.277      TRUE -0.435 0.528 -0.823  0.41
## 767     -1.094     -0.797      TRUE  0.296 0.614  0.483 0.629
## 768     -0.982     -0.490      TRUE  0.492 0.588  0.837 0.402
## 769      0.226      0.718      TRUE  0.491 0.527  0.932 0.351
## 770     -1.096     -1.056      TRUE  0.040 0.634  0.063  0.95
## 771      0.973     -0.325      TRUE -1.298 0.549 -2.364 0.018
## 772      1.147      1.297      TRUE  0.150 0.588  0.255 0.799
## 773      0.091      0.618      TRUE  0.527 0.525  1.004 0.315
## 774     -0.142      0.275      TRUE  0.418 0.524  0.797 0.425
## 775     -0.194     -0.067      TRUE  0.127 0.529  0.240  0.81
## 776      0.830      0.321      TRUE -0.510 0.532 -0.959 0.338
## 777     -0.374     -1.158      TRUE -0.784 0.598 -1.310  0.19
## 778      0.490      1.491      TRUE  1.001 0.579  1.731 0.083
## 779     -1.104     -1.518      TRUE -0.414 0.678 -0.611 0.541
## 780     -0.234      0.429      TRUE  0.662 0.528  1.254  0.21
## 781      0.187     -0.046      TRUE -0.232 0.522 -0.445 0.656
## 782      0.200      0.573      TRUE  0.373 0.523  0.714 0.475
## 783     -1.115     -1.213      TRUE -0.098 0.649 -0.151  0.88
## 784     -1.574     -1.285      TRUE  0.289 0.700  0.413 0.679
## 785     -1.013     -0.436      TRUE  0.577 0.588  0.981 0.326
## 786      1.213      1.472      TRUE  0.259 0.606  0.428 0.669
## 787     -0.914     -1.184      TRUE -0.271 0.630 -0.429 0.668
## 788      0.692      0.475      TRUE -0.216 0.528 -0.410 0.682
## 789      0.271      0.788      TRUE  0.517 0.530  0.976 0.329
## 790      1.959      1.086      TRUE -0.873 0.649 -1.346 0.178
## 791      0.289     -0.284      TRUE -0.573 0.529 -1.085 0.278
## 792      1.013      0.853      TRUE -0.160 0.554 -0.289 0.772
## 793     -0.616     -0.555      TRUE  0.061 0.565  0.107 0.915
## 794     -1.872     -1.098      TRUE  0.774 0.718  1.078 0.281
## 795     -0.174      0.021      TRUE  0.195 0.527  0.369 0.712
## 796      0.017     -0.039      TRUE -0.056 0.523 -0.106 0.916
## 797     -0.460     -0.103      TRUE  0.357 0.540  0.660 0.509
## 798     -0.275      0.620      TRUE  0.895 0.533  1.679 0.093
## 799      0.336      0.192      TRUE -0.143 0.519 -0.276 0.783
## 800     -0.396     -0.216      TRUE  0.180 0.540  0.333 0.739
## 801      0.786      0.929      TRUE  0.142 0.547  0.260 0.795
## 802     -0.164      0.264      TRUE  0.428 0.525  0.816 0.415
## 803     -0.675     -0.007      TRUE  0.668 0.550  1.215 0.224
## 804      1.261      0.925      TRUE -0.336 0.573 -0.586 0.558
## 805      1.502      1.657      TRUE  0.155 0.645  0.241  0.81
## 806     -1.317     -0.811      TRUE  0.506 0.636  0.795 0.427
## 807      0.641      0.662      TRUE  0.021 0.531  0.040 0.968
## 808      0.392      0.417      TRUE  0.025 0.521  0.049 0.961
## 809     -0.092     -0.180      TRUE -0.088 0.529 -0.166 0.868
## 810     -0.435     -0.754      TRUE -0.318 0.568 -0.560 0.575
## 811      1.549      0.928      TRUE -0.620 0.597 -1.038 0.299
## 812      1.015      0.330      TRUE -0.685 0.541 -1.266 0.206
## 813      1.558      0.599      TRUE -0.959 0.587 -1.634 0.102
## 814     -0.676     -0.897      TRUE -0.220 0.591 -0.373 0.709
## 815     -0.429      0.071      TRUE  0.500 0.535  0.933 0.351
## 816     -0.118     -0.631      TRUE -0.513 0.549 -0.933 0.351
## 817     -0.573      0.209      TRUE  0.782 0.542  1.444 0.149
## 818     -0.221      0.249      TRUE  0.469 0.526  0.892 0.372
## 819     -0.813     -0.718      TRUE  0.094 0.587  0.161 0.872
## 820     -0.398     -1.081      TRUE -0.683 0.592 -1.153 0.249
## 821      0.135      0.714      TRUE  0.579 0.527  1.098 0.272
## 822      1.303      1.704      TRUE  0.401 0.634  0.632 0.527
## 823     -1.389     -1.227      TRUE  0.162 0.675  0.240 0.811
## 824     -0.062     -0.136      TRUE -0.074 0.527 -0.141 0.888
## 825     -0.009     -0.004      TRUE  0.005 0.523  0.009 0.993
## 826      0.311      0.221      TRUE -0.091 0.519 -0.175 0.861
## 827     -1.142     -0.826      TRUE  0.316 0.621  0.509 0.611
## 828     -1.713     -0.696      TRUE  1.016 0.673  1.509 0.131
## 829      1.308      1.320      TRUE  0.012 0.601  0.020 0.984
## 830     -0.637      0.272      TRUE  0.909 0.546  1.666 0.096
## 831     -1.040     -1.029      TRUE  0.011 0.627  0.018 0.985
## 832      1.989      1.727      TRUE -0.262 0.699 -0.375 0.708
## 833      0.797      0.183      TRUE -0.615 0.530 -1.159 0.246
## 834      1.169      1.685      TRUE  0.516 0.624  0.827 0.408
## 835      0.471      0.182      TRUE -0.289 0.521 -0.554 0.579
## 836      1.031      0.742      TRUE -0.289 0.550 -0.525   0.6
## 837      0.358      0.085      TRUE -0.273 0.520 -0.524   0.6
## 838     -2.153     -1.522      TRUE  0.631 0.788  0.801 0.423
## 839      0.544      0.279      TRUE -0.265 0.522 -0.508 0.611
## 840     -0.112      0.820      TRUE  0.932 0.535  1.742 0.082
## 841     -0.518      0.793      TRUE  1.311 0.549  2.387 0.017
## 842      0.354      0.475      TRUE  0.121 0.521  0.232 0.817
## 843     -1.166     -0.984      TRUE  0.182 0.634  0.287 0.774
## 844     -0.682     -0.221      TRUE  0.462 0.555  0.831 0.406
## 845      0.019      0.454      TRUE  0.435 0.522  0.834 0.404
## 846      0.794      0.438      TRUE -0.357 0.531 -0.671 0.502
## 847     -0.338      0.099      TRUE  0.437 0.531  0.822 0.411
## 848     -0.448     -0.961      TRUE -0.513 0.584 -0.879  0.38
## 849      0.889     -0.180      TRUE -1.069 0.540 -1.979 0.048
## 850      0.690      1.812      TRUE  1.122 0.616  1.823 0.068
## 851      1.264      1.175      TRUE -0.089 0.587 -0.152 0.879
## 852      0.303     -0.447      TRUE -0.750 0.535 -1.400 0.161
## 853      0.264     -0.688      TRUE -0.952 0.549 -1.735 0.083
## 854     -1.872     -1.201      TRUE  0.671 0.726  0.923 0.356
## 855      0.211      0.174      TRUE -0.037 0.519 -0.071 0.943
## 856     -1.102     -1.555      TRUE -0.453 0.682 -0.665 0.506
## 857     -0.238     -0.440      TRUE -0.202 0.543 -0.372  0.71
## 858     -0.604     -0.612      TRUE -0.007 0.568 -0.013  0.99
## 859      0.171     -0.420      TRUE -0.591 0.534 -1.106 0.269
## 860     -0.897     -0.876      TRUE  0.021 0.604  0.035 0.972
## 861     -0.403     -0.858      TRUE -0.455 0.574 -0.793 0.428
## 862     -0.878     -0.902      TRUE -0.025 0.604 -0.041 0.967
## 863      1.533      1.101      TRUE -0.432 0.605 -0.715 0.475
## 864      0.708      0.980      TRUE  0.272 0.547  0.497 0.619
## 865     -0.090     -1.025      TRUE -0.935 0.578 -1.618 0.106
## 866     -1.184     -0.840      TRUE  0.345 0.625  0.551 0.582
## 867     -0.341     -0.715      TRUE -0.374 0.562 -0.667 0.505
## 868     -0.031     -0.384      TRUE -0.353 0.535 -0.661 0.509
## 869     -0.171     -0.445      TRUE -0.274 0.541 -0.506 0.613
## 870     -0.233      0.298      TRUE  0.531 0.527  1.007 0.314
## 871      0.484      0.773      TRUE  0.289 0.531  0.543 0.587
## 872     -0.643     -0.426      TRUE  0.217 0.561  0.386 0.699
## 873      0.596      0.513      TRUE -0.083 0.526 -0.157 0.875
## 874      0.186      0.205      TRUE  0.019 0.519  0.036 0.971
## 875      1.246      1.559      TRUE  0.313 0.616  0.508 0.611
## 876      0.960      1.623      TRUE  0.664 0.606  1.095 0.274
## 877     -0.639     -0.922      TRUE -0.284 0.591 -0.480 0.631
## 878     -0.069     -0.562      TRUE -0.493 0.544 -0.905 0.366
## 879      0.877      0.632      TRUE -0.245 0.539 -0.455 0.649
## 880      1.260      1.194      TRUE -0.066 0.588 -0.113  0.91
## 881     -0.525     -1.376      TRUE -0.851 0.627 -1.358 0.175
## 882     -0.534     -0.695      TRUE -0.161 0.569 -0.284 0.777
## 883      0.540     -0.109      TRUE -0.650 0.526 -1.234 0.217
## 884     -1.316     -2.153      TRUE -0.837 0.770 -1.087 0.277
## 885     -0.760     -0.580      TRUE  0.180 0.576  0.313 0.754
## 886      0.571      0.745      TRUE  0.174 0.532  0.327 0.744
## 887      0.392      0.048      TRUE -0.345 0.521 -0.662 0.508
## 888      0.554      0.789      TRUE  0.235 0.533  0.440  0.66
## 889     -2.153     -1.872      TRUE  0.281 0.823  0.342 0.732
## 890      1.251      1.606      TRUE  0.355 0.621  0.572 0.568
## 891     -0.696     -1.542      TRUE -0.846 0.653 -1.294 0.196
## 892      0.787      0.340      TRUE -0.448 0.530 -0.844 0.398
## 893     -0.532     -0.929      TRUE -0.397 0.585 -0.677 0.498
## 894     -1.039     -1.200      TRUE -0.161 0.641 -0.251 0.801
## 895     -1.574     -1.873      TRUE -0.298 0.760 -0.393 0.695
## 896      0.323      1.078      TRUE  0.755 0.545  1.385 0.166
## 897      0.758      0.445      TRUE -0.312 0.530 -0.589 0.556
## 898      0.754      0.162      TRUE -0.592 0.529 -1.120 0.263
## 899      2.354      2.072      TRUE -0.283 0.775 -0.364 0.716
## 900     -0.339     -0.536      TRUE -0.197 0.551 -0.357 0.721
## 901      1.406      0.988      TRUE -0.419 0.588 -0.713 0.476
## 902     -0.492     -1.141      TRUE -0.649 0.602 -1.079 0.281
## 903      0.554      0.294      TRUE -0.260 0.523 -0.498 0.619
## 904     -1.000     -1.236      TRUE -0.236 0.642 -0.367 0.713
## 905     -0.419     -0.751      TRUE -0.332 0.567 -0.585 0.559
## 906     -0.401     -0.564      TRUE -0.163 0.555 -0.293 0.769
## 907      0.364      0.291      TRUE -0.073 0.520 -0.140 0.888
## 908      0.037     -0.966      TRUE -1.003 0.571 -1.757 0.079
## 909      0.484     -0.093      TRUE -0.576 0.525 -1.098 0.272
## 910     -0.313      0.634      TRUE  0.947 0.535  1.771 0.077
## 911     -0.450      0.748      TRUE  1.198 0.544  2.201 0.028
## 912      0.349     -0.428      TRUE -0.776 0.535 -1.452 0.147
## 913     -1.384     -0.547      TRUE  0.837 0.628  1.331 0.183
## 914     -0.032      0.573      TRUE  0.605 0.525  1.152 0.249
## 915      1.852      1.736      TRUE -0.116 0.685 -0.169 0.866
## 916      1.835      1.852      TRUE  0.017 0.695  0.024 0.981
## 917      1.036      1.111      TRUE  0.075 0.569  0.132 0.895
## 918      0.340      0.310      TRUE -0.029 0.519 -0.056 0.955
## 919     -0.584     -0.303      TRUE  0.281 0.552  0.509 0.611
## 920     -0.048     -1.070      TRUE -1.022 0.581 -1.759 0.079
## 921      2.088      1.685      TRUE -0.403 0.706 -0.570 0.569
## 922      0.239     -0.165      TRUE -0.404 0.525 -0.770 0.441
## 923     -0.541     -0.309      TRUE  0.232 0.550  0.422 0.673
## 924     -0.880     -0.550      TRUE  0.330 0.583  0.567 0.571
## 925     -0.835     -1.035      TRUE -0.201 0.612 -0.328 0.743
## 926      0.636      0.107      TRUE -0.529 0.525 -1.008 0.313
## 927     -0.292      0.019      TRUE  0.312 0.530  0.587 0.557
## 928      0.288     -0.828      TRUE -1.116 0.559 -1.999 0.046
## 929      0.539      1.615      TRUE  1.077 0.591  1.821 0.069
## 930      0.580      0.053      TRUE -0.528 0.524 -1.006 0.314
## 931      0.877      0.179      TRUE -0.699 0.534 -1.309 0.191
## 932     -0.910     -1.254      TRUE -0.344 0.637 -0.540 0.589
## 933      0.747      0.378      TRUE -0.369 0.529 -0.698 0.485
## 934      0.381     -0.179      TRUE -0.561 0.526 -1.067 0.286
## 935     -0.019     -0.267      TRUE -0.249 0.530 -0.469 0.639
## 936     -1.112     -1.243      TRUE -0.131 0.651 -0.201 0.841
## 937      0.507      0.348      TRUE -0.159 0.522 -0.304 0.761
## 938      0.132     -1.002      TRUE -1.134 0.573 -1.980 0.048
## 939     -0.212     -0.691      TRUE -0.479 0.556 -0.862 0.389
## 940     -0.432      0.360      TRUE  0.791 0.535  1.479 0.139
## 941      0.555      1.355      TRUE  0.800 0.568  1.409 0.159
## 942     -2.153     -1.792      TRUE  0.362 0.814  0.444 0.657
## 943      0.027     -0.763      TRUE -0.790 0.555 -1.423 0.155
## 944     -0.931     -0.324      TRUE  0.607 0.577  1.052 0.293
## 945     -1.107     -0.849      TRUE  0.259 0.619  0.418 0.676
## 946      1.606      1.907      TRUE  0.302 0.679  0.444 0.657
## 947      0.485     -0.208      TRUE -0.693 0.528 -1.313 0.189
## 948      0.739      0.989      TRUE  0.251 0.548  0.458 0.647
## 949     -0.577     -0.053      TRUE  0.525 0.545  0.963 0.336
## 950      0.343      0.860      TRUE  0.517 0.533  0.969 0.332
## 951     -0.276     -0.241      TRUE  0.035 0.536  0.065 0.948
## 952     -0.657     -0.084      TRUE  0.573 0.550  1.041 0.298
## 953     -0.094     -1.713      TRUE -1.619 0.652 -2.483 0.013
## 954      0.293     -0.202      TRUE -0.495 0.526 -0.941 0.347
## 955      0.138      0.716      TRUE  0.578 0.527  1.096 0.273
## 956     -1.023     -1.148      TRUE -0.125 0.636 -0.197 0.844
## 957     -1.148     -1.042      TRUE  0.107 0.637  0.167 0.867
## 958     -0.426      0.232      TRUE  0.658 0.534  1.232 0.218
## 959      0.593      0.887      TRUE  0.294 0.538  0.546 0.585
## 960      1.720      1.555      TRUE -0.166 0.655 -0.253 0.801
## 961      0.651      0.608      TRUE -0.043 0.530 -0.082 0.935
## 962      2.354      1.989      TRUE -0.366 0.767 -0.477 0.633
## 963     -0.046     -0.875      TRUE -0.829 0.565 -1.469 0.142
## 964      1.048      0.824      TRUE -0.224 0.555 -0.404 0.686
## 965      0.419     -0.028      TRUE -0.446 0.523 -0.854 0.393
## 966      0.921      1.542      TRUE  0.621 0.596  1.041 0.298
## 967      0.937     -0.033      TRUE -0.970 0.539 -1.798 0.072
## 968     -0.029      0.299      TRUE  0.328 0.522  0.628  0.53
## 969      0.175     -0.436      TRUE -0.611 0.535 -1.142 0.253
## 970      1.214      1.230      TRUE  0.016 0.588  0.027 0.978
## 971      0.640      0.756      TRUE  0.117 0.534  0.218 0.827
## 972     -1.245     -1.302      TRUE -0.056 0.669 -0.084 0.933
## 973      0.640      0.694      TRUE  0.054 0.532  0.101  0.92
## 974     -0.137     -0.305      TRUE -0.168 0.534 -0.315 0.753
## 975      0.080      0.425      TRUE  0.345 0.521  0.662 0.508
## 976      0.064      0.251      TRUE  0.187 0.520  0.360 0.719
## 977     -1.096     -1.122      TRUE -0.026 0.639 -0.041 0.967
## 978     -0.161     -0.475      TRUE -0.314 0.542 -0.578 0.563
## 979     -0.060      0.230      TRUE  0.290 0.522  0.556 0.578
## 980      1.182      1.280      TRUE  0.097 0.589  0.165 0.869
## 981      0.171     -0.024      TRUE -0.196 0.522 -0.375 0.708
## 982      1.095      0.421      TRUE -0.674 0.547 -1.232 0.218
## 983     -0.469      0.176      TRUE  0.645 0.536  1.202 0.229
## 984      1.108      1.281      TRUE  0.173 0.585  0.296 0.767
## 985      0.684      0.762      TRUE  0.077 0.536  0.145 0.885
## 986     -1.660     -0.690      TRUE  0.970 0.667  1.455 0.146
## 987     -0.137      0.028      TRUE  0.165 0.525  0.315 0.753
## 988     -0.007     -0.172      TRUE -0.165 0.527 -0.313 0.754
## 989      1.251      0.469      TRUE -0.782 0.558 -1.401 0.161
## 990      0.821      0.229      TRUE -0.592 0.531 -1.115 0.265
## 991     -1.376     -0.918      TRUE  0.458 0.649  0.705 0.481
## 992     -1.872     -0.614      TRUE  1.258 0.689  1.826 0.068
## 993      0.204      0.420      TRUE  0.216 0.520  0.416 0.677
## 994     -0.705     -1.493      TRUE -0.788 0.648 -1.216 0.224
## 995     -0.941     -0.130      TRUE  0.811 0.572  1.419 0.156
## 996      0.508     -0.133      TRUE -0.641 0.526 -1.218 0.223
## 997     -1.518     -2.153      TRUE -0.635 0.787 -0.807  0.42
## 998     -1.660     -1.661      TRUE -0.001 0.746 -0.001 0.999
## 999      1.590      2.047      TRUE  0.457 0.693  0.659  0.51
## 1000    -1.259     -1.788      TRUE -0.529 0.721 -0.734 0.463
# single response pattern change using EAP information
RCI(mod, predat=dat_pre[1,], postdat=dat_post[1,])
##   pre.score post.score converged   diff   SEM     z     p
## 1     0.496      0.146      TRUE -0.349 0.522 -0.67 0.503
# WLE estimator with Fisher information for SE (see Jabrayilov et al. 2016)
RCI(mod, predat = dat_pre[1,], postdat = dat_post[1,],
    method = 'WLE', Fisher = TRUE)
##   pre.score post.score converged  diff  SEM      z     p
## 1     0.546      0.176      TRUE -0.37 0.55 -0.672 0.501
# multiple respondents
RCI(mod, predat = dat_pre[1:6,], postdat = dat_post[1:6,])
##   pre.score post.score converged   diff   SEM      z     p
## 1     0.496      0.146      TRUE -0.349 0.522 -0.670 0.503
## 2    -0.793     -0.818      TRUE -0.025 0.592 -0.043 0.966
## 3     0.231     -0.389      TRUE -0.620 0.533 -1.164 0.244
## 4    -0.098      0.157      TRUE  0.255 0.523  0.488 0.626
## 5     1.467      1.159      TRUE -0.308 0.602 -0.511  0.61
## 6     0.741      0.497      TRUE -0.244 0.530 -0.460 0.646
# include large-sample z-type cutoffs
RCI(mod, predat = dat_pre[1:6,], postdat = dat_post[1:6,],
    cutoffs = c(-1.96, 1.96))
##   pre.score post.score converged   diff   SEM      z     p cut_decision
## 1     0.496      0.146      TRUE -0.349 0.522 -0.670 0.503    unchanged
## 2    -0.793     -0.818      TRUE -0.025 0.592 -0.043 0.966    unchanged
## 3     0.231     -0.389      TRUE -0.620 0.533 -1.164 0.244    unchanged
## 4    -0.098      0.157      TRUE  0.255 0.523  0.488 0.626    unchanged
## 5     1.467      1.159      TRUE -0.308 0.602 -0.511  0.61    unchanged
## 6     0.741      0.497      TRUE -0.244 0.530 -0.460 0.646    unchanged
######
# CTT version by omitting IRT model
    # Requires either sample or population SEM's as input
(istats <- itemstats(dat_pre)$overall)
##     N mean_total.score sd_total.score ave.r  sd.r alpha SEM.alpha
##  1000            9.275          4.625 0.197 0.055 0.832     1.898
SEM.alpha <- istats$SEM.alpha    # SEM estimate of dat_pre

# assumes SEM.post = SEM.pre
RCI(predat = dat_pre, postdat = dat_post, SEM.pre=SEM.alpha)
##      pre.score post.score diff   SEM      z     p
## 1           12         10   -2 2.684 -0.745 0.456
## 2            5          5    0 2.684  0.000     1
## 3           10          6   -4 2.684 -1.490 0.136
## 4            9         10    1 2.684  0.373 0.709
## 5           17         15   -2 2.684 -0.745 0.456
## 6           14         12   -2 2.684 -0.745 0.456
## 7           11         13    2 2.684  0.745 0.456
## 8            6          8    2 2.684  0.745 0.456
## 9           11         14    3 2.684  1.118 0.264
## 10           8         10    2 2.684  0.745 0.456
## 11          11          9   -2 2.684 -0.745 0.456
## 12          15         16    1 2.684  0.373 0.709
## 13          16         13   -3 2.684 -1.118 0.264
## 14           9          6   -3 2.684 -1.118 0.264
## 15           8          6   -2 2.684 -0.745 0.456
## 16          10         10    0 2.684  0.000     1
## 17           2          2    0 2.684  0.000     1
## 18           8         11    3 2.684  1.118 0.264
## 19           9          8   -1 2.684 -0.373 0.709
## 20          14         16    2 2.684  0.745 0.456
## 21           3          2   -1 2.684 -0.373 0.709
## 22          11         13    2 2.684  0.745 0.456
## 23           2          2    0 2.684  0.000     1
## 24           1          2    1 2.684  0.373 0.709
## 25          10          8   -2 2.684 -0.745 0.456
## 26           2          2    0 2.684  0.000     1
## 27          10         10    0 2.684  0.000     1
## 28           1          2    1 2.684  0.373 0.709
## 29           1          1    0 2.684  0.000     1
## 30          14          7   -7 2.684 -2.608 0.009
## 31           5          3   -2 2.684 -0.745 0.456
## 32           2          1   -1 2.684 -0.373 0.709
## 33           4          7    3 2.684  1.118 0.264
## 34           7          4   -3 2.684 -1.118 0.264
## 35           5          3   -2 2.684 -0.745 0.456
## 36           1          7    6 2.684  2.236 0.025
## 37           8          7   -1 2.684 -0.373 0.709
## 38           4          4    0 2.684  0.000     1
## 39          15         17    2 2.684  0.745 0.456
## 40          13         12   -1 2.684 -0.373 0.709
## 41          12         11   -1 2.684 -0.373 0.709
## 42          14         14    0 2.684  0.000     1
## 43          12         15    3 2.684  1.118 0.264
## 44          11         11    0 2.684  0.000     1
## 45           6          3   -3 2.684 -1.118 0.264
## 46           1          1    0 2.684  0.000     1
## 47          17         12   -5 2.684 -1.863 0.062
## 48           9          8   -1 2.684 -0.373 0.709
## 49          13         15    2 2.684  0.745 0.456
## 50          13         11   -2 2.684 -0.745 0.456
## 51          12         11   -1 2.684 -0.373 0.709
## 52          19         19    0 2.684  0.000     1
## 53           8          8    0 2.684  0.000     1
## 54           4          1   -3 2.684 -1.118 0.264
## 55           7          9    2 2.684  0.745 0.456
## 56           5          6    1 2.684  0.373 0.709
## 57          12         10   -2 2.684 -0.745 0.456
## 58          14         13   -1 2.684 -0.373 0.709
## 59          13         10   -3 2.684 -1.118 0.264
## 60          14         17    3 2.684  1.118 0.264
## 61           4          5    1 2.684  0.373 0.709
## 62          13         11   -2 2.684 -0.745 0.456
## 63           6          7    1 2.684  0.373 0.709
## 64           6         11    5 2.684  1.863 0.062
## 65           6          3   -3 2.684 -1.118 0.264
## 66           5          1   -4 2.684 -1.490 0.136
## 67          15         18    3 2.684  1.118 0.264
## 68           8         15    7 2.684  2.608 0.009
## 69           3          7    4 2.684  1.490 0.136
## 70          11         15    4 2.684  1.490 0.136
## 71           6          6    0 2.684  0.000     1
## 72           5          7    2 2.684  0.745 0.456
## 73          13         11   -2 2.684 -0.745 0.456
## 74          10          6   -4 2.684 -1.490 0.136
## 75          15         15    0 2.684  0.000     1
## 76           8         13    5 2.684  1.863 0.062
## 77           4          3   -1 2.684 -0.373 0.709
## 78           5          6    1 2.684  0.373 0.709
## 79           7          5   -2 2.684 -0.745 0.456
## 80           6          1   -5 2.684 -1.863 0.062
## 81           4          4    0 2.684  0.000     1
## 82          11         12    1 2.684  0.373 0.709
## 83           3          4    1 2.684  0.373 0.709
## 84           7          9    2 2.684  0.745 0.456
## 85           5          6    1 2.684  0.373 0.709
## 86          14         13   -1 2.684 -0.373 0.709
## 87          10          7   -3 2.684 -1.118 0.264
## 88          15         18    3 2.684  1.118 0.264
## 89          16         15   -1 2.684 -0.373 0.709
## 90           5         12    7 2.684  2.608 0.009
## 91           5          7    2 2.684  0.745 0.456
## 92          12         13    1 2.684  0.373 0.709
## 93           2          5    3 2.684  1.118 0.264
## 94           9          4   -5 2.684 -1.863 0.062
## 95           0          2    2 2.684  0.745 0.456
## 96           1          3    2 2.684  0.745 0.456
## 97          10         15    5 2.684  1.863 0.062
## 98           8          5   -3 2.684 -1.118 0.264
## 99           7         11    4 2.684  1.490 0.136
## 100          7          5   -2 2.684 -0.745 0.456
## 101         12         10   -2 2.684 -0.745 0.456
## 102          8         11    3 2.684  1.118 0.264
## 103         18         18    0 2.684  0.000     1
## 104         17         12   -5 2.684 -1.863 0.062
## 105         16         15   -1 2.684 -0.373 0.709
## 106          2          2    0 2.684  0.000     1
## 107          8          9    1 2.684  0.373 0.709
## 108          5          3   -2 2.684 -0.745 0.456
## 109          1          1    0 2.684  0.000     1
## 110          6          5   -1 2.684 -0.373 0.709
## 111          3          4    1 2.684  0.373 0.709
## 112         11         12    1 2.684  0.373 0.709
## 113         12         12    0 2.684  0.000     1
## 114          6          5   -1 2.684 -0.373 0.709
## 115         11         13    2 2.684  0.745 0.456
## 116         13         13    0 2.684  0.000     1
## 117          4          7    3 2.684  1.118 0.264
## 118          2          3    1 2.684  0.373 0.709
## 119         11          9   -2 2.684 -0.745 0.456
## 120          5         10    5 2.684  1.863 0.062
## 121         16         17    1 2.684  0.373 0.709
## 122          2          3    1 2.684  0.373 0.709
## 123         18         15   -3 2.684 -1.118 0.264
## 124          9         10    1 2.684  0.373 0.709
## 125         15         10   -5 2.684 -1.863 0.062
## 126         17         18    1 2.684  0.373 0.709
## 127         15         18    3 2.684  1.118 0.264
## 128          3          8    5 2.684  1.863 0.062
## 129         16         13   -3 2.684 -1.118 0.264
## 130         10          6   -4 2.684 -1.490 0.136
## 131         15         17    2 2.684  0.745 0.456
## 132          8          4   -4 2.684 -1.490 0.136
## 133          4          4    0 2.684  0.000     1
## 134         17         17    0 2.684  0.000     1
## 135          6          9    3 2.684  1.118 0.264
## 136          7          3   -4 2.684 -1.490 0.136
## 137          3          8    5 2.684  1.863 0.062
## 138          4          8    4 2.684  1.490 0.136
## 139         14         18    4 2.684  1.490 0.136
## 140          9          2   -7 2.684 -2.608 0.009
## 141         16         15   -1 2.684 -0.373 0.709
## 142          9          5   -4 2.684 -1.490 0.136
## 143         19         17   -2 2.684 -0.745 0.456
## 144          9         10    1 2.684  0.373 0.709
## 145          7          5   -2 2.684 -0.745 0.456
## 146         15         15    0 2.684  0.000     1
## 147         10          7   -3 2.684 -1.118 0.264
## 148          6          4   -2 2.684 -0.745 0.456
## 149         11          8   -3 2.684 -1.118 0.264
## 150          9          9    0 2.684  0.000     1
## 151         10          7   -3 2.684 -1.118 0.264
## 152          7          9    2 2.684  0.745 0.456
## 153         14         12   -2 2.684 -0.745 0.456
## 154         10         13    3 2.684  1.118 0.264
## 155         13         10   -3 2.684 -1.118 0.264
## 156         10          7   -3 2.684 -1.118 0.264
## 157         12         12    0 2.684  0.000     1
## 158         14         11   -3 2.684 -1.118 0.264
## 159          6          6    0 2.684  0.000     1
## 160          4          4    0 2.684  0.000     1
## 161          6          5   -1 2.684 -0.373 0.709
## 162          3          2   -1 2.684 -0.373 0.709
## 163          4          4    0 2.684  0.000     1
## 164         18         18    0 2.684  0.000     1
## 165         12          8   -4 2.684 -1.490 0.136
## 166          2          2    0 2.684  0.000     1
## 167          6          3   -3 2.684 -1.118 0.264
## 168          2          5    3 2.684  1.118 0.264
## 169          9         11    2 2.684  0.745 0.456
## 170          5          4   -1 2.684 -0.373 0.709
## 171         19         18   -1 2.684 -0.373 0.709
## 172         11         12    1 2.684  0.373 0.709
## 173          9          3   -6 2.684 -2.236 0.025
## 174         18         14   -4 2.684 -1.490 0.136
## 175         11         13    2 2.684  0.745 0.456
## 176         16         18    2 2.684  0.745 0.456
## 177          9          7   -2 2.684 -0.745 0.456
## 178         10         14    4 2.684  1.490 0.136
## 179         13          9   -4 2.684 -1.490 0.136
## 180          3          5    2 2.684  0.745 0.456
## 181         11         12    1 2.684  0.373 0.709
## 182         13         11   -2 2.684 -0.745 0.456
## 183         14         15    1 2.684  0.373 0.709
## 184         15         16    1 2.684  0.373 0.709
## 185          6          4   -2 2.684 -0.745 0.456
## 186         16         19    3 2.684  1.118 0.264
## 187         19         19    0 2.684  0.000     1
## 188         14         15    1 2.684  0.373 0.709
## 189          5          7    2 2.684  0.745 0.456
## 190          5          6    1 2.684  0.373 0.709
## 191         11          9   -2 2.684 -0.745 0.456
## 192         11          8   -3 2.684 -1.118 0.264
## 193          4          4    0 2.684  0.000     1
## 194         15          9   -6 2.684 -2.236 0.025
## 195          6          8    2 2.684  0.745 0.456
## 196         13          8   -5 2.684 -1.863 0.062
## 197          9         11    2 2.684  0.745 0.456
## 198          8          6   -2 2.684 -0.745 0.456
## 199         16         17    1 2.684  0.373 0.709
## 200          5         10    5 2.684  1.863 0.062
## 201          3          5    2 2.684  0.745 0.456
## 202         14         15    1 2.684  0.373 0.709
## 203          4          8    4 2.684  1.490 0.136
## 204          9          7   -2 2.684 -0.745 0.456
## 205          5          2   -3 2.684 -1.118 0.264
## 206         18         15   -3 2.684 -1.118 0.264
## 207          3          3    0 2.684  0.000     1
## 208         17         17    0 2.684  0.000     1
## 209          7          7    0 2.684  0.000     1
## 210         11          9   -2 2.684 -0.745 0.456
## 211          2          5    3 2.684  1.118 0.264
## 212         11         12    1 2.684  0.373 0.709
## 213          6          4   -2 2.684 -0.745 0.456
## 214          6          7    1 2.684  0.373 0.709
## 215          8          6   -2 2.684 -0.745 0.456
## 216         15         15    0 2.684  0.000     1
## 217          3          3    0 2.684  0.000     1
## 218         14         12   -2 2.684 -0.745 0.456
## 219         10          7   -3 2.684 -1.118 0.264
## 220          9         13    4 2.684  1.490 0.136
## 221          3          5    2 2.684  0.745 0.456
## 222          6         10    4 2.684  1.490 0.136
## 223         14         13   -1 2.684 -0.373 0.709
## 224         18         18    0 2.684  0.000     1
## 225         17         14   -3 2.684 -1.118 0.264
## 226          8          9    1 2.684  0.373 0.709
## 227          8          9    1 2.684  0.373 0.709
## 228         17         11   -6 2.684 -2.236 0.025
## 229          3          4    1 2.684  0.373 0.709
## 230          7          8    1 2.684  0.373 0.709
## 231          7         10    3 2.684  1.118 0.264
## 232          7          9    2 2.684  0.745 0.456
## 233         12         14    2 2.684  0.745 0.456
## 234         17         13   -4 2.684 -1.490 0.136
## 235         16         13   -3 2.684 -1.118 0.264
## 236          4          3   -1 2.684 -0.373 0.709
## 237         12         11   -1 2.684 -0.373 0.709
## 238          3          9    6 2.684  2.236 0.025
## 239          2          4    2 2.684  0.745 0.456
## 240          8          7   -1 2.684 -0.373 0.709
## 241         10         13    3 2.684  1.118 0.264
## 242          2          6    4 2.684  1.490 0.136
## 243         18         19    1 2.684  0.373 0.709
## 244         11         11    0 2.684  0.000     1
## 245         11         11    0 2.684  0.000     1
## 246         17         15   -2 2.684 -0.745 0.456
## 247         15         18    3 2.684  1.118 0.264
## 248         14          9   -5 2.684 -1.863 0.062
## 249          9          4   -5 2.684 -1.863 0.062
## 250         14         13   -1 2.684 -0.373 0.709
## 251         16          7   -9 2.684 -3.354 0.001
## 252         15         14   -1 2.684 -0.373 0.709
## 253         12         11   -1 2.684 -0.373 0.709
## 254          3          4    1 2.684  0.373 0.709
## 255         12         12    0 2.684  0.000     1
## 256          7         11    4 2.684  1.490 0.136
## 257          5          5    0 2.684  0.000     1
## 258          8          8    0 2.684  0.000     1
## 259          6          6    0 2.684  0.000     1
## 260         12         12    0 2.684  0.000     1
## 261         13         15    2 2.684  0.745 0.456
## 262          9         13    4 2.684  1.490 0.136
## 263         13          8   -5 2.684 -1.863 0.062
## 264          6          9    3 2.684  1.118 0.264
## 265          8         11    3 2.684  1.118 0.264
## 266         11          9   -2 2.684 -0.745 0.456
## 267         10         12    2 2.684  0.745 0.456
## 268         18         16   -2 2.684 -0.745 0.456
## 269          4          4    0 2.684  0.000     1
## 270          9         14    5 2.684  1.863 0.062
## 271         14         16    2 2.684  0.745 0.456
## 272          8          7   -1 2.684 -0.373 0.709
## 273          7          6   -1 2.684 -0.373 0.709
## 274         16         15   -1 2.684 -0.373 0.709
## 275          8         15    7 2.684  2.608 0.009
## 276         15         16    1 2.684  0.373 0.709
## 277         15         14   -1 2.684 -0.373 0.709
## 278         13          9   -4 2.684 -1.490 0.136
## 279          8          9    1 2.684  0.373 0.709
## 280          5          9    4 2.684  1.490 0.136
## 281         13          9   -4 2.684 -1.490 0.136
## 282         13         10   -3 2.684 -1.118 0.264
## 283          9         13    4 2.684  1.490 0.136
## 284          5          4   -1 2.684 -0.373 0.709
## 285          4          6    2 2.684  0.745 0.456
## 286          2          6    4 2.684  1.490 0.136
## 287          3          2   -1 2.684 -0.373 0.709
## 288          9          7   -2 2.684 -0.745 0.456
## 289          7         10    3 2.684  1.118 0.264
## 290          8          5   -3 2.684 -1.118 0.264
## 291          9          6   -3 2.684 -1.118 0.264
## 292          4          3   -1 2.684 -0.373 0.709
## 293         14         17    3 2.684  1.118 0.264
## 294         15         18    3 2.684  1.118 0.264
## 295          3          4    1 2.684  0.373 0.709
## 296          1          4    3 2.684  1.118 0.264
## 297         12         10   -2 2.684 -0.745 0.456
## 298          5          8    3 2.684  1.118 0.264
## 299         12         12    0 2.684  0.000     1
## 300          8         10    2 2.684  0.745 0.456
## 301          6          5   -1 2.684 -0.373 0.709
## 302          5          7    2 2.684  0.745 0.456
## 303         14         15    1 2.684  0.373 0.709
## 304         11          8   -3 2.684 -1.118 0.264
## 305          4          2   -2 2.684 -0.745 0.456
## 306         11         11    0 2.684  0.000     1
## 307         13         11   -2 2.684 -0.745 0.456
## 308          9         13    4 2.684  1.490 0.136
## 309          4          6    2 2.684  0.745 0.456
## 310         13         11   -2 2.684 -0.745 0.456
## 311         10         12    2 2.684  0.745 0.456
## 312          8          9    1 2.684  0.373 0.709
## 313         16         12   -4 2.684 -1.490 0.136
## 314          8          9    1 2.684  0.373 0.709
## 315          2          1   -1 2.684 -0.373 0.709
## 316         13         11   -2 2.684 -0.745 0.456
## 317         15          8   -7 2.684 -2.608 0.009
## 318          7          4   -3 2.684 -1.118 0.264
## 319         16         15   -1 2.684 -0.373 0.709
## 320         12         11   -1 2.684 -0.373 0.709
## 321          2          1   -1 2.684 -0.373 0.709
## 322         14         15    1 2.684  0.373 0.709
## 323          1          2    1 2.684  0.373 0.709
## 324         10         11    1 2.684  0.373 0.709
## 325          8          9    1 2.684  0.373 0.709
## 326         13         14    1 2.684  0.373 0.709
## 327         15         16    1 2.684  0.373 0.709
## 328         16         11   -5 2.684 -1.863 0.062
## 329          7          7    0 2.684  0.000     1
## 330          8          9    1 2.684  0.373 0.709
## 331         14         10   -4 2.684 -1.490 0.136
## 332          5          8    3 2.684  1.118 0.264
## 333         11         15    4 2.684  1.490 0.136
## 334          5          7    2 2.684  0.745 0.456
## 335          0          4    4 2.684  1.490 0.136
## 336          3          4    1 2.684  0.373 0.709
## 337          9          4   -5 2.684 -1.863 0.062
## 338         10          9   -1 2.684 -0.373 0.709
## 339         12         16    4 2.684  1.490 0.136
## 340         14         17    3 2.684  1.118 0.264
## 341          9          8   -1 2.684 -0.373 0.709
## 342          6          8    2 2.684  0.745 0.456
## 343          7          3   -4 2.684 -1.490 0.136
## 344         16         18    2 2.684  0.745 0.456
## 345         14          7   -7 2.684 -2.608 0.009
## 346         12          6   -6 2.684 -2.236 0.025
## 347         14         14    0 2.684  0.000     1
## 348         15         15    0 2.684  0.000     1
## 349          7          3   -4 2.684 -1.490 0.136
## 350          8          9    1 2.684  0.373 0.709
## 351          5          2   -3 2.684 -1.118 0.264
## 352          8          6   -2 2.684 -0.745 0.456
## 353         17         18    1 2.684  0.373 0.709
## 354          7          8    1 2.684  0.373 0.709
## 355         12         10   -2 2.684 -0.745 0.456
## 356         11         12    1 2.684  0.373 0.709
## 357         15         12   -3 2.684 -1.118 0.264
## 358          5          7    2 2.684  0.745 0.456
## 359         10          8   -2 2.684 -0.745 0.456
## 360         14         14    0 2.684  0.000     1
## 361         10         11    1 2.684  0.373 0.709
## 362         10          9   -1 2.684 -0.373 0.709
## 363         14         14    0 2.684  0.000     1
## 364         17         15   -2 2.684 -0.745 0.456
## 365          8          7   -1 2.684 -0.373 0.709
## 366         17         11   -6 2.684 -2.236 0.025
## 367          5          3   -2 2.684 -0.745 0.456
## 368          2          1   -1 2.684 -0.373 0.709
## 369          2          1   -1 2.684 -0.373 0.709
## 370         12         12    0 2.684  0.000     1
## 371         11         11    0 2.684  0.000     1
## 372          4          7    3 2.684  1.118 0.264
## 373         16         11   -5 2.684 -1.863 0.062
## 374          4          4    0 2.684  0.000     1
## 375          6          4   -2 2.684 -0.745 0.456
## 376          5          7    2 2.684  0.745 0.456
## 377         12         11   -1 2.684 -0.373 0.709
## 378         12         16    4 2.684  1.490 0.136
## 379         16         18    2 2.684  0.745 0.456
## 380         14         12   -2 2.684 -0.745 0.456
## 381          6          5   -1 2.684 -0.373 0.709
## 382         10         12    2 2.684  0.745 0.456
## 383          8         11    3 2.684  1.118 0.264
## 384         10         14    4 2.684  1.490 0.136
## 385          4          5    1 2.684  0.373 0.709
## 386         14         14    0 2.684  0.000     1
## 387          7          7    0 2.684  0.000     1
## 388         11         10   -1 2.684 -0.373 0.709
## 389          4          4    0 2.684  0.000     1
## 390          8          7   -1 2.684 -0.373 0.709
## 391         10          9   -1 2.684 -0.373 0.709
## 392          5          8    3 2.684  1.118 0.264
## 393         12         10   -2 2.684 -0.745 0.456
## 394          8          7   -1 2.684 -0.373 0.709
## 395         10          4   -6 2.684 -2.236 0.025
## 396         18         15   -3 2.684 -1.118 0.264
## 397          4          7    3 2.684  1.118 0.264
## 398         13         13    0 2.684  0.000     1
## 399         14         11   -3 2.684 -1.118 0.264
## 400          4          6    2 2.684  0.745 0.456
## 401         15         16    1 2.684  0.373 0.709
## 402          4          4    0 2.684  0.000     1
## 403          5          6    1 2.684  0.373 0.709
## 404         17         15   -2 2.684 -0.745 0.456
## 405          8          4   -4 2.684 -1.490 0.136
## 406         10          6   -4 2.684 -1.490 0.136
## 407          3          2   -1 2.684 -0.373 0.709
## 408          8          7   -1 2.684 -0.373 0.709
## 409          6         10    4 2.684  1.490 0.136
## 410         11         12    1 2.684  0.373 0.709
## 411          3          2   -1 2.684 -0.373 0.709
## 412         14          9   -5 2.684 -1.863 0.062
## 413          9          8   -1 2.684 -0.373 0.709
## 414         15         17    2 2.684  0.745 0.456
## 415         13          9   -4 2.684 -1.490 0.136
## 416          3          5    2 2.684  0.745 0.456
## 417          4          2   -2 2.684 -0.745 0.456
## 418         18         18    0 2.684  0.000     1
## 419          2          1   -1 2.684 -0.373 0.709
## 420         15         13   -2 2.684 -0.745 0.456
## 421         15         11   -4 2.684 -1.490 0.136
## 422          6          7    1 2.684  0.373 0.709
## 423          4          5    1 2.684  0.373 0.709
## 424          7          4   -3 2.684 -1.118 0.264
## 425          8          9    1 2.684  0.373 0.709
## 426          6          2   -4 2.684 -1.490 0.136
## 427          5          6    1 2.684  0.373 0.709
## 428          3          7    4 2.684  1.490 0.136
## 429          9         13    4 2.684  1.490 0.136
## 430          6          4   -2 2.684 -0.745 0.456
## 431          5         11    6 2.684  2.236 0.025
## 432         14         12   -2 2.684 -0.745 0.456
## 433         18         19    1 2.684  0.373 0.709
## 434          0          0    0 2.684  0.000     1
## 435         15          9   -6 2.684 -2.236 0.025
## 436         10          8   -2 2.684 -0.745 0.456
## 437         15         16    1 2.684  0.373 0.709
## 438          3          2   -1 2.684 -0.373 0.709
## 439         14         13   -1 2.684 -0.373 0.709
## 440          9         13    4 2.684  1.490 0.136
## 441         10         11    1 2.684  0.373 0.709
## 442         15         10   -5 2.684 -1.863 0.062
## 443          4          4    0 2.684  0.000     1
## 444          5          8    3 2.684  1.118 0.264
## 445          6         11    5 2.684  1.863 0.062
## 446         12         13    1 2.684  0.373 0.709
## 447          3          5    2 2.684  0.745 0.456
## 448          2          1   -1 2.684 -0.373 0.709
## 449         16         15   -1 2.684 -0.373 0.709
## 450          6          4   -2 2.684 -0.745 0.456
## 451         17         15   -2 2.684 -0.745 0.456
## 452          6         12    6 2.684  2.236 0.025
## 453          4          6    2 2.684  0.745 0.456
## 454         19         19    0 2.684  0.000     1
## 455          9          8   -1 2.684 -0.373 0.709
## 456          7          5   -2 2.684 -0.745 0.456
## 457          6          5   -1 2.684 -0.373 0.709
## 458          1          2    1 2.684  0.373 0.709
## 459          8          7   -1 2.684 -0.373 0.709
## 460          8         10    2 2.684  0.745 0.456
## 461         15         13   -2 2.684 -0.745 0.456
## 462          4          3   -1 2.684 -0.373 0.709
## 463         16         17    1 2.684  0.373 0.709
## 464         10         12    2 2.684  0.745 0.456
## 465         17         13   -4 2.684 -1.490 0.136
## 466         11         13    2 2.684  0.745 0.456
## 467         10          6   -4 2.684 -1.490 0.136
## 468          9          4   -5 2.684 -1.863 0.062
## 469          6          5   -1 2.684 -0.373 0.709
## 470          9         12    3 2.684  1.118 0.264
## 471          7          4   -3 2.684 -1.118 0.264
## 472         17         17    0 2.684  0.000     1
## 473          5          7    2 2.684  0.745 0.456
## 474          8         10    2 2.684  0.745 0.456
## 475         12         18    6 2.684  2.236 0.025
## 476          7         10    3 2.684  1.118 0.264
## 477         14         13   -1 2.684 -0.373 0.709
## 478         13         15    2 2.684  0.745 0.456
## 479          8          5   -3 2.684 -1.118 0.264
## 480          8          8    0 2.684  0.000     1
## 481          8         12    4 2.684  1.490 0.136
## 482          6          4   -2 2.684 -0.745 0.456
## 483         18         16   -2 2.684 -0.745 0.456
## 484          6          4   -2 2.684 -0.745 0.456
## 485          8          6   -2 2.684 -0.745 0.456
## 486          9         10    1 2.684  0.373 0.709
## 487          6          1   -5 2.684 -1.863 0.062
## 488          8          8    0 2.684  0.000     1
## 489         13         13    0 2.684  0.000     1
## 490         11          9   -2 2.684 -0.745 0.456
## 491          2          3    1 2.684  0.373 0.709
## 492          5          5    0 2.684  0.000     1
## 493          9         12    3 2.684  1.118 0.264
## 494          7         11    4 2.684  1.490 0.136
## 495          3          5    2 2.684  0.745 0.456
## 496         17         14   -3 2.684 -1.118 0.264
## 497         10          8   -2 2.684 -0.745 0.456
## 498         18         17   -1 2.684 -0.373 0.709
## 499          5         11    6 2.684  2.236 0.025
## 500         13         15    2 2.684  0.745 0.456
## 501          3          0   -3 2.684 -1.118 0.264
## 502          5          4   -1 2.684 -0.373 0.709
## 503         11         13    2 2.684  0.745 0.456
## 504         10          5   -5 2.684 -1.863 0.062
## 505         11          8   -3 2.684 -1.118 0.264
## 506          2          5    3 2.684  1.118 0.264
## 507          4          2   -2 2.684 -0.745 0.456
## 508          3          2   -1 2.684 -0.373 0.709
## 509         18         16   -2 2.684 -0.745 0.456
## 510         16         17    1 2.684  0.373 0.709
## 511         10          8   -2 2.684 -0.745 0.456
## 512         11         13    2 2.684  0.745 0.456
## 513          2          6    4 2.684  1.490 0.136
## 514         19         20    1 2.684  0.373 0.709
## 515          5          5    0 2.684  0.000     1
## 516          6          3   -3 2.684 -1.118 0.264
## 517          7          7    0 2.684  0.000     1
## 518          3          4    1 2.684  0.373 0.709
## 519         17         15   -2 2.684 -0.745 0.456
## 520          1          6    5 2.684  1.863 0.062
## 521         10          7   -3 2.684 -1.118 0.264
## 522          7         12    5 2.684  1.863 0.062
## 523         18         17   -1 2.684 -0.373 0.709
## 524          3          1   -2 2.684 -0.745 0.456
## 525          6          8    2 2.684  0.745 0.456
## 526          7          6   -1 2.684 -0.373 0.709
## 527         14         15    1 2.684  0.373 0.709
## 528          7          2   -5 2.684 -1.863 0.062
## 529          9         11    2 2.684  0.745 0.456
## 530         10         16    6 2.684  2.236 0.025
## 531         14         12   -2 2.684 -0.745 0.456
## 532         10          9   -1 2.684 -0.373 0.709
## 533         14         13   -1 2.684 -0.373 0.709
## 534          6          4   -2 2.684 -0.745 0.456
## 535          8         12    4 2.684  1.490 0.136
## 536          6          9    3 2.684  1.118 0.264
## 537          2          2    0 2.684  0.000     1
## 538         16         16    0 2.684  0.000     1
## 539          8          9    1 2.684  0.373 0.709
## 540         14         11   -3 2.684 -1.118 0.264
## 541         10         10    0 2.684  0.000     1
## 542          7          3   -4 2.684 -1.490 0.136
## 543          7          3   -4 2.684 -1.490 0.136
## 544          4          8    4 2.684  1.490 0.136
## 545          4          6    2 2.684  0.745 0.456
## 546          9          9    0 2.684  0.000     1
## 547         12         11   -1 2.684 -0.373 0.709
## 548         12         11   -1 2.684 -0.373 0.709
## 549         11         11    0 2.684  0.000     1
## 550         14         14    0 2.684  0.000     1
## 551         12          9   -3 2.684 -1.118 0.264
## 552         13         12   -1 2.684 -0.373 0.709
## 553          1          3    2 2.684  0.745 0.456
## 554         12          9   -3 2.684 -1.118 0.264
## 555         13         11   -2 2.684 -0.745 0.456
## 556         15         15    0 2.684  0.000     1
## 557         13         13    0 2.684  0.000     1
## 558         12          4   -8 2.684 -2.981 0.003
## 559         13          9   -4 2.684 -1.490 0.136
## 560          3          2   -1 2.684 -0.373 0.709
## 561          2          1   -1 2.684 -0.373 0.709
## 562         19         19    0 2.684  0.000     1
## 563         10         10    0 2.684  0.000     1
## 564          8          7   -1 2.684 -0.373 0.709
## 565          3          4    1 2.684  0.373 0.709
## 566          6          7    1 2.684  0.373 0.709
## 567          7         12    5 2.684  1.863 0.062
## 568         10          7   -3 2.684 -1.118 0.264
## 569         11          7   -4 2.684 -1.490 0.136
## 570         18         19    1 2.684  0.373 0.709
## 571          5          7    2 2.684  0.745 0.456
## 572         16         16    0 2.684  0.000     1
## 573         15         14   -1 2.684 -0.373 0.709
## 574         11          4   -7 2.684 -2.608 0.009
## 575          7          7    0 2.684  0.000     1
## 576          6          3   -3 2.684 -1.118 0.264
## 577         14         11   -3 2.684 -1.118 0.264
## 578          8          5   -3 2.684 -1.118 0.264
## 579          5          4   -1 2.684 -0.373 0.709
## 580          3          3    0 2.684  0.000     1
## 581         10          8   -2 2.684 -0.745 0.456
## 582          2          1   -1 2.684 -0.373 0.709
## 583         14         15    1 2.684  0.373 0.709
## 584          4          9    5 2.684  1.863 0.062
## 585         11         14    3 2.684  1.118 0.264
## 586         11         13    2 2.684  0.745 0.456
## 587          9         10    1 2.684  0.373 0.709
## 588          6          4   -2 2.684 -0.745 0.456
## 589         10          9   -1 2.684 -0.373 0.709
## 590          4          3   -1 2.684 -0.373 0.709
## 591          4          3   -1 2.684 -0.373 0.709
## 592         11         12    1 2.684  0.373 0.709
## 593          9          7   -2 2.684 -0.745 0.456
## 594          8          9    1 2.684  0.373 0.709
## 595          9          9    0 2.684  0.000     1
## 596          5          8    3 2.684  1.118 0.264
## 597          8         11    3 2.684  1.118 0.264
## 598         15         11   -4 2.684 -1.490 0.136
## 599          7          5   -2 2.684 -0.745 0.456
## 600          8          8    0 2.684  0.000     1
## 601          7          5   -2 2.684 -0.745 0.456
## 602         12          6   -6 2.684 -2.236 0.025
## 603          4          4    0 2.684  0.000     1
## 604          9          4   -5 2.684 -1.863 0.062
## 605          9          3   -6 2.684 -2.236 0.025
## 606         13         18    5 2.684  1.863 0.062
## 607         11         10   -1 2.684 -0.373 0.709
## 608         14         14    0 2.684  0.000     1
## 609         16         14   -2 2.684 -0.745 0.456
## 610          6          8    2 2.684  0.745 0.456
## 611         14         11   -3 2.684 -1.118 0.264
## 612          2          8    6 2.684  2.236 0.025
## 613         18         16   -2 2.684 -0.745 0.456
## 614          7          8    1 2.684  0.373 0.709
## 615          5          8    3 2.684  1.118 0.264
## 616         16         18    2 2.684  0.745 0.456
## 617          9         12    3 2.684  1.118 0.264
## 618         16         14   -2 2.684 -0.745 0.456
## 619          5          3   -2 2.684 -0.745 0.456
## 620         13         13    0 2.684  0.000     1
## 621         12         12    0 2.684  0.000     1
## 622         12         15    3 2.684  1.118 0.264
## 623         18         16   -2 2.684 -0.745 0.456
## 624          7          3   -4 2.684 -1.490 0.136
## 625          3          2   -1 2.684 -0.373 0.709
## 626         13         13    0 2.684  0.000     1
## 627         13         11   -2 2.684 -0.745 0.456
## 628          9          9    0 2.684  0.000     1
## 629          5          6    1 2.684  0.373 0.709
## 630         13         10   -3 2.684 -1.118 0.264
## 631         13          8   -5 2.684 -1.863 0.062
## 632          8         11    3 2.684  1.118 0.264
## 633         13          8   -5 2.684 -1.863 0.062
## 634          7          5   -2 2.684 -0.745 0.456
## 635          5          5    0 2.684  0.000     1
## 636         13          9   -4 2.684 -1.490 0.136
## 637         11          9   -2 2.684 -0.745 0.456
## 638         13         14    1 2.684  0.373 0.709
## 639         18         18    0 2.684  0.000     1
## 640          6          8    2 2.684  0.745 0.456
## 641          7          7    0 2.684  0.000     1
## 642         14         13   -1 2.684 -0.373 0.709
## 643         15         18    3 2.684  1.118 0.264
## 644          5          7    2 2.684  0.745 0.456
## 645         13         11   -2 2.684 -0.745 0.456
## 646          6          9    3 2.684  1.118 0.264
## 647         12         14    2 2.684  0.745 0.456
## 648          8         12    4 2.684  1.490 0.136
## 649         10         13    3 2.684  1.118 0.264
## 650          7          9    2 2.684  0.745 0.456
## 651          1          4    3 2.684  1.118 0.264
## 652          9          7   -2 2.684 -0.745 0.456
## 653         14         10   -4 2.684 -1.490 0.136
## 654         12         11   -1 2.684 -0.373 0.709
## 655          5          5    0 2.684  0.000     1
## 656          5          5    0 2.684  0.000     1
## 657          9         12    3 2.684  1.118 0.264
## 658         10         12    2 2.684  0.745 0.456
## 659          6          3   -3 2.684 -1.118 0.264
## 660          9          8   -1 2.684 -0.373 0.709
## 661          8          9    1 2.684  0.373 0.709
## 662         10          8   -2 2.684 -0.745 0.456
## 663         13         10   -3 2.684 -1.118 0.264
## 664         10         10    0 2.684  0.000     1
## 665          3          5    2 2.684  0.745 0.456
## 666          5          8    3 2.684  1.118 0.264
## 667         10          5   -5 2.684 -1.863 0.062
## 668          8          6   -2 2.684 -0.745 0.456
## 669          2          2    0 2.684  0.000     1
## 670          6          6    0 2.684  0.000     1
## 671          3          7    4 2.684  1.490 0.136
## 672          8          5   -3 2.684 -1.118 0.264
## 673         14         14    0 2.684  0.000     1
## 674          4          3   -1 2.684 -0.373 0.709
## 675          5          4   -1 2.684 -0.373 0.709
## 676          1          6    5 2.684  1.863 0.062
## 677          1          1    0 2.684  0.000     1
## 678          8          6   -2 2.684 -0.745 0.456
## 679          8          8    0 2.684  0.000     1
## 680          3          3    0 2.684  0.000     1
## 681         10          7   -3 2.684 -1.118 0.264
## 682         11         14    3 2.684  1.118 0.264
## 683         11         11    0 2.684  0.000     1
## 684          4          4    0 2.684  0.000     1
## 685          9          8   -1 2.684 -0.373 0.709
## 686          4          8    4 2.684  1.490 0.136
## 687         10         11    1 2.684  0.373 0.709
## 688         15         10   -5 2.684 -1.863 0.062
## 689         11         14    3 2.684  1.118 0.264
## 690         14         16    2 2.684  0.745 0.456
## 691          8         11    3 2.684  1.118 0.264
## 692          7          4   -3 2.684 -1.118 0.264
## 693          4          4    0 2.684  0.000     1
## 694         15         16    1 2.684  0.373 0.709
## 695          6          6    0 2.684  0.000     1
## 696          7          8    1 2.684  0.373 0.709
## 697         10          8   -2 2.684 -0.745 0.456
## 698         14         17    3 2.684  1.118 0.264
## 699         13         16    3 2.684  1.118 0.264
## 700         10         13    3 2.684  1.118 0.264
## 701          2          1   -1 2.684 -0.373 0.709
## 702          3          4    1 2.684  0.373 0.709
## 703          8          8    0 2.684  0.000     1
## 704         17         15   -2 2.684 -0.745 0.456
## 705          2          5    3 2.684  1.118 0.264
## 706         11         13    2 2.684  0.745 0.456
## 707         11          8   -3 2.684 -1.118 0.264
## 708          9          9    0 2.684  0.000     1
## 709          8          6   -2 2.684 -0.745 0.456
## 710         11          9   -2 2.684 -0.745 0.456
## 711         16         16    0 2.684  0.000     1
## 712         14         14    0 2.684  0.000     1
## 713          3          1   -2 2.684 -0.745 0.456
## 714          1          0   -1 2.684 -0.373 0.709
## 715         16         12   -4 2.684 -1.490 0.136
## 716          6          9    3 2.684  1.118 0.264
## 717         16         11   -5 2.684 -1.863 0.062
## 718          5          4   -1 2.684 -0.373 0.709
## 719          9          8   -1 2.684 -0.373 0.709
## 720         14          8   -6 2.684 -2.236 0.025
## 721          8          9    1 2.684  0.373 0.709
## 722          5          6    1 2.684  0.373 0.709
## 723          7          8    1 2.684  0.373 0.709
## 724         14         15    1 2.684  0.373 0.709
## 725          5          7    2 2.684  0.745 0.456
## 726          4          8    4 2.684  1.490 0.136
## 727         11         10   -1 2.684 -0.373 0.709
## 728         16         14   -2 2.684 -0.745 0.456
## 729         16         15   -1 2.684 -0.373 0.709
## 730         14         12   -2 2.684 -0.745 0.456
## 731         13         14    1 2.684  0.373 0.709
## 732         11         10   -1 2.684 -0.373 0.709
## 733         12         13    1 2.684  0.373 0.709
## 734          7         10    3 2.684  1.118 0.264
## 735         12         12    0 2.684  0.000     1
## 736         15         15    0 2.684  0.000     1
## 737          0          1    1 2.684  0.373 0.709
## 738         12          7   -5 2.684 -1.863 0.062
## 739         15         13   -2 2.684 -0.745 0.456
## 740          2          4    2 2.684  0.745 0.456
## 741          4          5    1 2.684  0.373 0.709
## 742          0          1    1 2.684  0.373 0.709
## 743          8          9    1 2.684  0.373 0.709
## 744          1          1    0 2.684  0.000     1
## 745         14         11   -3 2.684 -1.118 0.264
## 746          6          6    0 2.684  0.000     1
## 747         12         11   -1 2.684 -0.373 0.709
## 748          4          6    2 2.684  0.745 0.456
## 749          9          7   -2 2.684 -0.745 0.456
## 750          2         13   11 2.684  4.099     0
## 751         19         17   -2 2.684 -0.745 0.456
## 752         14         12   -2 2.684 -0.745 0.456
## 753         19         19    0 2.684  0.000     1
## 754         16         14   -2 2.684 -0.745 0.456
## 755          5          6    1 2.684  0.373 0.709
## 756          3          4    1 2.684  0.373 0.709
## 757          5          8    3 2.684  1.118 0.264
## 758         11         15    4 2.684  1.490 0.136
## 759          7          7    0 2.684  0.000     1
## 760          5          2   -3 2.684 -1.118 0.264
## 761          1          0   -1 2.684 -0.373 0.709
## 762         12          8   -4 2.684 -1.490 0.136
## 763          9         12    3 2.684  1.118 0.264
## 764          8          6   -2 2.684 -0.745 0.456
## 765         16         16    0 2.684  0.000     1
## 766          9          7   -2 2.684 -0.745 0.456
## 767          4          5    1 2.684  0.373 0.709
## 768          4          7    3 2.684  1.118 0.264
## 769         11         14    3 2.684  1.118 0.264
## 770          4          4    0 2.684  0.000     1
## 771         14          8   -6 2.684 -2.236 0.025
## 772         16         16    0 2.684  0.000     1
## 773         10         12    2 2.684  0.745 0.456
## 774          8         10    2 2.684  0.745 0.456
## 775          8          9    1 2.684  0.373 0.709
## 776         13         12   -1 2.684 -0.373 0.709
## 777          6          4   -2 2.684 -0.745 0.456
## 778         12         17    5 2.684  1.863 0.062
## 779          4          2   -2 2.684 -0.745 0.456
## 780          9         12    3 2.684  1.118 0.264
## 781         11          9   -2 2.684 -0.745 0.456
## 782         11         13    2 2.684  0.745 0.456
## 783          4          3   -1 2.684 -0.373 0.709
## 784          2          3    1 2.684  0.373 0.709
## 785          4          7    3 2.684  1.118 0.264
## 786         15         17    2 2.684  0.745 0.456
## 787          5          3   -2 2.684 -0.745 0.456
## 788         14         12   -2 2.684 -0.745 0.456
## 789         10         14    4 2.684  1.490 0.136
## 790         19         15   -4 2.684 -1.490 0.136
## 791         11          8   -3 2.684 -1.118 0.264
## 792         15         13   -2 2.684 -0.745 0.456
## 793          6          5   -1 2.684 -0.373 0.709
## 794          1          3    2 2.684  0.745 0.456
## 795          9          9    0 2.684  0.000     1
## 796          9          9    0 2.684  0.000     1
## 797          7          8    1 2.684  0.373 0.709
## 798          8         13    5 2.684  1.863 0.062
## 799         11         10   -1 2.684 -0.373 0.709
## 800          6          8    2 2.684  0.745 0.456
## 801         14         15    1 2.684  0.373 0.709
## 802          8         10    2 2.684  0.745 0.456
## 803          5         10    5 2.684  1.863 0.062
## 804         16         14   -2 2.684 -0.745 0.456
## 805         17         18    1 2.684  0.373 0.709
## 806          3          5    2 2.684  0.745 0.456
## 807         12         13    1 2.684  0.373 0.709
## 808         12         12    0 2.684  0.000     1
## 809          8          8    0 2.684  0.000     1
## 810          8          5   -3 2.684 -1.118 0.264
## 811         17         14   -3 2.684 -1.118 0.264
## 812         14         11   -3 2.684 -1.118 0.264
## 813         17         13   -4 2.684 -1.490 0.136
## 814          6          5   -1 2.684 -0.373 0.709
## 815          7         10    3 2.684  1.118 0.264
## 816          8          6   -2 2.684 -0.745 0.456
## 817          6         11    5 2.684  1.863 0.062
## 818          8         11    3 2.684  1.118 0.264
## 819          5          5    0 2.684  0.000     1
## 820          6          4   -2 2.684 -0.745 0.456
## 821         10         13    3 2.684  1.118 0.264
## 822         16         18    2 2.684  0.745 0.456
## 823          2          3    1 2.684  0.373 0.709
## 824          9          8   -1 2.684 -0.373 0.709
## 825          9         10    1 2.684  0.373 0.709
## 826         11         11    0 2.684  0.000     1
## 827          4          5    1 2.684  0.373 0.709
## 828          1          5    4 2.684  1.490 0.136
## 829         16         16    0 2.684  0.000     1
## 830          5         10    5 2.684  1.863 0.062
## 831          3          4    1 2.684  0.373 0.709
## 832         19         18   -1 2.684 -0.373 0.709
## 833         13         10   -3 2.684 -1.118 0.264
## 834         15         18    3 2.684  1.118 0.264
## 835         12         11   -1 2.684 -0.373 0.709
## 836         15         13   -2 2.684 -0.745 0.456
## 837         12         10   -2 2.684 -0.745 0.456
## 838          0          2    2 2.684  0.745 0.456
## 839         12         10   -2 2.684 -0.745 0.456
## 840          9         14    5 2.684  1.863 0.062
## 841          6         13    7 2.684  2.608 0.009
## 842         11         11    0 2.684  0.000     1
## 843          3          4    1 2.684  0.373 0.709
## 844          5          8    3 2.684  1.118 0.264
## 845         10         12    2 2.684  0.745 0.456
## 846         14         11   -3 2.684 -1.118 0.264
## 847          7          9    2 2.684  0.745 0.456
## 848          6          4   -2 2.684 -0.745 0.456
## 849         14          9   -5 2.684 -1.863 0.062
## 850         13         18    5 2.684  1.863 0.062
## 851         16         16    0 2.684  0.000     1
## 852         11          6   -5 2.684 -1.863 0.062
## 853         11          6   -5 2.684 -1.863 0.062
## 854          1          3    2 2.684  0.745 0.456
## 855         11          9   -2 2.684 -0.745 0.456
## 856          4          2   -2 2.684 -0.745 0.456
## 857          8          6   -2 2.684 -0.745 0.456
## 858          6          6    0 2.684  0.000     1
## 859         11          7   -4 2.684 -1.490 0.136
## 860          5          4   -1 2.684 -0.373 0.709
## 861          7          4   -3 2.684 -1.118 0.264
## 862          4          4    0 2.684  0.000     1
## 863         17         15   -2 2.684 -0.745 0.456
## 864         13         15    2 2.684  0.745 0.456
## 865          9          4   -5 2.684 -1.863 0.062
## 866          3          5    2 2.684  0.745 0.456
## 867          7          5   -2 2.684 -0.745 0.456
## 868          9          7   -2 2.684 -0.745 0.456
## 869          8          7   -1 2.684 -0.373 0.709
## 870          8         11    3 2.684  1.118 0.264
## 871         12         14    2 2.684  0.745 0.456
## 872          6          7    1 2.684  0.373 0.709
## 873         13         12   -1 2.684 -0.373 0.709
## 874         10         10    0 2.684  0.000     1
## 875         16         17    1 2.684  0.373 0.709
## 876         15         17    2 2.684  0.745 0.456
## 877          6          4   -2 2.684 -0.745 0.456
## 878          8          6   -2 2.684 -0.745 0.456
## 879         14         13   -1 2.684 -0.373 0.709
## 880         16         15   -1 2.684 -0.373 0.709
## 881          7          3   -4 2.684 -1.490 0.136
## 882          6          5   -1 2.684 -0.373 0.709
## 883         11          9   -2 2.684 -0.745 0.456
## 884          3          0   -3 2.684 -1.118 0.264
## 885          5          6    1 2.684  0.373 0.709
## 886         13         13    0 2.684  0.000     1
## 887         11          9   -2 2.684 -0.745 0.456
## 888         12         13    1 2.684  0.373 0.709
## 889          0          1    1 2.684  0.373 0.709
## 890         16         17    1 2.684  0.373 0.709
## 891          5          2   -3 2.684 -1.118 0.264
## 892         13         11   -2 2.684 -0.745 0.456
## 893          7          4   -3 2.684 -1.118 0.264
## 894          4          3   -1 2.684 -0.373 0.709
## 895          2          1   -1 2.684 -0.373 0.709
## 896         10         15    5 2.684  1.863 0.062
## 897         13         12   -1 2.684 -0.373 0.709
## 898         13          9   -4 2.684 -1.490 0.136
## 899         20         19   -1 2.684 -0.373 0.709
## 900          7          6   -1 2.684 -0.373 0.709
## 901         16         14   -2 2.684 -0.745 0.456
## 902          6          4   -2 2.684 -0.745 0.456
## 903         13         11   -2 2.684 -0.745 0.456
## 904          4          3   -1 2.684 -0.373 0.709
## 905          7          5   -2 2.684 -0.745 0.456
## 906          7          7    0 2.684  0.000     1
## 907         11         11    0 2.684  0.000     1
## 908          9          5   -4 2.684 -1.490 0.136
## 909         12          9   -3 2.684 -1.118 0.264
## 910          8         13    5 2.684  1.863 0.062
## 911          6         13    7 2.684  2.608 0.009
## 912         11          7   -4 2.684 -1.490 0.136
## 913          3          6    3 2.684  1.118 0.264
## 914          9         12    3 2.684  1.118 0.264
## 915         18         18    0 2.684  0.000     1
## 916         18         18    0 2.684  0.000     1
## 917         14         15    1 2.684  0.373 0.709
## 918         11         11    0 2.684  0.000     1
## 919          7          7    0 2.684  0.000     1
## 920         10          4   -6 2.684 -2.236 0.025
## 921         19         18   -1 2.684 -0.373 0.709
## 922         12          8   -4 2.684 -1.490 0.136
## 923          6          7    1 2.684  0.373 0.709
## 924          5          6    1 2.684  0.373 0.709
## 925          5          4   -1 2.684 -0.373 0.709
## 926         12         10   -2 2.684 -0.745 0.456
## 927          8          9    1 2.684  0.373 0.709
## 928         10          5   -5 2.684 -1.863 0.062
## 929         12         17    5 2.684  1.863 0.062
## 930         13         10   -3 2.684 -1.118 0.264
## 931         14         10   -4 2.684 -1.490 0.136
## 932          4          2   -2 2.684 -0.745 0.456
## 933         13         12   -1 2.684 -0.373 0.709
## 934         12          8   -4 2.684 -1.490 0.136
## 935          9          8   -1 2.684 -0.373 0.709
## 936          4          3   -1 2.684 -0.373 0.709
## 937         13         12   -1 2.684 -0.373 0.709
## 938         10          4   -6 2.684 -2.236 0.025
## 939          7          5   -2 2.684 -0.745 0.456
## 940          6         12    6 2.684  2.236 0.025
## 941         12         17    5 2.684  1.863 0.062
## 942          0          1    1 2.684  0.373 0.709
## 943          9          5   -4 2.684 -1.490 0.136
## 944          5          8    3 2.684  1.118 0.264
## 945          4          5    1 2.684  0.373 0.709
## 946         17         19    2 2.684  0.745 0.456
## 947         11          9   -2 2.684 -0.745 0.456
## 948         13         14    1 2.684  0.373 0.709
## 949          5          9    4 2.684  1.490 0.136
## 950         11         14    3 2.684  1.118 0.264
## 951          8          7   -1 2.684 -0.373 0.709
## 952          6          9    3 2.684  1.118 0.264
## 953          9          1   -8 2.684 -2.981 0.003
## 954         11          8   -3 2.684 -1.118 0.264
## 955         10         13    3 2.684  1.118 0.264
## 956          4          3   -1 2.684 -0.373 0.709
## 957          3          4    1 2.684  0.373 0.709
## 958          7         11    4 2.684  1.490 0.136
## 959         13         14    1 2.684  0.373 0.709
## 960         18         17   -1 2.684 -0.373 0.709
## 961         13         13    0 2.684  0.000     1
## 962         20         19   -1 2.684 -0.373 0.709
## 963          8          4   -4 2.684 -1.490 0.136
## 964         15         15    0 2.684  0.000     1
## 965         11          8   -3 2.684 -1.118 0.264
## 966         14         17    3 2.684  1.118 0.264
## 967         14          9   -5 2.684 -1.863 0.062
## 968          9         10    1 2.684  0.373 0.709
## 969         10          8   -2 2.684 -0.745 0.456
## 970         16         15   -1 2.684 -0.373 0.709
## 971         13         14    1 2.684  0.373 0.709
## 972          3          3    0 2.684  0.000     1
## 973         12         13    1 2.684  0.373 0.709
## 974          8          6   -2 2.684 -0.745 0.456
## 975          9         11    2 2.684  0.745 0.456
## 976          9         11    2 2.684  0.745 0.456
## 977          4          4    0 2.684  0.000     1
## 978          8          7   -1 2.684 -0.373 0.709
## 979          9         10    1 2.684  0.373 0.709
## 980         15         17    2 2.684  0.745 0.456
## 981         10          9   -1 2.684 -0.373 0.709
## 982         15         12   -3 2.684 -1.118 0.264
## 983          7         10    3 2.684  1.118 0.264
## 984         15         16    1 2.684  0.373 0.709
## 985         13         13    0 2.684  0.000     1
## 986          2          6    4 2.684  1.490 0.136
## 987          8          9    1 2.684  0.373 0.709
## 988          9          9    0 2.684  0.000     1
## 989         16         11   -5 2.684 -1.863 0.062
## 990         13         10   -3 2.684 -1.118 0.264
## 991          3          4    1 2.684  0.373 0.709
## 992          1          6    5 2.684  1.863 0.062
## 993         11         12    1 2.684  0.373 0.709
## 994          5          2   -3 2.684 -1.118 0.264
## 995          5          9    4 2.684  1.490 0.136
## 996         12          8   -4 2.684 -1.490 0.136
## 997          2          0   -2 2.684 -0.745 0.456
## 998          2          2    0 2.684  0.000     1
## 999         17         19    2 2.684  0.745 0.456
## 1000         3          1   -2 2.684 -0.745 0.456
# include cutoffs
RCI(predat = dat_pre, postdat = dat_post, SEM.pre=SEM.alpha,
    cutoffs=c(-1.96, 1.96))
##      pre.score post.score diff   SEM      z     p cut_decision
## 1           12         10   -2 2.684 -0.745 0.456    unchanged
## 2            5          5    0 2.684  0.000     1    unchanged
## 3           10          6   -4 2.684 -1.490 0.136    unchanged
## 4            9         10    1 2.684  0.373 0.709    unchanged
## 5           17         15   -2 2.684 -0.745 0.456    unchanged
## 6           14         12   -2 2.684 -0.745 0.456    unchanged
## 7           11         13    2 2.684  0.745 0.456    unchanged
## 8            6          8    2 2.684  0.745 0.456    unchanged
## 9           11         14    3 2.684  1.118 0.264    unchanged
## 10           8         10    2 2.684  0.745 0.456    unchanged
## 11          11          9   -2 2.684 -0.745 0.456    unchanged
## 12          15         16    1 2.684  0.373 0.709    unchanged
## 13          16         13   -3 2.684 -1.118 0.264    unchanged
## 14           9          6   -3 2.684 -1.118 0.264    unchanged
## 15           8          6   -2 2.684 -0.745 0.456    unchanged
## 16          10         10    0 2.684  0.000     1    unchanged
## 17           2          2    0 2.684  0.000     1    unchanged
## 18           8         11    3 2.684  1.118 0.264    unchanged
## 19           9          8   -1 2.684 -0.373 0.709    unchanged
## 20          14         16    2 2.684  0.745 0.456    unchanged
## 21           3          2   -1 2.684 -0.373 0.709    unchanged
## 22          11         13    2 2.684  0.745 0.456    unchanged
## 23           2          2    0 2.684  0.000     1    unchanged
## 24           1          2    1 2.684  0.373 0.709    unchanged
## 25          10          8   -2 2.684 -0.745 0.456    unchanged
## 26           2          2    0 2.684  0.000     1    unchanged
## 27          10         10    0 2.684  0.000     1    unchanged
## 28           1          2    1 2.684  0.373 0.709    unchanged
## 29           1          1    0 2.684  0.000     1    unchanged
## 30          14          7   -7 2.684 -2.608 0.009    decreased
## 31           5          3   -2 2.684 -0.745 0.456    unchanged
## 32           2          1   -1 2.684 -0.373 0.709    unchanged
## 33           4          7    3 2.684  1.118 0.264    unchanged
## 34           7          4   -3 2.684 -1.118 0.264    unchanged
## 35           5          3   -2 2.684 -0.745 0.456    unchanged
## 36           1          7    6 2.684  2.236 0.025    increased
## 37           8          7   -1 2.684 -0.373 0.709    unchanged
## 38           4          4    0 2.684  0.000     1    unchanged
## 39          15         17    2 2.684  0.745 0.456    unchanged
## 40          13         12   -1 2.684 -0.373 0.709    unchanged
## 41          12         11   -1 2.684 -0.373 0.709    unchanged
## 42          14         14    0 2.684  0.000     1    unchanged
## 43          12         15    3 2.684  1.118 0.264    unchanged
## 44          11         11    0 2.684  0.000     1    unchanged
## 45           6          3   -3 2.684 -1.118 0.264    unchanged
## 46           1          1    0 2.684  0.000     1    unchanged
## 47          17         12   -5 2.684 -1.863 0.062    unchanged
## 48           9          8   -1 2.684 -0.373 0.709    unchanged
## 49          13         15    2 2.684  0.745 0.456    unchanged
## 50          13         11   -2 2.684 -0.745 0.456    unchanged
## 51          12         11   -1 2.684 -0.373 0.709    unchanged
## 52          19         19    0 2.684  0.000     1    unchanged
## 53           8          8    0 2.684  0.000     1    unchanged
## 54           4          1   -3 2.684 -1.118 0.264    unchanged
## 55           7          9    2 2.684  0.745 0.456    unchanged
## 56           5          6    1 2.684  0.373 0.709    unchanged
## 57          12         10   -2 2.684 -0.745 0.456    unchanged
## 58          14         13   -1 2.684 -0.373 0.709    unchanged
## 59          13         10   -3 2.684 -1.118 0.264    unchanged
## 60          14         17    3 2.684  1.118 0.264    unchanged
## 61           4          5    1 2.684  0.373 0.709    unchanged
## 62          13         11   -2 2.684 -0.745 0.456    unchanged
## 63           6          7    1 2.684  0.373 0.709    unchanged
## 64           6         11    5 2.684  1.863 0.062    unchanged
## 65           6          3   -3 2.684 -1.118 0.264    unchanged
## 66           5          1   -4 2.684 -1.490 0.136    unchanged
## 67          15         18    3 2.684  1.118 0.264    unchanged
## 68           8         15    7 2.684  2.608 0.009    increased
## 69           3          7    4 2.684  1.490 0.136    unchanged
## 70          11         15    4 2.684  1.490 0.136    unchanged
## 71           6          6    0 2.684  0.000     1    unchanged
## 72           5          7    2 2.684  0.745 0.456    unchanged
## 73          13         11   -2 2.684 -0.745 0.456    unchanged
## 74          10          6   -4 2.684 -1.490 0.136    unchanged
## 75          15         15    0 2.684  0.000     1    unchanged
## 76           8         13    5 2.684  1.863 0.062    unchanged
## 77           4          3   -1 2.684 -0.373 0.709    unchanged
## 78           5          6    1 2.684  0.373 0.709    unchanged
## 79           7          5   -2 2.684 -0.745 0.456    unchanged
## 80           6          1   -5 2.684 -1.863 0.062    unchanged
## 81           4          4    0 2.684  0.000     1    unchanged
## 82          11         12    1 2.684  0.373 0.709    unchanged
## 83           3          4    1 2.684  0.373 0.709    unchanged
## 84           7          9    2 2.684  0.745 0.456    unchanged
## 85           5          6    1 2.684  0.373 0.709    unchanged
## 86          14         13   -1 2.684 -0.373 0.709    unchanged
## 87          10          7   -3 2.684 -1.118 0.264    unchanged
## 88          15         18    3 2.684  1.118 0.264    unchanged
## 89          16         15   -1 2.684 -0.373 0.709    unchanged
## 90           5         12    7 2.684  2.608 0.009    increased
## 91           5          7    2 2.684  0.745 0.456    unchanged
## 92          12         13    1 2.684  0.373 0.709    unchanged
## 93           2          5    3 2.684  1.118 0.264    unchanged
## 94           9          4   -5 2.684 -1.863 0.062    unchanged
## 95           0          2    2 2.684  0.745 0.456    unchanged
## 96           1          3    2 2.684  0.745 0.456    unchanged
## 97          10         15    5 2.684  1.863 0.062    unchanged
## 98           8          5   -3 2.684 -1.118 0.264    unchanged
## 99           7         11    4 2.684  1.490 0.136    unchanged
## 100          7          5   -2 2.684 -0.745 0.456    unchanged
## 101         12         10   -2 2.684 -0.745 0.456    unchanged
## 102          8         11    3 2.684  1.118 0.264    unchanged
## 103         18         18    0 2.684  0.000     1    unchanged
## 104         17         12   -5 2.684 -1.863 0.062    unchanged
## 105         16         15   -1 2.684 -0.373 0.709    unchanged
## 106          2          2    0 2.684  0.000     1    unchanged
## 107          8          9    1 2.684  0.373 0.709    unchanged
## 108          5          3   -2 2.684 -0.745 0.456    unchanged
## 109          1          1    0 2.684  0.000     1    unchanged
## 110          6          5   -1 2.684 -0.373 0.709    unchanged
## 111          3          4    1 2.684  0.373 0.709    unchanged
## 112         11         12    1 2.684  0.373 0.709    unchanged
## 113         12         12    0 2.684  0.000     1    unchanged
## 114          6          5   -1 2.684 -0.373 0.709    unchanged
## 115         11         13    2 2.684  0.745 0.456    unchanged
## 116         13         13    0 2.684  0.000     1    unchanged
## 117          4          7    3 2.684  1.118 0.264    unchanged
## 118          2          3    1 2.684  0.373 0.709    unchanged
## 119         11          9   -2 2.684 -0.745 0.456    unchanged
## 120          5         10    5 2.684  1.863 0.062    unchanged
## 121         16         17    1 2.684  0.373 0.709    unchanged
## 122          2          3    1 2.684  0.373 0.709    unchanged
## 123         18         15   -3 2.684 -1.118 0.264    unchanged
## 124          9         10    1 2.684  0.373 0.709    unchanged
## 125         15         10   -5 2.684 -1.863 0.062    unchanged
## 126         17         18    1 2.684  0.373 0.709    unchanged
## 127         15         18    3 2.684  1.118 0.264    unchanged
## 128          3          8    5 2.684  1.863 0.062    unchanged
## 129         16         13   -3 2.684 -1.118 0.264    unchanged
## 130         10          6   -4 2.684 -1.490 0.136    unchanged
## 131         15         17    2 2.684  0.745 0.456    unchanged
## 132          8          4   -4 2.684 -1.490 0.136    unchanged
## 133          4          4    0 2.684  0.000     1    unchanged
## 134         17         17    0 2.684  0.000     1    unchanged
## 135          6          9    3 2.684  1.118 0.264    unchanged
## 136          7          3   -4 2.684 -1.490 0.136    unchanged
## 137          3          8    5 2.684  1.863 0.062    unchanged
## 138          4          8    4 2.684  1.490 0.136    unchanged
## 139         14         18    4 2.684  1.490 0.136    unchanged
## 140          9          2   -7 2.684 -2.608 0.009    decreased
## 141         16         15   -1 2.684 -0.373 0.709    unchanged
## 142          9          5   -4 2.684 -1.490 0.136    unchanged
## 143         19         17   -2 2.684 -0.745 0.456    unchanged
## 144          9         10    1 2.684  0.373 0.709    unchanged
## 145          7          5   -2 2.684 -0.745 0.456    unchanged
## 146         15         15    0 2.684  0.000     1    unchanged
## 147         10          7   -3 2.684 -1.118 0.264    unchanged
## 148          6          4   -2 2.684 -0.745 0.456    unchanged
## 149         11          8   -3 2.684 -1.118 0.264    unchanged
## 150          9          9    0 2.684  0.000     1    unchanged
## 151         10          7   -3 2.684 -1.118 0.264    unchanged
## 152          7          9    2 2.684  0.745 0.456    unchanged
## 153         14         12   -2 2.684 -0.745 0.456    unchanged
## 154         10         13    3 2.684  1.118 0.264    unchanged
## 155         13         10   -3 2.684 -1.118 0.264    unchanged
## 156         10          7   -3 2.684 -1.118 0.264    unchanged
## 157         12         12    0 2.684  0.000     1    unchanged
## 158         14         11   -3 2.684 -1.118 0.264    unchanged
## 159          6          6    0 2.684  0.000     1    unchanged
## 160          4          4    0 2.684  0.000     1    unchanged
## 161          6          5   -1 2.684 -0.373 0.709    unchanged
## 162          3          2   -1 2.684 -0.373 0.709    unchanged
## 163          4          4    0 2.684  0.000     1    unchanged
## 164         18         18    0 2.684  0.000     1    unchanged
## 165         12          8   -4 2.684 -1.490 0.136    unchanged
## 166          2          2    0 2.684  0.000     1    unchanged
## 167          6          3   -3 2.684 -1.118 0.264    unchanged
## 168          2          5    3 2.684  1.118 0.264    unchanged
## 169          9         11    2 2.684  0.745 0.456    unchanged
## 170          5          4   -1 2.684 -0.373 0.709    unchanged
## 171         19         18   -1 2.684 -0.373 0.709    unchanged
## 172         11         12    1 2.684  0.373 0.709    unchanged
## 173          9          3   -6 2.684 -2.236 0.025    decreased
## 174         18         14   -4 2.684 -1.490 0.136    unchanged
## 175         11         13    2 2.684  0.745 0.456    unchanged
## 176         16         18    2 2.684  0.745 0.456    unchanged
## 177          9          7   -2 2.684 -0.745 0.456    unchanged
## 178         10         14    4 2.684  1.490 0.136    unchanged
## 179         13          9   -4 2.684 -1.490 0.136    unchanged
## 180          3          5    2 2.684  0.745 0.456    unchanged
## 181         11         12    1 2.684  0.373 0.709    unchanged
## 182         13         11   -2 2.684 -0.745 0.456    unchanged
## 183         14         15    1 2.684  0.373 0.709    unchanged
## 184         15         16    1 2.684  0.373 0.709    unchanged
## 185          6          4   -2 2.684 -0.745 0.456    unchanged
## 186         16         19    3 2.684  1.118 0.264    unchanged
## 187         19         19    0 2.684  0.000     1    unchanged
## 188         14         15    1 2.684  0.373 0.709    unchanged
## 189          5          7    2 2.684  0.745 0.456    unchanged
## 190          5          6    1 2.684  0.373 0.709    unchanged
## 191         11          9   -2 2.684 -0.745 0.456    unchanged
## 192         11          8   -3 2.684 -1.118 0.264    unchanged
## 193          4          4    0 2.684  0.000     1    unchanged
## 194         15          9   -6 2.684 -2.236 0.025    decreased
## 195          6          8    2 2.684  0.745 0.456    unchanged
## 196         13          8   -5 2.684 -1.863 0.062    unchanged
## 197          9         11    2 2.684  0.745 0.456    unchanged
## 198          8          6   -2 2.684 -0.745 0.456    unchanged
## 199         16         17    1 2.684  0.373 0.709    unchanged
## 200          5         10    5 2.684  1.863 0.062    unchanged
## 201          3          5    2 2.684  0.745 0.456    unchanged
## 202         14         15    1 2.684  0.373 0.709    unchanged
## 203          4          8    4 2.684  1.490 0.136    unchanged
## 204          9          7   -2 2.684 -0.745 0.456    unchanged
## 205          5          2   -3 2.684 -1.118 0.264    unchanged
## 206         18         15   -3 2.684 -1.118 0.264    unchanged
## 207          3          3    0 2.684  0.000     1    unchanged
## 208         17         17    0 2.684  0.000     1    unchanged
## 209          7          7    0 2.684  0.000     1    unchanged
## 210         11          9   -2 2.684 -0.745 0.456    unchanged
## 211          2          5    3 2.684  1.118 0.264    unchanged
## 212         11         12    1 2.684  0.373 0.709    unchanged
## 213          6          4   -2 2.684 -0.745 0.456    unchanged
## 214          6          7    1 2.684  0.373 0.709    unchanged
## 215          8          6   -2 2.684 -0.745 0.456    unchanged
## 216         15         15    0 2.684  0.000     1    unchanged
## 217          3          3    0 2.684  0.000     1    unchanged
## 218         14         12   -2 2.684 -0.745 0.456    unchanged
## 219         10          7   -3 2.684 -1.118 0.264    unchanged
## 220          9         13    4 2.684  1.490 0.136    unchanged
## 221          3          5    2 2.684  0.745 0.456    unchanged
## 222          6         10    4 2.684  1.490 0.136    unchanged
## 223         14         13   -1 2.684 -0.373 0.709    unchanged
## 224         18         18    0 2.684  0.000     1    unchanged
## 225         17         14   -3 2.684 -1.118 0.264    unchanged
## 226          8          9    1 2.684  0.373 0.709    unchanged
## 227          8          9    1 2.684  0.373 0.709    unchanged
## 228         17         11   -6 2.684 -2.236 0.025    decreased
## 229          3          4    1 2.684  0.373 0.709    unchanged
## 230          7          8    1 2.684  0.373 0.709    unchanged
## 231          7         10    3 2.684  1.118 0.264    unchanged
## 232          7          9    2 2.684  0.745 0.456    unchanged
## 233         12         14    2 2.684  0.745 0.456    unchanged
## 234         17         13   -4 2.684 -1.490 0.136    unchanged
## 235         16         13   -3 2.684 -1.118 0.264    unchanged
## 236          4          3   -1 2.684 -0.373 0.709    unchanged
## 237         12         11   -1 2.684 -0.373 0.709    unchanged
## 238          3          9    6 2.684  2.236 0.025    increased
## 239          2          4    2 2.684  0.745 0.456    unchanged
## 240          8          7   -1 2.684 -0.373 0.709    unchanged
## 241         10         13    3 2.684  1.118 0.264    unchanged
## 242          2          6    4 2.684  1.490 0.136    unchanged
## 243         18         19    1 2.684  0.373 0.709    unchanged
## 244         11         11    0 2.684  0.000     1    unchanged
## 245         11         11    0 2.684  0.000     1    unchanged
## 246         17         15   -2 2.684 -0.745 0.456    unchanged
## 247         15         18    3 2.684  1.118 0.264    unchanged
## 248         14          9   -5 2.684 -1.863 0.062    unchanged
## 249          9          4   -5 2.684 -1.863 0.062    unchanged
## 250         14         13   -1 2.684 -0.373 0.709    unchanged
## 251         16          7   -9 2.684 -3.354 0.001    decreased
## 252         15         14   -1 2.684 -0.373 0.709    unchanged
## 253         12         11   -1 2.684 -0.373 0.709    unchanged
## 254          3          4    1 2.684  0.373 0.709    unchanged
## 255         12         12    0 2.684  0.000     1    unchanged
## 256          7         11    4 2.684  1.490 0.136    unchanged
## 257          5          5    0 2.684  0.000     1    unchanged
## 258          8          8    0 2.684  0.000     1    unchanged
## 259          6          6    0 2.684  0.000     1    unchanged
## 260         12         12    0 2.684  0.000     1    unchanged
## 261         13         15    2 2.684  0.745 0.456    unchanged
## 262          9         13    4 2.684  1.490 0.136    unchanged
## 263         13          8   -5 2.684 -1.863 0.062    unchanged
## 264          6          9    3 2.684  1.118 0.264    unchanged
## 265          8         11    3 2.684  1.118 0.264    unchanged
## 266         11          9   -2 2.684 -0.745 0.456    unchanged
## 267         10         12    2 2.684  0.745 0.456    unchanged
## 268         18         16   -2 2.684 -0.745 0.456    unchanged
## 269          4          4    0 2.684  0.000     1    unchanged
## 270          9         14    5 2.684  1.863 0.062    unchanged
## 271         14         16    2 2.684  0.745 0.456    unchanged
## 272          8          7   -1 2.684 -0.373 0.709    unchanged
## 273          7          6   -1 2.684 -0.373 0.709    unchanged
## 274         16         15   -1 2.684 -0.373 0.709    unchanged
## 275          8         15    7 2.684  2.608 0.009    increased
## 276         15         16    1 2.684  0.373 0.709    unchanged
## 277         15         14   -1 2.684 -0.373 0.709    unchanged
## 278         13          9   -4 2.684 -1.490 0.136    unchanged
## 279          8          9    1 2.684  0.373 0.709    unchanged
## 280          5          9    4 2.684  1.490 0.136    unchanged
## 281         13          9   -4 2.684 -1.490 0.136    unchanged
## 282         13         10   -3 2.684 -1.118 0.264    unchanged
## 283          9         13    4 2.684  1.490 0.136    unchanged
## 284          5          4   -1 2.684 -0.373 0.709    unchanged
## 285          4          6    2 2.684  0.745 0.456    unchanged
## 286          2          6    4 2.684  1.490 0.136    unchanged
## 287          3          2   -1 2.684 -0.373 0.709    unchanged
## 288          9          7   -2 2.684 -0.745 0.456    unchanged
## 289          7         10    3 2.684  1.118 0.264    unchanged
## 290          8          5   -3 2.684 -1.118 0.264    unchanged
## 291          9          6   -3 2.684 -1.118 0.264    unchanged
## 292          4          3   -1 2.684 -0.373 0.709    unchanged
## 293         14         17    3 2.684  1.118 0.264    unchanged
## 294         15         18    3 2.684  1.118 0.264    unchanged
## 295          3          4    1 2.684  0.373 0.709    unchanged
## 296          1          4    3 2.684  1.118 0.264    unchanged
## 297         12         10   -2 2.684 -0.745 0.456    unchanged
## 298          5          8    3 2.684  1.118 0.264    unchanged
## 299         12         12    0 2.684  0.000     1    unchanged
## 300          8         10    2 2.684  0.745 0.456    unchanged
## 301          6          5   -1 2.684 -0.373 0.709    unchanged
## 302          5          7    2 2.684  0.745 0.456    unchanged
## 303         14         15    1 2.684  0.373 0.709    unchanged
## 304         11          8   -3 2.684 -1.118 0.264    unchanged
## 305          4          2   -2 2.684 -0.745 0.456    unchanged
## 306         11         11    0 2.684  0.000     1    unchanged
## 307         13         11   -2 2.684 -0.745 0.456    unchanged
## 308          9         13    4 2.684  1.490 0.136    unchanged
## 309          4          6    2 2.684  0.745 0.456    unchanged
## 310         13         11   -2 2.684 -0.745 0.456    unchanged
## 311         10         12    2 2.684  0.745 0.456    unchanged
## 312          8          9    1 2.684  0.373 0.709    unchanged
## 313         16         12   -4 2.684 -1.490 0.136    unchanged
## 314          8          9    1 2.684  0.373 0.709    unchanged
## 315          2          1   -1 2.684 -0.373 0.709    unchanged
## 316         13         11   -2 2.684 -0.745 0.456    unchanged
## 317         15          8   -7 2.684 -2.608 0.009    decreased
## 318          7          4   -3 2.684 -1.118 0.264    unchanged
## 319         16         15   -1 2.684 -0.373 0.709    unchanged
## 320         12         11   -1 2.684 -0.373 0.709    unchanged
## 321          2          1   -1 2.684 -0.373 0.709    unchanged
## 322         14         15    1 2.684  0.373 0.709    unchanged
## 323          1          2    1 2.684  0.373 0.709    unchanged
## 324         10         11    1 2.684  0.373 0.709    unchanged
## 325          8          9    1 2.684  0.373 0.709    unchanged
## 326         13         14    1 2.684  0.373 0.709    unchanged
## 327         15         16    1 2.684  0.373 0.709    unchanged
## 328         16         11   -5 2.684 -1.863 0.062    unchanged
## 329          7          7    0 2.684  0.000     1    unchanged
## 330          8          9    1 2.684  0.373 0.709    unchanged
## 331         14         10   -4 2.684 -1.490 0.136    unchanged
## 332          5          8    3 2.684  1.118 0.264    unchanged
## 333         11         15    4 2.684  1.490 0.136    unchanged
## 334          5          7    2 2.684  0.745 0.456    unchanged
## 335          0          4    4 2.684  1.490 0.136    unchanged
## 336          3          4    1 2.684  0.373 0.709    unchanged
## 337          9          4   -5 2.684 -1.863 0.062    unchanged
## 338         10          9   -1 2.684 -0.373 0.709    unchanged
## 339         12         16    4 2.684  1.490 0.136    unchanged
## 340         14         17    3 2.684  1.118 0.264    unchanged
## 341          9          8   -1 2.684 -0.373 0.709    unchanged
## 342          6          8    2 2.684  0.745 0.456    unchanged
## 343          7          3   -4 2.684 -1.490 0.136    unchanged
## 344         16         18    2 2.684  0.745 0.456    unchanged
## 345         14          7   -7 2.684 -2.608 0.009    decreased
## 346         12          6   -6 2.684 -2.236 0.025    decreased
## 347         14         14    0 2.684  0.000     1    unchanged
## 348         15         15    0 2.684  0.000     1    unchanged
## 349          7          3   -4 2.684 -1.490 0.136    unchanged
## 350          8          9    1 2.684  0.373 0.709    unchanged
## 351          5          2   -3 2.684 -1.118 0.264    unchanged
## 352          8          6   -2 2.684 -0.745 0.456    unchanged
## 353         17         18    1 2.684  0.373 0.709    unchanged
## 354          7          8    1 2.684  0.373 0.709    unchanged
## 355         12         10   -2 2.684 -0.745 0.456    unchanged
## 356         11         12    1 2.684  0.373 0.709    unchanged
## 357         15         12   -3 2.684 -1.118 0.264    unchanged
## 358          5          7    2 2.684  0.745 0.456    unchanged
## 359         10          8   -2 2.684 -0.745 0.456    unchanged
## 360         14         14    0 2.684  0.000     1    unchanged
## 361         10         11    1 2.684  0.373 0.709    unchanged
## 362         10          9   -1 2.684 -0.373 0.709    unchanged
## 363         14         14    0 2.684  0.000     1    unchanged
## 364         17         15   -2 2.684 -0.745 0.456    unchanged
## 365          8          7   -1 2.684 -0.373 0.709    unchanged
## 366         17         11   -6 2.684 -2.236 0.025    decreased
## 367          5          3   -2 2.684 -0.745 0.456    unchanged
## 368          2          1   -1 2.684 -0.373 0.709    unchanged
## 369          2          1   -1 2.684 -0.373 0.709    unchanged
## 370         12         12    0 2.684  0.000     1    unchanged
## 371         11         11    0 2.684  0.000     1    unchanged
## 372          4          7    3 2.684  1.118 0.264    unchanged
## 373         16         11   -5 2.684 -1.863 0.062    unchanged
## 374          4          4    0 2.684  0.000     1    unchanged
## 375          6          4   -2 2.684 -0.745 0.456    unchanged
## 376          5          7    2 2.684  0.745 0.456    unchanged
## 377         12         11   -1 2.684 -0.373 0.709    unchanged
## 378         12         16    4 2.684  1.490 0.136    unchanged
## 379         16         18    2 2.684  0.745 0.456    unchanged
## 380         14         12   -2 2.684 -0.745 0.456    unchanged
## 381          6          5   -1 2.684 -0.373 0.709    unchanged
## 382         10         12    2 2.684  0.745 0.456    unchanged
## 383          8         11    3 2.684  1.118 0.264    unchanged
## 384         10         14    4 2.684  1.490 0.136    unchanged
## 385          4          5    1 2.684  0.373 0.709    unchanged
## 386         14         14    0 2.684  0.000     1    unchanged
## 387          7          7    0 2.684  0.000     1    unchanged
## 388         11         10   -1 2.684 -0.373 0.709    unchanged
## 389          4          4    0 2.684  0.000     1    unchanged
## 390          8          7   -1 2.684 -0.373 0.709    unchanged
## 391         10          9   -1 2.684 -0.373 0.709    unchanged
## 392          5          8    3 2.684  1.118 0.264    unchanged
## 393         12         10   -2 2.684 -0.745 0.456    unchanged
## 394          8          7   -1 2.684 -0.373 0.709    unchanged
## 395         10          4   -6 2.684 -2.236 0.025    decreased
## 396         18         15   -3 2.684 -1.118 0.264    unchanged
## 397          4          7    3 2.684  1.118 0.264    unchanged
## 398         13         13    0 2.684  0.000     1    unchanged
## 399         14         11   -3 2.684 -1.118 0.264    unchanged
## 400          4          6    2 2.684  0.745 0.456    unchanged
## 401         15         16    1 2.684  0.373 0.709    unchanged
## 402          4          4    0 2.684  0.000     1    unchanged
## 403          5          6    1 2.684  0.373 0.709    unchanged
## 404         17         15   -2 2.684 -0.745 0.456    unchanged
## 405          8          4   -4 2.684 -1.490 0.136    unchanged
## 406         10          6   -4 2.684 -1.490 0.136    unchanged
## 407          3          2   -1 2.684 -0.373 0.709    unchanged
## 408          8          7   -1 2.684 -0.373 0.709    unchanged
## 409          6         10    4 2.684  1.490 0.136    unchanged
## 410         11         12    1 2.684  0.373 0.709    unchanged
## 411          3          2   -1 2.684 -0.373 0.709    unchanged
## 412         14          9   -5 2.684 -1.863 0.062    unchanged
## 413          9          8   -1 2.684 -0.373 0.709    unchanged
## 414         15         17    2 2.684  0.745 0.456    unchanged
## 415         13          9   -4 2.684 -1.490 0.136    unchanged
## 416          3          5    2 2.684  0.745 0.456    unchanged
## 417          4          2   -2 2.684 -0.745 0.456    unchanged
## 418         18         18    0 2.684  0.000     1    unchanged
## 419          2          1   -1 2.684 -0.373 0.709    unchanged
## 420         15         13   -2 2.684 -0.745 0.456    unchanged
## 421         15         11   -4 2.684 -1.490 0.136    unchanged
## 422          6          7    1 2.684  0.373 0.709    unchanged
## 423          4          5    1 2.684  0.373 0.709    unchanged
## 424          7          4   -3 2.684 -1.118 0.264    unchanged
## 425          8          9    1 2.684  0.373 0.709    unchanged
## 426          6          2   -4 2.684 -1.490 0.136    unchanged
## 427          5          6    1 2.684  0.373 0.709    unchanged
## 428          3          7    4 2.684  1.490 0.136    unchanged
## 429          9         13    4 2.684  1.490 0.136    unchanged
## 430          6          4   -2 2.684 -0.745 0.456    unchanged
## 431          5         11    6 2.684  2.236 0.025    increased
## 432         14         12   -2 2.684 -0.745 0.456    unchanged
## 433         18         19    1 2.684  0.373 0.709    unchanged
## 434          0          0    0 2.684  0.000     1    unchanged
## 435         15          9   -6 2.684 -2.236 0.025    decreased
## 436         10          8   -2 2.684 -0.745 0.456    unchanged
## 437         15         16    1 2.684  0.373 0.709    unchanged
## 438          3          2   -1 2.684 -0.373 0.709    unchanged
## 439         14         13   -1 2.684 -0.373 0.709    unchanged
## 440          9         13    4 2.684  1.490 0.136    unchanged
## 441         10         11    1 2.684  0.373 0.709    unchanged
## 442         15         10   -5 2.684 -1.863 0.062    unchanged
## 443          4          4    0 2.684  0.000     1    unchanged
## 444          5          8    3 2.684  1.118 0.264    unchanged
## 445          6         11    5 2.684  1.863 0.062    unchanged
## 446         12         13    1 2.684  0.373 0.709    unchanged
## 447          3          5    2 2.684  0.745 0.456    unchanged
## 448          2          1   -1 2.684 -0.373 0.709    unchanged
## 449         16         15   -1 2.684 -0.373 0.709    unchanged
## 450          6          4   -2 2.684 -0.745 0.456    unchanged
## 451         17         15   -2 2.684 -0.745 0.456    unchanged
## 452          6         12    6 2.684  2.236 0.025    increased
## 453          4          6    2 2.684  0.745 0.456    unchanged
## 454         19         19    0 2.684  0.000     1    unchanged
## 455          9          8   -1 2.684 -0.373 0.709    unchanged
## 456          7          5   -2 2.684 -0.745 0.456    unchanged
## 457          6          5   -1 2.684 -0.373 0.709    unchanged
## 458          1          2    1 2.684  0.373 0.709    unchanged
## 459          8          7   -1 2.684 -0.373 0.709    unchanged
## 460          8         10    2 2.684  0.745 0.456    unchanged
## 461         15         13   -2 2.684 -0.745 0.456    unchanged
## 462          4          3   -1 2.684 -0.373 0.709    unchanged
## 463         16         17    1 2.684  0.373 0.709    unchanged
## 464         10         12    2 2.684  0.745 0.456    unchanged
## 465         17         13   -4 2.684 -1.490 0.136    unchanged
## 466         11         13    2 2.684  0.745 0.456    unchanged
## 467         10          6   -4 2.684 -1.490 0.136    unchanged
## 468          9          4   -5 2.684 -1.863 0.062    unchanged
## 469          6          5   -1 2.684 -0.373 0.709    unchanged
## 470          9         12    3 2.684  1.118 0.264    unchanged
## 471          7          4   -3 2.684 -1.118 0.264    unchanged
## 472         17         17    0 2.684  0.000     1    unchanged
## 473          5          7    2 2.684  0.745 0.456    unchanged
## 474          8         10    2 2.684  0.745 0.456    unchanged
## 475         12         18    6 2.684  2.236 0.025    increased
## 476          7         10    3 2.684  1.118 0.264    unchanged
## 477         14         13   -1 2.684 -0.373 0.709    unchanged
## 478         13         15    2 2.684  0.745 0.456    unchanged
## 479          8          5   -3 2.684 -1.118 0.264    unchanged
## 480          8          8    0 2.684  0.000     1    unchanged
## 481          8         12    4 2.684  1.490 0.136    unchanged
## 482          6          4   -2 2.684 -0.745 0.456    unchanged
## 483         18         16   -2 2.684 -0.745 0.456    unchanged
## 484          6          4   -2 2.684 -0.745 0.456    unchanged
## 485          8          6   -2 2.684 -0.745 0.456    unchanged
## 486          9         10    1 2.684  0.373 0.709    unchanged
## 487          6          1   -5 2.684 -1.863 0.062    unchanged
## 488          8          8    0 2.684  0.000     1    unchanged
## 489         13         13    0 2.684  0.000     1    unchanged
## 490         11          9   -2 2.684 -0.745 0.456    unchanged
## 491          2          3    1 2.684  0.373 0.709    unchanged
## 492          5          5    0 2.684  0.000     1    unchanged
## 493          9         12    3 2.684  1.118 0.264    unchanged
## 494          7         11    4 2.684  1.490 0.136    unchanged
## 495          3          5    2 2.684  0.745 0.456    unchanged
## 496         17         14   -3 2.684 -1.118 0.264    unchanged
## 497         10          8   -2 2.684 -0.745 0.456    unchanged
## 498         18         17   -1 2.684 -0.373 0.709    unchanged
## 499          5         11    6 2.684  2.236 0.025    increased
## 500         13         15    2 2.684  0.745 0.456    unchanged
## 501          3          0   -3 2.684 -1.118 0.264    unchanged
## 502          5          4   -1 2.684 -0.373 0.709    unchanged
## 503         11         13    2 2.684  0.745 0.456    unchanged
## 504         10          5   -5 2.684 -1.863 0.062    unchanged
## 505         11          8   -3 2.684 -1.118 0.264    unchanged
## 506          2          5    3 2.684  1.118 0.264    unchanged
## 507          4          2   -2 2.684 -0.745 0.456    unchanged
## 508          3          2   -1 2.684 -0.373 0.709    unchanged
## 509         18         16   -2 2.684 -0.745 0.456    unchanged
## 510         16         17    1 2.684  0.373 0.709    unchanged
## 511         10          8   -2 2.684 -0.745 0.456    unchanged
## 512         11         13    2 2.684  0.745 0.456    unchanged
## 513          2          6    4 2.684  1.490 0.136    unchanged
## 514         19         20    1 2.684  0.373 0.709    unchanged
## 515          5          5    0 2.684  0.000     1    unchanged
## 516          6          3   -3 2.684 -1.118 0.264    unchanged
## 517          7          7    0 2.684  0.000     1    unchanged
## 518          3          4    1 2.684  0.373 0.709    unchanged
## 519         17         15   -2 2.684 -0.745 0.456    unchanged
## 520          1          6    5 2.684  1.863 0.062    unchanged
## 521         10          7   -3 2.684 -1.118 0.264    unchanged
## 522          7         12    5 2.684  1.863 0.062    unchanged
## 523         18         17   -1 2.684 -0.373 0.709    unchanged
## 524          3          1   -2 2.684 -0.745 0.456    unchanged
## 525          6          8    2 2.684  0.745 0.456    unchanged
## 526          7          6   -1 2.684 -0.373 0.709    unchanged
## 527         14         15    1 2.684  0.373 0.709    unchanged
## 528          7          2   -5 2.684 -1.863 0.062    unchanged
## 529          9         11    2 2.684  0.745 0.456    unchanged
## 530         10         16    6 2.684  2.236 0.025    increased
## 531         14         12   -2 2.684 -0.745 0.456    unchanged
## 532         10          9   -1 2.684 -0.373 0.709    unchanged
## 533         14         13   -1 2.684 -0.373 0.709    unchanged
## 534          6          4   -2 2.684 -0.745 0.456    unchanged
## 535          8         12    4 2.684  1.490 0.136    unchanged
## 536          6          9    3 2.684  1.118 0.264    unchanged
## 537          2          2    0 2.684  0.000     1    unchanged
## 538         16         16    0 2.684  0.000     1    unchanged
## 539          8          9    1 2.684  0.373 0.709    unchanged
## 540         14         11   -3 2.684 -1.118 0.264    unchanged
## 541         10         10    0 2.684  0.000     1    unchanged
## 542          7          3   -4 2.684 -1.490 0.136    unchanged
## 543          7          3   -4 2.684 -1.490 0.136    unchanged
## 544          4          8    4 2.684  1.490 0.136    unchanged
## 545          4          6    2 2.684  0.745 0.456    unchanged
## 546          9          9    0 2.684  0.000     1    unchanged
## 547         12         11   -1 2.684 -0.373 0.709    unchanged
## 548         12         11   -1 2.684 -0.373 0.709    unchanged
## 549         11         11    0 2.684  0.000     1    unchanged
## 550         14         14    0 2.684  0.000     1    unchanged
## 551         12          9   -3 2.684 -1.118 0.264    unchanged
## 552         13         12   -1 2.684 -0.373 0.709    unchanged
## 553          1          3    2 2.684  0.745 0.456    unchanged
## 554         12          9   -3 2.684 -1.118 0.264    unchanged
## 555         13         11   -2 2.684 -0.745 0.456    unchanged
## 556         15         15    0 2.684  0.000     1    unchanged
## 557         13         13    0 2.684  0.000     1    unchanged
## 558         12          4   -8 2.684 -2.981 0.003    decreased
## 559         13          9   -4 2.684 -1.490 0.136    unchanged
## 560          3          2   -1 2.684 -0.373 0.709    unchanged
## 561          2          1   -1 2.684 -0.373 0.709    unchanged
## 562         19         19    0 2.684  0.000     1    unchanged
## 563         10         10    0 2.684  0.000     1    unchanged
## 564          8          7   -1 2.684 -0.373 0.709    unchanged
## 565          3          4    1 2.684  0.373 0.709    unchanged
## 566          6          7    1 2.684  0.373 0.709    unchanged
## 567          7         12    5 2.684  1.863 0.062    unchanged
## 568         10          7   -3 2.684 -1.118 0.264    unchanged
## 569         11          7   -4 2.684 -1.490 0.136    unchanged
## 570         18         19    1 2.684  0.373 0.709    unchanged
## 571          5          7    2 2.684  0.745 0.456    unchanged
## 572         16         16    0 2.684  0.000     1    unchanged
## 573         15         14   -1 2.684 -0.373 0.709    unchanged
## 574         11          4   -7 2.684 -2.608 0.009    decreased
## 575          7          7    0 2.684  0.000     1    unchanged
## 576          6          3   -3 2.684 -1.118 0.264    unchanged
## 577         14         11   -3 2.684 -1.118 0.264    unchanged
## 578          8          5   -3 2.684 -1.118 0.264    unchanged
## 579          5          4   -1 2.684 -0.373 0.709    unchanged
## 580          3          3    0 2.684  0.000     1    unchanged
## 581         10          8   -2 2.684 -0.745 0.456    unchanged
## 582          2          1   -1 2.684 -0.373 0.709    unchanged
## 583         14         15    1 2.684  0.373 0.709    unchanged
## 584          4          9    5 2.684  1.863 0.062    unchanged
## 585         11         14    3 2.684  1.118 0.264    unchanged
## 586         11         13    2 2.684  0.745 0.456    unchanged
## 587          9         10    1 2.684  0.373 0.709    unchanged
## 588          6          4   -2 2.684 -0.745 0.456    unchanged
## 589         10          9   -1 2.684 -0.373 0.709    unchanged
## 590          4          3   -1 2.684 -0.373 0.709    unchanged
## 591          4          3   -1 2.684 -0.373 0.709    unchanged
## 592         11         12    1 2.684  0.373 0.709    unchanged
## 593          9          7   -2 2.684 -0.745 0.456    unchanged
## 594          8          9    1 2.684  0.373 0.709    unchanged
## 595          9          9    0 2.684  0.000     1    unchanged
## 596          5          8    3 2.684  1.118 0.264    unchanged
## 597          8         11    3 2.684  1.118 0.264    unchanged
## 598         15         11   -4 2.684 -1.490 0.136    unchanged
## 599          7          5   -2 2.684 -0.745 0.456    unchanged
## 600          8          8    0 2.684  0.000     1    unchanged
## 601          7          5   -2 2.684 -0.745 0.456    unchanged
## 602         12          6   -6 2.684 -2.236 0.025    decreased
## 603          4          4    0 2.684  0.000     1    unchanged
## 604          9          4   -5 2.684 -1.863 0.062    unchanged
## 605          9          3   -6 2.684 -2.236 0.025    decreased
## 606         13         18    5 2.684  1.863 0.062    unchanged
## 607         11         10   -1 2.684 -0.373 0.709    unchanged
## 608         14         14    0 2.684  0.000     1    unchanged
## 609         16         14   -2 2.684 -0.745 0.456    unchanged
## 610          6          8    2 2.684  0.745 0.456    unchanged
## 611         14         11   -3 2.684 -1.118 0.264    unchanged
## 612          2          8    6 2.684  2.236 0.025    increased
## 613         18         16   -2 2.684 -0.745 0.456    unchanged
## 614          7          8    1 2.684  0.373 0.709    unchanged
## 615          5          8    3 2.684  1.118 0.264    unchanged
## 616         16         18    2 2.684  0.745 0.456    unchanged
## 617          9         12    3 2.684  1.118 0.264    unchanged
## 618         16         14   -2 2.684 -0.745 0.456    unchanged
## 619          5          3   -2 2.684 -0.745 0.456    unchanged
## 620         13         13    0 2.684  0.000     1    unchanged
## 621         12         12    0 2.684  0.000     1    unchanged
## 622         12         15    3 2.684  1.118 0.264    unchanged
## 623         18         16   -2 2.684 -0.745 0.456    unchanged
## 624          7          3   -4 2.684 -1.490 0.136    unchanged
## 625          3          2   -1 2.684 -0.373 0.709    unchanged
## 626         13         13    0 2.684  0.000     1    unchanged
## 627         13         11   -2 2.684 -0.745 0.456    unchanged
## 628          9          9    0 2.684  0.000     1    unchanged
## 629          5          6    1 2.684  0.373 0.709    unchanged
## 630         13         10   -3 2.684 -1.118 0.264    unchanged
## 631         13          8   -5 2.684 -1.863 0.062    unchanged
## 632          8         11    3 2.684  1.118 0.264    unchanged
## 633         13          8   -5 2.684 -1.863 0.062    unchanged
## 634          7          5   -2 2.684 -0.745 0.456    unchanged
## 635          5          5    0 2.684  0.000     1    unchanged
## 636         13          9   -4 2.684 -1.490 0.136    unchanged
## 637         11          9   -2 2.684 -0.745 0.456    unchanged
## 638         13         14    1 2.684  0.373 0.709    unchanged
## 639         18         18    0 2.684  0.000     1    unchanged
## 640          6          8    2 2.684  0.745 0.456    unchanged
## 641          7          7    0 2.684  0.000     1    unchanged
## 642         14         13   -1 2.684 -0.373 0.709    unchanged
## 643         15         18    3 2.684  1.118 0.264    unchanged
## 644          5          7    2 2.684  0.745 0.456    unchanged
## 645         13         11   -2 2.684 -0.745 0.456    unchanged
## 646          6          9    3 2.684  1.118 0.264    unchanged
## 647         12         14    2 2.684  0.745 0.456    unchanged
## 648          8         12    4 2.684  1.490 0.136    unchanged
## 649         10         13    3 2.684  1.118 0.264    unchanged
## 650          7          9    2 2.684  0.745 0.456    unchanged
## 651          1          4    3 2.684  1.118 0.264    unchanged
## 652          9          7   -2 2.684 -0.745 0.456    unchanged
## 653         14         10   -4 2.684 -1.490 0.136    unchanged
## 654         12         11   -1 2.684 -0.373 0.709    unchanged
## 655          5          5    0 2.684  0.000     1    unchanged
## 656          5          5    0 2.684  0.000     1    unchanged
## 657          9         12    3 2.684  1.118 0.264    unchanged
## 658         10         12    2 2.684  0.745 0.456    unchanged
## 659          6          3   -3 2.684 -1.118 0.264    unchanged
## 660          9          8   -1 2.684 -0.373 0.709    unchanged
## 661          8          9    1 2.684  0.373 0.709    unchanged
## 662         10          8   -2 2.684 -0.745 0.456    unchanged
## 663         13         10   -3 2.684 -1.118 0.264    unchanged
## 664         10         10    0 2.684  0.000     1    unchanged
## 665          3          5    2 2.684  0.745 0.456    unchanged
## 666          5          8    3 2.684  1.118 0.264    unchanged
## 667         10          5   -5 2.684 -1.863 0.062    unchanged
## 668          8          6   -2 2.684 -0.745 0.456    unchanged
## 669          2          2    0 2.684  0.000     1    unchanged
## 670          6          6    0 2.684  0.000     1    unchanged
## 671          3          7    4 2.684  1.490 0.136    unchanged
## 672          8          5   -3 2.684 -1.118 0.264    unchanged
## 673         14         14    0 2.684  0.000     1    unchanged
## 674          4          3   -1 2.684 -0.373 0.709    unchanged
## 675          5          4   -1 2.684 -0.373 0.709    unchanged
## 676          1          6    5 2.684  1.863 0.062    unchanged
## 677          1          1    0 2.684  0.000     1    unchanged
## 678          8          6   -2 2.684 -0.745 0.456    unchanged
## 679          8          8    0 2.684  0.000     1    unchanged
## 680          3          3    0 2.684  0.000     1    unchanged
## 681         10          7   -3 2.684 -1.118 0.264    unchanged
## 682         11         14    3 2.684  1.118 0.264    unchanged
## 683         11         11    0 2.684  0.000     1    unchanged
## 684          4          4    0 2.684  0.000     1    unchanged
## 685          9          8   -1 2.684 -0.373 0.709    unchanged
## 686          4          8    4 2.684  1.490 0.136    unchanged
## 687         10         11    1 2.684  0.373 0.709    unchanged
## 688         15         10   -5 2.684 -1.863 0.062    unchanged
## 689         11         14    3 2.684  1.118 0.264    unchanged
## 690         14         16    2 2.684  0.745 0.456    unchanged
## 691          8         11    3 2.684  1.118 0.264    unchanged
## 692          7          4   -3 2.684 -1.118 0.264    unchanged
## 693          4          4    0 2.684  0.000     1    unchanged
## 694         15         16    1 2.684  0.373 0.709    unchanged
## 695          6          6    0 2.684  0.000     1    unchanged
## 696          7          8    1 2.684  0.373 0.709    unchanged
## 697         10          8   -2 2.684 -0.745 0.456    unchanged
## 698         14         17    3 2.684  1.118 0.264    unchanged
## 699         13         16    3 2.684  1.118 0.264    unchanged
## 700         10         13    3 2.684  1.118 0.264    unchanged
## 701          2          1   -1 2.684 -0.373 0.709    unchanged
## 702          3          4    1 2.684  0.373 0.709    unchanged
## 703          8          8    0 2.684  0.000     1    unchanged
## 704         17         15   -2 2.684 -0.745 0.456    unchanged
## 705          2          5    3 2.684  1.118 0.264    unchanged
## 706         11         13    2 2.684  0.745 0.456    unchanged
## 707         11          8   -3 2.684 -1.118 0.264    unchanged
## 708          9          9    0 2.684  0.000     1    unchanged
## 709          8          6   -2 2.684 -0.745 0.456    unchanged
## 710         11          9   -2 2.684 -0.745 0.456    unchanged
## 711         16         16    0 2.684  0.000     1    unchanged
## 712         14         14    0 2.684  0.000     1    unchanged
## 713          3          1   -2 2.684 -0.745 0.456    unchanged
## 714          1          0   -1 2.684 -0.373 0.709    unchanged
## 715         16         12   -4 2.684 -1.490 0.136    unchanged
## 716          6          9    3 2.684  1.118 0.264    unchanged
## 717         16         11   -5 2.684 -1.863 0.062    unchanged
## 718          5          4   -1 2.684 -0.373 0.709    unchanged
## 719          9          8   -1 2.684 -0.373 0.709    unchanged
## 720         14          8   -6 2.684 -2.236 0.025    decreased
## 721          8          9    1 2.684  0.373 0.709    unchanged
## 722          5          6    1 2.684  0.373 0.709    unchanged
## 723          7          8    1 2.684  0.373 0.709    unchanged
## 724         14         15    1 2.684  0.373 0.709    unchanged
## 725          5          7    2 2.684  0.745 0.456    unchanged
## 726          4          8    4 2.684  1.490 0.136    unchanged
## 727         11         10   -1 2.684 -0.373 0.709    unchanged
## 728         16         14   -2 2.684 -0.745 0.456    unchanged
## 729         16         15   -1 2.684 -0.373 0.709    unchanged
## 730         14         12   -2 2.684 -0.745 0.456    unchanged
## 731         13         14    1 2.684  0.373 0.709    unchanged
## 732         11         10   -1 2.684 -0.373 0.709    unchanged
## 733         12         13    1 2.684  0.373 0.709    unchanged
## 734          7         10    3 2.684  1.118 0.264    unchanged
## 735         12         12    0 2.684  0.000     1    unchanged
## 736         15         15    0 2.684  0.000     1    unchanged
## 737          0          1    1 2.684  0.373 0.709    unchanged
## 738         12          7   -5 2.684 -1.863 0.062    unchanged
## 739         15         13   -2 2.684 -0.745 0.456    unchanged
## 740          2          4    2 2.684  0.745 0.456    unchanged
## 741          4          5    1 2.684  0.373 0.709    unchanged
## 742          0          1    1 2.684  0.373 0.709    unchanged
## 743          8          9    1 2.684  0.373 0.709    unchanged
## 744          1          1    0 2.684  0.000     1    unchanged
## 745         14         11   -3 2.684 -1.118 0.264    unchanged
## 746          6          6    0 2.684  0.000     1    unchanged
## 747         12         11   -1 2.684 -0.373 0.709    unchanged
## 748          4          6    2 2.684  0.745 0.456    unchanged
## 749          9          7   -2 2.684 -0.745 0.456    unchanged
## 750          2         13   11 2.684  4.099     0    increased
## 751         19         17   -2 2.684 -0.745 0.456    unchanged
## 752         14         12   -2 2.684 -0.745 0.456    unchanged
## 753         19         19    0 2.684  0.000     1    unchanged
## 754         16         14   -2 2.684 -0.745 0.456    unchanged
## 755          5          6    1 2.684  0.373 0.709    unchanged
## 756          3          4    1 2.684  0.373 0.709    unchanged
## 757          5          8    3 2.684  1.118 0.264    unchanged
## 758         11         15    4 2.684  1.490 0.136    unchanged
## 759          7          7    0 2.684  0.000     1    unchanged
## 760          5          2   -3 2.684 -1.118 0.264    unchanged
## 761          1          0   -1 2.684 -0.373 0.709    unchanged
## 762         12          8   -4 2.684 -1.490 0.136    unchanged
## 763          9         12    3 2.684  1.118 0.264    unchanged
## 764          8          6   -2 2.684 -0.745 0.456    unchanged
## 765         16         16    0 2.684  0.000     1    unchanged
## 766          9          7   -2 2.684 -0.745 0.456    unchanged
## 767          4          5    1 2.684  0.373 0.709    unchanged
## 768          4          7    3 2.684  1.118 0.264    unchanged
## 769         11         14    3 2.684  1.118 0.264    unchanged
## 770          4          4    0 2.684  0.000     1    unchanged
## 771         14          8   -6 2.684 -2.236 0.025    decreased
## 772         16         16    0 2.684  0.000     1    unchanged
## 773         10         12    2 2.684  0.745 0.456    unchanged
## 774          8         10    2 2.684  0.745 0.456    unchanged
## 775          8          9    1 2.684  0.373 0.709    unchanged
## 776         13         12   -1 2.684 -0.373 0.709    unchanged
## 777          6          4   -2 2.684 -0.745 0.456    unchanged
## 778         12         17    5 2.684  1.863 0.062    unchanged
## 779          4          2   -2 2.684 -0.745 0.456    unchanged
## 780          9         12    3 2.684  1.118 0.264    unchanged
## 781         11          9   -2 2.684 -0.745 0.456    unchanged
## 782         11         13    2 2.684  0.745 0.456    unchanged
## 783          4          3   -1 2.684 -0.373 0.709    unchanged
## 784          2          3    1 2.684  0.373 0.709    unchanged
## 785          4          7    3 2.684  1.118 0.264    unchanged
## 786         15         17    2 2.684  0.745 0.456    unchanged
## 787          5          3   -2 2.684 -0.745 0.456    unchanged
## 788         14         12   -2 2.684 -0.745 0.456    unchanged
## 789         10         14    4 2.684  1.490 0.136    unchanged
## 790         19         15   -4 2.684 -1.490 0.136    unchanged
## 791         11          8   -3 2.684 -1.118 0.264    unchanged
## 792         15         13   -2 2.684 -0.745 0.456    unchanged
## 793          6          5   -1 2.684 -0.373 0.709    unchanged
## 794          1          3    2 2.684  0.745 0.456    unchanged
## 795          9          9    0 2.684  0.000     1    unchanged
## 796          9          9    0 2.684  0.000     1    unchanged
## 797          7          8    1 2.684  0.373 0.709    unchanged
## 798          8         13    5 2.684  1.863 0.062    unchanged
## 799         11         10   -1 2.684 -0.373 0.709    unchanged
## 800          6          8    2 2.684  0.745 0.456    unchanged
## 801         14         15    1 2.684  0.373 0.709    unchanged
## 802          8         10    2 2.684  0.745 0.456    unchanged
## 803          5         10    5 2.684  1.863 0.062    unchanged
## 804         16         14   -2 2.684 -0.745 0.456    unchanged
## 805         17         18    1 2.684  0.373 0.709    unchanged
## 806          3          5    2 2.684  0.745 0.456    unchanged
## 807         12         13    1 2.684  0.373 0.709    unchanged
## 808         12         12    0 2.684  0.000     1    unchanged
## 809          8          8    0 2.684  0.000     1    unchanged
## 810          8          5   -3 2.684 -1.118 0.264    unchanged
## 811         17         14   -3 2.684 -1.118 0.264    unchanged
## 812         14         11   -3 2.684 -1.118 0.264    unchanged
## 813         17         13   -4 2.684 -1.490 0.136    unchanged
## 814          6          5   -1 2.684 -0.373 0.709    unchanged
## 815          7         10    3 2.684  1.118 0.264    unchanged
## 816          8          6   -2 2.684 -0.745 0.456    unchanged
## 817          6         11    5 2.684  1.863 0.062    unchanged
## 818          8         11    3 2.684  1.118 0.264    unchanged
## 819          5          5    0 2.684  0.000     1    unchanged
## 820          6          4   -2 2.684 -0.745 0.456    unchanged
## 821         10         13    3 2.684  1.118 0.264    unchanged
## 822         16         18    2 2.684  0.745 0.456    unchanged
## 823          2          3    1 2.684  0.373 0.709    unchanged
## 824          9          8   -1 2.684 -0.373 0.709    unchanged
## 825          9         10    1 2.684  0.373 0.709    unchanged
## 826         11         11    0 2.684  0.000     1    unchanged
## 827          4          5    1 2.684  0.373 0.709    unchanged
## 828          1          5    4 2.684  1.490 0.136    unchanged
## 829         16         16    0 2.684  0.000     1    unchanged
## 830          5         10    5 2.684  1.863 0.062    unchanged
## 831          3          4    1 2.684  0.373 0.709    unchanged
## 832         19         18   -1 2.684 -0.373 0.709    unchanged
## 833         13         10   -3 2.684 -1.118 0.264    unchanged
## 834         15         18    3 2.684  1.118 0.264    unchanged
## 835         12         11   -1 2.684 -0.373 0.709    unchanged
## 836         15         13   -2 2.684 -0.745 0.456    unchanged
## 837         12         10   -2 2.684 -0.745 0.456    unchanged
## 838          0          2    2 2.684  0.745 0.456    unchanged
## 839         12         10   -2 2.684 -0.745 0.456    unchanged
## 840          9         14    5 2.684  1.863 0.062    unchanged
## 841          6         13    7 2.684  2.608 0.009    increased
## 842         11         11    0 2.684  0.000     1    unchanged
## 843          3          4    1 2.684  0.373 0.709    unchanged
## 844          5          8    3 2.684  1.118 0.264    unchanged
## 845         10         12    2 2.684  0.745 0.456    unchanged
## 846         14         11   -3 2.684 -1.118 0.264    unchanged
## 847          7          9    2 2.684  0.745 0.456    unchanged
## 848          6          4   -2 2.684 -0.745 0.456    unchanged
## 849         14          9   -5 2.684 -1.863 0.062    unchanged
## 850         13         18    5 2.684  1.863 0.062    unchanged
## 851         16         16    0 2.684  0.000     1    unchanged
## 852         11          6   -5 2.684 -1.863 0.062    unchanged
## 853         11          6   -5 2.684 -1.863 0.062    unchanged
## 854          1          3    2 2.684  0.745 0.456    unchanged
## 855         11          9   -2 2.684 -0.745 0.456    unchanged
## 856          4          2   -2 2.684 -0.745 0.456    unchanged
## 857          8          6   -2 2.684 -0.745 0.456    unchanged
## 858          6          6    0 2.684  0.000     1    unchanged
## 859         11          7   -4 2.684 -1.490 0.136    unchanged
## 860          5          4   -1 2.684 -0.373 0.709    unchanged
## 861          7          4   -3 2.684 -1.118 0.264    unchanged
## 862          4          4    0 2.684  0.000     1    unchanged
## 863         17         15   -2 2.684 -0.745 0.456    unchanged
## 864         13         15    2 2.684  0.745 0.456    unchanged
## 865          9          4   -5 2.684 -1.863 0.062    unchanged
## 866          3          5    2 2.684  0.745 0.456    unchanged
## 867          7          5   -2 2.684 -0.745 0.456    unchanged
## 868          9          7   -2 2.684 -0.745 0.456    unchanged
## 869          8          7   -1 2.684 -0.373 0.709    unchanged
## 870          8         11    3 2.684  1.118 0.264    unchanged
## 871         12         14    2 2.684  0.745 0.456    unchanged
## 872          6          7    1 2.684  0.373 0.709    unchanged
## 873         13         12   -1 2.684 -0.373 0.709    unchanged
## 874         10         10    0 2.684  0.000     1    unchanged
## 875         16         17    1 2.684  0.373 0.709    unchanged
## 876         15         17    2 2.684  0.745 0.456    unchanged
## 877          6          4   -2 2.684 -0.745 0.456    unchanged
## 878          8          6   -2 2.684 -0.745 0.456    unchanged
## 879         14         13   -1 2.684 -0.373 0.709    unchanged
## 880         16         15   -1 2.684 -0.373 0.709    unchanged
## 881          7          3   -4 2.684 -1.490 0.136    unchanged
## 882          6          5   -1 2.684 -0.373 0.709    unchanged
## 883         11          9   -2 2.684 -0.745 0.456    unchanged
## 884          3          0   -3 2.684 -1.118 0.264    unchanged
## 885          5          6    1 2.684  0.373 0.709    unchanged
## 886         13         13    0 2.684  0.000     1    unchanged
## 887         11          9   -2 2.684 -0.745 0.456    unchanged
## 888         12         13    1 2.684  0.373 0.709    unchanged
## 889          0          1    1 2.684  0.373 0.709    unchanged
## 890         16         17    1 2.684  0.373 0.709    unchanged
## 891          5          2   -3 2.684 -1.118 0.264    unchanged
## 892         13         11   -2 2.684 -0.745 0.456    unchanged
## 893          7          4   -3 2.684 -1.118 0.264    unchanged
## 894          4          3   -1 2.684 -0.373 0.709    unchanged
## 895          2          1   -1 2.684 -0.373 0.709    unchanged
## 896         10         15    5 2.684  1.863 0.062    unchanged
## 897         13         12   -1 2.684 -0.373 0.709    unchanged
## 898         13          9   -4 2.684 -1.490 0.136    unchanged
## 899         20         19   -1 2.684 -0.373 0.709    unchanged
## 900          7          6   -1 2.684 -0.373 0.709    unchanged
## 901         16         14   -2 2.684 -0.745 0.456    unchanged
## 902          6          4   -2 2.684 -0.745 0.456    unchanged
## 903         13         11   -2 2.684 -0.745 0.456    unchanged
## 904          4          3   -1 2.684 -0.373 0.709    unchanged
## 905          7          5   -2 2.684 -0.745 0.456    unchanged
## 906          7          7    0 2.684  0.000     1    unchanged
## 907         11         11    0 2.684  0.000     1    unchanged
## 908          9          5   -4 2.684 -1.490 0.136    unchanged
## 909         12          9   -3 2.684 -1.118 0.264    unchanged
## 910          8         13    5 2.684  1.863 0.062    unchanged
## 911          6         13    7 2.684  2.608 0.009    increased
## 912         11          7   -4 2.684 -1.490 0.136    unchanged
## 913          3          6    3 2.684  1.118 0.264    unchanged
## 914          9         12    3 2.684  1.118 0.264    unchanged
## 915         18         18    0 2.684  0.000     1    unchanged
## 916         18         18    0 2.684  0.000     1    unchanged
## 917         14         15    1 2.684  0.373 0.709    unchanged
## 918         11         11    0 2.684  0.000     1    unchanged
## 919          7          7    0 2.684  0.000     1    unchanged
## 920         10          4   -6 2.684 -2.236 0.025    decreased
## 921         19         18   -1 2.684 -0.373 0.709    unchanged
## 922         12          8   -4 2.684 -1.490 0.136    unchanged
## 923          6          7    1 2.684  0.373 0.709    unchanged
## 924          5          6    1 2.684  0.373 0.709    unchanged
## 925          5          4   -1 2.684 -0.373 0.709    unchanged
## 926         12         10   -2 2.684 -0.745 0.456    unchanged
## 927          8          9    1 2.684  0.373 0.709    unchanged
## 928         10          5   -5 2.684 -1.863 0.062    unchanged
## 929         12         17    5 2.684  1.863 0.062    unchanged
## 930         13         10   -3 2.684 -1.118 0.264    unchanged
## 931         14         10   -4 2.684 -1.490 0.136    unchanged
## 932          4          2   -2 2.684 -0.745 0.456    unchanged
## 933         13         12   -1 2.684 -0.373 0.709    unchanged
## 934         12          8   -4 2.684 -1.490 0.136    unchanged
## 935          9          8   -1 2.684 -0.373 0.709    unchanged
## 936          4          3   -1 2.684 -0.373 0.709    unchanged
## 937         13         12   -1 2.684 -0.373 0.709    unchanged
## 938         10          4   -6 2.684 -2.236 0.025    decreased
## 939          7          5   -2 2.684 -0.745 0.456    unchanged
## 940          6         12    6 2.684  2.236 0.025    increased
## 941         12         17    5 2.684  1.863 0.062    unchanged
## 942          0          1    1 2.684  0.373 0.709    unchanged
## 943          9          5   -4 2.684 -1.490 0.136    unchanged
## 944          5          8    3 2.684  1.118 0.264    unchanged
## 945          4          5    1 2.684  0.373 0.709    unchanged
## 946         17         19    2 2.684  0.745 0.456    unchanged
## 947         11          9   -2 2.684 -0.745 0.456    unchanged
## 948         13         14    1 2.684  0.373 0.709    unchanged
## 949          5          9    4 2.684  1.490 0.136    unchanged
## 950         11         14    3 2.684  1.118 0.264    unchanged
## 951          8          7   -1 2.684 -0.373 0.709    unchanged
## 952          6          9    3 2.684  1.118 0.264    unchanged
## 953          9          1   -8 2.684 -2.981 0.003    decreased
## 954         11          8   -3 2.684 -1.118 0.264    unchanged
## 955         10         13    3 2.684  1.118 0.264    unchanged
## 956          4          3   -1 2.684 -0.373 0.709    unchanged
## 957          3          4    1 2.684  0.373 0.709    unchanged
## 958          7         11    4 2.684  1.490 0.136    unchanged
## 959         13         14    1 2.684  0.373 0.709    unchanged
## 960         18         17   -1 2.684 -0.373 0.709    unchanged
## 961         13         13    0 2.684  0.000     1    unchanged
## 962         20         19   -1 2.684 -0.373 0.709    unchanged
## 963          8          4   -4 2.684 -1.490 0.136    unchanged
## 964         15         15    0 2.684  0.000     1    unchanged
## 965         11          8   -3 2.684 -1.118 0.264    unchanged
## 966         14         17    3 2.684  1.118 0.264    unchanged
## 967         14          9   -5 2.684 -1.863 0.062    unchanged
## 968          9         10    1 2.684  0.373 0.709    unchanged
## 969         10          8   -2 2.684 -0.745 0.456    unchanged
## 970         16         15   -1 2.684 -0.373 0.709    unchanged
## 971         13         14    1 2.684  0.373 0.709    unchanged
## 972          3          3    0 2.684  0.000     1    unchanged
## 973         12         13    1 2.684  0.373 0.709    unchanged
## 974          8          6   -2 2.684 -0.745 0.456    unchanged
## 975          9         11    2 2.684  0.745 0.456    unchanged
## 976          9         11    2 2.684  0.745 0.456    unchanged
## 977          4          4    0 2.684  0.000     1    unchanged
## 978          8          7   -1 2.684 -0.373 0.709    unchanged
## 979          9         10    1 2.684  0.373 0.709    unchanged
## 980         15         17    2 2.684  0.745 0.456    unchanged
## 981         10          9   -1 2.684 -0.373 0.709    unchanged
## 982         15         12   -3 2.684 -1.118 0.264    unchanged
## 983          7         10    3 2.684  1.118 0.264    unchanged
## 984         15         16    1 2.684  0.373 0.709    unchanged
## 985         13         13    0 2.684  0.000     1    unchanged
## 986          2          6    4 2.684  1.490 0.136    unchanged
## 987          8          9    1 2.684  0.373 0.709    unchanged
## 988          9          9    0 2.684  0.000     1    unchanged
## 989         16         11   -5 2.684 -1.863 0.062    unchanged
## 990         13         10   -3 2.684 -1.118 0.264    unchanged
## 991          3          4    1 2.684  0.373 0.709    unchanged
## 992          1          6    5 2.684  1.863 0.062    unchanged
## 993         11         12    1 2.684  0.373 0.709    unchanged
## 994          5          2   -3 2.684 -1.118 0.264    unchanged
## 995          5          9    4 2.684  1.490 0.136    unchanged
## 996         12          8   -4 2.684 -1.490 0.136    unchanged
## 997          2          0   -2 2.684 -0.745 0.456    unchanged
## 998          2          2    0 2.684  0.000     1    unchanged
## 999         17         19    2 2.684  0.745 0.456    unchanged
## 1000         3          1   -2 2.684 -0.745 0.456    unchanged
# allows SEM.post != SEM.pre
(istats.post <- itemstats(dat_post)$overall)
##     N mean_total.score sd_total.score ave.r  sd.r alpha SEM.alpha
##  1000            9.125          4.628 0.199 0.053 0.833     1.889
SEM.alpha.post <- istats.post$SEM.alpha

RCI(predat = dat_pre, postdat = dat_post,
   SEM.pre=SEM.alpha, SEM.post=SEM.alpha.post)
##      pre.score post.score diff   SEM      z     p
## 1           12         10   -2 2.678 -0.747 0.455
## 2            5          5    0 2.678  0.000     1
## 3           10          6   -4 2.678 -1.494 0.135
## 4            9         10    1 2.678  0.373 0.709
## 5           17         15   -2 2.678 -0.747 0.455
## 6           14         12   -2 2.678 -0.747 0.455
## 7           11         13    2 2.678  0.747 0.455
## 8            6          8    2 2.678  0.747 0.455
## 9           11         14    3 2.678  1.120 0.263
## 10           8         10    2 2.678  0.747 0.455
## 11          11          9   -2 2.678 -0.747 0.455
## 12          15         16    1 2.678  0.373 0.709
## 13          16         13   -3 2.678 -1.120 0.263
## 14           9          6   -3 2.678 -1.120 0.263
## 15           8          6   -2 2.678 -0.747 0.455
## 16          10         10    0 2.678  0.000     1
## 17           2          2    0 2.678  0.000     1
## 18           8         11    3 2.678  1.120 0.263
## 19           9          8   -1 2.678 -0.373 0.709
## 20          14         16    2 2.678  0.747 0.455
## 21           3          2   -1 2.678 -0.373 0.709
## 22          11         13    2 2.678  0.747 0.455
## 23           2          2    0 2.678  0.000     1
## 24           1          2    1 2.678  0.373 0.709
## 25          10          8   -2 2.678 -0.747 0.455
## 26           2          2    0 2.678  0.000     1
## 27          10         10    0 2.678  0.000     1
## 28           1          2    1 2.678  0.373 0.709
## 29           1          1    0 2.678  0.000     1
## 30          14          7   -7 2.678 -2.614 0.009
## 31           5          3   -2 2.678 -0.747 0.455
## 32           2          1   -1 2.678 -0.373 0.709
## 33           4          7    3 2.678  1.120 0.263
## 34           7          4   -3 2.678 -1.120 0.263
## 35           5          3   -2 2.678 -0.747 0.455
## 36           1          7    6 2.678  2.241 0.025
## 37           8          7   -1 2.678 -0.373 0.709
## 38           4          4    0 2.678  0.000     1
## 39          15         17    2 2.678  0.747 0.455
## 40          13         12   -1 2.678 -0.373 0.709
## 41          12         11   -1 2.678 -0.373 0.709
## 42          14         14    0 2.678  0.000     1
## 43          12         15    3 2.678  1.120 0.263
## 44          11         11    0 2.678  0.000     1
## 45           6          3   -3 2.678 -1.120 0.263
## 46           1          1    0 2.678  0.000     1
## 47          17         12   -5 2.678 -1.867 0.062
## 48           9          8   -1 2.678 -0.373 0.709
## 49          13         15    2 2.678  0.747 0.455
## 50          13         11   -2 2.678 -0.747 0.455
## 51          12         11   -1 2.678 -0.373 0.709
## 52          19         19    0 2.678  0.000     1
## 53           8          8    0 2.678  0.000     1
## 54           4          1   -3 2.678 -1.120 0.263
## 55           7          9    2 2.678  0.747 0.455
## 56           5          6    1 2.678  0.373 0.709
## 57          12         10   -2 2.678 -0.747 0.455
## 58          14         13   -1 2.678 -0.373 0.709
## 59          13         10   -3 2.678 -1.120 0.263
## 60          14         17    3 2.678  1.120 0.263
## 61           4          5    1 2.678  0.373 0.709
## 62          13         11   -2 2.678 -0.747 0.455
## 63           6          7    1 2.678  0.373 0.709
## 64           6         11    5 2.678  1.867 0.062
## 65           6          3   -3 2.678 -1.120 0.263
## 66           5          1   -4 2.678 -1.494 0.135
## 67          15         18    3 2.678  1.120 0.263
## 68           8         15    7 2.678  2.614 0.009
## 69           3          7    4 2.678  1.494 0.135
## 70          11         15    4 2.678  1.494 0.135
## 71           6          6    0 2.678  0.000     1
## 72           5          7    2 2.678  0.747 0.455
## 73          13         11   -2 2.678 -0.747 0.455
## 74          10          6   -4 2.678 -1.494 0.135
## 75          15         15    0 2.678  0.000     1
## 76           8         13    5 2.678  1.867 0.062
## 77           4          3   -1 2.678 -0.373 0.709
## 78           5          6    1 2.678  0.373 0.709
## 79           7          5   -2 2.678 -0.747 0.455
## 80           6          1   -5 2.678 -1.867 0.062
## 81           4          4    0 2.678  0.000     1
## 82          11         12    1 2.678  0.373 0.709
## 83           3          4    1 2.678  0.373 0.709
## 84           7          9    2 2.678  0.747 0.455
## 85           5          6    1 2.678  0.373 0.709
## 86          14         13   -1 2.678 -0.373 0.709
## 87          10          7   -3 2.678 -1.120 0.263
## 88          15         18    3 2.678  1.120 0.263
## 89          16         15   -1 2.678 -0.373 0.709
## 90           5         12    7 2.678  2.614 0.009
## 91           5          7    2 2.678  0.747 0.455
## 92          12         13    1 2.678  0.373 0.709
## 93           2          5    3 2.678  1.120 0.263
## 94           9          4   -5 2.678 -1.867 0.062
## 95           0          2    2 2.678  0.747 0.455
## 96           1          3    2 2.678  0.747 0.455
## 97          10         15    5 2.678  1.867 0.062
## 98           8          5   -3 2.678 -1.120 0.263
## 99           7         11    4 2.678  1.494 0.135
## 100          7          5   -2 2.678 -0.747 0.455
## 101         12         10   -2 2.678 -0.747 0.455
## 102          8         11    3 2.678  1.120 0.263
## 103         18         18    0 2.678  0.000     1
## 104         17         12   -5 2.678 -1.867 0.062
## 105         16         15   -1 2.678 -0.373 0.709
## 106          2          2    0 2.678  0.000     1
## 107          8          9    1 2.678  0.373 0.709
## 108          5          3   -2 2.678 -0.747 0.455
## 109          1          1    0 2.678  0.000     1
## 110          6          5   -1 2.678 -0.373 0.709
## 111          3          4    1 2.678  0.373 0.709
## 112         11         12    1 2.678  0.373 0.709
## 113         12         12    0 2.678  0.000     1
## 114          6          5   -1 2.678 -0.373 0.709
## 115         11         13    2 2.678  0.747 0.455
## 116         13         13    0 2.678  0.000     1
## 117          4          7    3 2.678  1.120 0.263
## 118          2          3    1 2.678  0.373 0.709
## 119         11          9   -2 2.678 -0.747 0.455
## 120          5         10    5 2.678  1.867 0.062
## 121         16         17    1 2.678  0.373 0.709
## 122          2          3    1 2.678  0.373 0.709
## 123         18         15   -3 2.678 -1.120 0.263
## 124          9         10    1 2.678  0.373 0.709
## 125         15         10   -5 2.678 -1.867 0.062
## 126         17         18    1 2.678  0.373 0.709
## 127         15         18    3 2.678  1.120 0.263
## 128          3          8    5 2.678  1.867 0.062
## 129         16         13   -3 2.678 -1.120 0.263
## 130         10          6   -4 2.678 -1.494 0.135
## 131         15         17    2 2.678  0.747 0.455
## 132          8          4   -4 2.678 -1.494 0.135
## 133          4          4    0 2.678  0.000     1
## 134         17         17    0 2.678  0.000     1
## 135          6          9    3 2.678  1.120 0.263
## 136          7          3   -4 2.678 -1.494 0.135
## 137          3          8    5 2.678  1.867 0.062
## 138          4          8    4 2.678  1.494 0.135
## 139         14         18    4 2.678  1.494 0.135
## 140          9          2   -7 2.678 -2.614 0.009
## 141         16         15   -1 2.678 -0.373 0.709
## 142          9          5   -4 2.678 -1.494 0.135
## 143         19         17   -2 2.678 -0.747 0.455
## 144          9         10    1 2.678  0.373 0.709
## 145          7          5   -2 2.678 -0.747 0.455
## 146         15         15    0 2.678  0.000     1
## 147         10          7   -3 2.678 -1.120 0.263
## 148          6          4   -2 2.678 -0.747 0.455
## 149         11          8   -3 2.678 -1.120 0.263
## 150          9          9    0 2.678  0.000     1
## 151         10          7   -3 2.678 -1.120 0.263
## 152          7          9    2 2.678  0.747 0.455
## 153         14         12   -2 2.678 -0.747 0.455
## 154         10         13    3 2.678  1.120 0.263
## 155         13         10   -3 2.678 -1.120 0.263
## 156         10          7   -3 2.678 -1.120 0.263
## 157         12         12    0 2.678  0.000     1
## 158         14         11   -3 2.678 -1.120 0.263
## 159          6          6    0 2.678  0.000     1
## 160          4          4    0 2.678  0.000     1
## 161          6          5   -1 2.678 -0.373 0.709
## 162          3          2   -1 2.678 -0.373 0.709
## 163          4          4    0 2.678  0.000     1
## 164         18         18    0 2.678  0.000     1
## 165         12          8   -4 2.678 -1.494 0.135
## 166          2          2    0 2.678  0.000     1
## 167          6          3   -3 2.678 -1.120 0.263
## 168          2          5    3 2.678  1.120 0.263
## 169          9         11    2 2.678  0.747 0.455
## 170          5          4   -1 2.678 -0.373 0.709
## 171         19         18   -1 2.678 -0.373 0.709
## 172         11         12    1 2.678  0.373 0.709
## 173          9          3   -6 2.678 -2.241 0.025
## 174         18         14   -4 2.678 -1.494 0.135
## 175         11         13    2 2.678  0.747 0.455
## 176         16         18    2 2.678  0.747 0.455
## 177          9          7   -2 2.678 -0.747 0.455
## 178         10         14    4 2.678  1.494 0.135
## 179         13          9   -4 2.678 -1.494 0.135
## 180          3          5    2 2.678  0.747 0.455
## 181         11         12    1 2.678  0.373 0.709
## 182         13         11   -2 2.678 -0.747 0.455
## 183         14         15    1 2.678  0.373 0.709
## 184         15         16    1 2.678  0.373 0.709
## 185          6          4   -2 2.678 -0.747 0.455
## 186         16         19    3 2.678  1.120 0.263
## 187         19         19    0 2.678  0.000     1
## 188         14         15    1 2.678  0.373 0.709
## 189          5          7    2 2.678  0.747 0.455
## 190          5          6    1 2.678  0.373 0.709
## 191         11          9   -2 2.678 -0.747 0.455
## 192         11          8   -3 2.678 -1.120 0.263
## 193          4          4    0 2.678  0.000     1
## 194         15          9   -6 2.678 -2.241 0.025
## 195          6          8    2 2.678  0.747 0.455
## 196         13          8   -5 2.678 -1.867 0.062
## 197          9         11    2 2.678  0.747 0.455
## 198          8          6   -2 2.678 -0.747 0.455
## 199         16         17    1 2.678  0.373 0.709
## 200          5         10    5 2.678  1.867 0.062
## 201          3          5    2 2.678  0.747 0.455
## 202         14         15    1 2.678  0.373 0.709
## 203          4          8    4 2.678  1.494 0.135
## 204          9          7   -2 2.678 -0.747 0.455
## 205          5          2   -3 2.678 -1.120 0.263
## 206         18         15   -3 2.678 -1.120 0.263
## 207          3          3    0 2.678  0.000     1
## 208         17         17    0 2.678  0.000     1
## 209          7          7    0 2.678  0.000     1
## 210         11          9   -2 2.678 -0.747 0.455
## 211          2          5    3 2.678  1.120 0.263
## 212         11         12    1 2.678  0.373 0.709
## 213          6          4   -2 2.678 -0.747 0.455
## 214          6          7    1 2.678  0.373 0.709
## 215          8          6   -2 2.678 -0.747 0.455
## 216         15         15    0 2.678  0.000     1
## 217          3          3    0 2.678  0.000     1
## 218         14         12   -2 2.678 -0.747 0.455
## 219         10          7   -3 2.678 -1.120 0.263
## 220          9         13    4 2.678  1.494 0.135
## 221          3          5    2 2.678  0.747 0.455
## 222          6         10    4 2.678  1.494 0.135
## 223         14         13   -1 2.678 -0.373 0.709
## 224         18         18    0 2.678  0.000     1
## 225         17         14   -3 2.678 -1.120 0.263
## 226          8          9    1 2.678  0.373 0.709
## 227          8          9    1 2.678  0.373 0.709
## 228         17         11   -6 2.678 -2.241 0.025
## 229          3          4    1 2.678  0.373 0.709
## 230          7          8    1 2.678  0.373 0.709
## 231          7         10    3 2.678  1.120 0.263
## 232          7          9    2 2.678  0.747 0.455
## 233         12         14    2 2.678  0.747 0.455
## 234         17         13   -4 2.678 -1.494 0.135
## 235         16         13   -3 2.678 -1.120 0.263
## 236          4          3   -1 2.678 -0.373 0.709
## 237         12         11   -1 2.678 -0.373 0.709
## 238          3          9    6 2.678  2.241 0.025
## 239          2          4    2 2.678  0.747 0.455
## 240          8          7   -1 2.678 -0.373 0.709
## 241         10         13    3 2.678  1.120 0.263
## 242          2          6    4 2.678  1.494 0.135
## 243         18         19    1 2.678  0.373 0.709
## 244         11         11    0 2.678  0.000     1
## 245         11         11    0 2.678  0.000     1
## 246         17         15   -2 2.678 -0.747 0.455
## 247         15         18    3 2.678  1.120 0.263
## 248         14          9   -5 2.678 -1.867 0.062
## 249          9          4   -5 2.678 -1.867 0.062
## 250         14         13   -1 2.678 -0.373 0.709
## 251         16          7   -9 2.678 -3.361 0.001
## 252         15         14   -1 2.678 -0.373 0.709
## 253         12         11   -1 2.678 -0.373 0.709
## 254          3          4    1 2.678  0.373 0.709
## 255         12         12    0 2.678  0.000     1
## 256          7         11    4 2.678  1.494 0.135
## 257          5          5    0 2.678  0.000     1
## 258          8          8    0 2.678  0.000     1
## 259          6          6    0 2.678  0.000     1
## 260         12         12    0 2.678  0.000     1
## 261         13         15    2 2.678  0.747 0.455
## 262          9         13    4 2.678  1.494 0.135
## 263         13          8   -5 2.678 -1.867 0.062
## 264          6          9    3 2.678  1.120 0.263
## 265          8         11    3 2.678  1.120 0.263
## 266         11          9   -2 2.678 -0.747 0.455
## 267         10         12    2 2.678  0.747 0.455
## 268         18         16   -2 2.678 -0.747 0.455
## 269          4          4    0 2.678  0.000     1
## 270          9         14    5 2.678  1.867 0.062
## 271         14         16    2 2.678  0.747 0.455
## 272          8          7   -1 2.678 -0.373 0.709
## 273          7          6   -1 2.678 -0.373 0.709
## 274         16         15   -1 2.678 -0.373 0.709
## 275          8         15    7 2.678  2.614 0.009
## 276         15         16    1 2.678  0.373 0.709
## 277         15         14   -1 2.678 -0.373 0.709
## 278         13          9   -4 2.678 -1.494 0.135
## 279          8          9    1 2.678  0.373 0.709
## 280          5          9    4 2.678  1.494 0.135
## 281         13          9   -4 2.678 -1.494 0.135
## 282         13         10   -3 2.678 -1.120 0.263
## 283          9         13    4 2.678  1.494 0.135
## 284          5          4   -1 2.678 -0.373 0.709
## 285          4          6    2 2.678  0.747 0.455
## 286          2          6    4 2.678  1.494 0.135
## 287          3          2   -1 2.678 -0.373 0.709
## 288          9          7   -2 2.678 -0.747 0.455
## 289          7         10    3 2.678  1.120 0.263
## 290          8          5   -3 2.678 -1.120 0.263
## 291          9          6   -3 2.678 -1.120 0.263
## 292          4          3   -1 2.678 -0.373 0.709
## 293         14         17    3 2.678  1.120 0.263
## 294         15         18    3 2.678  1.120 0.263
## 295          3          4    1 2.678  0.373 0.709
## 296          1          4    3 2.678  1.120 0.263
## 297         12         10   -2 2.678 -0.747 0.455
## 298          5          8    3 2.678  1.120 0.263
## 299         12         12    0 2.678  0.000     1
## 300          8         10    2 2.678  0.747 0.455
## 301          6          5   -1 2.678 -0.373 0.709
## 302          5          7    2 2.678  0.747 0.455
## 303         14         15    1 2.678  0.373 0.709
## 304         11          8   -3 2.678 -1.120 0.263
## 305          4          2   -2 2.678 -0.747 0.455
## 306         11         11    0 2.678  0.000     1
## 307         13         11   -2 2.678 -0.747 0.455
## 308          9         13    4 2.678  1.494 0.135
## 309          4          6    2 2.678  0.747 0.455
## 310         13         11   -2 2.678 -0.747 0.455
## 311         10         12    2 2.678  0.747 0.455
## 312          8          9    1 2.678  0.373 0.709
## 313         16         12   -4 2.678 -1.494 0.135
## 314          8          9    1 2.678  0.373 0.709
## 315          2          1   -1 2.678 -0.373 0.709
## 316         13         11   -2 2.678 -0.747 0.455
## 317         15          8   -7 2.678 -2.614 0.009
## 318          7          4   -3 2.678 -1.120 0.263
## 319         16         15   -1 2.678 -0.373 0.709
## 320         12         11   -1 2.678 -0.373 0.709
## 321          2          1   -1 2.678 -0.373 0.709
## 322         14         15    1 2.678  0.373 0.709
## 323          1          2    1 2.678  0.373 0.709
## 324         10         11    1 2.678  0.373 0.709
## 325          8          9    1 2.678  0.373 0.709
## 326         13         14    1 2.678  0.373 0.709
## 327         15         16    1 2.678  0.373 0.709
## 328         16         11   -5 2.678 -1.867 0.062
## 329          7          7    0 2.678  0.000     1
## 330          8          9    1 2.678  0.373 0.709
## 331         14         10   -4 2.678 -1.494 0.135
## 332          5          8    3 2.678  1.120 0.263
## 333         11         15    4 2.678  1.494 0.135
## 334          5          7    2 2.678  0.747 0.455
## 335          0          4    4 2.678  1.494 0.135
## 336          3          4    1 2.678  0.373 0.709
## 337          9          4   -5 2.678 -1.867 0.062
## 338         10          9   -1 2.678 -0.373 0.709
## 339         12         16    4 2.678  1.494 0.135
## 340         14         17    3 2.678  1.120 0.263
## 341          9          8   -1 2.678 -0.373 0.709
## 342          6          8    2 2.678  0.747 0.455
## 343          7          3   -4 2.678 -1.494 0.135
## 344         16         18    2 2.678  0.747 0.455
## 345         14          7   -7 2.678 -2.614 0.009
## 346         12          6   -6 2.678 -2.241 0.025
## 347         14         14    0 2.678  0.000     1
## 348         15         15    0 2.678  0.000     1
## 349          7          3   -4 2.678 -1.494 0.135
## 350          8          9    1 2.678  0.373 0.709
## 351          5          2   -3 2.678 -1.120 0.263
## 352          8          6   -2 2.678 -0.747 0.455
## 353         17         18    1 2.678  0.373 0.709
## 354          7          8    1 2.678  0.373 0.709
## 355         12         10   -2 2.678 -0.747 0.455
## 356         11         12    1 2.678  0.373 0.709
## 357         15         12   -3 2.678 -1.120 0.263
## 358          5          7    2 2.678  0.747 0.455
## 359         10          8   -2 2.678 -0.747 0.455
## 360         14         14    0 2.678  0.000     1
## 361         10         11    1 2.678  0.373 0.709
## 362         10          9   -1 2.678 -0.373 0.709
## 363         14         14    0 2.678  0.000     1
## 364         17         15   -2 2.678 -0.747 0.455
## 365          8          7   -1 2.678 -0.373 0.709
## 366         17         11   -6 2.678 -2.241 0.025
## 367          5          3   -2 2.678 -0.747 0.455
## 368          2          1   -1 2.678 -0.373 0.709
## 369          2          1   -1 2.678 -0.373 0.709
## 370         12         12    0 2.678  0.000     1
## 371         11         11    0 2.678  0.000     1
## 372          4          7    3 2.678  1.120 0.263
## 373         16         11   -5 2.678 -1.867 0.062
## 374          4          4    0 2.678  0.000     1
## 375          6          4   -2 2.678 -0.747 0.455
## 376          5          7    2 2.678  0.747 0.455
## 377         12         11   -1 2.678 -0.373 0.709
## 378         12         16    4 2.678  1.494 0.135
## 379         16         18    2 2.678  0.747 0.455
## 380         14         12   -2 2.678 -0.747 0.455
## 381          6          5   -1 2.678 -0.373 0.709
## 382         10         12    2 2.678  0.747 0.455
## 383          8         11    3 2.678  1.120 0.263
## 384         10         14    4 2.678  1.494 0.135
## 385          4          5    1 2.678  0.373 0.709
## 386         14         14    0 2.678  0.000     1
## 387          7          7    0 2.678  0.000     1
## 388         11         10   -1 2.678 -0.373 0.709
## 389          4          4    0 2.678  0.000     1
## 390          8          7   -1 2.678 -0.373 0.709
## 391         10          9   -1 2.678 -0.373 0.709
## 392          5          8    3 2.678  1.120 0.263
## 393         12         10   -2 2.678 -0.747 0.455
## 394          8          7   -1 2.678 -0.373 0.709
## 395         10          4   -6 2.678 -2.241 0.025
## 396         18         15   -3 2.678 -1.120 0.263
## 397          4          7    3 2.678  1.120 0.263
## 398         13         13    0 2.678  0.000     1
## 399         14         11   -3 2.678 -1.120 0.263
## 400          4          6    2 2.678  0.747 0.455
## 401         15         16    1 2.678  0.373 0.709
## 402          4          4    0 2.678  0.000     1
## 403          5          6    1 2.678  0.373 0.709
## 404         17         15   -2 2.678 -0.747 0.455
## 405          8          4   -4 2.678 -1.494 0.135
## 406         10          6   -4 2.678 -1.494 0.135
## 407          3          2   -1 2.678 -0.373 0.709
## 408          8          7   -1 2.678 -0.373 0.709
## 409          6         10    4 2.678  1.494 0.135
## 410         11         12    1 2.678  0.373 0.709
## 411          3          2   -1 2.678 -0.373 0.709
## 412         14          9   -5 2.678 -1.867 0.062
## 413          9          8   -1 2.678 -0.373 0.709
## 414         15         17    2 2.678  0.747 0.455
## 415         13          9   -4 2.678 -1.494 0.135
## 416          3          5    2 2.678  0.747 0.455
## 417          4          2   -2 2.678 -0.747 0.455
## 418         18         18    0 2.678  0.000     1
## 419          2          1   -1 2.678 -0.373 0.709
## 420         15         13   -2 2.678 -0.747 0.455
## 421         15         11   -4 2.678 -1.494 0.135
## 422          6          7    1 2.678  0.373 0.709
## 423          4          5    1 2.678  0.373 0.709
## 424          7          4   -3 2.678 -1.120 0.263
## 425          8          9    1 2.678  0.373 0.709
## 426          6          2   -4 2.678 -1.494 0.135
## 427          5          6    1 2.678  0.373 0.709
## 428          3          7    4 2.678  1.494 0.135
## 429          9         13    4 2.678  1.494 0.135
## 430          6          4   -2 2.678 -0.747 0.455
## 431          5         11    6 2.678  2.241 0.025
## 432         14         12   -2 2.678 -0.747 0.455
## 433         18         19    1 2.678  0.373 0.709
## 434          0          0    0 2.678  0.000     1
## 435         15          9   -6 2.678 -2.241 0.025
## 436         10          8   -2 2.678 -0.747 0.455
## 437         15         16    1 2.678  0.373 0.709
## 438          3          2   -1 2.678 -0.373 0.709
## 439         14         13   -1 2.678 -0.373 0.709
## 440          9         13    4 2.678  1.494 0.135
## 441         10         11    1 2.678  0.373 0.709
## 442         15         10   -5 2.678 -1.867 0.062
## 443          4          4    0 2.678  0.000     1
## 444          5          8    3 2.678  1.120 0.263
## 445          6         11    5 2.678  1.867 0.062
## 446         12         13    1 2.678  0.373 0.709
## 447          3          5    2 2.678  0.747 0.455
## 448          2          1   -1 2.678 -0.373 0.709
## 449         16         15   -1 2.678 -0.373 0.709
## 450          6          4   -2 2.678 -0.747 0.455
## 451         17         15   -2 2.678 -0.747 0.455
## 452          6         12    6 2.678  2.241 0.025
## 453          4          6    2 2.678  0.747 0.455
## 454         19         19    0 2.678  0.000     1
## 455          9          8   -1 2.678 -0.373 0.709
## 456          7          5   -2 2.678 -0.747 0.455
## 457          6          5   -1 2.678 -0.373 0.709
## 458          1          2    1 2.678  0.373 0.709
## 459          8          7   -1 2.678 -0.373 0.709
## 460          8         10    2 2.678  0.747 0.455
## 461         15         13   -2 2.678 -0.747 0.455
## 462          4          3   -1 2.678 -0.373 0.709
## 463         16         17    1 2.678  0.373 0.709
## 464         10         12    2 2.678  0.747 0.455
## 465         17         13   -4 2.678 -1.494 0.135
## 466         11         13    2 2.678  0.747 0.455
## 467         10          6   -4 2.678 -1.494 0.135
## 468          9          4   -5 2.678 -1.867 0.062
## 469          6          5   -1 2.678 -0.373 0.709
## 470          9         12    3 2.678  1.120 0.263
## 471          7          4   -3 2.678 -1.120 0.263
## 472         17         17    0 2.678  0.000     1
## 473          5          7    2 2.678  0.747 0.455
## 474          8         10    2 2.678  0.747 0.455
## 475         12         18    6 2.678  2.241 0.025
## 476          7         10    3 2.678  1.120 0.263
## 477         14         13   -1 2.678 -0.373 0.709
## 478         13         15    2 2.678  0.747 0.455
## 479          8          5   -3 2.678 -1.120 0.263
## 480          8          8    0 2.678  0.000     1
## 481          8         12    4 2.678  1.494 0.135
## 482          6          4   -2 2.678 -0.747 0.455
## 483         18         16   -2 2.678 -0.747 0.455
## 484          6          4   -2 2.678 -0.747 0.455
## 485          8          6   -2 2.678 -0.747 0.455
## 486          9         10    1 2.678  0.373 0.709
## 487          6          1   -5 2.678 -1.867 0.062
## 488          8          8    0 2.678  0.000     1
## 489         13         13    0 2.678  0.000     1
## 490         11          9   -2 2.678 -0.747 0.455
## 491          2          3    1 2.678  0.373 0.709
## 492          5          5    0 2.678  0.000     1
## 493          9         12    3 2.678  1.120 0.263
## 494          7         11    4 2.678  1.494 0.135
## 495          3          5    2 2.678  0.747 0.455
## 496         17         14   -3 2.678 -1.120 0.263
## 497         10          8   -2 2.678 -0.747 0.455
## 498         18         17   -1 2.678 -0.373 0.709
## 499          5         11    6 2.678  2.241 0.025
## 500         13         15    2 2.678  0.747 0.455
## 501          3          0   -3 2.678 -1.120 0.263
## 502          5          4   -1 2.678 -0.373 0.709
## 503         11         13    2 2.678  0.747 0.455
## 504         10          5   -5 2.678 -1.867 0.062
## 505         11          8   -3 2.678 -1.120 0.263
## 506          2          5    3 2.678  1.120 0.263
## 507          4          2   -2 2.678 -0.747 0.455
## 508          3          2   -1 2.678 -0.373 0.709
## 509         18         16   -2 2.678 -0.747 0.455
## 510         16         17    1 2.678  0.373 0.709
## 511         10          8   -2 2.678 -0.747 0.455
## 512         11         13    2 2.678  0.747 0.455
## 513          2          6    4 2.678  1.494 0.135
## 514         19         20    1 2.678  0.373 0.709
## 515          5          5    0 2.678  0.000     1
## 516          6          3   -3 2.678 -1.120 0.263
## 517          7          7    0 2.678  0.000     1
## 518          3          4    1 2.678  0.373 0.709
## 519         17         15   -2 2.678 -0.747 0.455
## 520          1          6    5 2.678  1.867 0.062
## 521         10          7   -3 2.678 -1.120 0.263
## 522          7         12    5 2.678  1.867 0.062
## 523         18         17   -1 2.678 -0.373 0.709
## 524          3          1   -2 2.678 -0.747 0.455
## 525          6          8    2 2.678  0.747 0.455
## 526          7          6   -1 2.678 -0.373 0.709
## 527         14         15    1 2.678  0.373 0.709
## 528          7          2   -5 2.678 -1.867 0.062
## 529          9         11    2 2.678  0.747 0.455
## 530         10         16    6 2.678  2.241 0.025
## 531         14         12   -2 2.678 -0.747 0.455
## 532         10          9   -1 2.678 -0.373 0.709
## 533         14         13   -1 2.678 -0.373 0.709
## 534          6          4   -2 2.678 -0.747 0.455
## 535          8         12    4 2.678  1.494 0.135
## 536          6          9    3 2.678  1.120 0.263
## 537          2          2    0 2.678  0.000     1
## 538         16         16    0 2.678  0.000     1
## 539          8          9    1 2.678  0.373 0.709
## 540         14         11   -3 2.678 -1.120 0.263
## 541         10         10    0 2.678  0.000     1
## 542          7          3   -4 2.678 -1.494 0.135
## 543          7          3   -4 2.678 -1.494 0.135
## 544          4          8    4 2.678  1.494 0.135
## 545          4          6    2 2.678  0.747 0.455
## 546          9          9    0 2.678  0.000     1
## 547         12         11   -1 2.678 -0.373 0.709
## 548         12         11   -1 2.678 -0.373 0.709
## 549         11         11    0 2.678  0.000     1
## 550         14         14    0 2.678  0.000     1
## 551         12          9   -3 2.678 -1.120 0.263
## 552         13         12   -1 2.678 -0.373 0.709
## 553          1          3    2 2.678  0.747 0.455
## 554         12          9   -3 2.678 -1.120 0.263
## 555         13         11   -2 2.678 -0.747 0.455
## 556         15         15    0 2.678  0.000     1
## 557         13         13    0 2.678  0.000     1
## 558         12          4   -8 2.678 -2.988 0.003
## 559         13          9   -4 2.678 -1.494 0.135
## 560          3          2   -1 2.678 -0.373 0.709
## 561          2          1   -1 2.678 -0.373 0.709
## 562         19         19    0 2.678  0.000     1
## 563         10         10    0 2.678  0.000     1
## 564          8          7   -1 2.678 -0.373 0.709
## 565          3          4    1 2.678  0.373 0.709
## 566          6          7    1 2.678  0.373 0.709
## 567          7         12    5 2.678  1.867 0.062
## 568         10          7   -3 2.678 -1.120 0.263
## 569         11          7   -4 2.678 -1.494 0.135
## 570         18         19    1 2.678  0.373 0.709
## 571          5          7    2 2.678  0.747 0.455
## 572         16         16    0 2.678  0.000     1
## 573         15         14   -1 2.678 -0.373 0.709
## 574         11          4   -7 2.678 -2.614 0.009
## 575          7          7    0 2.678  0.000     1
## 576          6          3   -3 2.678 -1.120 0.263
## 577         14         11   -3 2.678 -1.120 0.263
## 578          8          5   -3 2.678 -1.120 0.263
## 579          5          4   -1 2.678 -0.373 0.709
## 580          3          3    0 2.678  0.000     1
## 581         10          8   -2 2.678 -0.747 0.455
## 582          2          1   -1 2.678 -0.373 0.709
## 583         14         15    1 2.678  0.373 0.709
## 584          4          9    5 2.678  1.867 0.062
## 585         11         14    3 2.678  1.120 0.263
## 586         11         13    2 2.678  0.747 0.455
## 587          9         10    1 2.678  0.373 0.709
## 588          6          4   -2 2.678 -0.747 0.455
## 589         10          9   -1 2.678 -0.373 0.709
## 590          4          3   -1 2.678 -0.373 0.709
## 591          4          3   -1 2.678 -0.373 0.709
## 592         11         12    1 2.678  0.373 0.709
## 593          9          7   -2 2.678 -0.747 0.455
## 594          8          9    1 2.678  0.373 0.709
## 595          9          9    0 2.678  0.000     1
## 596          5          8    3 2.678  1.120 0.263
## 597          8         11    3 2.678  1.120 0.263
## 598         15         11   -4 2.678 -1.494 0.135
## 599          7          5   -2 2.678 -0.747 0.455
## 600          8          8    0 2.678  0.000     1
## 601          7          5   -2 2.678 -0.747 0.455
## 602         12          6   -6 2.678 -2.241 0.025
## 603          4          4    0 2.678  0.000     1
## 604          9          4   -5 2.678 -1.867 0.062
## 605          9          3   -6 2.678 -2.241 0.025
## 606         13         18    5 2.678  1.867 0.062
## 607         11         10   -1 2.678 -0.373 0.709
## 608         14         14    0 2.678  0.000     1
## 609         16         14   -2 2.678 -0.747 0.455
## 610          6          8    2 2.678  0.747 0.455
## 611         14         11   -3 2.678 -1.120 0.263
## 612          2          8    6 2.678  2.241 0.025
## 613         18         16   -2 2.678 -0.747 0.455
## 614          7          8    1 2.678  0.373 0.709
## 615          5          8    3 2.678  1.120 0.263
## 616         16         18    2 2.678  0.747 0.455
## 617          9         12    3 2.678  1.120 0.263
## 618         16         14   -2 2.678 -0.747 0.455
## 619          5          3   -2 2.678 -0.747 0.455
## 620         13         13    0 2.678  0.000     1
## 621         12         12    0 2.678  0.000     1
## 622         12         15    3 2.678  1.120 0.263
## 623         18         16   -2 2.678 -0.747 0.455
## 624          7          3   -4 2.678 -1.494 0.135
## 625          3          2   -1 2.678 -0.373 0.709
## 626         13         13    0 2.678  0.000     1
## 627         13         11   -2 2.678 -0.747 0.455
## 628          9          9    0 2.678  0.000     1
## 629          5          6    1 2.678  0.373 0.709
## 630         13         10   -3 2.678 -1.120 0.263
## 631         13          8   -5 2.678 -1.867 0.062
## 632          8         11    3 2.678  1.120 0.263
## 633         13          8   -5 2.678 -1.867 0.062
## 634          7          5   -2 2.678 -0.747 0.455
## 635          5          5    0 2.678  0.000     1
## 636         13          9   -4 2.678 -1.494 0.135
## 637         11          9   -2 2.678 -0.747 0.455
## 638         13         14    1 2.678  0.373 0.709
## 639         18         18    0 2.678  0.000     1
## 640          6          8    2 2.678  0.747 0.455
## 641          7          7    0 2.678  0.000     1
## 642         14         13   -1 2.678 -0.373 0.709
## 643         15         18    3 2.678  1.120 0.263
## 644          5          7    2 2.678  0.747 0.455
## 645         13         11   -2 2.678 -0.747 0.455
## 646          6          9    3 2.678  1.120 0.263
## 647         12         14    2 2.678  0.747 0.455
## 648          8         12    4 2.678  1.494 0.135
## 649         10         13    3 2.678  1.120 0.263
## 650          7          9    2 2.678  0.747 0.455
## 651          1          4    3 2.678  1.120 0.263
## 652          9          7   -2 2.678 -0.747 0.455
## 653         14         10   -4 2.678 -1.494 0.135
## 654         12         11   -1 2.678 -0.373 0.709
## 655          5          5    0 2.678  0.000     1
## 656          5          5    0 2.678  0.000     1
## 657          9         12    3 2.678  1.120 0.263
## 658         10         12    2 2.678  0.747 0.455
## 659          6          3   -3 2.678 -1.120 0.263
## 660          9          8   -1 2.678 -0.373 0.709
## 661          8          9    1 2.678  0.373 0.709
## 662         10          8   -2 2.678 -0.747 0.455
## 663         13         10   -3 2.678 -1.120 0.263
## 664         10         10    0 2.678  0.000     1
## 665          3          5    2 2.678  0.747 0.455
## 666          5          8    3 2.678  1.120 0.263
## 667         10          5   -5 2.678 -1.867 0.062
## 668          8          6   -2 2.678 -0.747 0.455
## 669          2          2    0 2.678  0.000     1
## 670          6          6    0 2.678  0.000     1
## 671          3          7    4 2.678  1.494 0.135
## 672          8          5   -3 2.678 -1.120 0.263
## 673         14         14    0 2.678  0.000     1
## 674          4          3   -1 2.678 -0.373 0.709
## 675          5          4   -1 2.678 -0.373 0.709
## 676          1          6    5 2.678  1.867 0.062
## 677          1          1    0 2.678  0.000     1
## 678          8          6   -2 2.678 -0.747 0.455
## 679          8          8    0 2.678  0.000     1
## 680          3          3    0 2.678  0.000     1
## 681         10          7   -3 2.678 -1.120 0.263
## 682         11         14    3 2.678  1.120 0.263
## 683         11         11    0 2.678  0.000     1
## 684          4          4    0 2.678  0.000     1
## 685          9          8   -1 2.678 -0.373 0.709
## 686          4          8    4 2.678  1.494 0.135
## 687         10         11    1 2.678  0.373 0.709
## 688         15         10   -5 2.678 -1.867 0.062
## 689         11         14    3 2.678  1.120 0.263
## 690         14         16    2 2.678  0.747 0.455
## 691          8         11    3 2.678  1.120 0.263
## 692          7          4   -3 2.678 -1.120 0.263
## 693          4          4    0 2.678  0.000     1
## 694         15         16    1 2.678  0.373 0.709
## 695          6          6    0 2.678  0.000     1
## 696          7          8    1 2.678  0.373 0.709
## 697         10          8   -2 2.678 -0.747 0.455
## 698         14         17    3 2.678  1.120 0.263
## 699         13         16    3 2.678  1.120 0.263
## 700         10         13    3 2.678  1.120 0.263
## 701          2          1   -1 2.678 -0.373 0.709
## 702          3          4    1 2.678  0.373 0.709
## 703          8          8    0 2.678  0.000     1
## 704         17         15   -2 2.678 -0.747 0.455
## 705          2          5    3 2.678  1.120 0.263
## 706         11         13    2 2.678  0.747 0.455
## 707         11          8   -3 2.678 -1.120 0.263
## 708          9          9    0 2.678  0.000     1
## 709          8          6   -2 2.678 -0.747 0.455
## 710         11          9   -2 2.678 -0.747 0.455
## 711         16         16    0 2.678  0.000     1
## 712         14         14    0 2.678  0.000     1
## 713          3          1   -2 2.678 -0.747 0.455
## 714          1          0   -1 2.678 -0.373 0.709
## 715         16         12   -4 2.678 -1.494 0.135
## 716          6          9    3 2.678  1.120 0.263
## 717         16         11   -5 2.678 -1.867 0.062
## 718          5          4   -1 2.678 -0.373 0.709
## 719          9          8   -1 2.678 -0.373 0.709
## 720         14          8   -6 2.678 -2.241 0.025
## 721          8          9    1 2.678  0.373 0.709
## 722          5          6    1 2.678  0.373 0.709
## 723          7          8    1 2.678  0.373 0.709
## 724         14         15    1 2.678  0.373 0.709
## 725          5          7    2 2.678  0.747 0.455
## 726          4          8    4 2.678  1.494 0.135
## 727         11         10   -1 2.678 -0.373 0.709
## 728         16         14   -2 2.678 -0.747 0.455
## 729         16         15   -1 2.678 -0.373 0.709
## 730         14         12   -2 2.678 -0.747 0.455
## 731         13         14    1 2.678  0.373 0.709
## 732         11         10   -1 2.678 -0.373 0.709
## 733         12         13    1 2.678  0.373 0.709
## 734          7         10    3 2.678  1.120 0.263
## 735         12         12    0 2.678  0.000     1
## 736         15         15    0 2.678  0.000     1
## 737          0          1    1 2.678  0.373 0.709
## 738         12          7   -5 2.678 -1.867 0.062
## 739         15         13   -2 2.678 -0.747 0.455
## 740          2          4    2 2.678  0.747 0.455
## 741          4          5    1 2.678  0.373 0.709
## 742          0          1    1 2.678  0.373 0.709
## 743          8          9    1 2.678  0.373 0.709
## 744          1          1    0 2.678  0.000     1
## 745         14         11   -3 2.678 -1.120 0.263
## 746          6          6    0 2.678  0.000     1
## 747         12         11   -1 2.678 -0.373 0.709
## 748          4          6    2 2.678  0.747 0.455
## 749          9          7   -2 2.678 -0.747 0.455
## 750          2         13   11 2.678  4.108     0
## 751         19         17   -2 2.678 -0.747 0.455
## 752         14         12   -2 2.678 -0.747 0.455
## 753         19         19    0 2.678  0.000     1
## 754         16         14   -2 2.678 -0.747 0.455
## 755          5          6    1 2.678  0.373 0.709
## 756          3          4    1 2.678  0.373 0.709
## 757          5          8    3 2.678  1.120 0.263
## 758         11         15    4 2.678  1.494 0.135
## 759          7          7    0 2.678  0.000     1
## 760          5          2   -3 2.678 -1.120 0.263
## 761          1          0   -1 2.678 -0.373 0.709
## 762         12          8   -4 2.678 -1.494 0.135
## 763          9         12    3 2.678  1.120 0.263
## 764          8          6   -2 2.678 -0.747 0.455
## 765         16         16    0 2.678  0.000     1
## 766          9          7   -2 2.678 -0.747 0.455
## 767          4          5    1 2.678  0.373 0.709
## 768          4          7    3 2.678  1.120 0.263
## 769         11         14    3 2.678  1.120 0.263
## 770          4          4    0 2.678  0.000     1
## 771         14          8   -6 2.678 -2.241 0.025
## 772         16         16    0 2.678  0.000     1
## 773         10         12    2 2.678  0.747 0.455
## 774          8         10    2 2.678  0.747 0.455
## 775          8          9    1 2.678  0.373 0.709
## 776         13         12   -1 2.678 -0.373 0.709
## 777          6          4   -2 2.678 -0.747 0.455
## 778         12         17    5 2.678  1.867 0.062
## 779          4          2   -2 2.678 -0.747 0.455
## 780          9         12    3 2.678  1.120 0.263
## 781         11          9   -2 2.678 -0.747 0.455
## 782         11         13    2 2.678  0.747 0.455
## 783          4          3   -1 2.678 -0.373 0.709
## 784          2          3    1 2.678  0.373 0.709
## 785          4          7    3 2.678  1.120 0.263
## 786         15         17    2 2.678  0.747 0.455
## 787          5          3   -2 2.678 -0.747 0.455
## 788         14         12   -2 2.678 -0.747 0.455
## 789         10         14    4 2.678  1.494 0.135
## 790         19         15   -4 2.678 -1.494 0.135
## 791         11          8   -3 2.678 -1.120 0.263
## 792         15         13   -2 2.678 -0.747 0.455
## 793          6          5   -1 2.678 -0.373 0.709
## 794          1          3    2 2.678  0.747 0.455
## 795          9          9    0 2.678  0.000     1
## 796          9          9    0 2.678  0.000     1
## 797          7          8    1 2.678  0.373 0.709
## 798          8         13    5 2.678  1.867 0.062
## 799         11         10   -1 2.678 -0.373 0.709
## 800          6          8    2 2.678  0.747 0.455
## 801         14         15    1 2.678  0.373 0.709
## 802          8         10    2 2.678  0.747 0.455
## 803          5         10    5 2.678  1.867 0.062
## 804         16         14   -2 2.678 -0.747 0.455
## 805         17         18    1 2.678  0.373 0.709
## 806          3          5    2 2.678  0.747 0.455
## 807         12         13    1 2.678  0.373 0.709
## 808         12         12    0 2.678  0.000     1
## 809          8          8    0 2.678  0.000     1
## 810          8          5   -3 2.678 -1.120 0.263
## 811         17         14   -3 2.678 -1.120 0.263
## 812         14         11   -3 2.678 -1.120 0.263
## 813         17         13   -4 2.678 -1.494 0.135
## 814          6          5   -1 2.678 -0.373 0.709
## 815          7         10    3 2.678  1.120 0.263
## 816          8          6   -2 2.678 -0.747 0.455
## 817          6         11    5 2.678  1.867 0.062
## 818          8         11    3 2.678  1.120 0.263
## 819          5          5    0 2.678  0.000     1
## 820          6          4   -2 2.678 -0.747 0.455
## 821         10         13    3 2.678  1.120 0.263
## 822         16         18    2 2.678  0.747 0.455
## 823          2          3    1 2.678  0.373 0.709
## 824          9          8   -1 2.678 -0.373 0.709
## 825          9         10    1 2.678  0.373 0.709
## 826         11         11    0 2.678  0.000     1
## 827          4          5    1 2.678  0.373 0.709
## 828          1          5    4 2.678  1.494 0.135
## 829         16         16    0 2.678  0.000     1
## 830          5         10    5 2.678  1.867 0.062
## 831          3          4    1 2.678  0.373 0.709
## 832         19         18   -1 2.678 -0.373 0.709
## 833         13         10   -3 2.678 -1.120 0.263
## 834         15         18    3 2.678  1.120 0.263
## 835         12         11   -1 2.678 -0.373 0.709
## 836         15         13   -2 2.678 -0.747 0.455
## 837         12         10   -2 2.678 -0.747 0.455
## 838          0          2    2 2.678  0.747 0.455
## 839         12         10   -2 2.678 -0.747 0.455
## 840          9         14    5 2.678  1.867 0.062
## 841          6         13    7 2.678  2.614 0.009
## 842         11         11    0 2.678  0.000     1
## 843          3          4    1 2.678  0.373 0.709
## 844          5          8    3 2.678  1.120 0.263
## 845         10         12    2 2.678  0.747 0.455
## 846         14         11   -3 2.678 -1.120 0.263
## 847          7          9    2 2.678  0.747 0.455
## 848          6          4   -2 2.678 -0.747 0.455
## 849         14          9   -5 2.678 -1.867 0.062
## 850         13         18    5 2.678  1.867 0.062
## 851         16         16    0 2.678  0.000     1
## 852         11          6   -5 2.678 -1.867 0.062
## 853         11          6   -5 2.678 -1.867 0.062
## 854          1          3    2 2.678  0.747 0.455
## 855         11          9   -2 2.678 -0.747 0.455
## 856          4          2   -2 2.678 -0.747 0.455
## 857          8          6   -2 2.678 -0.747 0.455
## 858          6          6    0 2.678  0.000     1
## 859         11          7   -4 2.678 -1.494 0.135
## 860          5          4   -1 2.678 -0.373 0.709
## 861          7          4   -3 2.678 -1.120 0.263
## 862          4          4    0 2.678  0.000     1
## 863         17         15   -2 2.678 -0.747 0.455
## 864         13         15    2 2.678  0.747 0.455
## 865          9          4   -5 2.678 -1.867 0.062
## 866          3          5    2 2.678  0.747 0.455
## 867          7          5   -2 2.678 -0.747 0.455
## 868          9          7   -2 2.678 -0.747 0.455
## 869          8          7   -1 2.678 -0.373 0.709
## 870          8         11    3 2.678  1.120 0.263
## 871         12         14    2 2.678  0.747 0.455
## 872          6          7    1 2.678  0.373 0.709
## 873         13         12   -1 2.678 -0.373 0.709
## 874         10         10    0 2.678  0.000     1
## 875         16         17    1 2.678  0.373 0.709
## 876         15         17    2 2.678  0.747 0.455
## 877          6          4   -2 2.678 -0.747 0.455
## 878          8          6   -2 2.678 -0.747 0.455
## 879         14         13   -1 2.678 -0.373 0.709
## 880         16         15   -1 2.678 -0.373 0.709
## 881          7          3   -4 2.678 -1.494 0.135
## 882          6          5   -1 2.678 -0.373 0.709
## 883         11          9   -2 2.678 -0.747 0.455
## 884          3          0   -3 2.678 -1.120 0.263
## 885          5          6    1 2.678  0.373 0.709
## 886         13         13    0 2.678  0.000     1
## 887         11          9   -2 2.678 -0.747 0.455
## 888         12         13    1 2.678  0.373 0.709
## 889          0          1    1 2.678  0.373 0.709
## 890         16         17    1 2.678  0.373 0.709
## 891          5          2   -3 2.678 -1.120 0.263
## 892         13         11   -2 2.678 -0.747 0.455
## 893          7          4   -3 2.678 -1.120 0.263
## 894          4          3   -1 2.678 -0.373 0.709
## 895          2          1   -1 2.678 -0.373 0.709
## 896         10         15    5 2.678  1.867 0.062
## 897         13         12   -1 2.678 -0.373 0.709
## 898         13          9   -4 2.678 -1.494 0.135
## 899         20         19   -1 2.678 -0.373 0.709
## 900          7          6   -1 2.678 -0.373 0.709
## 901         16         14   -2 2.678 -0.747 0.455
## 902          6          4   -2 2.678 -0.747 0.455
## 903         13         11   -2 2.678 -0.747 0.455
## 904          4          3   -1 2.678 -0.373 0.709
## 905          7          5   -2 2.678 -0.747 0.455
## 906          7          7    0 2.678  0.000     1
## 907         11         11    0 2.678  0.000     1
## 908          9          5   -4 2.678 -1.494 0.135
## 909         12          9   -3 2.678 -1.120 0.263
## 910          8         13    5 2.678  1.867 0.062
## 911          6         13    7 2.678  2.614 0.009
## 912         11          7   -4 2.678 -1.494 0.135
## 913          3          6    3 2.678  1.120 0.263
## 914          9         12    3 2.678  1.120 0.263
## 915         18         18    0 2.678  0.000     1
## 916         18         18    0 2.678  0.000     1
## 917         14         15    1 2.678  0.373 0.709
## 918         11         11    0 2.678  0.000     1
## 919          7          7    0 2.678  0.000     1
## 920         10          4   -6 2.678 -2.241 0.025
## 921         19         18   -1 2.678 -0.373 0.709
## 922         12          8   -4 2.678 -1.494 0.135
## 923          6          7    1 2.678  0.373 0.709
## 924          5          6    1 2.678  0.373 0.709
## 925          5          4   -1 2.678 -0.373 0.709
## 926         12         10   -2 2.678 -0.747 0.455
## 927          8          9    1 2.678  0.373 0.709
## 928         10          5   -5 2.678 -1.867 0.062
## 929         12         17    5 2.678  1.867 0.062
## 930         13         10   -3 2.678 -1.120 0.263
## 931         14         10   -4 2.678 -1.494 0.135
## 932          4          2   -2 2.678 -0.747 0.455
## 933         13         12   -1 2.678 -0.373 0.709
## 934         12          8   -4 2.678 -1.494 0.135
## 935          9          8   -1 2.678 -0.373 0.709
## 936          4          3   -1 2.678 -0.373 0.709
## 937         13         12   -1 2.678 -0.373 0.709
## 938         10          4   -6 2.678 -2.241 0.025
## 939          7          5   -2 2.678 -0.747 0.455
## 940          6         12    6 2.678  2.241 0.025
## 941         12         17    5 2.678  1.867 0.062
## 942          0          1    1 2.678  0.373 0.709
## 943          9          5   -4 2.678 -1.494 0.135
## 944          5          8    3 2.678  1.120 0.263
## 945          4          5    1 2.678  0.373 0.709
## 946         17         19    2 2.678  0.747 0.455
## 947         11          9   -2 2.678 -0.747 0.455
## 948         13         14    1 2.678  0.373 0.709
## 949          5          9    4 2.678  1.494 0.135
## 950         11         14    3 2.678  1.120 0.263
## 951          8          7   -1 2.678 -0.373 0.709
## 952          6          9    3 2.678  1.120 0.263
## 953          9          1   -8 2.678 -2.988 0.003
## 954         11          8   -3 2.678 -1.120 0.263
## 955         10         13    3 2.678  1.120 0.263
## 956          4          3   -1 2.678 -0.373 0.709
## 957          3          4    1 2.678  0.373 0.709
## 958          7         11    4 2.678  1.494 0.135
## 959         13         14    1 2.678  0.373 0.709
## 960         18         17   -1 2.678 -0.373 0.709
## 961         13         13    0 2.678  0.000     1
## 962         20         19   -1 2.678 -0.373 0.709
## 963          8          4   -4 2.678 -1.494 0.135
## 964         15         15    0 2.678  0.000     1
## 965         11          8   -3 2.678 -1.120 0.263
## 966         14         17    3 2.678  1.120 0.263
## 967         14          9   -5 2.678 -1.867 0.062
## 968          9         10    1 2.678  0.373 0.709
## 969         10          8   -2 2.678 -0.747 0.455
## 970         16         15   -1 2.678 -0.373 0.709
## 971         13         14    1 2.678  0.373 0.709
## 972          3          3    0 2.678  0.000     1
## 973         12         13    1 2.678  0.373 0.709
## 974          8          6   -2 2.678 -0.747 0.455
## 975          9         11    2 2.678  0.747 0.455
## 976          9         11    2 2.678  0.747 0.455
## 977          4          4    0 2.678  0.000     1
## 978          8          7   -1 2.678 -0.373 0.709
## 979          9         10    1 2.678  0.373 0.709
## 980         15         17    2 2.678  0.747 0.455
## 981         10          9   -1 2.678 -0.373 0.709
## 982         15         12   -3 2.678 -1.120 0.263
## 983          7         10    3 2.678  1.120 0.263
## 984         15         16    1 2.678  0.373 0.709
## 985         13         13    0 2.678  0.000     1
## 986          2          6    4 2.678  1.494 0.135
## 987          8          9    1 2.678  0.373 0.709
## 988          9          9    0 2.678  0.000     1
## 989         16         11   -5 2.678 -1.867 0.062
## 990         13         10   -3 2.678 -1.120 0.263
## 991          3          4    1 2.678  0.373 0.709
## 992          1          6    5 2.678  1.867 0.062
## 993         11         12    1 2.678  0.373 0.709
## 994          5          2   -3 2.678 -1.120 0.263
## 995          5          9    4 2.678  1.494 0.135
## 996         12          8   -4 2.678 -1.494 0.135
## 997          2          0   -2 2.678 -0.747 0.455
## 998          2          2    0 2.678  0.000     1
## 999         17         19    2 2.678  0.747 0.455
## 1000         3          1   -2 2.678 -0.747 0.455
######

# interactive shiny interfaces for live scoring
mod_pre <- mirt(Science)

# (optional) setup mod_post to have medium effect size change (d = 0.5)
sv <- mod2values(mod_pre)
sv$value[sv$name == 'MEAN_1'] <- 0.5
mod_post <- mirt(Science, pars=sv, TOL=NA)

# only use pre-test model for scoring
if(interactive()){
    RCI(mod_pre=mod_pre, shiny=TRUE)

    # use both pre-test and post-test models for including empirical priors
    RCI(mod_pre=mod_pre, mod_post=mod_post, shiny=TRUE,
        main='Perceptions of Science and Technology')
 }


############################
# Example where individuals take completely different item set pre-post
#   but prior calibration has been performed to equate the items

dat <- key2binary(SAT12,
  key = c(1,4,5,2,3,1,2,1,3,1,2,4,2,1,5,3,4,4,1,4,3,3,4,1,3,5,1,3,1,5,4,5))

mod <- mirt(dat)

# with N=5 individuals under investigation
predat <- postdat <- dat[1:5,]
predat[, 17:32] <- NA
postdat[, 1:16] <- NA

head(predat)
##      Item.1 Item.2 Item.3 Item.4 Item.5 Item.6 Item.7 Item.8 Item.9 Item.10
## [1,]      1      1      1      1      1      1      1      1      1       1
## [2,]      0      1      0      0      1      0      1      0      1       1
## [3,]      1      1      1      0      1      0      1      0      1       0
## [4,]      0      1      0      1      1      0      1      0      1       0
## [5,]      0      1      1      1      1      0      1      1      0       0
##      Item.11 Item.12 Item.13 Item.14 Item.15 Item.16 Item.17 Item.18 Item.19
## [1,]       1       1       1       1       1       1      NA      NA      NA
## [2,]       1       0       1       1       1       0      NA      NA      NA
## [3,]       1       0       0       1       1       0      NA      NA      NA
## [4,]       1       1       1       1       1       0      NA      NA      NA
## [5,]       1       1       1       1       1       0      NA      NA      NA
##      Item.20 Item.21 Item.22 Item.23 Item.24 Item.25 Item.26 Item.27 Item.28
## [1,]      NA      NA      NA      NA      NA      NA      NA      NA      NA
## [2,]      NA      NA      NA      NA      NA      NA      NA      NA      NA
## [3,]      NA      NA      NA      NA      NA      NA      NA      NA      NA
## [4,]      NA      NA      NA      NA      NA      NA      NA      NA      NA
## [5,]      NA      NA      NA      NA      NA      NA      NA      NA      NA
##      Item.29 Item.30 Item.31 Item.32
## [1,]      NA      NA      NA      NA
## [2,]      NA      NA      NA      NA
## [3,]      NA      NA      NA      NA
## [4,]      NA      NA      NA      NA
## [5,]      NA      NA      NA      NA
head(postdat)
##      Item.1 Item.2 Item.3 Item.4 Item.5 Item.6 Item.7 Item.8 Item.9 Item.10
## [1,]     NA     NA     NA     NA     NA     NA     NA     NA     NA      NA
## [2,]     NA     NA     NA     NA     NA     NA     NA     NA     NA      NA
## [3,]     NA     NA     NA     NA     NA     NA     NA     NA     NA      NA
## [4,]     NA     NA     NA     NA     NA     NA     NA     NA     NA      NA
## [5,]     NA     NA     NA     NA     NA     NA     NA     NA     NA      NA
##      Item.11 Item.12 Item.13 Item.14 Item.15 Item.16 Item.17 Item.18 Item.19
## [1,]      NA      NA      NA      NA      NA      NA       1       1       1
## [2,]      NA      NA      NA      NA      NA      NA       1       0       1
## [3,]      NA      NA      NA      NA      NA      NA       1       0       0
## [4,]      NA      NA      NA      NA      NA      NA       1       0       0
## [5,]      NA      NA      NA      NA      NA      NA       1       0       1
##      Item.20 Item.21 Item.22 Item.23 Item.24 Item.25 Item.26 Item.27 Item.28
## [1,]       1       1       1       1       1       1       1       1       1
## [2,]       1       1       1       0       1       0       0       1       0
## [3,]       1       1       1       0       1       1       0       1       1
## [4,]       1       1       0       0       0       0       0       1       1
## [5,]       1       1       1       0       1       0       1       1       1
##      Item.29 Item.30 Item.31 Item.32
## [1,]       1       1       1       1
## [2,]       0       0       1       0
## [3,]       0       0       1       0
## [4,]       0       0       1       0
## [5,]       1       0       1       0
RCI(mod, predat, postdat)
##   pre.score post.score converged   diff   SEM      z     p
## 1     2.206      1.808      TRUE -0.398 0.951 -0.419 0.675
## 2     0.373     -0.344      TRUE -0.717 0.720 -0.995  0.32
## 3     0.303     -0.115      TRUE -0.419 0.728 -0.575 0.566
## 4     0.295     -0.864      TRUE -1.159 0.699 -1.658 0.097
## 5     0.670      0.513      TRUE -0.157 0.772 -0.203 0.839
## End(No test)

[Package mirt version 1.43 Index]