SCS: Seminars 2007-08

From MathWiki

Table of contents

Meeting 1: September 28

From Dave Flora:

The text is

Kline, Rex B. (2004). Beyond significance testing: Reforming data analysis methods in behavioral research. Washington, DC: American Psychological Association.

It has a website : [1] (http://www.apa.org/books/resources/kline/) Here there are things like exercises, downloadable data sets, and more links.

The author's personal website is here : [2] (http://psychology.concordia.ca/fac/Kline/rexbkline.html) If you want to see pictures of his family (there are other things too).

Below are .pdf files of Chapter 1 and 3.

Chapter 1 is very short, outlining the purpose and plan of the book. Chapter 3 reviews null-hypothesis significance testing and its logic and problems. I think that theme will fit nicely with Hugh's presentation, assuming he is still willing to do it.

I decided to skip chapter 2 because it is mostly just a review of introductory statistics, namely "principles of sampling and estimation that underlie confidence intervals and statistical tests," with things like the usual t-test and ANOVA formulas.

Chapter 1 (http://www.math.yorku.ca/~georges/SCS/SCS07chapter01.pdf)
Chapter 3 (http://www.math.yorku.ca/~georges/SCS/SCS07chapter03.pdf)

Some references:

Wilkinson, L. and the Task Force on Statistical Inference (1999) "Statistical Methods in Psychology Journals: Guidelines and Explanations," American Psychologist 54 594--604. (http://www.math.yorku.ca/~georges/SCS/WilkinsonStatistical%20Methods%20in%20Psychology%20Journals.pdf)

Meeting 2: October 12

Readings:

  • Continue with Kline, Chapter 3 (http://www.math.yorku.ca/~georges/SCS/SCS07chapter03.pdf)
  • The article that led to the creation of the Task Force on Statistical Inference is

Cohen, J. (1994). The Earth is round (p < .05). American Psychologist, 49, 997-1003. Link to the .pdf from York library (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=0003066x&issue=v49i0012&article=997_teir&form=pdf&file=file.pdf)

(this article also discusses Pr(Data|Null hypothesis))

  • Some short commentaries (also linked through York library)

Hubbard (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=0003066x&issue=v50i0012&article=1098_teihsr&form=pdf&file=file.pdf)

Baril & Cannon (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=0003066x&issue=v50i0012&article=1098_witptnhtim&form=pdf&file=file.pdf)

McGraw (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=0003066x&issue=v50i0012&article=1099_dfarinhtr&form=pdf&file=file.pdf)

Svyantek & Ekeberg (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=0003066x&issue=v50i0012&article=1101_teirwcpgtfh&form=pdf&file=file.pdf)

Parker (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=0003066x&issue=v50i0012&article=1101_tommnbts&form=pdf&file=file.pdf)

Frick (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=0003066x&issue=v50i0012&article=1102_apwci&form=pdf&file=file.pdf)

Cohen's rejoinder (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=0003066x&issue=v50i0012&article=1103_teirr&form=pdf&file=file.pdf)

Meeting 3: October 26

Kline, chapters 4 and 5.

Meeting 4: November 9

  • Kline, chapter 5

This paper mostly focuses on IRT, but the general points about effect sizes at the beginning and end are interesting.

Meeting 5: November 23

Diversion on power analysis

Meeting 6: December 7

No meeting -- undergrad classes are over and the meeting room is being used by ISR for another purpose.

Happy holidays and See you in January 2008!

Meeting 7: January 18

Kline, chapter 6

Meeting 8: February 1

Kline, chapter 8

Meeting 9: February 22

Kline, chapter 9

Fan, X. (2003). Using commonly available software for bootstrapping in both substantive and measurement analyses. Educational and Psychological Measurement, 63, 24-50. (http://www-mi1.csa.com/ids70/linking.php?linktype=FulltextPDF&record=ids%3Asage-set-c%2FEPM_2003_63_1.SE.20070907%3A%3A01%3A25%3A34.wais.utf8fix+375242+sageduc-set-c&SID=0636ea41a1c1337837a01477743d1098)

Meeting 10: March 7

original "p-rep" article:

Killeen, P.R. (2005). An alternative to null hypothesis significance tests. Psychological Science, 16, 345-353. (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=09567976&issue=v16i0005&article=345_aatnst&form=pdf&file=file.pdf)

Some commentaries:

Cumming, G. (2005). Understanding the average probability of replication: Comment on Killeen (2005). Psychological Science, 16, 1002-1004. (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=09567976&issue=v16i0012&article=1002_utapor&form=pdf&file=file.pdf)

Doros, G., & Geier, A.B. (2005). Probability of replication revisited: Comment on "an alternative to null hypothesis significance tests." Psychological Science, 2005, 1005-1006. (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=09567976&issue=v16i0012&article=1005_porr&form=pdf&file=file.pdf)

MacDonald, Ranald R. (2005). Why replication probabilities depend on prior probability distributions. Psychological Science, 16, 471-481. (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=09567976&issue=v16i0012&article=1007_wrpdoppd&form=pdf&file=file.pdf)

Wagenmakers, E,-J., & Gruenwald, P. (2006). A Bayesian perspective on hypothesis testing: A comment on Killeen (2005). Psychological Science, 17, 641-642. (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=09567976&issue=v17i0007&article=641_abpohtacok&form=pdf&file=file.pdf)


Killeen's rejoinders:

Killeen, P.R. (2005). Replicability, confidence, and priors. Psychological Science, 16, 1009-10012. (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=09567976&issue=v16i0012&article=1009_rcap&form=pdf&file=file.pdf)

Killeen, P.R. (2006). The problem with Bayes. Psychological Science, 17, 643-644. (http://scholarsportal.info/cgi-bin/sciserv.pl?collection=journals&journal=09567976&issue=v17i0007&article=643_tpwb&form=pdf&file=file.pdf)

Meeting 12: April 11

Main references

Additional references