The SoTL Advocate

Supporting efforts to make public the reflection and study of teaching and learning at Illinois State University and beyond…

Leave a comment

Winter Break News & Opportunities for Feedback

The SoTL Advocate is officially on winter break! We will return with weekly posts, beginning January 11, 2016. The editors of this blog would like to wish you all a wonderful, restful winter break and a happy and very productive 2016.

Perhaps as you have some reflective moments during winter break, you might:

  1. Suggest an idea or two for future blogs/blog topics in the comments below. Let us know what content you’d like to see here on The SoTL Advocate in the new year!
  2. Author a 500-800 word blog post, describing:
    • a SoTL project you’re considering or implementing
    • a reflection on SoTL and it’s role at your university, in your discipline, or as a global effort
    • resources to support the application of SoTL for scholarly teaching

Please feel free to email Kathleen McKinney ( or Jen Friberg ( with any questions about blog content or contributions.

Thank you for your readership this year! See you in 2016!

1 Comment

“Brushing Up” on the Scholarship of Teaching and Learning: A Sample of Books

Written by Kathleen McKinney, Cross Endowed Chair in SoTL, Illinois State University

Though many SoTL projects are discipline-specific, local, and context-specific, there are general book resources available related to SoTL. These include books on designing/doing SoTL, examples of SoTL projects, SoTL in the disciplines or related to teaching specific topics, and issues in the field of SoTL. Most of these books are useful to those in any discipline.

Are you new to SoTL? Are you a more experienced ‘SoTLer’ but looking to expand your knowledge of the field? Are you a faculty developer who helps others do SoTL? If any of these apply to you, perhaps you will find one or more of the following books useful. This list is a sample of books about SoTL or reporting on SoTL and published in the last 15 years. Happy reading!

General or Issue-Specific “How To Do” SoTL Books:

  • Bishop-Clark, C., & Dietz-Uhler, B. (2012). Engaging in the scholarship of teaching and learning: A guide to the process, and how to develop a project from start to finish. Sterling, VA: Stylus.
  • Gurung, R. A. R., & Schwartz, B. M. (2009). Optimizing teaching and learning: Practicing pedagogical research. Malden, MA: Wiley-Blackwell.
  • Gurung, R. A. R., & Wilson, J. H. (Eds.). (2013). Doing the scholarship of teaching and learning: Measuring systematic changes to teaching and improvements in learning. San Francisco: Jossey-Bass.
  • Hutchings, P. (2002). Ethics of inquiry: Issues in the scholarship of teaching and learning. Menlo Park, CA: Carnegie Foundation for the Advancement of Teaching.
  • McKinney, K. (2007). Enhancing learning through the scholarship of teaching and learning: The challenges and joys of juggling. San Francisco: Jossey-Bass.
  • Werder, C., & Otis, M. M. (Eds.). (2010). Engaging student voices in the study of teaching and learning. Sterling, VA: Stylus.

SoTL in a/the Discipline(s) or Related to a Topic Area:

  • Dewar, J. M., & Bennett, C. D. (Eds.). (2015). Doing the scholarship of teaching and learning in mathematics. Washington, DC: Mathematical Association of America.
  • Ferrett, T. A., Geelan, D. R., Schlegel, W. M., & Stewart, J. L. (Eds.) (2013). Connected Science: Strategies for Integrative Learning in College. Bloomington, IN: Indiana University Press.
  • Ginsberg, S., Friberg, J., & Visconti, C. (2012). Scholarship of Teaching and learning in speech-language and audiology: Evidence-based education. San Diego: Plural Publishing.
  • Huber, M. T., & Morreale, S. P. (Eds.). (2002). Disciplinary styles in the scholarship of teaching and learning: Exploring common ground. Washington, DC: American Association for Higher Education.
  • Manarin, K., Carey, M., Rathburn, M., & Ryland, G. (2015). Critical Reading in Higher Education: Academic Goals and Social Engagement. Bloomington, IN: Indiana University Press.
  • Mashek, D. J., & Hammer, E. Y. (Eds.). (2011). Empirical research in teaching and learning: Contributions from social psychology. Malden, MA: Wiley-Blackwell.
  • McKinney, K. (Ed.). (2013). The scholarship of teaching and learning in and across disciplines. Bloomington, IN: Indiana University Press.
  • Smith, M. B., Nowacek, R. S., & Bernstein, J. L. (Eds.) (2010). Citizenship Across the Curriculum. Bloomington, IN: Indiana University Press.
  • Tinberg, H. & Weisberger, R. (2013). Teaching, Learning, and the Holocaust: An Integrative Approach. Bloomington, IN: Indiana University Press.

SoTL Support and/or Impact:

  • Becker, W. E., & Andrews, M. L. (Eds.). (2004). The scholarship of teaching and learning in higher education: Contributions of research universities. Bloomington, IN: Indiana University Press.
  • Cambridge, B. L. (Ed.). (2004). Campus progress: Supporting the scholarship of teaching and learning. Washington, DC: American Association for Higher Education.
  • Huber, M. T., & Hutchings, P. (2005). The advancement of learning: Building the teaching commons. San Francisco, CA: Jossey-Bass.
  • Hutchings, P., Huber, M. T., & Ciccone, A. (2011). The scholarship of teaching and learning reconsidered: Institutional integration and impact. San Francisco, CA: Jossey-Bass.
  • Kreber, C. (2013). Authenticity in and through teaching in higher education: The transformative potential of the scholarship of teaching. London; New York: Routledge.
  • Weimer, M. (2006). Enhancing scholarly work on teaching and learning: Professional literature that makes a difference. San Francisco, CA: Jossey-Bass.


Is SoTL ‘Less Rigorous’ or Simply ‘Different’ than Other Research?

By Kathleen McKinney, Cross Endowed Chair in SoTL, Illinois State University

Often when I am facilitating workshops on designing, conducting, and sharing scholarship of teaching and learning empirical projects, I am questioned about the methodological rigor of SoTL research. Such questions are usually from participants in disciplines that emphasize quantitative research and/or experimental methodologies and/or large sample sizes and/or the use of known and tested instruments in their disciplinary research. Sometimes they are traditional educational researchers using such techniques often in K-12 settings. They are concerned, understandably, with reliability, internal validity, and external validity of SoTL studies.

Of course, there is SoTL research that uses quantitative research or experiments or instruments with known statistical characteristics or large samples. These SoTL studies, however, are atypical rather than the norm. And those of us who do SoTL are concerned with rigor, and with reliability and validity. But, we may think about these issues somewhat differently or emphasize other aspects of our projects over the traditional view of these methodological standards. I also believe, however, that there is overlap in how SoTL researchers and other researchers attempt to enhance reliability and validity.

Usually, reliability is defined as consistency, that is, the extent to which a measurement instrument or other tool yields essentially the same result when used more than once. Of course, this assumes no real change has taken place in what is being measured. Thus, as a hypothetical example, if you have an instrument to measure a student’s ability to engage in metacognition and they score in the ‘medium-high range’, when you give that student the same measure two weeks later, they should still score in the ‘medium-high range’ (assuming nothing happened that actually significantly decreased or increased this ability).

Internal validity is the degree to which a measure actually measures what it is supposed to or claims to measure. Thus, for example, if you have a measure to assess the quality of a student’s analysis of historical text, the measure should in fact be measuring the quality of that historical analysis and this should be demonstrated in a variety of ways (e.g., face, construct, criterion validity). The measure should not be measuring something else such as the student’s ability to write well or to tell a good story or to think critically (though those may correlate or overlap to some degree with your measure if they are related to or part of your construct of historical analysis). Internal validity also has a meaning in experimental designs in terms of the quality of the manipulations, measures, and design to give us clear results related to cause and effect; ruling out confounding factors and alternative explanations of the results.

External validity deals with the extent to which we can legitimately generalize the results of our study beyond that study. If our study was replicated or adapted, would the same results be found? We may want or be expected to have our results generalize to other contexts or situations, samples, measures of variables, etc. To what extent, for instance, does our finding that the use of reflective learning logs enhances student learning in our sociology senior capstone class generalize to other classes or students or disciplines or institutions?

There are two answers (at least) to the questions about SoTL lacking rigor in terms of reliability, and internal and external validity. The first answer is that SoTL does concern itself with these traditional methodological standards. We, similar to many other researchers in different fields, attempt to strengthen these qualities of our research by doing the following:

  • building on prior research,
  • using theory to guide our work,
  • using established reliable and valid measures if they exist for our constructs or variables,
  • making use of multiple measures of the same concept or behavior or outcome we are studying,
  • making use of multiple methods (often both qualitative and quantitative) so as to triangulate our results,
  • engaging and honoring student voices in our SoTL projects in terms of both their descriptive data and as members of our research teams,
  • replicating others’ and our own SoTL research, and
  • seeing a single SoTL study as only one piece of a large and complex puzzle in a long-term, multi-study SoTL research agenda.

The second answer to such questions, especially to the concern about external validity or generalizability, is to remind others that SoTL is a special type of research and scholarly activity. SoTL is applied, action, practitioner research. The purposes are to learn about or teaching and, more so, our students’ learning and other outcomes in our classes and programs. And to use what we learn to enhance the learning and development of those and future students. Because of these purposes, SoTL is context-specific in terms of the specific students or tasks, the learning we are attempting to measure, or the discipline, program or institution.

I argue, then, that SoTL research does not inherently lack rigor. It is not, by definition, ‘weaker’ than other research. It is just a little different!