Showing posts with label Scholarship of Teaching and Learning. Show all posts
Showing posts with label Scholarship of Teaching and Learning. Show all posts

Tuesday, July 13, 2010

New Research in the Scholarship of Teaching & Learning

The Journal of the Scholarship of Teaching & Learning is an outlet for professors to share their reflections and knowledge and teaching and learning. 

Two articles of general interest are:
 Knowledge surveys: Students ability to self-assess by Jon Clauss and Kevin Geedey.  In this article the authors examine students' abilities to understand their own level of ability and assess their own knowledge along Bloom's taxonomy.  Findings indicate that students predictive ability is better at the base (knowledge) and top (analysis, synthesis, evaluation) levels of the taxonomy, but weak in the middle (comprehension and application).  For details of methodology, findings, and reflections check out the complete article.

Creating effective student engagement in online courses:  What do students find engaging? by Marcia D. Dixson.  The author set out to identify the activities and forms of interaction that lead to highly engaged students, but instead found that there is no one answer, but rather a strategy of meaningful activities and a variety of interactions can lead to success. Of particular importance was finding ways to compel students to interact with the professor and each other.  To learn about more ways to enhance the on-line learning environment contact Faculty Instructional Technology Services.

Wednesday, February 10, 2010

What Makes a Great Lecture? Use of Lectures in a Hybrid PBL Curriculum

Engaging students in a class session can be done in any number of ways, and lecture remains one of the most popular instructional strategies. Azer (2009) recognizes this, and offers ideas for how to maximize the effectiveness of lectures. While Azer focuses on lectures in the context of problem-based learning in medical courses, most of his recommendations can be applied to lecture in a range of disciplines.

Azer (2009) suggests that a great lecture should empower the audience and keep them focused; move the audience and make them more willing to learn more about the topics discussed; and provide new insights and stimulate thinking and analysis (p. 110).

This requires us to know something about our audience, including asking questions such as (Azer, 2009, p. 111):
  • What do students already know about the subject?
  • What other subjects have students learned and how does this relate to the current lecture?
  • What examples will encourage deeper learning?
  • How will the lecture differ from readings or other course materials?
  • What stories or analogies will make the content more clear?
Azer (2009) suggests beginning a lecture with an open-ended question that will get students interested in the topic and intellectually curious to learn more (p. 112). Furthermore, you can engage students by showing them how to apply the knowledge they are gaining, showing how the content relates to knowledge from other disciplines, and by listening to and addressing learner needs (Azer, 2009, p. 112).

Finally, Azer (2009) lists a few common mistakes that can spoil a lecture but are relatively easy to correct (p. 113):
  • Relying too heavily on Powerpoint slides or using too many of them
  • Presenting only factual information
  • Not assessing students’ previous knowledge
  • Leaving out real world examples or applications
  • Not leaving enough time for questions
To address these concerns and further engage students in a lecture, visit the Teaching Commons pages covering:

References

Azer S.A. (2009). What makes a great lecture? Use of lectures in a hybrid PBL curriculum. The Kaohsiung Journal of Medical Sciences, 25(3), 109-115.

Wednesday, October 7, 2009

Teaching Experiential Learning: Adoption of an Innovative Course in an MBA Curriculum

In a recent study Li, Greenberg, & Nicholls (2007) evaluated the success of implementing experiential learning techniques in an MBA curriculum.

Researchers adopted Marketplace, software that could simulate companies from inception to maturity in a global market. Each week of the course simulated a business quarter, and students interacted with one another to make business decisions and to devise strategy. Instructors’ roles were adapted to this technique by assuming the “role of an arbitrator, such as the commissioner of the Federal Trade Commission (FTC) who handles complaints and claims” (Li et al., 2009, p. 26). Class materials were provided “in the form of industry newsletters, quarterly electronic presentations, advertising arbitration decisions, and their responses to teams’ inquiries” (Li et al., 2007, p. 28).

Evaluations of this technique were conducted by administering student questionnaires that analyzed their perception of this technique and compared their perceptions of this technique to traditional lectures. With a sample size of 588 graduate students, Li et al. (2007) found that student perceptions of the effectiveness of the technique in engagement, development of career skills, and improved competence were statistically significant (p. 31). Comparing this technique to traditional lectures, Li et al. (2007) found that 10 out of their 12 criteria including problem solving, thinking on your feet, and team work were significantly higher rated using the new experiential learning technique than traditional lectures (p. 31). Only two were not statistically significant- learning principles and concepts and using written communication.

These results give evidence towards the efficacy of using experiential learning in a course. If your learning goals are along the lines of engaging students in course concepts, improving team work, improving interpersonal skills, facilitating management skills, or examining diverse solutions, experiential learning is worth considering.

Further DePaul Resources


References

Li, T., Greenberg, B. A., & Nicholls, J. A. F. (2007). Teaching Experiential Learning: Adoption of an Innovative Course in an MBA Marketing Curriculum. Journal of Marketing Education, 29(1), 25-33. Retrieved October 7, 2009, from ABI/INFORM Global. (Document ID: 1244131751).

Tuesday, September 29, 2009

Using Online Concept Mapping with Peer Learning to Enhance Concept Application

In a recent study, Chang & Chang (2008) found that students in an online course who used concept maps as a learning strategy improved their ability to apply a theory to a real world scenario (2008).

Concept maps are diagrams that can be created using tools such as pen and paper, post it notes, or computer software. A concept map involves nodes that are linked together by relationships. Each node represents a concept such as "viral marketing," "Greek philosophy," or "energy conservation." Each relationship represents a relationship between two nodes such as "affects the population," "was influenced by," or "being developed by."

Concept maps were used in the experimenter's course that covered learning theory. They were implemented to help achieve the learning goal of organizing and giving structure to multiple theories of learning and how the theories related to scenarios that the students would face in future learning environments.

In this experiment, two conditions were formed, students who were required to use concept maps throughout the class and those who did not. The research team assessed student learning by grading assignments that demonstrated concept application in the learning theory domain; using a rubric following the categories of (Chang & Chang, 2005, p.20):
  1. Instructional strategies were clearly described and appropriate for the given learners to achieve the learning goal
  2. The instructional strategies were consistent with the concepts of the given learning theory
  3. The rationale for using the instructional strategy was logical and consistent with theory
Researchers found that students who had used concept maps had statistically significant higher scores on their concept application assignments than those who did not. While the research team admits that this could be due to a number of experimental biases, most notably that those in the control condition did not have any additional instructional techniques applied, the results do warrant further study of concept mapping as an instructional strategy.

With that in mind, we provide some links to concept maps and examples of how they might be applied in a course.

Resources

How to make a concept map
List of concept mapping software from Penn State University

Concept Map Examples:

References

Chang, S., & Chang, Y. (2008, Spring2008). USING ONLINE CONCEPT MAPPING WITH PEER LEARNING TO ENHANCE CONCEPT APPLICATION. Quarterly Review of Distance Education, 9(1), 17-27. Retrieved September 29, 2009, from Professional Development Collection database.

Thursday, September 10, 2009

Problem-based Learning in Quantitative Classes

Problem based learning (PBL) is a strategy that engages students by using current problems in the world in class assignments. This helps students become invested in course assignments and teaches them problem solving skills that are required of professionals.

In the spring 2009 issue of Academic Exchange Quarterly Blaylock and Kopf (2009) present an example of how we can implement PBL in our classroom.

In a quantitative analysis course, Blaylock and Kopf prompted their class with the following statement from the 2008 presidential campaign. In the statement, then presidential candidate Obama speaks on the energy savings and long term lowered fuel costs gained from proper tire inflation.


After viewing the statement as a class, they presented the overarching question in a manner that reached students on a personal level: “Will this part of Mr. Obama's energy plan cause the price you and I pay for gas to decline?”

After some initial discussion Blaylock and Kopf challenged students to defend their positions by asking, “How do you know?”

This lead into the larger assignment which asked students to consider:

  1. What information do you need to know to evaluate the accuracy of Mr. Obama's statement?

  2. What primary or secondary data support your claims?

  3. How can you use the data to support your claims?

These questions required students to consider new challenges such as developing an experimental design, assessing appropriate sample sizes, finding representative sample populations, and organizing and analyzing a new set of data.

Throughout this process Blaylock and Kopf supported students through short lectures and guidance to individual groups.

While many students felt that the practical application allowed students to better understand statistical concepts, some felt that the topic had already been over analyzed and their data was irrelevant. Overall, Blaylock and Kopf felt that PBL engaged students in the course material at a much deeper level than if they had simply used text book examples.

References


Blaylock, B. K., & Kopf, J. M. (2009). Problem-Based Learning in Quantitative Classes. Academic Exchange Quarterly, 13(1). Retrieved September 10, 2009, from http://www.rapidintellect.com/AEQweb/cho4258w9.htm.

Friday, August 21, 2009

Factors Contributing to Improved Teaching Performance

In a recent article published (DePaul Library - Requires CampusConnect) in Innovative Higher Education McGowan and Graham (2009) reported on teaching surveys from 203 faculty at Brigham Young University. These faculty were selected for improvement on their student ratings over the past three years.

Conducted by the University’s Center for Teaching and Learning, the researchers were interested in finding out what factors led to improved teaching performance. The team analyzed the teaching surveys and conducted follow up interviews with 27 faculty from 10 of the 12 colleges at BYU. They reported 3 factors that contributed to improved teaching performance:

  • Active/practical learning


    • Frequent in class discussions

    • Real world experience/practical applications of course content


  • Clear expectations/learning outcomes


    • Focus on defined learning outcomes

    • Emphasis on learning outcomes when giving feedback


  • Teacher/student interactions


    • Demonstrating interest in students’ lives

    • Learning students’ names


McGowan and Graham reported 6 factors that motivated the change towards improved teaching:

  1. Online student rating scores

  2. Mid term surveys and exit interviews

  3. Lack of excitement in class

  4. Personal desire

  5. Teaching support

  6. Teaching material


While the this research was conducted at one University, many of the findings and concepts can be universally applied. Indeed, many of the factors, including active learning techniques, defining learning outcomes, and personalism are advocated for in some of the most well known literature on college teaching including McKeachie's McKeachie's Teaching Tips and Fink's Creating Significant Learning Experiences. Both of these books can be found in the Office for Teaching, Learning and Assessment library.


References

McGowan, W., & Graham, C. (2009, December). Factors Contributing to Improved Teaching Performance. Innovative Higher Education, 34(3), 161-171. Retrieved August 21, 2009, doi:10.1007/s10755-009-9103-6

Monday, May 18, 2009

Team-based Learning

A couple of weeks ago the New York Times posted a special report on a team-based learning program at Duke-N.U.S. Graduate Medical School in Singapore.

What is team-based learning (TBL)?  Michaelsen, Knight, and Fink (2004) define TBL as "a particular instructional strategy, not a series of independent small-group activities ... team-based learning revolves around the development of teams, a kind of social unit that is quite distinct from groups" (p. 8). Typically a team-based learning course is restructured into units that involve three phases:
1. Preparation in which all readings are completed and pre-requisite knowledge is
attained
2. Application in which content is used to solve common problems
3. Assessment phase in which a final problem is given to solve as a team
(Michaelsen et al., p. 9-11)
Duke-N.U.S. is employing TBL to give students increased guided hands-on time in the classroom.  They use pre-recorded lectures to impart knowledge about course concepts and class time to develop a deeper understanding and knowledge of the concepts.

A discussion of where the program is going and ongoing research they are conducting was posted by Dr. Sandy Cook, Associate Dean of the Duke-N.U.S. Graduate Medical School Singapore from the TEAMLEARNING archives.

To learn more about Team-based learning and about how to design a course with TBL in mind, visit the course design guide at the University of British Columbia.


References:

Michaelsen A. L., Knight A.B., Fink, L.D. (Eds.). (2004). Team-Based Learning: A Transformative Use of Small Groups. Sterling, VA: Stylus Publishing.

Wednesday, April 1, 2009

Do Quizzes Matter?

As reported in the Chronicle of Higher Education, several recent studies confirmed that frequently quizzing students on reading material helps them retain what they have learned.

One study, published in Psychological Science, was based on two experiments in which students read passages on scientific topics. In the first experiment, students were assigned to one of two groups. Students in the first group took a test on the material, those in the second group re-read it, then both groups took a test five minutes, two days or one week later. In the second experiment, students read the material and then either (a) took three tests, (b) re-read the material three times and took one test, or (c) read the material four times.

The study's authors found that the students who were directed to review the material reported greater confidence in their ability to remember the material (and, indeed, they performed better on the retention test given five minutes later). However, on the tests taken days later, "prior testing produced substantially greater retention than studying."

References


Glenn, David. (2007, June 8). You will be tested on this.
The Chronicle of Higher Education
-DPU-

Roediger III, H.L., & Karpicke, J.D. (2006). Test-enhanced learning
Psychological Science, 17 (3), 249-255. -DPU-

Related Links


Tests and quizzes: strategies and resources

Giving quizzes with clickers

Give quizzes or tests online

The Benefits of Peer Instruction

When working in groups, do discussions help students gain a better understanding of the material, or do students typically give in to the group consensus or the dominant voice? Early indications from a recent report in Science suggest that students working in groups do tend to improve their conceptual understanding, rather than merely agreeing with another student's answer.

In their study of students taking introductory genetics at the University of Colorado at Boulder, faculty used feedback from clickers to measure student performance on a series of questions. First a conceptual question is posed to the class, next the same question is asked but after peer discussion, and finally a third question, different in content, but requiring the application of the same principles required to solve the first question. As expected, students tended to answer more questions correct when working with the aid of a group, however a welcome surprise was that "students who answered both question 1 and question 1 (after discussion) incorrectly still appeared to learn from discussions with peers ... Of these students 44% answered question 2 correctly, significantly better than expected from random guessing." (Smith, M.K. et al., 2009, p. 123) These results help support the theory that students engaged in discussion gain a stronger conceptual understanding of the course content.

Read more from Inside Higher ED.

References


Lederman, Doug. (2009, January 5). Proving the Benefits of Peer Instruction. Inside Higher Ed.

Smith, M.K., Wood, W.B., Adams, W.K., Wieman, C., Knight, J.K., Guild, N., Su, T.T., (2009, January). Why Peer Discussion Improves Student Performance on In-Class Concept Questions. Science. 323(5910), 122-124. DOI: 10.1126/science.1165919

Related Links


Collaborative learning techniques by the Teaching Commons.

Using clickers for peer instruction by the Teaching Commons.