The Journal of the Scholarship of Teaching & Learning is an outlet for professors to share their reflections and knowledge and teaching and learning.
Two articles of general interest are:
Knowledge surveys: Students ability to self-assess by Jon Clauss and Kevin Geedey. In this article the authors examine students' abilities to understand their own level of ability and assess their own knowledge along Bloom's taxonomy. Findings indicate that students predictive ability is better at the base (knowledge) and top (analysis, synthesis, evaluation) levels of the taxonomy, but weak in the middle (comprehension and application). For details of methodology, findings, and reflections check out the complete article.
Creating effective student engagement in online courses: What do students find engaging? by Marcia D. Dixson. The author set out to identify the activities and forms of interaction that lead to highly engaged students, but instead found that there is no one answer, but rather a strategy of meaningful activities and a variety of interactions can lead to success. Of particular importance was finding ways to compel students to interact with the professor and each other. To learn about more ways to enhance the on-line learning environment contact Faculty Instructional Technology Services.
Showing posts with label Scholarship of Teaching and Learning. Show all posts
Showing posts with label Scholarship of Teaching and Learning. Show all posts
Tuesday, July 13, 2010
Wednesday, February 10, 2010
What Makes a Great Lecture? Use of Lectures in a Hybrid PBL Curriculum
Engaging students in a class session can be done in any number of ways, and lecture remains one of the most popular instructional strategies. Azer (2009) recognizes this, and offers ideas for how to maximize the effectiveness of lectures. While Azer focuses on lectures in the context of problem-based learning in medical courses, most of his recommendations can be applied to lecture in a range of disciplines.
Azer (2009) suggests that a great lecture should empower the audience and keep them focused; move the audience and make them more willing to learn more about the topics discussed; and provide new insights and stimulate thinking and analysis (p. 110).
This requires us to know something about our audience, including asking questions such as (Azer, 2009, p. 111):
Finally, Azer (2009) lists a few common mistakes that can spoil a lecture but are relatively easy to correct (p. 113):
Azer (2009) suggests that a great lecture should empower the audience and keep them focused; move the audience and make them more willing to learn more about the topics discussed; and provide new insights and stimulate thinking and analysis (p. 110).
This requires us to know something about our audience, including asking questions such as (Azer, 2009, p. 111):
- What do students already know about the subject?
- What other subjects have students learned and how does this relate to the current lecture?
- What examples will encourage deeper learning?
- How will the lecture differ from readings or other course materials?
- What stories or analogies will make the content more clear?
Finally, Azer (2009) lists a few common mistakes that can spoil a lecture but are relatively easy to correct (p. 113):
- Relying too heavily on Powerpoint slides or using too many of them
- Presenting only factual information
- Not assessing students’ previous knowledge
- Leaving out real world examples or applications
- Not leaving enough time for questions
- Engaging Students
- Getting to Know My Students
- Classroom Assessment Techniques
- Matching Learning Goals to Assignment Types
References
Azer S.A. (2009). What makes a great lecture? Use of lectures in a hybrid PBL curriculum. The Kaohsiung Journal of Medical Sciences, 25(3), 109-115.Wednesday, October 7, 2009
Teaching Experiential Learning: Adoption of an Innovative Course in an MBA Curriculum
In a recent study Li, Greenberg, & Nicholls (2007) evaluated the success of implementing experiential learning techniques in an MBA curriculum.
Researchers adopted Marketplace, software that could simulate companies from inception to maturity in a global market. Each week of the course simulated a business quarter, and students interacted with one another to make business decisions and to devise strategy. Instructors’ roles were adapted to this technique by assuming the “role of an arbitrator, such as the commissioner of the Federal Trade Commission (FTC) who handles complaints and claims” (Li et al., 2009, p. 26). Class materials were provided “in the form of industry newsletters, quarterly electronic presentations, advertising arbitration decisions, and their responses to teams’ inquiries” (Li et al., 2007, p. 28).
Evaluations of this technique were conducted by administering student questionnaires that analyzed their perception of this technique and compared their perceptions of this technique to traditional lectures. With a sample size of 588 graduate students, Li et al. (2007) found that student perceptions of the effectiveness of the technique in engagement, development of career skills, and improved competence were statistically significant (p. 31). Comparing this technique to traditional lectures, Li et al. (2007) found that 10 out of their 12 criteria including problem solving, thinking on your feet, and team work were significantly higher rated using the new experiential learning technique than traditional lectures (p. 31). Only two were not statistically significant- learning principles and concepts and using written communication.
These results give evidence towards the efficacy of using experiential learning in a course. If your learning goals are along the lines of engaging students in course concepts, improving team work, improving interpersonal skills, facilitating management skills, or examining diverse solutions, experiential learning is worth considering.
Researchers adopted Marketplace, software that could simulate companies from inception to maturity in a global market. Each week of the course simulated a business quarter, and students interacted with one another to make business decisions and to devise strategy. Instructors’ roles were adapted to this technique by assuming the “role of an arbitrator, such as the commissioner of the Federal Trade Commission (FTC) who handles complaints and claims” (Li et al., 2009, p. 26). Class materials were provided “in the form of industry newsletters, quarterly electronic presentations, advertising arbitration decisions, and their responses to teams’ inquiries” (Li et al., 2007, p. 28).
Evaluations of this technique were conducted by administering student questionnaires that analyzed their perception of this technique and compared their perceptions of this technique to traditional lectures. With a sample size of 588 graduate students, Li et al. (2007) found that student perceptions of the effectiveness of the technique in engagement, development of career skills, and improved competence were statistically significant (p. 31). Comparing this technique to traditional lectures, Li et al. (2007) found that 10 out of their 12 criteria including problem solving, thinking on your feet, and team work were significantly higher rated using the new experiential learning technique than traditional lectures (p. 31). Only two were not statistically significant- learning principles and concepts and using written communication.
These results give evidence towards the efficacy of using experiential learning in a course. If your learning goals are along the lines of engaging students in course concepts, improving team work, improving interpersonal skills, facilitating management skills, or examining diverse solutions, experiential learning is worth considering.
Further DePaul Resources
- Steans Center for Community-based Service Learning & Community Service Studies
- University Internship and Co-op Program
- Office for Teaching, Learning, and Assessment
References
Li, T., Greenberg, B. A., & Nicholls, J. A. F. (2007). Teaching Experiential Learning: Adoption of an Innovative Course in an MBA Marketing Curriculum. Journal of Marketing Education, 29(1), 25-33. Retrieved October 7, 2009, from ABI/INFORM Global. (Document ID: 1244131751).Tuesday, September 29, 2009
Using Online Concept Mapping with Peer Learning to Enhance Concept Application
In a recent study, Chang & Chang (2008) found that students in an online course who used concept maps as a learning strategy improved their ability to apply a theory to a real world scenario (2008).
Concept maps are diagrams that can be created using tools such as pen and paper, post it notes, or computer software. A concept map involves nodes that are linked together by relationships. Each node represents a concept such as "viral marketing," "Greek philosophy," or "energy conservation." Each relationship represents a relationship between two nodes such as "affects the population," "was influenced by," or "being developed by."
Concept maps were used in the experimenter's course that covered learning theory. They were implemented to help achieve the learning goal of organizing and giving structure to multiple theories of learning and how the theories related to scenarios that the students would face in future learning environments.
In this experiment, two conditions were formed, students who were required to use concept maps throughout the class and those who did not. The research team assessed student learning by grading assignments that demonstrated concept application in the learning theory domain; using a rubric following the categories of (Chang & Chang, 2005, p.20):
With that in mind, we provide some links to concept maps and examples of how they might be applied in a course.
List of concept mapping software from Penn State University
Concept Map Examples:
Concept maps are diagrams that can be created using tools such as pen and paper, post it notes, or computer software. A concept map involves nodes that are linked together by relationships. Each node represents a concept such as "viral marketing," "Greek philosophy," or "energy conservation." Each relationship represents a relationship between two nodes such as "affects the population," "was influenced by," or "being developed by."
Concept maps were used in the experimenter's course that covered learning theory. They were implemented to help achieve the learning goal of organizing and giving structure to multiple theories of learning and how the theories related to scenarios that the students would face in future learning environments.
In this experiment, two conditions were formed, students who were required to use concept maps throughout the class and those who did not. The research team assessed student learning by grading assignments that demonstrated concept application in the learning theory domain; using a rubric following the categories of (Chang & Chang, 2005, p.20):
- Instructional strategies were clearly described and appropriate for the given learners to achieve the learning goal
- The instructional strategies were consistent with the concepts of the given learning theory
- The rationale for using the instructional strategy was logical and consistent with theory
With that in mind, we provide some links to concept maps and examples of how they might be applied in a course.
Resources
How to make a concept mapList of concept mapping software from Penn State University
Concept Map Examples:
References
Chang, S., & Chang, Y. (2008, Spring2008). USING ONLINE CONCEPT MAPPING WITH PEER LEARNING TO ENHANCE CONCEPT APPLICATION. Quarterly Review of Distance Education, 9(1), 17-27. Retrieved September 29, 2009, from Professional Development Collection database.Thursday, September 10, 2009
Problem-based Learning in Quantitative Classes
Problem based learning (PBL) is a strategy that engages students by using current problems in the world in class assignments. This helps students become invested in course assignments and teaches them problem solving skills that are required of professionals.
In the spring 2009 issue of Academic Exchange Quarterly Blaylock and Kopf (2009) present an example of how we can implement PBL in our classroom.
In a quantitative analysis course, Blaylock and Kopf prompted their class with the following statement from the 2008 presidential campaign. In the statement, then presidential candidate Obama speaks on the energy savings and long term lowered fuel costs gained from proper tire inflation.
After viewing the statement as a class, they presented the overarching question in a manner that reached students on a personal level: “Will this part of Mr. Obama's energy plan cause the price you and I pay for gas to decline?”
After some initial discussion Blaylock and Kopf challenged students to defend their positions by asking, “How do you know?”
This lead into the larger assignment which asked students to consider:
Throughout this process Blaylock and Kopf supported students through short lectures and guidance to individual groups.
While many students felt that the practical application allowed students to better understand statistical concepts, some felt that the topic had already been over analyzed and their data was irrelevant. Overall, Blaylock and Kopf felt that PBL engaged students in the course material at a much deeper level than if they had simply used text book examples.
Blaylock, B. K., & Kopf, J. M. (2009). Problem-Based Learning in Quantitative Classes. Academic Exchange Quarterly, 13(1). Retrieved September 10, 2009, from http://www.rapidintellect.com/AEQweb/cho4258w9.htm.
In the spring 2009 issue of Academic Exchange Quarterly Blaylock and Kopf (2009) present an example of how we can implement PBL in our classroom.
In a quantitative analysis course, Blaylock and Kopf prompted their class with the following statement from the 2008 presidential campaign. In the statement, then presidential candidate Obama speaks on the energy savings and long term lowered fuel costs gained from proper tire inflation.
After viewing the statement as a class, they presented the overarching question in a manner that reached students on a personal level: “Will this part of Mr. Obama's energy plan cause the price you and I pay for gas to decline?”
After some initial discussion Blaylock and Kopf challenged students to defend their positions by asking, “How do you know?”
This lead into the larger assignment which asked students to consider:
- What information do you need to know to evaluate the accuracy of Mr. Obama's statement?
- What primary or secondary data support your claims?
- How can you use the data to support your claims?
Throughout this process Blaylock and Kopf supported students through short lectures and guidance to individual groups.
While many students felt that the practical application allowed students to better understand statistical concepts, some felt that the topic had already been over analyzed and their data was irrelevant. Overall, Blaylock and Kopf felt that PBL engaged students in the course material at a much deeper level than if they had simply used text book examples.
References
Blaylock, B. K., & Kopf, J. M. (2009). Problem-Based Learning in Quantitative Classes. Academic Exchange Quarterly, 13(1). Retrieved September 10, 2009, from http://www.rapidintellect.com/AEQweb/cho4258w9.htm.
Friday, August 21, 2009
Factors Contributing to Improved Teaching Performance
In a recent article published (DePaul Library - Requires CampusConnect) in Innovative Higher Education McGowan and Graham (2009) reported on teaching surveys from 203 faculty at Brigham Young University. These faculty were selected for improvement on their student ratings over the past three years.
While the this research was conducted at one University, many of the findings and concepts can be universally applied. Indeed, many of the factors, including active learning techniques, defining learning outcomes, and personalism are advocated for in some of the most well known literature on college teaching including McKeachie's McKeachie's Teaching Tips and Fink's Creating Significant Learning Experiences. Both of these books can be found in the Office for Teaching, Learning and Assessment library.
Conducted by the University’s Center for Teaching and Learning, the researchers were interested in finding out what factors led to improved teaching performance. The team analyzed the teaching surveys and conducted follow up interviews with 27 faculty from 10 of the 12 colleges at BYU. They reported 3 factors that contributed to improved teaching performance:
- Active/practical learning
- Frequent in class discussions
- Real world experience/practical applications of course content
- Clear expectations/learning outcomes
- Focus on defined learning outcomes
- Emphasis on learning outcomes when giving feedback
- Teacher/student interactions
- Demonstrating interest in students’ lives
- Learning students’ names
- Online student rating scores
- Mid term surveys and exit interviews
- Lack of excitement in class
- Personal desire
- Teaching support
- Teaching material
While the this research was conducted at one University, many of the findings and concepts can be universally applied. Indeed, many of the factors, including active learning techniques, defining learning outcomes, and personalism are advocated for in some of the most well known literature on college teaching including McKeachie's McKeachie's Teaching Tips and Fink's Creating Significant Learning Experiences. Both of these books can be found in the Office for Teaching, Learning and Assessment library.
References
McGowan, W., & Graham, C. (2009, December). Factors Contributing to Improved Teaching Performance. Innovative Higher Education, 34(3), 161-171. Retrieved August 21, 2009, doi:10.1007/s10755-009-9103-6
Monday, May 18, 2009
Team-based Learning
A couple of weeks ago the New York Times posted a special report on a team-based learning program at Duke-N.U.S. Graduate Medical School in Singapore.
To learn more about Team-based learning and about how to design a course with TBL in mind, visit the course design guide at the University of British Columbia.
References:
Michaelsen A. L., Knight A.B., Fink, L.D. (Eds.). (2004). Team-Based Learning: A Transformative Use of Small Groups. Sterling, VA: Stylus Publishing.
What is team-based learning (TBL)? Michaelsen, Knight, and Fink (2004) define TBL as "a particular instructional strategy, not a series of independent small-group activities ... team-based learning revolves around the development of teams, a kind of social unit that is quite distinct from groups" (p. 8). Typically a team-based learning course is restructured into units that involve three phases:
1. Preparation in which all readings are completed and pre-requisite knowledge is
attained
2. Application in which content is used to solve common problems
3. Assessment phase in which a final problem is given to solve as a team
(Michaelsen et al., p. 9-11)
Duke-N.U.S. is employing TBL to give students increased guided hands-on time in the classroom. They use pre-recorded lectures to impart knowledge about course concepts and class time to develop a deeper understanding and knowledge of the concepts.
A discussion of where the program is going and ongoing research they are conducting was posted by Dr. Sandy Cook, Associate Dean of the Duke-N.U.S. Graduate Medical School Singapore from the TEAMLEARNING archives.
To learn more about Team-based learning and about how to design a course with TBL in mind, visit the course design guide at the University of British Columbia.
References:
Michaelsen A. L., Knight A.B., Fink, L.D. (Eds.). (2004). Team-Based Learning: A Transformative Use of Small Groups. Sterling, VA: Stylus Publishing.
Wednesday, April 1, 2009
Do Quizzes Matter?
As reported in the Chronicle of Higher Education, several recent studies confirmed that frequently quizzing students on reading material helps them retain what they have learned.
One study, published in Psychological Science, was based on two experiments in which students read passages on scientific topics. In the first experiment, students were assigned to one of two groups. Students in the first group took a test on the material, those in the second group re-read it, then both groups took a test five minutes, two days or one week later. In the second experiment, students read the material and then either (a) took three tests, (b) re-read the material three times and took one test, or (c) read the material four times.
The study's authors found that the students who were directed to review the material reported greater confidence in their ability to remember the material (and, indeed, they performed better on the retention test given five minutes later). However, on the tests taken days later, "prior testing produced substantially greater retention than studying."
Glenn, David. (2007, June 8). You will be tested on this.
The Chronicle of Higher Education
-DPU-
Roediger III, H.L., & Karpicke, J.D. (2006). Test-enhanced learning
Psychological Science, 17 (3), 249-255. -DPU-
Tests and quizzes: strategies and resources
Giving quizzes with clickers
Give quizzes or tests online
One study, published in Psychological Science, was based on two experiments in which students read passages on scientific topics. In the first experiment, students were assigned to one of two groups. Students in the first group took a test on the material, those in the second group re-read it, then both groups took a test five minutes, two days or one week later. In the second experiment, students read the material and then either (a) took three tests, (b) re-read the material three times and took one test, or (c) read the material four times.
The study's authors found that the students who were directed to review the material reported greater confidence in their ability to remember the material (and, indeed, they performed better on the retention test given five minutes later). However, on the tests taken days later, "prior testing produced substantially greater retention than studying."
References
Glenn, David. (2007, June 8). You will be tested on this.
The Chronicle of Higher Education
-DPU-
Roediger III, H.L., & Karpicke, J.D. (2006). Test-enhanced learning
Psychological Science, 17 (3), 249-255. -DPU-
Related Links
Tests and quizzes: strategies and resources
Giving quizzes with clickers
Give quizzes or tests online
The Benefits of Peer Instruction
When working in groups, do discussions help students gain a better understanding of the material, or do students typically give in to the group consensus or the dominant voice? Early indications from a recent report in Science suggest that students working in groups do tend to improve their conceptual understanding, rather than merely agreeing with another student's answer.
In their study of students taking introductory genetics at the University of Colorado at Boulder, faculty used feedback from clickers to measure student performance on a series of questions. First a conceptual question is posed to the class, next the same question is asked but after peer discussion, and finally a third question, different in content, but requiring the application of the same principles required to solve the first question. As expected, students tended to answer more questions correct when working with the aid of a group, however a welcome surprise was that "students who answered both question 1 and question 1 (after discussion) incorrectly still appeared to learn from discussions with peers ... Of these students 44% answered question 2 correctly, significantly better than expected from random guessing." (Smith, M.K. et al., 2009, p. 123) These results help support the theory that students engaged in discussion gain a stronger conceptual understanding of the course content.
Read more from Inside Higher ED.
Lederman, Doug. (2009, January 5). Proving the Benefits of Peer Instruction. Inside Higher Ed.
Smith, M.K., Wood, W.B., Adams, W.K., Wieman, C., Knight, J.K., Guild, N., Su, T.T., (2009, January). Why Peer Discussion Improves Student Performance on In-Class Concept Questions. Science. 323(5910), 122-124. DOI: 10.1126/science.1165919
Collaborative learning techniques by the Teaching Commons.
Using clickers for peer instruction by the Teaching Commons.
In their study of students taking introductory genetics at the University of Colorado at Boulder, faculty used feedback from clickers to measure student performance on a series of questions. First a conceptual question is posed to the class, next the same question is asked but after peer discussion, and finally a third question, different in content, but requiring the application of the same principles required to solve the first question. As expected, students tended to answer more questions correct when working with the aid of a group, however a welcome surprise was that "students who answered both question 1 and question 1 (after discussion) incorrectly still appeared to learn from discussions with peers ... Of these students 44% answered question 2 correctly, significantly better than expected from random guessing." (Smith, M.K. et al., 2009, p. 123) These results help support the theory that students engaged in discussion gain a stronger conceptual understanding of the course content.
Read more from Inside Higher ED.
References
Lederman, Doug. (2009, January 5). Proving the Benefits of Peer Instruction. Inside Higher Ed.
Smith, M.K., Wood, W.B., Adams, W.K., Wieman, C., Knight, J.K., Guild, N., Su, T.T., (2009, January). Why Peer Discussion Improves Student Performance on In-Class Concept Questions. Science. 323(5910), 122-124. DOI: 10.1126/science.1165919
Related Links
Collaborative learning techniques by the Teaching Commons.
Using clickers for peer instruction by the Teaching Commons.
Subscribe to:
Posts (Atom)