Pages

Using ChatGPT to Write Quiz Questions

/in /by

Using ChatGPT to Write Quiz Questions

The following are notes from OTL’s session for the AI in Action series.

Mark Kaysar and Agustin Ríos used AI to create quiz questions with different question types. They also prompted ChatGPT to properly format a quiz for uploading into Bruin Learn.

Can ChatGPT help faculty create and format low stakes assessments for using in Canvas?

Demo Question Generation

  • Question Types
  • Multiple Choice
  • True/False
  • Fill in the blank
  • Short Answer
  • Short Essay
  • Adding feedback to answers

Quiz Formatting

When working in ChatGPT, if you include the format instructions shown below you will receive questions that are ready for upload to Canvas. ChatGPT will usually respond in the format you tell it to use, but if it does not, resubmit and ask it to reformat.

Please create all quiz questions using the following format. Each choice needs to start with a lower case alphabet, 
a, b, c, d, etc. with a close parenthesis. The correct choice is designated with an asterisk.

1. What is 2+3?
a) 6
b) 1
*c) 5
d) 10

Sample ChatGPT Prompts

Provide a topic

Can you write some multiple choice questions about [Insert topic]?

Provide a link to a reading

Please write multiple choice questions to evaluate this content.
[paste content]

1.2 The Weakness of Early Patent Systems - Introduction to Intellectual Property | OpenStax

Provide a link to a Canvas page

Please write multiple choice questions to evaluate this content.

Can you provide feedback on why the incorrect items are incorrect?
[paste content]

https://canvas.ucdavis.edu/courses/34528/pages/being-present-in-your-online-course

Provide a desired outcome

Please write multiple choice questions that evaluate this outcome [paste outcome]

Analyze how the costume designer’s interpretation of the screenplay is affected by the 
tone of the politics of the era and the pressures from the studio

Provide a video script or video captions

Please write multiple choice questions to evaluate this content.

[paste content]

Provide a set of answers

Please write multiple choice questions that have the following as answers.

[paste answers]

Provide similar questions to use as a model

Please write multiple choice questions that evaluate the same content as this question.

[paste question]

Uploading to Canvas

Before you can upload the quiz into Canvas, you need to save the questions in the QTI file type.

Step one

Step two

This will create a quiz with your new questions.

See also the original session document.

Using ChatGPT in Conversations with IDs

/in /by

Using ChatGPT to Lead In-depth Conversations with Instructional Designers

The following are notes from OTL’s session for the AI in Action series.

Sirui Wang and Brittany Goodwell explored possible ways to use ChatGPT to start thinking about different teaching and learning challenges using two scenarios to begin instructional design conversations between faculty and instructional designers. Both scenarios included questions and requests often asked by faculty. There were opportunities to interact with ChatGPT and instructional designers.

How can ChatGPT be involved in the course design process?

  • ChatGPT integrates related information and output in a well-structured way. The advantage of using this generative AI enhances the consultation process with higher efficiency.
  • The conservation style allows the information to be built upon one another, forming a useful dialogue designers can share later.
  • Using ChatGPT in the initiative process of an instructional design consultation helps focus on what faculty needs and narrow the topics, making the discussion with instructional designers more efficient and allowing in-depth discussion.

However, what ChatGPT provides is usually very surface and general, and instructional designers must step in and continue the in-depth conversation.

Instructional Designers’ Roles in the AI Age

  • In-depth conversation
  • Connect with the real course design
  • Ensure equity and inclusion
  • Create personalized learning experiences that adapt to the needs of individual learners
  • Incorporate gamification and simulations to make learning more interactive and engaging
  • Share experience

Scenario 1 – Identify the Teaching and Learning Challenges

ChatGPT Screenshot 1: Engaging students more effectively

How to use ChatGPT to begin the conversation?

  • Start with the basic question/challenge
  • Go through the options, and see if there is anything that interests you
  • Ask for or think of more specific questions, such as #5, why frequent feedback will engage students more efficiently, how to provide frequent feedback, what types of feedback can be provided, etc.

But ChatGPT does not have the accurate context for what it outputs, so a continued conversation with instructional designers are strongly encouraged.

How to continue the topic with an Instructional Designer?

  • Discuss and continue the specific questions: Why feedback loop is important, especially online? What feedback loops can and will include?
  • Clarify the focus: what could be a good fit for your class? How do involve the three parties in a class: instructor, TAs, and students?
  • The deeper conversations: how does it align with other class pieces?
  • Access to other successful course design experiences from different courses

Scenario 2 – Educational Technology Recommendations

Screenshot 2: ChatGPT advice on good class technologies
Screenshot 3: Refining ChatGPT session

How to continue the topic with an Instructional Designer?

  1. Review and refine the recommendations: The faculty member could work with the instructional designer to review the recommendations generated by ChatGPT and refine them based on their specific course needs. The instructional designer could help the faculty member evaluate the options based on factors such as ease of use, accessibility, cost, and pedagogical value.
  2. Identify and address potential challenges: The faculty member and instructional designer could discuss potential challenges that may arise from implementing the selected educational technology in their course. This could include issues related to technology integration, student engagement, and support for students who may have varying levels of technological proficiency.
  3. Explore implementation strategies: The faculty member and instructional designer could work together to explore implementation strategies for the educational technology recommendations.
  4. Determine next steps: The faculty member and instructional designer could determine next steps for moving forward with the implementation of the selected educational technology. This could include identifying any additional support or resources needed, setting timelines for implementation, and designing appropriate activities.

See also the original session document.

AI in Action – Course Design Opportunities with AI

/in /by

Course Design Opportunities with AI

On May 16, 2023, as part of the campus series, “AI in Action: Exploring AI’s Potential in Teaching and Learning,” OTL instructional designers worked with over 30 participants across three breakout rooms to explore ways that AI can be used to enhance teaching and learning.

  • Using ChatGPT to Lead In-depth Conversations with Instructional Designers: Sirui Wang and Brittany Goodwell explored possible ways to use ChatGPT to start thinking about different teaching and learning challenges using two scenarios to begin instructional design conversations between faculty and instructional designers. Both scenarios included questions and requests often asked by faculty. There were opportunities to interact with ChatGPT and instructional designers.
  • Using ChatGPT to Write Quiz Questions: Mark Kaysar and Agustin Ríos used AI to create quiz questions with different question types. They also prompted ChatGPT to properly format a quiz for uploading into Bruin Learn.
  • Syllabus Refresh Using Prompt Engineering in ChatGPT: Kim DeBacco and Kate Schaller worked with faculty to generate and regenerate a course syllabus. Together they investigated prompt engineering to iteratively refine their choices.

ID Showcase – Using Slack in Education

/in /by

Using Slack to Build an Equitable and Diverse Learning Community in Education

In this showcase, Prof. Glory Tobiason will demonstrate how she uses Slack in undergraduate courses to engage and welcome students, streamline communication, and conduct formative assessments.

Slack is a UCLA-approved app that facilitates communication and collaboration in a variety of contexts: project teams, administrative units, research groups, etc.

The showcase is organized like a “tasting menu” of several possible pedagogical uses of Slack, including:

  • Community building
  • Shared course FAQs
  • TA communication
  • Making students’ thinking accessible to their peers
  • “Slack Hands,” a strategy for more inclusive participation
  • Collaborative study guide for quizzes

Presenter Bio

Prof. Glory Tobiason is clinical faculty in the Education Department (where she teaches undergraduate and graduate courses in research methods) and a Research Scientist at the Center for Research on Evaluation, Standards, and Student Testing (CRESST). She also co-leads the Holistic Evaluation of Teaching initiative at UCLA. The goal of her research and faculty-engagement work is to understand and support the work of teachers.

ID Showcase – SCAND 60 – Introduction to Nordic Cinema

/in /by

Scandinavian Studies 60 – Introduction to Nordic Cinema

SCAND 60 course screenshot

In this course showcase, Prof. Patrick Wen will share his experience designing a fully asynchronous online course on Nordic cinema based on earlier experiences teaching similar courses in person. The aims of the in-person and online courses remain the same: to offer undergraduates a broad introduction to a lesser-known cinematic tradition while also engaging them in critical thinking and writing.

Topics to be covered include:

  • Employing various pedagogical strategies, such as podcasting, peer review, and blogging, to foster student engagement and build a vibrant learning community.
  • Encouraging students to have informal discussions through podcast activities to increase their engagement and interaction.
  • Effectively managing asynchronous student schedules.
  • Utilizing Bruin Learn to facilitate a successful transition from in-person to asynchronous learning in the Introduction to Nordic Cinema course.

Presenter Bio

Prof. Patrick Wen is a continuing lecturer in Scandinavian within the Department of European Languages and Transcultural Studies. He teaches courses on film history, modern literature, and also Norwegian language.

Selected Q&A from the Showcase


QuestionAnswer
Given that the films aren’t screened live, do you find that the students do other things to create community when screening them for themselves (chatting, watching over Zoom, etc.)?Students did organize/gather informally to watch together in person and virtually.
How do you grade the peer reviewed blog postings?Canvas has some quirks to assign points. The instructor created a separate assignment to give points.
How often did you or the TAs respond to the students posts or submissions?For a roughly 60-person class, every week TA or instructor responded to individual responses (not a general post to all). The instructor enjoyed responding to students and got “sucked in.”
Are the responses to the blog posts from peers expected to be done within a certain time frame? Or at any time? If a student did not complete the peer review/response, how was that handled?For asynchronous work, it was important to keep students on the same page re: submissions. (Some wanted to do things early, others wanted to wait right up til the deadline.) This created a peer review issue because if a student posts early, they have to wait for other students to post to complete their peer review.

The instructor set expectations about what students could do in advance, but for back-and-forth type of activities–like blog posts–students need to complete tasks more “at deadline.”

This was a learning curve!

Were rubrics used for podcasts/blog posts?A rubric was used for the blog post/podcast (3 points total), as well as for the peer review portion of the blog post assignment (2 points total). The instructor explained this as a two-part assignment.
Did you use the podcast feature in Bruin Learn discussions for the Week 5 Podcast Postings? (And….how does that work? I’ve never known…)Students either recorded on Zoom or just created an audio file. The instructor provided instructions on how to do this. It was simple because students had already been using the discussion boards in Canvas.
Was there some buildup or scaffolding done for the podcasts? Creating an outline or talking points?The students were given prompts, pretty similar to the ones for the blog postings – but more designed for conversation (between two students).
Can you talk a little bit about students’ choices for the projects – how many of them chose a paper vs. a group video assignment? And what kinds of video assignments did they create?Video assignments took different forms depending on prompts chosen. Often they were borne of blog postings – that got them thinking about something that they wanted to fully develop in a longer project. Often the videos were powerpoint-style presentations that they may have written about. In group video projects, they were interacting, but in a more formal way than in the podcast – a thesis, evidence, etc.
What do you see as next steps or enhancements for the course?Changing up the syllabus, but keeping the podcast/video presentation options open for the students. How can more of this be incorporated, is a question. Also, thinking about adding more informal conversations, like Patrick’s informal conversation with a colleague working on a book about Ingmar Bergman. (Not long – but this would bring in other voices)
What is the demographic of the course – do they already have film studies/Scandinavian studies knowledge going in?For the most part, the students don’t have knowledge of Scandinavian studies going in (readings are in English, films subtitled). Some students do have this knowledge/background, so it’s a nice mix. Tendency towards older students (fourth years) taking and appreciating the course! Maybe this is specifically because it’s an online class and that’s what this group wants.
How do you think the quality of the blog writing compares to the written papers?More polished than expected. Peer reviews in particular felt like a conversation.
Do you know if students ever continue blogging after your class?A few students in particular – avid film buffs! Some continue other forms of film writing, not necessarily blogging.
Is there a difference between blogging on Bruin Learn and blogging on WordPress (for example)?Technical differences yes – WordPress/others are third party sites and students will need to create logons for them. (They are also public, which can be an issue for students.) They may afford more for creativity/incorporating media, but using BL Discussions keeps everything in Bruin Learn (and you can still add images, videos, links).
Do you think the sporadic grading positively contributed to increased instructor/social presence?Aim – students should feel like the TA and the instructor were both engaged. Responding to the posts (not necessarily on time) should impart that he was engaging with the students, reading what they were writing. He does think this was a positive thing!

This Google Doc contains the comments, questions and answers collected during the showcase.

ID Showcase – ISLM ST M20 – Introduction to Islam

/in /by

Islamic Studies M20 – Introduction to Islam

This showcase demonstrates how the instructor and TAs have applied different design approaches to build the Introduction to Islam course in Bruin Learn and use educational technology tools to bring an immersive learning environment to students to discuss and reflect on Islam’s history and contemporary practices through visuals and social annotation. By creating several interactive activities in Canvas/Bruin Learn, the instructor and TAs encouraged student participation and highlighted key passages to focus students’ attention for discussion and reflection.

In this course showcase session, the instructor will share his experience of using a variety of design approaches and educational technologies, such as Bruin Learn and Perusall, to create an immersive learning environment for students to discuss and reflect on Islam’s history and contemporary practices. Highlights from the session include but not limited to:

  • Use of Perusall for: 
    • Low-stake reading assignments to encourage students’ participation
    • Highlighting key passages to focus student attention for discussion and reflection
  • Interactive activities through Canvas discussion boards and quizzes to complement lectures
    • Use of media, includes audio and images to create immersive learning experience of Islams’s history and contemporary practices
  • Creation of a user-friendly homepage and modules structure to guide students

Presenter Bio:

Dr. Mohsin Ali is a lecturer for the Global Islam Writing Cluster and an instructional designer for the UCLA Library. He completed his PhD in Islamic Studies at UCLA in September 2022 and wrote about modern changes in historical writing among Muslim scholars in India writing in Arabic and Urdu. While a graduate student in the Near Eastern Languages and Cultures (NELC) Department, he helped transform Professor Asma Sayeed’s Introduction to Islam course into an online course. He also served as an instructional technology assistant for NELC while it transitioned from CCLE to Bruin Learn. 

Presented: Thursday, March 9, 2023

ID Showcase – Nursing 171 – Public Health Nursing

/in /by

Nursing 171 – Public Health Nursing

Nursing 171 – Public Health Nursing is designed and taught by Prof. Dorothy Wiley.

This showcase demonstrates how Prof. Wiley uses several features and tools in Bruin Learn and digital portfolios in support of the competency-based curriculum design in this hybrid Nursing course. Prof. Wiley uses Modules in Bruin Learn to support course content organization, which helps students easily recognize their learning path. The emerging technology of Learning Glass adopted by Prof. Wiley produces high-quality instructional videos and lectures to encourage student engagement with learning materials. Prof. Wiley also experiments with the approach of learning pods and the digital portfolio to allow students collaboratively document and contribute to where they can apply what they learned from the class to the local community.

N171 has experimented with several educational technologies and applied different pedagogical strategies to increase student engagement. In this presentation, the instructor will share their experiences with the following aspects:

  • Using Modules in Bruin Learn to organize content for this hybrid course
  • Using Learning Glass to pre-record lectures
  • Creating and redesigning several learning activities to support competency-based learning
  • Using different educational technologies to help students build their learning portfolio and encourage collaboration across projects

Faculty Bio

Dorothy Wiley, a professor with the UCLA School of Nursing, has clinical expertise in community and public health prevention strategies, including the sexually transmitted diseases HIV and HPV. She led UCLA’s randomized clinical trial study site that contributed to the first HPV vaccine approved for use in the U.S. Her areas of scholarly expertise and interest include sexuality, sexually-transmitted diseases, including HIV and HPV infection; cancer screening, cancer prevention, vaccine efficacy, molecular biomarkers for acute and chronic infections and infection clearance.

Presented: Thursday, Nov 16, 2022

Selected Q&A from the Showcase


QuestionResponse
Can you share more about their Padlet experience? What would be the difference between using Bruin Learn Discussion and Padlet?Dr. Wiley uses both Discussions in BL and Padlet! Uses Discussions in BL for students to post and then comment on short essays, for instance. Big focus on reflection – proven to help nurses learn. Padlet is mainly used for icebreaking. GoReact is another tool being used in different courses.
Does “doodle-y” just draw lecture content you submit?It provides you with the images. You then voice-over them; there is a music feature that you can pay for. You submit the text and the hand draws over them.
Do these additional programs (Doodle-y, Padlet, etc.) incur additional costs?Yes – Prof. Wiley purchased these (at least Doodley) with her own funds. Padlet has a fee too. She also purchased a Wacom tablet to help with tracing, sketching, and drawing.
Did you have to re-record any (or many) of your own videos since 2020?Yes, and used different media/recording methods for videos and lectures. Learning Glass is one tool for re-recording lecture content and key concepts.
What are some differences between the Learning Glass recordings than recording through Zoom and making them available from Kaltura?Learning Glass captures the attention of students, universally. The Learning Glass is a see-through screen that allows you to draw or write on a “board” while directly facing the students. UCLA has a couple on campus and you can go and film with one (a video recording in a studio – free to you), and then it is uploaded to Kaltura.

A tip on using the Learning Glass: Make sure you have fresh pens! It is awful to draw and record with weak pens and realize later they do not display well; you have to re-record the segment.

But yes it is different from recording in Zoom at home. There are many many video options!

OTL can help faculty use Learning Glass and other media. Please see: OTL Media Production.

You mentioned that some students navigated directly to assignments and skipped over other course content. Have you considered hiding the Assignments section and only use Modules? Is this is too limiting, or more streamlined?Yes, Prof. Wiley tried to hide Assignments, but there were some issues of navigation. Work with OTL and the Bruin Learn team to discuss possible options.
What are some considerations with gamification?Prof. Wiley suggests working with OTL instructional designers to understand the ramification of class size, such as what you might do differently with 7 students compared to 40 students.

This Google Doc contains the comments, questions and answers collected during the showcase.

ID Showcase – Liberating Structure: Scaffolding Digital Project Integration with Bruin Learn

/in /by

Liberating Structure: Scaffolding Digital Project Integration with Bruin Learn

The presenters shared the experience of course development and re-design that includes curated content collections, methods of inquiry, and digital project work, using an innovative curriculum template in Bruin Learn.

This Liberating Structure showcase session is presented by Prof. Chien-Ling Liu Zeleny, and Instructional Designers, Christopher Gilman from UCLA Library and Greg Steinke from Center of Excellence.

Presented: Thursday, June 2, 2022

ID Showcase – GERMAN 1 – Elementary German

/in /by

German 1 – Elementary German

Screenshot of German 1

German 1 is designed and taught by Prof. Magdalena Tarnawska Senel

This showcase demonstrates how Prof. Senel has successfully applied Universal Design for Learning (UDL) principles in her course design, including creating several student “Action & Expression” activities in Bruin Learn.

Prof. Senel shared how she used Discussion Forums and Assignment tools to allow students to deeply interact with course content and actively collaborate with each other. She also used the Quiz survey to have students provide confidential feedback about their learning experience.

Presented: Thursday, August 4, 2022

ID Showcase – Leganto – Course Reading List

/in /by

Leganto – Course Reading List


The Leganto showcase session is presented by Michelle Brasseur, who is the contact person for the UCLA Library for Leganto/Course Reading List in Bruin Learn. Course Reading List allows UCLA instructors to incorporate up-to-date links to Library resources and easily compile other freely available online resources into their courses in Bruin Learn.
Resources shared by presenters:
Leganto guide provided by UCLA Library: https://guides.library.ucla.edu/leganto
Presenter: Wednesday, September 7, 2022

Events

Nothing Found

Sorry, no posts matched your criteria