Events

Nothing Found

Sorry, no posts matched your criteria

Pages

ID Showcase – Honors 37W and ChatGPT

/in /by

A ChatGPT Experiment in Honors 37W

This showcase is an extension of an earlier talk Laurel Westrup gave as part of the Spring 2023 “AI in Action” event. It will focus on a specific use of ChatGPT in a Spring 2023 Honors Collegium Writing II course, “Sampling and Remix: The Aesthetics and Politics of Cultural Appropriation.”

Honors 37W, which focuses on cultural borrowing of many kinds, was an apt forum for discussion of generative artificial intelligence (Gen-AI) and large language models (LLMs) that draw on borrowed sources in order to create text. The instructor re-designed a staple course assignment to provide students an opportunity to try out and reflect on co-writing with a chatbot. The showcase will:

  • Provide context and a rationale for this particular use of ChatGPT
  • Discuss the assignment design
  • Review student responses to the assignment
  • Offer some thoughts on integrating ChatGPT into our courses based on this experiment 

Presenter Bio

Laurel Westrup is a Continuing Lecturer with Writing Programs and the Honors Program and the Coordinator of the Graduate Certificate in Writing Pedagogy (GCWP). She teaches courses across Writing Programs’ curriculum, from first-year composition and Writing II to upper division courses in the Professional Writing Minor, and she also teaches graduate pedagogy courses with the GCWP. She received a UCLA Distinguished Teaching Award in 2023.

ID Showcase – English Composition 2

/in /by

English Composition 2 – Approaches to University Writing | Meta-Narrative and the Narrative Self

ENGComp2 Homepage

In this course showcase session, Shane Crosby will share his experiences, the pros and cons, of using a variety of Bruin Learn tools to actively engage undergraduate students in the content of a first-year composition course.

This showcase demonstrates how the instructor uses Bruin Learn to actively engage undergraduate students in a first-year composition course. Several essential Bruin Learn tools and features, such as homepage, modules, assignments, and gradebook, are discussed. The exploration of different tool settings throughout the course design process with the support of the Bruin Learn Center of Excellence is shared.

The tools reviewed include:

  • Home Page
    • Attendance, ebook integration, syllabi, course notification settings
    • eBook integration: They Say, I Say: The Moves That Matter in Academic Writing
  • Modules
    • Organization
    • The “getting started” / Course Resource module
    • Lock Until | prerequisites | requirements
    • New feature: dropdown arrow options
    • Creating all assignments from within the Modules(?)
  • Assignments
    • Creating grading rules
  • Grades / Gradebook Settings
    • When to make it available, pros and cons, likes and dislikes
    • Late submission policy considerations
    • Grade posting considerations
    • Advanced feature settings

Presenter Bio

Shane Crosby is a Continuing Lecturer in Writing Programs at UCLA. He completed his BA at UCLA, MA in Special Education at Clark Atlanta University, PhD in Special Education at Georgia State University, and his MFA degree at UC Irvine.

This ID Showcase is a collaboration between the UCLA Teaching and Learning Center and the Bruin Learn Center of Excellence.

AI Resources for Learning Design

/in /by

AI Resources for Learning Design

Sample syllabi + syllabus formats and sections

Syllabus Statements on the Use of AI in Courses

AI for Assignment & Learning Design

  • Stanford University. Curricular Resources About AI for Teaching (CRAFT)
  • Trust, T. (2023). Chat GPT & Education, UMass (Amherst); including:
    • What ChatGPT Can Do, pp. 18-39;
    • What Chat GPT Can’t Do (Yet), pp. 40-42.
  • UNESCO. (2023). Chat GPT and AI in Higher Education: Quick Start Guide. See the table on page 9.
  • Watkins, R. Update Your Course Syllabus for ChatGPT – GWU
  • Young J. (2023). Why I’m Excited About ChatGPT: Here are 10 ways ChatGPT will be a boon to first-year writing instruction, Jennie Young writes.
  • Kim DeBacco’s (untested) assignment idea:
    • Ask your students to input into ChatGPT the assignment prompt (eg. compare and contrast 2 films on the same topic).
    • They must then analyze what Chat GPT generates first time round: what it got right, wrong, what’s missing, what’s not emphasized that should have been, and perhaps more, depending on the original prompt and your imagination – or indeed the conceptual demands of the course!
    • Ask the students to submit the initial AI-generated raw version to you, along with their critical analysis of the AI-generated piece in light of the other course-related material (eg. films or readings) you were asking them to compare & contrast, or analyze.

The World of AI Tools

Using ChatGPT for Syllabus Refresh

/in /by

Syllabus Refresh – Prompt Engineering for ChatGPT

The following are notes from OTL’s session for the AI in Action series.

Kim DeBacco and Kate Schaller worked with faculty to generate and regenerate a course syllabus. Together they investigated prompt engineering to iteratively refine their choices.

Session materials:

Ask Chat GPT to create a syllabus

Initial prompt:

Design a syllabus for an introductory, undergraduate-level university course about "The Psychology of Aging".

Sample refining prompt:

Regenerate this syllabus to include the following syllabus sections:

Course title: “The Psychology of Aging” (PSY136) 
Instructor Information: Kim DeBacco, PhD; kdebacco@online.ucla.edu
TA Information: Qiwen Moore, David Christomakis. 
Contact Information: tba
Course Prerequisites: PSY124
Course Description:
Learning Outcomes for this Course:
Course Materials:
Technical Requirements (Bruin Learn, browsers etc.)
How to Succeed in this Course (Expectations for Students, Study Advice & Tips)
Creating an Inclusive Classroom Community (Instructor, TA, and Community Expectations)
Course Schedule (Dates & Topics, Readings)
Predictable Weekly Pattern (for Students)
How Your Learning Will Be Assessed (Grading Policy)
Information about the Course Assignments
Link to the Quarter dates in the UCLA Academic calendar 
The class dates and times: Tuesday 10am - 12noon; Thursdays 10am - 12 noon
Link to UCLA resources for Student Well-being
Link to UCLA Policy on Academic Integrity

Model the prompt by inputting two or three past syllabi:

Integrate information, readings and topics from this syllabus. Do not include the dates.

NOTE: The example syllabi were freely provided, and previously downloaded from merlot.org

Additional Refining Steps

Provide a list of readings with links; link to a textbook, etc.

Add your lists of readings – Required/Essential, Recommended, etc.

Integrate these readings into the syllabus schedule:

Park, D.C., K. Warner Schaie, K. Schaie, S. L. Willis, S. Willis. Handbook of the Psychology of Aging. 7th edition.

Provide a focused, scripted course description, to narrow and specify content.

Regenerate the syllabus to reflect this description: [your course description goes here]

Read closely and correct!

  • Add your emphases, your voice and values, special sections, and more.
  • Consider sharing your syllabus with a colleague for feedback.

Solicit student feedback

After the quarter is over, ask (some of) your students to give you annotated feedback on your syllabus. Ask them to add comments all over it:

  • what worked well;
  • what advice would they give future students;
  • what would they change;
  • which readings and media made sense;
  • which readings were tough but worthwhile;

and so on…

See also the original session document.

ChatGPT-Generated Quiz Instructions

/in /by

Advice from ChatGPT on how to best use ChatGPT to create quiz questions

Instructions Generated by AI

Here are some instructions for college instructors to use ChatGPT to author low stakes quizzes. By following these steps, you can use ChatGPT to create low-stakes quizzes that assess your students’ knowledge and understanding of course concepts.

Identify the Topic

Decide on the topic for the quiz. This could be a specific concept or a broad subject area.

Determine the Learning Objectives

Identify the learning objectives you want your students to achieve through the quiz. These objectives should be specific, measurable, achievable, relevant, and time-bound (SMART).

Choose the Quiz Type

Determine the type of quiz you want to create. This could be a multiple-choice, true/false, or short answer quiz.

Provide ChatGPT with the Question

Use ChatGPT to generate questions related to the learning objectives and the chosen quiz type. You can provide ChatGPT with a prompt, such as “Please generate five multiple-choice questions about the topic of X,” and it will provide you with questions to choose from.

Review and Edit Questions

Review the questions generated by ChatGPT and edit them as needed. Ensure that the questions are clear, concise, and aligned with the learning objectives.

Create Answer Choices

If you’re creating a multiple-choice quiz, provide ChatGPT with answer choices for each question. Ensure that the answer choices are plausible and that one option is clearly the correct answer.

Finalize the Quiz

Once you’ve reviewed and edited the questions and answer choices, finalize the quiz by creating a clear and concise set of instructions for your students, specifying the time limit, grading criteria, and any other relevant information.

Administer the Quiz

Administer the quiz to your students through your preferred learning management system (LMS) or other means of distribution.

Grade the Quiz

Once the quiz is completed, grade the responses according to the grading criteria you established.

Provide Feedback

Provide feedback to your students on their performance on the quiz, including areas where they did well and areas where they could improve.

Suggestions for getting better results when generating quiz questions using ChatGPT

Be Specific with Your Prompts

The more specific your prompts are, the better the results will be. Instead of asking ChatGPT to generate questions about a broad topic, try to provide a specific question or scenario to prompt the AI. This will help ChatGPT understand what type of questions you’re looking for and generate more relevant and focused results.

Provide Additional Context

Providing additional context to ChatGPT can help it generate more relevant and accurate questions. For example, if you’re asking ChatGPT to generate questions about a historical figure, provide some additional context about their life, achievements, and legacy.

Use Proper Grammar and Syntax

ChatGPT works best with clear and grammatically correct input. If you use improper grammar or sentence structure in your prompts, ChatGPT may generate questions that are difficult to understand or nonsensical.

Choose the Right Quiz Type

Different quiz types require different types of prompts. For example, if you’re creating a multiple-choice quiz, provide ChatGPT with answer choices for each question. If you’re creating a short-answer quiz, provide ChatGPT with examples of possible answers to the question.

Review and Edit Generated Questions

ChatGPT is not perfect and may generate questions that are unclear or irrelevant. It’s important to review and edit the generated questions to ensure that they align with your learning objectives and are appropriate for your students.

Using ChatGPT to Write Quiz Questions

/in /by

Using ChatGPT to Write Quiz Questions

The following are notes from OTL’s session for the AI in Action series.

Mark Kaysar and Agustin Ríos used AI to create quiz questions with different question types. They also prompted ChatGPT to properly format a quiz for uploading into Bruin Learn.

Can ChatGPT help faculty create and format low stakes assessments for using in Canvas?

Demo Question Generation

  • Question Types
  • Multiple Choice
  • True/False
  • Fill in the blank
  • Short Answer
  • Short Essay
  • Adding feedback to answers

Quiz Formatting

When working in ChatGPT, if you include the format instructions shown below you will receive questions that are ready for upload to Canvas. ChatGPT will usually respond in the format you tell it to use, but if it does not, resubmit and ask it to reformat.

Please create all quiz questions using the following format. Each choice needs to start with a lower case alphabet, 
a, b, c, d, etc. with a close parenthesis. The correct choice is designated with an asterisk.

1. What is 2+3?
a) 6
b) 1
*c) 5
d) 10

Sample ChatGPT Prompts

Provide a topic

Can you write some multiple choice questions about [Insert topic]?

Provide a link to a reading

Please write multiple choice questions to evaluate this content.
[paste content]

1.2 The Weakness of Early Patent Systems - Introduction to Intellectual Property | OpenStax

Provide a link to a Canvas page

Please write multiple choice questions to evaluate this content.

Can you provide feedback on why the incorrect items are incorrect?
[paste content]

https://canvas.ucdavis.edu/courses/34528/pages/being-present-in-your-online-course

Provide a desired outcome

Please write multiple choice questions that evaluate this outcome [paste outcome]

Analyze how the costume designer’s interpretation of the screenplay is affected by the 
tone of the politics of the era and the pressures from the studio

Provide a video script or video captions

Please write multiple choice questions to evaluate this content.

[paste content]

Provide a set of answers

Please write multiple choice questions that have the following as answers.

[paste answers]

Provide similar questions to use as a model

Please write multiple choice questions that evaluate the same content as this question.

[paste question]

Uploading to Canvas

Before you can upload the quiz into Canvas, you need to save the questions in the QTI file type.

Step one

Step two

This will create a quiz with your new questions.

See also the original session document.

Using ChatGPT in Conversations with IDs

/in /by

Using ChatGPT to Lead In-depth Conversations with Instructional Designers

The following are notes from OTL’s session for the AI in Action series.

Sirui Wang and Brittany Goodwell explored possible ways to use ChatGPT to start thinking about different teaching and learning challenges using two scenarios to begin instructional design conversations between faculty and instructional designers. Both scenarios included questions and requests often asked by faculty. There were opportunities to interact with ChatGPT and instructional designers.

How can ChatGPT be involved in the course design process?

  • ChatGPT integrates related information and output in a well-structured way. The advantage of using this generative AI enhances the consultation process with higher efficiency.
  • The conservation style allows the information to be built upon one another, forming a useful dialogue designers can share later.
  • Using ChatGPT in the initiative process of an instructional design consultation helps focus on what faculty needs and narrow the topics, making the discussion with instructional designers more efficient and allowing in-depth discussion.

However, what ChatGPT provides is usually very surface and general, and instructional designers must step in and continue the in-depth conversation.

Instructional Designers’ Roles in the AI Age

  • In-depth conversation
  • Connect with the real course design
  • Ensure equity and inclusion
  • Create personalized learning experiences that adapt to the needs of individual learners
  • Incorporate gamification and simulations to make learning more interactive and engaging
  • Share experience

Scenario 1 – Identify the Teaching and Learning Challenges

ChatGPT Screenshot 1: Engaging students more effectively

How to use ChatGPT to begin the conversation?

  • Start with the basic question/challenge
  • Go through the options, and see if there is anything that interests you
  • Ask for or think of more specific questions, such as #5, why frequent feedback will engage students more efficiently, how to provide frequent feedback, what types of feedback can be provided, etc.

But ChatGPT does not have the accurate context for what it outputs, so a continued conversation with instructional designers are strongly encouraged.

How to continue the topic with an Instructional Designer?

  • Discuss and continue the specific questions: Why feedback loop is important, especially online? What feedback loops can and will include?
  • Clarify the focus: what could be a good fit for your class? How do involve the three parties in a class: instructor, TAs, and students?
  • The deeper conversations: how does it align with other class pieces?
  • Access to other successful course design experiences from different courses

Scenario 2 – Educational Technology Recommendations

Screenshot 2: ChatGPT advice on good class technologies
Screenshot 3: Refining ChatGPT session

How to continue the topic with an Instructional Designer?

  1. Review and refine the recommendations: The faculty member could work with the instructional designer to review the recommendations generated by ChatGPT and refine them based on their specific course needs. The instructional designer could help the faculty member evaluate the options based on factors such as ease of use, accessibility, cost, and pedagogical value.
  2. Identify and address potential challenges: The faculty member and instructional designer could discuss potential challenges that may arise from implementing the selected educational technology in their course. This could include issues related to technology integration, student engagement, and support for students who may have varying levels of technological proficiency.
  3. Explore implementation strategies: The faculty member and instructional designer could work together to explore implementation strategies for the educational technology recommendations.
  4. Determine next steps: The faculty member and instructional designer could determine next steps for moving forward with the implementation of the selected educational technology. This could include identifying any additional support or resources needed, setting timelines for implementation, and designing appropriate activities.

See also the original session document.

AI in Action – Course Design Opportunities with AI

/in /by

Course Design Opportunities with AI

On May 16, 2023, as part of the campus series, “AI in Action: Exploring AI’s Potential in Teaching and Learning,” OTL instructional designers worked with over 30 participants across three breakout rooms to explore ways that AI can be used to enhance teaching and learning.

  • Using ChatGPT to Lead In-depth Conversations with Instructional Designers: Sirui Wang and Brittany Goodwell explored possible ways to use ChatGPT to start thinking about different teaching and learning challenges using two scenarios to begin instructional design conversations between faculty and instructional designers. Both scenarios included questions and requests often asked by faculty. There were opportunities to interact with ChatGPT and instructional designers.
  • Using ChatGPT to Write Quiz Questions: Mark Kaysar and Agustin Ríos used AI to create quiz questions with different question types. They also prompted ChatGPT to properly format a quiz for uploading into Bruin Learn.
  • Syllabus Refresh Using Prompt Engineering in ChatGPT: Kim DeBacco and Kate Schaller worked with faculty to generate and regenerate a course syllabus. Together they investigated prompt engineering to iteratively refine their choices.

ID Showcase – Using Slack in Education

/in /by

Using Slack to Build an Equitable and Diverse Learning Community in Education

In this showcase, Prof. Glory Tobiason will demonstrate how she uses Slack in undergraduate courses to engage and welcome students, streamline communication, and conduct formative assessments.

Slack is a UCLA-approved app that facilitates communication and collaboration in a variety of contexts: project teams, administrative units, research groups, etc.

The showcase is organized like a “tasting menu” of several possible pedagogical uses of Slack, including:

  • Community building
  • Shared course FAQs
  • TA communication
  • Making students’ thinking accessible to their peers
  • “Slack Hands,” a strategy for more inclusive participation
  • Collaborative study guide for quizzes

Presenter Bio

Prof. Glory Tobiason is clinical faculty in the Education Department (where she teaches undergraduate and graduate courses in research methods) and a Research Scientist at the Center for Research on Evaluation, Standards, and Student Testing (CRESST). She also co-leads the Holistic Evaluation of Teaching initiative at UCLA. The goal of her research and faculty-engagement work is to understand and support the work of teachers.

ID Showcase – SCAND 60 – Introduction to Nordic Cinema

/in /by

Scandinavian Studies 60 – Introduction to Nordic Cinema

SCAND 60 course screenshot

In this course showcase, Prof. Patrick Wen will share his experience designing a fully asynchronous online course on Nordic cinema based on earlier experiences teaching similar courses in person. The aims of the in-person and online courses remain the same: to offer undergraduates a broad introduction to a lesser-known cinematic tradition while also engaging them in critical thinking and writing.

Topics to be covered include:

  • Employing various pedagogical strategies, such as podcasting, peer review, and blogging, to foster student engagement and build a vibrant learning community.
  • Encouraging students to have informal discussions through podcast activities to increase their engagement and interaction.
  • Effectively managing asynchronous student schedules.
  • Utilizing Bruin Learn to facilitate a successful transition from in-person to asynchronous learning in the Introduction to Nordic Cinema course.

Presenter Bio

Prof. Patrick Wen is a continuing lecturer in Scandinavian within the Department of European Languages and Transcultural Studies. He teaches courses on film history, modern literature, and also Norwegian language.

Selected Q&A from the Showcase


QuestionAnswer
Given that the films aren’t screened live, do you find that the students do other things to create community when screening them for themselves (chatting, watching over Zoom, etc.)?Students did organize/gather informally to watch together in person and virtually.
How do you grade the peer reviewed blog postings?Canvas has some quirks to assign points. The instructor created a separate assignment to give points.
How often did you or the TAs respond to the students posts or submissions?For a roughly 60-person class, every week TA or instructor responded to individual responses (not a general post to all). The instructor enjoyed responding to students and got “sucked in.”
Are the responses to the blog posts from peers expected to be done within a certain time frame? Or at any time? If a student did not complete the peer review/response, how was that handled?For asynchronous work, it was important to keep students on the same page re: submissions. (Some wanted to do things early, others wanted to wait right up til the deadline.) This created a peer review issue because if a student posts early, they have to wait for other students to post to complete their peer review.

The instructor set expectations about what students could do in advance, but for back-and-forth type of activities–like blog posts–students need to complete tasks more “at deadline.”

This was a learning curve!

Were rubrics used for podcasts/blog posts?A rubric was used for the blog post/podcast (3 points total), as well as for the peer review portion of the blog post assignment (2 points total). The instructor explained this as a two-part assignment.
Did you use the podcast feature in Bruin Learn discussions for the Week 5 Podcast Postings? (And….how does that work? I’ve never known…)Students either recorded on Zoom or just created an audio file. The instructor provided instructions on how to do this. It was simple because students had already been using the discussion boards in Canvas.
Was there some buildup or scaffolding done for the podcasts? Creating an outline or talking points?The students were given prompts, pretty similar to the ones for the blog postings – but more designed for conversation (between two students).
Can you talk a little bit about students’ choices for the projects – how many of them chose a paper vs. a group video assignment? And what kinds of video assignments did they create?Video assignments took different forms depending on prompts chosen. Often they were borne of blog postings – that got them thinking about something that they wanted to fully develop in a longer project. Often the videos were powerpoint-style presentations that they may have written about. In group video projects, they were interacting, but in a more formal way than in the podcast – a thesis, evidence, etc.
What do you see as next steps or enhancements for the course?Changing up the syllabus, but keeping the podcast/video presentation options open for the students. How can more of this be incorporated, is a question. Also, thinking about adding more informal conversations, like Patrick’s informal conversation with a colleague working on a book about Ingmar Bergman. (Not long – but this would bring in other voices)
What is the demographic of the course – do they already have film studies/Scandinavian studies knowledge going in?For the most part, the students don’t have knowledge of Scandinavian studies going in (readings are in English, films subtitled). Some students do have this knowledge/background, so it’s a nice mix. Tendency towards older students (fourth years) taking and appreciating the course! Maybe this is specifically because it’s an online class and that’s what this group wants.
How do you think the quality of the blog writing compares to the written papers?More polished than expected. Peer reviews in particular felt like a conversation.
Do you know if students ever continue blogging after your class?A few students in particular – avid film buffs! Some continue other forms of film writing, not necessarily blogging.
Is there a difference between blogging on Bruin Learn and blogging on WordPress (for example)?Technical differences yes – WordPress/others are third party sites and students will need to create logons for them. (They are also public, which can be an issue for students.) They may afford more for creativity/incorporating media, but using BL Discussions keeps everything in Bruin Learn (and you can still add images, videos, links).
Do you think the sporadic grading positively contributed to increased instructor/social presence?Aim – students should feel like the TA and the instructor were both engaged. Responding to the posts (not necessarily on time) should impart that he was engaging with the students, reading what they were writing. He does think this was a positive thing!

This Google Doc contains the comments, questions and answers collected during the showcase.