Events

Design a Grading Rubric using Generative AI (ChatGPT)

May 14 @ 10:00 am 10:20 am

Spring 2024 10+10 Pop-up Series

In spring quarter 2024, the Teaching and Learning Center (TLC) instructional designers are offering a series of seven pop-up sessions – each just 10 minutes in length – on focused, specific topics related to online/hybrid course design.

Each of these 10 + 10 sessions will take place at 10am every Tuesday in spring quarter 2024, from Week 2 thru Week 7.  While the sessions are not recorded, session slides and resources will be made available in this 10+10 Pop-ups Series Bruin Learn site. Individuals can self-enroll in this site using this URL: https://bruinlearn.ucla.edu/enroll/C6KRL6

Zoom link for all sessions: https://ucla.zoom.us/j/98654413254?pwd=SXAzcUFsS1VpM0doU0tQUy9hKzdodz09

Meeting ID: 986 5441 3254         Passcode: 196561

Pages

ID Showcase – Introduction to Public Health

Public Health 50A – Introduction to Public Health

Screenshot of Public Health 50A website

This showcase highlights how a Bruin Learn course site and its integrated tools have been selected and adopted in this newly designed Introduction to Public Health course. By utilizing the Bruin Learn course site, the instructor builds an efficient online learning space that helps students easily navigate course lectures and other materials and resources. Adopting Jones & Bartlett e-Textbook and its interactive lectures and quizzes provides rich opportunities that foster student interaction and collaboration. Zoom has been selected and creatively designed by the instructor and instructional designers as a solution for simultaneous screen-sharing and front-of-classroom camera views

What to Expect in the Showcase

The PH 50A Introduction to Public Health course is a newly designed course by Dr. Kim-Farley in collaboration with UCLA Instructional Designers. It is for the new Undergraduate Public Health Major at the UCLA Fielding School of Public Health. The following pedagogical strategies and design approaches will be shared during the presentation.

  • Utilization of Bruin Learn course site to showcase highlighting such features as a lecture-by-lecture home page with links to modules;
  • Adoption of LTI Integration with the Jones & Bartlett eTextbook, interactive lectures, and quizzes;
  • Implementation of an upload site for the Opinion Editorial written assignments with “Turnitin” and grading rubric; and
  • Use “dual-feed” Zoom as a solution for simultaneously screen-sharing and “front of classroom” camera views.

Presenter Bio

Dr. Kim-Farley currently serves as a Professor with joint appointments in the Departments of Epidemiology and Community Health Sciences at the Fielding School of Public Health at the University of California at Los Angeles (UCLA). From 2004 to 2018, he served as the Director of the Division of Communicable Disease Control and Prevention at the Los Angeles County Department of Public Health. His responsibilities included supervision of the Acute Communicable Disease Control Program, the Vaccine Preventable Disease Control Program (Immunization Program), the Tuberculosis Control Program, the Veterinary Public Health and Rabies Control Program, and the Public Health Laboratory.

Dr. Kim-Farley holds degrees in Electronic Engineering, Public Health, and Medicine from the University of California. He is Board Certified in Preventive Medicine and Public Health. He is the author of numerous articles and publications in the field of public health.

Spring 2024 10+10 Pop-up Series

Spring 2024 10+10 Pop-up Series

In spring quarter 2024, the Teaching and Learning Center (TLC) instructional designers are offering a series of seven pop-up sessions – each just 10 minutes in length – on focused, specific topics related to online/hybrid course design.

Each of these 10 + 10 sessions will take place at 10am every Tuesday in spring quarter 2024, from Week 2 thru Week 7.  While the sessions are not recorded, session slides and resources will be made available in this 10+10 Pop-ups Series Bruin Learn site. Individuals can self-enroll in this site using this URL: https://bruinlearn.ucla.edu/enroll/C6KRL6

Zoom link for all sessions: https://ucla.zoom.us/j/98654413254?pwd=SXAzcUFsS1VpM0doU0tQUy9hKzdodz09

Meeting ID: 986 5441 3254         Passcode: 196561

Schedule of Topics

Note: Because of the 10 minute duration, sessions will start promptly at 10:00 am.

Add a Template to Your New Bruin Learn Course Site
04/09 10:00-10:20 am
#coursedesign #savetime
Facilitator: Kate Schaller

Giving Feedback in Bruin Learn Speedgrader
04/16 10:00-10:20 am
#tips #workload #morewithless #saveyourfeedback #justclickit #rubrics
Facilitator: Mark Kayser

Handling Large Classes with Fewer TAs: Some Strategies
04/23 10:00-10:20 am
#workload #student interaction #morewithless
Facilitator: Brittany Goodwell

Inserting Images into Bruin Learn Pages and Assignments
04/30 10:00-10:20
#alttext #designtools #pixels #sizing
Facilitator: Agustin Rios

Sequencing Learning Material in a Module
05/07 10:00- 10:20 am
#learnerpathway #studentperspective #whatsnext
Facilitator: Sirui Wang

Design a Grading Rubric using Generative AI (ChatGPT)
05/14 10:00-10:20 am
#prompt #input #checkit #refineit
Facilitator:  Kim DeBacco

Spring 2024 10+10 Workshop Series Flyer

ID Showcase: Honors 136

Scaffolding the Online Seminar: Honors 136—Art, Entertainment, & Social Change

Screenshot from Honors 136 course

What to Expect in the Showcase

In this showcase, Lecturer Terri Anderson will explain and illustrate the genesis and process of scaffolding a seminar aiming for student success in a student-led online hybrid Honors seminar. Student performance is extraordinarily engaged and advanced; student response is overwhelmingly enthusiastic. Topics to be covered include:

  • How to scaffold student engagement in a seminar
  • The unique value of an entirely online hybrid seminar
  • How to effectively use the online format—including working with Zoom, using the chat bar, effectively using discussion forums, and so on
  • How to develop an original and challenging, yet level-appropriate and doable, set of materials
  • How to coach students through creating an effective presentation

Presenter Bio

Terri Anderson is a Continuing Lecturer with Sociology and the Honors Program. She teaches a wide variety of Sociology courses, including Introductory Sociology, Research Methods, Environmental Sociology, Sociology of Emotions, Self & Society, Social Psychology, Sociology of the Body, Sociology of Mental Illness, Sociology of Gender, Sociology of Family, Sociology of Education, Sociology of Mass Communication, Food & Society, and Hip & Cool: A Study of Distinction & Exclusion. She has developed three online hybrid seminars for the Honors Program: Art, Entertainment, & Social Change; Between the Species: The Human/Non-Human Animal Relationship; and Living Consciously: Philosophy in Everyday Life.

Following a 20+ year career of in-person teaching, Dr. Anderson has been teaching online since 2017, and is currently redeveloping her Sociology of Mental Illness course (cross-listed with Disability Studies) for delivery throughout the entire UC system via UC Online.

ID Showcase – Care Work – Disability Justice and Health Care

Nursing M172 & M172XP – Care Work: Disability Justice and Health Care

NURS172XP course site

This showcase highlights accessibility and engaged learning through the instructor’s experience designing a multidisciplinary two-course package. Community-engaged learning personalized disability care policy and caregiving practice through reflective relationship building. For instance, the course integrated Perusall to center disabled voices, deepen student preparation, and provide flexible engagement. It authorizes students to become creators of accessible information. By creating small groups called bird flocks, the course simulates carewebs that accomplish class activities. In addition, it structures community engagement through reflective relational logs, a field trip to the Momentum partner agency, attendance at the Ability Expo, and movies supported by the library mini-grant program, which creates a highly engaged learning environment for students. 


What to Expect in this Showcase

In this session, the instructor will share her experience designing a multidisciplinary two-course package that showcases accessibility and engaged learning. Course topics of accessibility and carework were mirrored in course design. Community-engaged learning personalized disability care policy and caregiving practice through reflective relationship building. Topics to be covered include:

  • Using Perusall to center disabled voices, deepen student preparation, and provide flexible engagement.
  • Authorizing students to become creators of accessible information.
  • Creating small groups called bird flocks to simulate carewebs that accomplish class activities.
  • Structuring community engagement through reflective relational logs, a field trip to the Momentum partner agency, attendance at the Ability Expo, and movies supported by the library mini-grant program.

Presenter Bios
Lauren Clark is a public health nurse and the Shapiro Family Endowed Chair in Developmental Disability Studies in the School of Nursing. She teaches health professions students to advocate for health equity and quality of life for people with intellectual and developmental disabilities. She works with the UCLA Tarjan Center and is on the Board of Directors of Disability Rights California.

Yuri Matsuo is a psychiatric-mental health nurse practitioner and a PhD student studying Down syndrome, aging, and family care. She is a Teaching Assistant in the Care Work community-engaged learning course.

ID Showcase – ENGCOMP 403

ENGCOMP 403 – Language Pedagogy: Form, Meaning, and Function

What to Expect in this Showcase

This Instructional Design Showcase will explore several online-synchronous course design elements that were developed during the pandemic and have been continually refined in the years after based on student feedback. Through the course demonstration, the instructor explained how the homepage and modules had been setup, discussed several student engagement solutions such as flipped course design, audio-video content packages, and interactive class sessions, and also explored a few effective feedback practices through audio-video feedback packages and extended zoom conferences.The specific items that will be covered are as follows:

  • Course Organization (Homepage Design & Module Setup)
  • Student Engagement (Flipped Course Design, Audio-Video Content Packages, and interactive Class Sessions)
  • Feedback Practice (Audio-Video Feedback Packages and extended Zoom Conferences)

Presenter Bio

Jeremy Kelley serves as the Associate Director of UCLA’s Writing Programs, UCLA’s academic home for both English composition and English as a Second Language. In addition to teaching both undergraduate and graduate language and writing courses, he teaches the language teacher training seminar for graduate student ESL instructors and mentors new graduate instructors through their initial teaching appointment. He also teaches the core language pedagogy seminar for the language-learner emphasis of Writing Programs’ Graduate Certificate in Writing Pedagogy.

ID Showcase – Honors 37W and ChatGPT

A ChatGPT Experiment in Honors 37W

This showcase is an extension of an earlier talk Laurel Westrup gave as part of the Spring 2023 “AI in Action” event. It will focus on a specific use of ChatGPT in a Spring 2023 Honors Collegium Writing II course, “Sampling and Remix: The Aesthetics and Politics of Cultural Appropriation.”

Honors 37W, which focuses on cultural borrowing of many kinds, was an apt forum for discussion of generative artificial intelligence (Gen-AI) and large language models (LLMs) that draw on borrowed sources in order to create text. The instructor re-designed a staple course assignment to provide students an opportunity to try out and reflect on co-writing with a chatbot. The showcase will:

  • Provide context and a rationale for this particular use of ChatGPT
  • Discuss the assignment design
  • Review student responses to the assignment
  • Offer some thoughts on integrating ChatGPT into our courses based on this experiment 

Presenter Bio

Laurel Westrup is a Continuing Lecturer with Writing Programs and the Honors Program and the Coordinator of the Graduate Certificate in Writing Pedagogy (GCWP). She teaches courses across Writing Programs’ curriculum, from first-year composition and Writing II to upper division courses in the Professional Writing Minor, and she also teaches graduate pedagogy courses with the GCWP. She received a UCLA Distinguished Teaching Award in 2023.

ID Showcase – English Composition 2

English Composition 2 – Approaches to University Writing | Meta-Narrative and the Narrative Self

In this course showcase session, Shane Crosby will share his experiences, the pros and cons, of using a variety of Bruin Learn tools to actively engage undergraduate students in the content of a first-year composition course.

This showcase demonstrates how the instructor uses Bruin Learn to actively engage undergraduate students in a first-year composition course. Several essential Bruin Learn tools and features, such as homepage, modules, assignments, and gradebook, are discussed. The exploration of different tool settings throughout the course design process with the support of the Bruin Learn Center of Excellence is shared.

The tools reviewed include:

  • Home Page
    • Attendance, ebook integration, syllabi, course notification settings
    • eBook integration: They Say, I Say: The Moves That Matter in Academic Writing
  • Modules
    • Organization
    • The “getting started” / Course Resource module
    • Lock Until | prerequisites | requirements
    • New feature: dropdown arrow options
    • Creating all assignments from within the Modules(?)
  • Assignments
    • Creating grading rules
  • Grades / Gradebook Settings
    • When to make it available, pros and cons, likes and dislikes
    • Late submission policy considerations
    • Grade posting considerations
    • Advanced feature settings

Presenter Bio

Shane Crosby is a Continuing Lecturer in Writing Programs at UCLA. He completed his BA at UCLA, MA in Special Education at Clark Atlanta University, PhD in Special Education at Georgia State University, and his MFA degree at UC Irvine.

This ID Showcase is a collaboration between the UCLA Teaching and Learning Center and the Bruin Learn Center of Excellence.

AI Resources for Learning Design

AI Resources for Learning Design

Sample syllabi + syllabus formats and sections

Syllabus Statements on the Use of AI in Courses

AI for Assignment & Learning Design

  • Stanford University. Curricular Resources About AI for Teaching (CRAFT)
  • Trust, T. (2023). Chat GPT & Education, UMass (Amherst); including:
    • What ChatGPT Can Do, pp. 18-39;
    • What Chat GPT Can’t Do (Yet), pp. 40-42.
  • UNESCO. (2023). Chat GPT and AI in Higher Education: Quick Start Guide. See the table on page 9.
  • Watkins, R. Update Your Course Syllabus for ChatGPT – GWU
  • Young J. (2023). Why I’m Excited About ChatGPT: Here are 10 ways ChatGPT will be a boon to first-year writing instruction, Jennie Young writes.
  • Kim DeBacco’s (untested) assignment idea:
    • Ask your students to input into ChatGPT the assignment prompt (eg. compare and contrast 2 films on the same topic).
    • They must then analyze what Chat GPT generates first time round: what it got right, wrong, what’s missing, what’s not emphasized that should have been, and perhaps more, depending on the original prompt and your imagination – or indeed the conceptual demands of the course!
    • Ask the students to submit the initial AI-generated raw version to you, along with their critical analysis of the AI-generated piece in light of the other course-related material (eg. films or readings) you were asking them to compare & contrast, or analyze.

The World of AI Tools

Using ChatGPT for Syllabus Refresh

Syllabus Refresh – Prompt Engineering for ChatGPT

The following are notes from OTL’s session for the AI in Action series.

Kim DeBacco and Kate Schaller worked with faculty to generate and regenerate a course syllabus. Together they investigated prompt engineering to iteratively refine their choices.

Session materials:

Ask Chat GPT to create a syllabus

Initial prompt:

Design a syllabus for an introductory, undergraduate-level university course about "The Psychology of Aging".

Sample refining prompt:

Regenerate this syllabus to include the following syllabus sections:

Course title: “The Psychology of Aging” (PSY136) 
Instructor Information: Kim DeBacco, PhD; kdebacco@online.ucla.edu
TA Information: Qiwen Moore, David Christomakis. 
Contact Information: tba
Course Prerequisites: PSY124
Course Description:
Learning Outcomes for this Course:
Course Materials:
Technical Requirements (Bruin Learn, browsers etc.)
How to Succeed in this Course (Expectations for Students, Study Advice & Tips)
Creating an Inclusive Classroom Community (Instructor, TA, and Community Expectations)
Course Schedule (Dates & Topics, Readings)
Predictable Weekly Pattern (for Students)
How Your Learning Will Be Assessed (Grading Policy)
Information about the Course Assignments
Link to the Quarter dates in the UCLA Academic calendar 
The class dates and times: Tuesday 10am - 12noon; Thursdays 10am - 12 noon
Link to UCLA resources for Student Well-being
Link to UCLA Policy on Academic Integrity

Model the prompt by inputting two or three past syllabi:

Integrate information, readings and topics from this syllabus. Do not include the dates.

NOTE: The example syllabi were freely provided, and previously downloaded from merlot.org

Additional Refining Steps

Provide a list of readings with links; link to a textbook, etc.

Add your lists of readings – Required/Essential, Recommended, etc.

Integrate these readings into the syllabus schedule:

Park, D.C., K. Warner Schaie, K. Schaie, S. L. Willis, S. Willis. Handbook of the Psychology of Aging. 7th edition.

Provide a focused, scripted course description, to narrow and specify content.

Regenerate the syllabus to reflect this description: [your course description goes here]

Read closely and correct!

  • Add your emphases, your voice and values, special sections, and more.
  • Consider sharing your syllabus with a colleague for feedback.

Solicit student feedback

After the quarter is over, ask (some of) your students to give you annotated feedback on your syllabus. Ask them to add comments all over it:

  • what worked well;
  • what advice would they give future students;
  • what would they change;
  • which readings and media made sense;
  • which readings were tough but worthwhile;

and so on…

See also the original session document.

ChatGPT-Generated Quiz Instructions

Advice from ChatGPT on how to best use ChatGPT to create quiz questions

Instructions Generated by AI

Here are some instructions for college instructors to use ChatGPT to author low stakes quizzes. By following these steps, you can use ChatGPT to create low-stakes quizzes that assess your students’ knowledge and understanding of course concepts.

Identify the Topic

Decide on the topic for the quiz. This could be a specific concept or a broad subject area.

Determine the Learning Objectives

Identify the learning objectives you want your students to achieve through the quiz. These objectives should be specific, measurable, achievable, relevant, and time-bound (SMART).

Choose the Quiz Type

Determine the type of quiz you want to create. This could be a multiple-choice, true/false, or short answer quiz.

Provide ChatGPT with the Question

Use ChatGPT to generate questions related to the learning objectives and the chosen quiz type. You can provide ChatGPT with a prompt, such as “Please generate five multiple-choice questions about the topic of X,” and it will provide you with questions to choose from.

Review and Edit Questions

Review the questions generated by ChatGPT and edit them as needed. Ensure that the questions are clear, concise, and aligned with the learning objectives.

Create Answer Choices

If you’re creating a multiple-choice quiz, provide ChatGPT with answer choices for each question. Ensure that the answer choices are plausible and that one option is clearly the correct answer.

Finalize the Quiz

Once you’ve reviewed and edited the questions and answer choices, finalize the quiz by creating a clear and concise set of instructions for your students, specifying the time limit, grading criteria, and any other relevant information.

Administer the Quiz

Administer the quiz to your students through your preferred learning management system (LMS) or other means of distribution.

Grade the Quiz

Once the quiz is completed, grade the responses according to the grading criteria you established.

Provide Feedback

Provide feedback to your students on their performance on the quiz, including areas where they did well and areas where they could improve.

Suggestions for getting better results when generating quiz questions using ChatGPT

Be Specific with Your Prompts

The more specific your prompts are, the better the results will be. Instead of asking ChatGPT to generate questions about a broad topic, try to provide a specific question or scenario to prompt the AI. This will help ChatGPT understand what type of questions you’re looking for and generate more relevant and focused results.

Provide Additional Context

Providing additional context to ChatGPT can help it generate more relevant and accurate questions. For example, if you’re asking ChatGPT to generate questions about a historical figure, provide some additional context about their life, achievements, and legacy.

Use Proper Grammar and Syntax

ChatGPT works best with clear and grammatically correct input. If you use improper grammar or sentence structure in your prompts, ChatGPT may generate questions that are difficult to understand or nonsensical.

Choose the Right Quiz Type

Different quiz types require different types of prompts. For example, if you’re creating a multiple-choice quiz, provide ChatGPT with answer choices for each question. If you’re creating a short-answer quiz, provide ChatGPT with examples of possible answers to the question.

Review and Edit Generated Questions

ChatGPT is not perfect and may generate questions that are unclear or irrelevant. It’s important to review and edit the generated questions to ensure that they align with your learning objectives and are appropriate for your students.