PROBLEM STATEMENT
The problem
2023 has seen a surge in interest around Artificial Intelligence (AI) in education, driven by rapid advancements in AI technology. Despite the potential benefits offered by AI, much of the discourse within educational circles has been focused on how to restrict or ban its use in education settings, rather than exploring how it could be harnessed to enhance learning and teaching practices. This cautionary stance stems from concerns about academic integrity, equity, and the potential for AI to undermine traditional educational methods.
As an educator and Instructional Designer passionate about the possibilities of new technology, I found this one-sided narrative limiting. Instead of focusing on prohibitions, I was inspired to delve deeper into the potential of AI. I was curious about how it could be integrated into educational settings to improve student engagement, personalize learning experiences, and streamline administrative tasks. My motivation was to shift the conversation from fear and resistance to exploration and innovation, seeking to uncover practical and ethical ways to leverage AI in education.
Gaps in existing solution
The existing resources were largely focused on outlining the dangers of AI rather than offering practical strategies for its responsible and beneficial use. This left a void where innovative approaches to AI in education could have been developed, particularly in creating tailored solutions that address the unique challenges and opportunities presented by AI technologies. The lack of forward-thinking discussions and resources created an environment where educators were more likely to shy away from AI rather than embrace its potential to transform educational experiences for the better.
My approach
I aim to explore AI and assessment from a new perspective. As AI will become an integral part of the future, I asked: how can we enhance collaboration between humans and AI through assessment design while still maintaining the integrity of the assessment goals?
To address this, I created a video that showcases three specific approaches instructors can adopt to integrate AI into assessments:
Enhancing inquiry development: Utilizing Generative AI to craft more effective and insightful questions.
Promoting critical data analysis: Leveraging AI to support deeper evaluation and understanding of data.
Improving idea communication: Using AI tools to facilitate clearer and more impactful communication of ideas.
THE PROCESS
Need Analysis
I began by meeting with stakeholders, including faculty and Instructional Designers (IDs), to understand their concerns and identify areas where AI could be integrated into assessment practices. These discussions helped to clarify the goals and expectations for the instructional video.
I studied assessments from 10 different courses, including quizzes, assignments, and discussion prompts, to identify opportunities for incorporating AI. This analysis highlighted potential areas where AI could enhance the effectiveness and efficiency of assessments.
Design
Using Google Docs and Canva, I created a detailed storyboard outlining the structure and content of the video. The storyboard included the key strategies for integrating AI into assessments and visual elements to support these concepts.
I shared the storyboard with Subject Matter Experts (SMEs) and two Instructional Designers from SPS to gather feedback. Their insights were invaluable in refining the content and ensuring that the video would meet the needs of the intended audience.
Development
Based on the refined storyboard, I developed a tutorial video that presented three strategies for incorporating AI into assessments. The video was designed to be engaging and informative, demonstrating practical applications of AI in assessment design.
Implementation and Evaluation
I presented the completed video to the Instructional Design and Curriculum Support team. The feedback was positive, indicating that the video effectively addressed the integration of AI in assessments and was well-received by the team. This feedback helped to validate the approach and content of the instructional video.
FINAL PRODUCT
Description
The instructional video serves as a valuable resource for faculty members, guiding them in designing assessments that not only embrace AI tools but also align with key QM standards to enhance course quality and student learning outcomes.
SRS 3.4: Multiple Types of Assessments Suited to the Course Level. The video highlights the importance of designing assessments that promote higher-order thinking, such as evaluating AI-generated data, synthesizing AI-researched information, and creating artifacts to communicate ideas. These forms of assessment are particularly suited to graduate-level courses, where critical thinking and creativity are paramount. Additionally, the video explores the use of AI to facilitate various assessment formats, allowing instructors to move beyond traditional paper writing and encourage submissions through video, visual representations, or other creative pathways.
SRS 6.2: Course Tools Promote Learner Engagement and Active Learning. Incorporating AI tools into course assessments is an effective way to engage learners actively. The video demonstrates how AI can be used to foster active learning by enabling students to interact creatively with information. For example, learners can examine AI-generated data insights, compare them with their approaches, and identify areas for improvement. This interactive process not only promotes engagement but also enhances knowledge construction and critical analysis skills.
SRS 6.3: Variety of Technology Used in the Course. The video encourages the use of a wide range of AI tools in assessments, contributing to the achievement of SRS 6.3. By providing learners with access to various AI technologies, such as research tools, data analysis tools, and visualization tools, instructors can create a technologically diverse learning environment. This variety enhances the learning experience and ensures that students are exposed to multiple ways of interacting with and applying technology in their work.
Results
The feedback was positive and the final product was well-received. The team noted that the video effectively addressed integration of AI in assessments.
The final product was accepted for presentation at the International Society for Technology in Education Conference 2024.
