{"id":2495,"date":"2021-07-07T16:42:52","date_gmt":"2021-07-07T15:42:52","guid":{"rendered":"https:\/\/microsites.ncl.ac.uk\/casestudies\/?p=2495"},"modified":"2025-07-11T14:37:16","modified_gmt":"2025-07-11T13:37:16","slug":"informed-dynamic-changes-to-teaching-practice-using-panopto-recap-analytics","status":"publish","type":"post","link":"https:\/\/microsites.ncl.ac.uk\/casestudies\/2021\/07\/07\/informed-dynamic-changes-to-teaching-practice-using-panopto-recap-analytics\/","title":{"rendered":"Informed dynamic changes to teaching practice using Panopto (ReCap) Analytics"},"content":{"rendered":"<h4 class=\"entry-content\"><strong style=\"color: #003f80\">Dr David Grundy, Director of Digital Education<\/strong><\/h4>\n<h4 class=\"entry-content\"><strong style=\"color: #003f80\">Newcastle University Business School<\/strong><\/h4>\n<h4 class=\"entry-content\"><strong style=\"color: #e96556\">Faculty of Humanities and Social Sciences<\/strong><\/h4>\n<hr \/>\n<p><iframe loading=\"lazy\" style=\"border: 1px solid #464646\" src=\"https:\/\/campus.recap.ncl.ac.uk\/Panopto\/Pages\/Embed.aspx?id=2efbd823-8d1c-4e52-b962-ad4b00f8a9b0&amp;autoplay=false&amp;offerviewer=true&amp;showtitle=true&amp;showbrand=false&amp;start=0&amp;interactivity=all\" width=\"720\" height=\"405\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<h4><strong>What did you do?<\/strong><\/h4>\n<p>I used Panopto (ReCap) Analytics to inform changes and alterations to my teaching approaches and activities for my Executive MBA classes. Due to the flexible learning approaches of 2020\/21 a modules weekly pre-seminar content which students were to review to inform their understanding of a case study were all on the Panopto (ReCap) recording platform broken into bite-sized chunks in very much a flipped seminar approach. This allowed for me to review the Panopto (ReCap) analytics of the video recordings to understand exactly which students (see example below) had reviewed the content before the seminar and which had not. As this was a very small cohort (n=14) I was then able to re-work and tailor the content of the seminar\u2019s examination of the case study to maximise both the usage of what students did know, or had engaged with, and best support areas which clearly hadn\u2019t been engaged with but were key to know. The key aspects of this were the smaller chunking of the videos into multiple parts and the viewer engagement statistics.<\/p>\n<p><a href=\"http:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/07\/Recap-1.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-2496 size-full\" src=\"http:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/07\/Recap-1.jpg\" alt=\"Table showing views and downloads, Minutes delivered Average minutes delivered and Percent Completed\" width=\"775\" height=\"260\" srcset=\"https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/07\/Recap-1.jpg 775w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/07\/Recap-1-300x101.jpg 300w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/07\/Recap-1-768x258.jpg 768w\" sizes=\"auto, (max-width: 775px) 100vw, 775px\" \/><\/a><\/p>\n<hr \/>\n<h4><strong>Who is involved?<\/strong><\/h4>\n<p>Dr David Grundy, Director of Digital Education<\/p>\n<hr \/>\n<h4><strong>How did you do it?<\/strong><\/h4>\n<p>The Panopto (ReCap) Analytics functionality of the Panopto (ReCap) platform was used. This involved both using the Top Viewers\/Users Screen for an \u201cat a glance\u201d analytics screen which gives a good overview, the individual student user level analytics and finally also using the downloadable Viewer Engagement stats using the Download Reports function at the bottom of the analytics page. The Top Viewers screen was useful for more immediate information on exactly which students had watched exactly how much of which videos and gave good \u201cheadlines\u201d as to the general level of student engagement in the class.<\/p>\n<p>I then generally unpicked the individual student engagement in the Analytics page. This can be found by simply clicking the individual user and this gives you a powerful overview of exactly how much of a selection of videos have been watched by an individual student (see below). In the screenshot below for example I can see that the student has watched section 1 and 2 of that week\u2019s delivery, hasn\u2019t watched 3 at all, and barely touched part 4. This gives me a good understanding of the content covered by the student from the flipped content. With a very small cohort and enough prep time this allowed me then to reconfigure the seminar\u2019s approach.<\/p>\n<p>&nbsp;<\/p>\n<p><strong><a href=\"http:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/07\/ReCap22.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-2500 size-full\" src=\"http:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/07\/ReCap22.png\" alt=\"Table showing the top 3 sessions in ReCap. This shows the title and figures for views and downloads, minutes delivered, average minutes delivered and percent completed\" width=\"1117\" height=\"330\" srcset=\"https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/07\/ReCap22.png 1117w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/07\/ReCap22-300x89.png 300w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/07\/ReCap22-1024x303.png 1024w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/07\/ReCap22-768x227.png 768w\" sizes=\"auto, (max-width: 1117px) 100vw, 1117px\" \/><\/a><\/strong><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>Finally, the viewer engagement download statistics create a heat map of content viewing. This was used to inform future pedagogic design choices at the module content review stage. By looking for commonalities in the data I was able for example to quickly identify common \u201cbreak points\u201d for users. A \u201cbreak-point\u201d is a point in the video in which the user either stops the video to later resume (they\u2019re taking a break) or stops the video never to return. One of my more complex conceptual chunked lectures for example had a common \u201cbreak-point\u201d around 6 minutes in. I was able to identify that when I used a particularly complex theory at that point in the lecture, and so for future design this has now been flagged for me to review other approaches to these concepts or build in more digestible examples and so forth. Looking for commonalities in the data isn\u2019t unfortunately something the Panopto (ReCap) platform will do automatically in the download and requires a little post-Excel manipulation, or with a small enough cohort size eyeballing the data yourself and drawing inferences to investigate.<\/p>\n<hr \/>\n<h4><strong>Why did you do it?<\/strong><\/h4>\n<p>The Executive MBA at NUBS is a small group of extremely high performing individuals who are very highly engaged but time poor. If they have not done the work for the session it is usually due to pressing real world issues within their business. As such I was determined to adapt and flex the sessions to maximise the value of the sessions to them as learners. This entailed a higher level of prep than say for a typical UG class, with in some cases me completely re-writing my seminar plans or design.<\/p>\n<hr \/>\n<h4><strong>Does it work?<\/strong><\/h4>\n<p>The interesting thing about re-writing and delivering an alternative seminar is that the students have no baseline of the original seminar to compare against! So student feedback, or even awareness, that I was re-writing the seminar approach and design to suit how they were digesting the module content wasn\u2019t actually told to the students. However, what I did find was that attendance was extremely good (usually 12 out of 14), and indeed I had a couple of apology e-mails from the Executive MBA students saying that they were sorry to miss the sessions, one noting that they\u2019d heard we\u2019d had as a class some good discussions and was very sorry to miss them.<\/p>\n<p>What I did find during the teaching was that the classroom conversation (on Teams) was very free flowing. We for a full hour never seemed to stop talking as a class. I feel this was because I was able to avoid areas where there were clear gaps in knowledge and avoid turning the session into a \u201cmini-lecture\u201d to resolve those gaps by using the case more actively to highlight learning points. Student feedback from the seminars was good and students engaged in positive learning behaviours after the seminars with the analytics showing clearly that several students after the seminar went back and watched videos that they had not until that point. While causality is hard to perfectly know on this, I would like to infer (as it\u2019s positive to think this way!) that the way I used the case to highlight the learning points in the materials they hadn\u2019t yet engaged with prompted them or engaged them enough to go back and complete what they hadn\u2019t done until that point.<\/p>\n<p>I think this approach works very well with very small group size(n&lt;20) high quality learners on programmes in which the educator has sufficient prep time. Certainly the flipped approach to seminars, and small chunking approach to the pre-seminar content, that was already being used for the class seemed to gel well with the analytics to adapt the content. I think that the core of the pre-seminar learning being within the videos also helped. In flipped seminars in which students are digesting their pre-seminar content from a much wider array of resources it may be more difficult to fully rely on just the Panopto (ReCap) analytics.<\/p>\n<hr \/>\n<h4><strong>Interested in finding out more?<\/strong><\/h4>\n<p>Get in touch with <a href=\"https:\/\/www.ncl.ac.uk\/business\/people\/profile\/davidgrundy.html\">Dr David Grundy, Director of Digital Education.<\/a><\/p>\n<hr \/>\n<h4><strong>Useful Resources<\/strong><\/h4>\n<ul>\n<li><a href=\"https:\/\/www.ncl.ac.uk\/learning-and-teaching\/digital-technologies\/recap\/\">ReCap guides on Learning and Teaching website<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Dr David Grundy used Panopto (ReCap) Analytics to inform changes and alterations to teaching approaches and activities for Executive MBA students.<\/p>\n","protected":false},"author":3007,"featured_media":2501,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1,306,272,561,582],"tags":[626,600,616],"class_list":["post-2495","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-all","category-business-school","category-hass","category-recap","category-reflective-practice","tag-flipped-classroom","tag-reflective-and-self-aware","tag-student-engagement"],"_links":{"self":[{"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/posts\/2495","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/users\/3007"}],"replies":[{"embeddable":true,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/comments?post=2495"}],"version-history":[{"count":7,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/posts\/2495\/revisions"}],"predecessor-version":[{"id":2891,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/posts\/2495\/revisions\/2891"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/media\/2501"}],"wp:attachment":[{"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/media?parent=2495"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/categories?post=2495"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/tags?post=2495"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}