{"id":2834,"date":"2021-12-01T16:00:11","date_gmt":"2021-12-01T16:00:11","guid":{"rendered":"https:\/\/microsites.ncl.ac.uk\/casestudies\/?p=2834"},"modified":"2025-07-16T14:53:53","modified_gmt":"2025-07-16T13:53:53","slug":"quizzesanalytics_for_community_design","status":"publish","type":"post","link":"https:\/\/microsites.ncl.ac.uk\/casestudies\/2021\/12\/01\/quizzesanalytics_for_community_design\/","title":{"rendered":"The Great Wall of student engagement: Using Quizzes and New Analytics to inform community design"},"content":{"rendered":"<h4><a href=\"http:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/Helen_Atkinson.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-2848 alignnone\" src=\"http:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/Helen_Atkinson-222x300.jpg\" alt=\"photo of Helen Atkinson\" width=\"222\" height=\"300\" srcset=\"https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/Helen_Atkinson-222x300.jpg 222w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/Helen_Atkinson.jpg 624w\" sizes=\"auto, (max-width: 222px) 100vw, 222px\" \/><\/a><\/h4>\n<h4><strong style=\"color: #003f80;\"><span class=\"TextRun SCXW85014333 BCX0\" lang=\"EN-GB\" xml:lang=\"EN-GB\"><span class=\"NormalTextRun SCXW85014333 BCX0\">Helen Atkinson <\/span><span class=\"NormalTextRun SCXW85014333 BCX0\">\u2013 Careers Consultant<\/span><\/span><\/strong><\/h4>\n<h4 class=\"entry-content\"><strong style=\"color: #e96556;\">Careers Service<\/strong><\/h4>\n<hr \/>\n<h4><strong>What did you do?<\/strong><\/h4>\n<p>I used Canvas New Analytics and Quizzes to monitor how students were engaging with non-credit bearing careers initiatives, specifically the following two projects:<\/p>\n<p>China Career Gateway: An annual extracurricular career development programme designed to help Chinese students at Newcastle University prepare for their graduate career in the UK and\/or China. Since 2020\/21, China Career Gateway has been delivered as a predominantly asynchronous course via Canvas.<\/p>\n<p>SNES Skills &amp; Employability Canvas community: A new Canvas community providing supplementary discipline-specific careers education, information and guidance to students in the School of Natural &amp; Environmental Sciences.<\/p>\n<hr \/>\n<h4><strong>Who is involved?<\/strong><\/h4>\n<p>Helen Atkinson, Careers Consultant, Newcastle University Careers Service. I have also worked with the following colleagues from the School of Natural &amp; Environmental Sciences to launch the SNES Skills &amp; Employability Canvas community:<\/p>\n<ul>\n<li>Lee Higham, Senior Lecturer in Chemistry and School of Natural &amp; Environmental Sciences Academic Lead for Employability &amp; Enterprise.<\/li>\n<li>Julia Robinson, SAgE Faculty Liaison Librarian<\/li>\n<li>Abby French, Student Engagement Facilitator, SAgE Faculty<\/li>\n<\/ul>\n<hr \/>\n<h4><strong>How did you do it?<\/strong><\/h4>\n<p>For China Career Gateway, I used the Quizzes function in Canvas to create a survey for students to complete at the start of the programme. This encourages students to reflect on their levels of career readiness and how confident they feel about preparing for different stages of the recruitment process. At the end of the programme students repeat the survey, to help them reflect on their progress and distance travelled.<\/p>\n<div id=\"attachment_2842\" style=\"width: 1828px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/2021-12-01_15-28-40.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-2842\" class=\"wp-image-2842 size-full\" src=\"http:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/2021-12-01_15-28-40.png\" alt=\"Screenshot of pre &amp; post survey results. Barchart showing Near unanimous agreement in understanding job market for UK and chinese markets and where to search after programme\" width=\"1818\" height=\"692\" srcset=\"https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/2021-12-01_15-28-40.png 1818w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/2021-12-01_15-28-40-300x114.png 300w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/2021-12-01_15-28-40-1024x390.png 1024w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/2021-12-01_15-28-40-768x292.png 768w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/2021-12-01_15-28-40-1536x585.png 1536w\" sizes=\"auto, (max-width: 1818px) 100vw, 1818px\" \/><\/a><p id=\"caption-attachment-2842\" class=\"wp-caption-text\">China Career Gateway survey results &#8211; pre (left), and post (right) programme.<\/p><\/div>\n<p>As the SNES Skills &amp; Employability Canvas community was a new initiative for 2021\/22 and non-credit bearing, we weren\u2019t sure how students would engage with content. I used the New Analytics tool to monitor students\u2019 weekly online activity to understand which elements of the Canvas community students were engaging with more frequently.<\/p>\n<div id=\"attachment_2838\" style=\"width: 946px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/figbi.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-2838\" class=\"wp-image-2838\" src=\"http:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/figbi.png\" alt=\"line chart showing average page views, spiking at 10 for mid september, remaining around 3-4, and then dropping off around mid November\" width=\"936\" height=\"451\" srcset=\"https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/figbi.png 1250w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/figbi-300x144.png 300w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/figbi-1024x493.png 1024w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/figbi-768x370.png 768w\" sizes=\"auto, (max-width: 936px) 100vw, 936px\" \/><\/a><p id=\"caption-attachment-2838\" class=\"wp-caption-text\">Chart outlining student interactions in the SNES skills &amp; employability Canvas community<\/p><\/div>\n<div id=\"attachment_2839\" style=\"width: 680px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/figbii.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-2839\" class=\"wp-image-2839\" src=\"http:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/figbii.png\" alt=\"Screenshot of page numbers. 688 students viewed of 1,789, Total page views 5,671.\" width=\"670\" height=\"396\" srcset=\"https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/figbii.png 718w, https:\/\/microsites.ncl.ac.uk\/casestudies\/files\/2021\/12\/figbii-300x177.png 300w\" sizes=\"auto, (max-width: 670px) 100vw, 670px\" \/><\/a><p id=\"caption-attachment-2839\" class=\"wp-caption-text\">Tabling outlining student interactions in the SNES Skills &amp; Employability Canvas Community and resources<\/p><\/div>\n<hr \/>\n<h4><strong>Why did you do it?<\/strong><\/h4>\n<p>We put a lot of effort into developing asynchronous career-related content in Canvas and are keen to ensure that students are benefiting from this- we don\u2019t want this to be wasted effort after all!<\/p>\n<p>Using survey functionality as part of China Career Gateway facilitates the collection and analysis of quantitative and qualitative feedback. Using the Survey Statistics tool I can now easily compare pre and post programme results directly in Canvas- it used to be a much more manual process! For example, in 2020\/21, 94% of post-programme respondents told us they felt confident knowing where to search for graduate roles in the UK and China, compared with only 20% of pre-programme respondents. This has helped me assess programme impact and understand where to focus programme enhancements in future. It has also had the benefit of providing me with some useful statistics to include in future China Career Gateway marketing materials.<\/p>\n<p>Using New Analytics to monitor student engagement in our SNES Skills &amp; Employability Canvas community has been instrumental in understanding which features of the community students are engaging with more frequently. For instance, we\u2019ve noticed that our use of Announcements to promote SNES-relevant vacancies and events appear to be particularly popular with students. This will provide us with useful pointers when we come to review and update the community in 2022.<\/p>\n<hr \/>\n<h4><strong>Student Voice<\/strong><\/h4>\n<p>I made use of the Quizzes function in Canvas to gather student feedback:<\/p>\n<blockquote><p><em>\u201cGreat respect and appreciation for the work of the team of China Career Gateway programme! After completing the 5-week course, I have a general understanding of job hunting in China and the UK, and I am more confident and know what challenges I will face on the road of job hunting.\u201d<br \/>\n<\/em><\/p><\/blockquote>\n<p>&#8211; China Career Gateway 2021\/22 participant<\/p>\n<blockquote><p><em>\u201cAs a final year undergraduate, it&#8217;s good to see some things explicitly stated that I may not have been aware of previously (e.g. graduate application deadlines being a year in advance and other alternatives to graduate schemes). Learning more about the RSC (Royal Society of Chemistry) is really encouraging and I feel that I would be more confident in attending local RSC events after having watched the video in that section. It is good to see the wealth of links and resources all in one place, particularly more focused\/specific resources just for SNES students.\u201d<br \/>\n<\/em><\/p><\/blockquote>\n<p><em>&#8211; <\/em>Stage 3 Chemistry student<em><br \/>\n<\/em><\/p>\n<hr \/>\n<h4>Does it work?<\/h4>\n<p>We are confident that Canvas communities are providing students with more bespoke resources to aid their career development and this promotes accessibility and inclusion by enabling students to access resources and work through materials at a time which suits them.<\/p>\n<p>Monitoring activity via the New Analytics tool demonstrates that students are using the communities- for example we saw that 37% of SNES students engaged with the Skills &amp; Employability community during Induction Week 2021 alone. While we know students are using the community, feedback from SNES students has been limited, so we are also working with Staff-Student-Committee representatives to gather further feedback.<\/p>\n<p>I have also experienced some limitations using the Canvas New Analytics function. I currently monitor students\u2019 weekly online activity, however would benefit from understanding cumulative data, e.g. the total percentage of students who have accessed community content since the start of the academic year.<\/p>\n<p>Overall, the Quizzes and New Analytics functions have increased my confidence in using Canvas to support and enhance students\u2019 learning experiences, tailor provision, monitor engagement and gather feedback.<\/p>\n<hr \/>\n<h4>Framework<\/h4>\n<p>This approach develops the following attributes:<\/p>\n<ul>\n<li>Confident<\/li>\n<li>Curious<\/li>\n<li>Digitally capable<\/li>\n<li>Engaged<\/li>\n<li>Future focused<\/li>\n<\/ul>\n<p>Find out more about the\u00a0<a href=\"https:\/\/www.ncl.ac.uk\/careers\/graduateframework\/\">Graduate Framework<\/a><\/p>\n<h4>See also<\/h4>\n<ul>\n<li><a href=\"https:\/\/www.ncl.ac.uk\/learning-and-teaching\/digital-technologies\/canvas\/canvas-quizzes\/\">Guides on Canvas Quizzes<\/a><\/li>\n<li><a href=\"https:\/\/www.ncl.ac.uk\/learning-and-teaching\/digital-technologies\/canvas\/canvas-new-analytics\/\">Guides on Canvas New Analytics<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Helen Atkinson \u2013 Careers Consultant Careers Service What did you do? I used Canvas New Analytics and Quizzes to monitor how students were engaging with non-credit bearing careers initiatives, specifically the following two projects: China Career Gateway: An annual extracurricular career development programme designed to help Chinese students at Newcastle University prepare for their graduate <a href=\"https:\/\/microsites.ncl.ac.uk\/casestudies\/2021\/12\/01\/quizzesanalytics_for_community_design\/\" rel=\"nofollow\"><span class=\"sr-only\">Read more about The Great Wall of student engagement: Using Quizzes and New Analytics to inform community design<\/span>[&hellip;]<\/a><\/p>\n","protected":false},"author":4592,"featured_media":2840,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1,560,322,321,576,583],"tags":[608,614,600],"class_list":["post-2834","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-all","category-canvas","category-careers-service","category-central-services","category-digital-education","category-international","tag-digital-skills","tag-future-focused","tag-reflective-and-self-aware"],"_links":{"self":[{"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/posts\/2834","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/users\/4592"}],"replies":[{"embeddable":true,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/comments?post=2834"}],"version-history":[{"count":12,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/posts\/2834\/revisions"}],"predecessor-version":[{"id":4054,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/posts\/2834\/revisions\/4054"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/media\/2840"}],"wp:attachment":[{"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/media?parent=2834"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/categories?post=2834"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/microsites.ncl.ac.uk\/casestudies\/wp-json\/wp\/v2\/tags?post=2834"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}