{"id":1169,"date":"2023-09-05T14:35:56","date_gmt":"2023-09-05T13:35:56","guid":{"rendered":"https:\/\/blogs.bath.ac.uk\/clt\/?p=1169"},"modified":"2023-09-05T14:35:56","modified_gmt":"2023-09-05T13:35:56","slug":"crowdmark-pilot-for-efficient-and-quality-feedback","status":"publish","type":"post","link":"https:\/\/blogs.bath.ac.uk\/clt\/2023\/09\/05\/crowdmark-pilot-for-efficient-and-quality-feedback\/","title":{"rendered":"Crowdmark pilot for efficient and quality feedback"},"content":{"rendered":"<p><span data-contrast=\"auto\">Building<\/span><span data-contrast=\"auto\"> on the successes of an initial trial, <\/span><a href=\"https:\/\/forms.office.com\/e\/NdwwppmLgW\"><span data-contrast=\"none\">teaching staff are invited to pilot Crowdmark<\/span><\/a><span data-contrast=\"auto\"> to see if it can help them grade and feedback on students scripts more efficiently and consistently.\u00a0<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<h3><span data-contrast=\"none\">What is Crowdmark?\u00a0<\/span><span data-ccp-props=\"{&quot;134245418&quot;:true,&quot;134245529&quot;:true,&quot;201341983&quot;:0,&quot;335559738&quot;:240,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/h3>\n<p><a href=\"https:\/\/crowdmark.com\/\"><span data-contrast=\"none\">Crowdmark<\/span><\/a><span data-contrast=\"auto\"> is an online marking platform that is focused on making it easier to deliver efficient, consistent grading and feedback on students work at scale.\u00a0<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">Students submit their work through Moodle to a Crowdmark assessment point, which opens up Crowdmark\u2019s marking tools to staff. In addition to standard marking tools, here are 5 features that separate it from other tools:<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<ol>\n<li><span data-contrast=\"auto\">Write once \u2013 use everywhere. Every comment gets added to a shared Comment Library so to easily give consistent feedback at scale.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li><span data-contrast=\"auto\">Work as a team: Comment Library items are shared \u2013 helping feedback consistency across marking teams.\u00a0<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li><span data-contrast=\"auto\">Marks can be attached to comments \u2013 this helps self- and team- marking consistency.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li><span data-contrast=\"auto\">Update once, update everywhere. From the Comment Library, you can edit a mark\/comment and choose that to update to everywhere it has been used.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li><span data-contrast=\"auto\">Students can upload from camera roll \u2013 this makes it easy for students to submit problem sheets to be marked question-by-question.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<\/ol>\n<p><span data-contrast=\"auto\">Crowdmark also supports many other features including double blind marking, group assessments, scanning support for in-class tests\/problem sheets, and support for rich comments (e.g. images\/links\/videos and type equations using LaTeX syntax).\u00a0<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-1170 aligncenter\" src=\"https:\/\/blogs.bath.ac.uk\/clt\/wp-content\/uploads\/sites\/135\/2023\/09\/Snip20230905_1-300x196.png\" alt=\"The Crowdmark interface showing annotations picked from the Comment Library \" width=\"300\" height=\"196\" srcset=\"https:\/\/blogs.bath.ac.uk\/clt\/wp-content\/uploads\/sites\/135\/2023\/09\/Snip20230905_1-300x196.png 300w, https:\/\/blogs.bath.ac.uk\/clt\/wp-content\/uploads\/sites\/135\/2023\/09\/Snip20230905_1-329x215.png 329w, https:\/\/blogs.bath.ac.uk\/clt\/wp-content\/uploads\/sites\/135\/2023\/09\/Snip20230905_1.png 683w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/p>\n<h5 style=\"text-align: center\"><span data-contrast=\"auto\">The Crowdmark interface showing annotations picked from the Comment Library (see <\/span><a href=\"https:\/\/www.youtube.com\/watch?v=IZe2dBl8EtQ\"><span data-contrast=\"none\">Crowdmark demo video<\/span><\/a><span data-contrast=\"auto\"> 8:27).<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/h5>\n<p>&nbsp;<\/p>\n<h3><span data-contrast=\"none\">Staff experiences at the University\u00a0<\/span><span data-ccp-props=\"{&quot;134245418&quot;:true,&quot;134245529&quot;:true,&quot;201341983&quot;:0,&quot;335559738&quot;:240,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/h3>\n<p><span data-contrast=\"auto\">Last academic year, staff from Chemical Engineering, Mathematics and Physics ran a small pilot with a few hundred students (see <\/span><a href=\"https:\/\/uniofbath.cloud.panopto.eu\/Panopto\/Pages\/Viewer.aspx?id=75fbb1c1-5920-4a48-9b2e-b03000be854b\"><span data-contrast=\"none\">Crowdmark Pilot Overview<\/span><\/a><span data-contrast=\"auto\"> recording) to evaluate how useful and impactful the platform was on assessment and marking. Overall, there was a strong positive response from staff. The key areas that showed the main benefits were around marking efficiency and quality of feedback markers felt they were able to give.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<h4><span data-contrast=\"none\">Marking efficiency<\/span><span data-ccp-props=\"{&quot;134245418&quot;:true,&quot;134245529&quot;:true,&quot;201341983&quot;:0,&quot;335559738&quot;:40,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/h4>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"auto\">\u201cIf we are serious about providing individual feedback to large student cohorts then we need a tool like this.\"<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"2\" data-aria-level=\"1\"><span data-contrast=\"auto\">\u201cIn moving assessments to Crowdmark, it took roughly a third of the time normally taken to grade assessments.\u201d<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"3\" data-aria-level=\"1\"><span data-contrast=\"auto\">You get suggestions from your Comment Library as soon as you start typing.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Importing comments from Excel\/Moodle gives good starting point (and speed things up next year).<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"5\" data-aria-level=\"1\"><span data-contrast=\"auto\">Small\/gentle learning curve to getting started.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"5\" data-aria-level=\"1\"><span data-contrast=\"auto\">Analytics \u2013 \u201cI can see frequent comments and easily identify common mistakes.\"<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<\/ul>\n<h4><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559685&quot;:720,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><span data-contrast=\"none\">Feedback quality<\/span><span data-ccp-props=\"{&quot;134245418&quot;:true,&quot;134245529&quot;:true,&quot;201341983&quot;:0,&quot;335559738&quot;:40,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/h4>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"2\" data-aria-level=\"1\"><span data-contrast=\"auto\">\u201cI could provide longer feedback as this is done only once per comment and re-used.\u201d<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"3\" data-aria-level=\"1\"><span data-contrast=\"auto\">Batch editing comments. \u201cOnly after seeing a slightly unusual way of doing things several times did I understand what the students <\/span><i><span data-contrast=\"auto\">meant<\/span><\/i><span data-contrast=\"auto\"> to do. It allowed me to navigate very easily back to the other students and adjust my comments.\u201d<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:720,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" data-aria-posinset=\"3\" data-aria-level=\"1\"><span data-contrast=\"auto\">Unit convenors could provide comments for demonstrators hitting the right tone and level of detail.<\/span><\/li>\n<\/ul>\n<h5><span data-contrast=\"auto\">Watch <\/span><a href=\"https:\/\/uniofbath.cloud.panopto.eu\/Panopto\/Pages\/Viewer.aspx?id=6836ec86-09e6-4686-ac13-b07400a5898c\"><span data-contrast=\"none\">Tina Duren share her experiences of using Crowdmark<\/span><\/a><span data-contrast=\"auto\"> (4:27)<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/h5>\n<p>&nbsp;<\/p>\n<h3><span data-contrast=\"none\">Student feedback<\/span><span data-ccp-props=\"{&quot;134245418&quot;:true,&quot;134245529&quot;:true,&quot;201341983&quot;:0,&quot;335559738&quot;:240,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/h3>\n<p><span data-contrast=\"auto\">Students were given the opportunity to feedback and were largely positive about the submission, viewing their marked work and their feedback. A few comments:<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">\u201cWay easier than moodle, straight forward and convenient.\u201d<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">\u201cI liked how I got comments on my work specific and it was very easy to use Crowdmark.\u201d<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">\u201cWe were told specifically which areas we did well or poorly. Feedback comments were useful and not general. Overall I was very happy with using Crowdmark!\u201d<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">\u201cFeedback on how to improve and exactly where marks were deducted not just comments on general shortcomings.\u201d<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<h3><span data-contrast=\"none\">Try Crowdmark for yourself<\/span><span data-ccp-props=\"{&quot;134245418&quot;:true,&quot;134245529&quot;:true,&quot;201341983&quot;:0,&quot;335559738&quot;:240,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/h3>\n<p><span data-contrast=\"auto\">With financial support from the <\/span><a href=\"https:\/\/www.bath.ac.uk\/guides\/teaching-development-fund-tdf\/\"><span data-contrast=\"none\">Teaching Development Fund<\/span><\/a><span data-contrast=\"auto\"> and also the Faculty of Engineering and Design, you (and your students) can test out Crowdmark for yourself. If you are interested in trying this for coursework, problem sheets or class tests, please fill in this <\/span><a href=\"https:\/\/forms.office.com\/e\/NdwwppmLgW\"><span data-contrast=\"none\">contact form<\/span><\/a><span data-contrast=\"auto\"> or for any questions ask James Foadi (Department of Mathematics) or Josh Lim (Technology Enhanced Learning team). We especially welcome trials during semester 1 and whilst, the pilot to date has focused on STEM subjects, we welcome participants from across the University.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">The initial pilot during the 2022\/2023 academic year was supported by the <\/span><a href=\"https:\/\/www.bath.ac.uk\/guides\/teaching-development-fund-tdf\/\"><span data-contrast=\"none\">Teaching Development Fund<\/span><\/a><span data-contrast=\"auto\">.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Building on the successes of an initial trial, teaching staff are invited to pilot Crowdmark to see if it can help them grade and feedback on students scripts more efficiently and consistently.\u00a0\u00a0 &nbsp; What is Crowdmark?\u00a0\u00a0 Crowdmark is an online...<\/p>\n","protected":false},"author":1637,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[95,90,20,3],"tags":[],"class_list":["post-1169","post","type-post","status-publish","format-standard","hentry","category-accessibility","category-innovation","category-learning-and-teaching","category-teaching-development"],"acf":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/pd4Piw-iR","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/blogs.bath.ac.uk\/clt\/wp-json\/wp\/v2\/posts\/1169","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bath.ac.uk\/clt\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bath.ac.uk\/clt\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/clt\/wp-json\/wp\/v2\/users\/1637"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/clt\/wp-json\/wp\/v2\/comments?post=1169"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bath.ac.uk\/clt\/wp-json\/wp\/v2\/posts\/1169\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bath.ac.uk\/clt\/wp-json\/wp\/v2\/media?parent=1169"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/clt\/wp-json\/wp\/v2\/categories?post=1169"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/clt\/wp-json\/wp\/v2\/tags?post=1169"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}