Think First ,Talk Later: Introducing Paced Social Annotation

Hi everyone. Thanks so much for joining us today. I'm Joe Ferraro. I am the CEO here at Hypothesis and I'm joined by Michael de Roberts, our head of product, who's going to be walking us through everything today. Um, so before we get into it, a little context on where we're coming from. Uh, Hypothesis has powered over 100 million annotations. We're live in over 300 institutions in the LMS. And based on our internal reporting, 98% of faculty users have reported improved student engagement using social annotation. Honestly, it's obvious we're meeting a real need here. And this is one of the most registered for events in our company's history. We take that seriously and everything we build starts from what our users and our instructors are telling us what they need. Today's feature is a really great example of that. Uh so think first, talk later. That's the idea behind what we're launching today. And that's paste social annotation. Especially in today's world, AI can summarize a text in seconds. We think it's more important than ever for students to save to have room for work where they can actually go through their own thinking at their own pace before the conversation begins. There's real learning science behind that. Metacognitively, engagement and interaction on top of a text drives a lot more uptake of the information than reading alone. And students retain more when they're actively working with the text, not just passively consuming it. That annotation layer, that moment where a student stops and writes down what they're thinking, that's where the actual learning happens. And pay social annotation can protect that moment. Students annotate on their own first. They can form their own understanding and then that work gets revealed. So the conversation builds on original thinking rather than everyone piling up on the first post that shows up. It also works really well as a simple one-to-one student to instructor mode if you never want to reveal peer work at all. Uh so if we click through to the agenda, I'll talk about what we've got planned. Uh Michael's going to walk through what Pace Social annotation actually is. He's going to show a demo, cover some ways that some instructors are already using the feature, and then we're going to open it up for Q&A and take a look at what's coming next. So with that, I'll hand it over to Michael. >> Hi everybody. Uh, it's a pleasure to have you all here. Thank you so much. Um, I just wanted to let you all know we do have both a chat and a Q&A. So, as you come up with your product questions as we go, try and pop them into the Q&A if you can. We'll monitor both. Uh, but it might just help us stay more organized. I'll try and go live through all the Q&A questions at the end. Um, uh, I wanted to, uh, what do we got here? A little, uh, meet the speakers page. Um, yeah, I am so pleased to bring folks this new feature and I can't wait to explain it to you. Before I started, um, in the chat or with a little thumbs up or something if you have that, I'm really curious who here hasn't used hypothesis at all before. Nobody yet. Okay, cool. Uh, who used us last school year? So, the 2526 school year. Um, yes. Cool. Yeah. Yeah. Yeah. I I see some names I know. Awesome. Uh, what about uh what about the year before the 2425 school year? I'm curious how far back we're going to get. Uh, yeah, we're seeing Yeah. Well, Yep. I see I see names I know again. Yep. Uh, even earlier 23 24 to five years ago. That's great. Yeah. And then seeing lots of yeses. 22 23. Yeah, I think so. I I also the years are starting to to go quickly. Uh what I what did I say? Uh 22 23. How about 2122? That's that's back quite a ways. Uh yeah, people there. Awesome. You you are our longtimers. Thank you so much for that. I'll go back. I won't go farther than 2020, but I'm curious if anyone was here in 2020 21. Yeah. Awesome. Super. Uh, I'm also exposing my background as an elementary school teacher and camp counselor. So, thank you for participating in that. I appreciate it. Well, let's talk about what pay social annotation is. I I'm super excited to uh talk through this all with you now and and and explain why we built this. So, um what pay social annotation is, it's a way for instructors to hide student annotations from the students peers but not from the instructor. and then optionally uh reveal those annotations later. Um during the hide portion of the assignment um instructors can see their students work and students can see their own work uh but students like I said won't see each other's work. Uh we found that we had a lot of requests coming in for like discussion board like functionality where in discussion boards posts are hidden until students um get to a certain point in the assignment. Um, and we wanted to find a way to adapt that to social annotation uh over text and videos and image documents and things like that. Um, so you don't have to use the reveal portion of the assignment in past social annotation. We also get a lot of requests for a sort of onetoone instructor to student mode and this new feature will make that a lot simpler. Um, in fact, it'll help to aggregate student responses on the instructor end so you can see what everyone thinks in one view. Um, and then still separate students with your um, grading interface if you need. Um, during the hide phase, like I said, students can see their own annotations and instructors can reply to student annotations if they want. And the instructor replies will also remain hidden during the hide phase and then they'll be revealed during the reveal phase. Uh, I'm going to show you what this looks like now because I think that explanation, while accurate, uh, doesn't paint a picture as well as a picture does. Uh, so here we go. This is first the instructor's view. And I I put this first just because I want to tell you the instructor's view doesn't change between the hidden portion and the reveal portion of the assignment. It's going to look the same for you on both sides. Um, we're using the term checkpoint as the moment when annotations and replies move from the hidden state to the revealed state for students. Um, right now that's going to be accomplished by the instructor pushing a reveal button as you'll see in the demo. Um, but we're starting with this here because I want to show you what's coming up is on the instructor side. An instructor posted question by Michael admin, the instructor, answers from both Becky and Allen. And then also Alan and Becky have created their own annotations as well. So let's look at what the students will see now. Um so in the students view before the checkpoint here's here's here's Allen's view. He saw the instructor question and he made a reply and he doesn't see Becky's reply. After the checkpoint he does he continues to see his old work but he now sees the work that Becky did prior to the checkpoint as well. Um in the The important thing here is that the top level annotation, the original annotation an instructor made for whatever prompting you might want to do, a model annotation, some kind of scaffolding, a question, uh, is visible to all the students even if their replies under it won't be um, until after the checkpoint. Here's also an example of Allen's annotation. So Allen made an annotation, the instructor replied to his annotation. Great. he can see uh the instructor's reply, but after the checkpoint, he can see that Becky also made an annotation and both Becky's annotation and theru instructor's reply to Becky's annotation were hidden. Um we'll talk a little bit at the end about use cases and you know how you might use this feature, but uh this is sort of the core of the feature. Um, and then finally, the reminder that if the instructor never presses the reveal annotations button, uh, Alan will never see Becky's annotation and will never see the instructor's reply to Becky's annotation. So, if you're looking for that one-on-one private feedback mode, you just never hit the reveal button. Um, cool. So, I'm going to move now into an actual video demo to show you sort of how this is working um, in the moment. Uh, the demo is going to involve me showing you the creation of how to make a pay social annotation assignment, what it looks like on the instructor side, and then I'll swap in different windows to show you Allen's view and Becky's view, both before the checkpoint and after the checkpoint. So, here we go. Hi there, Hypothesis users. This is a demo of our new LMS app feature, paste social annotation. I'm going to walk you through what it looks like as an instructor to create this new assignment mode and then we'll see what it looks like as both an instructor and as a student. While this demo video uses canvas paste social annotation looks the same in all LMS's. When I first launch Hypothesis to create my assignment, I used to be asked to select a document, but now instructors are going to see the assignment mode screen. On this screen are two choices. The social annotation mode is our classic hypothesis enabled reading. The other mode is paste social annotation. This mode uses all of our previous social annotation components. It just adds a few things to help instructors add structure to their assignments. Clicking on paste social annotation, the first thing we're asked to do is select a checkpoint type. Checkpoints are the point in the assignment when students annotations go from hidden to being revealed. We'll talk more about this in a little bit, but for now, it's enough to know that a manual checkpoint means you're going to need to click a button to reveal student annotations that were previously hidden. And now we have the document selection page. I'm going to use a URL for this assignment. We still have the option to enable automatic participation grading or turn this into an assignment that uses the LMS groups integration. Let's publish this and take a look at it as an instructor. So, we see the text on one side and we see the sidebar on the other as we'd expect. But what's new is this top bar. In the top left, we display the checkpoint type you selected. In this case, it's manual. In the top right, there's a button that says reveal annotations. And that's what you, as an instructor, will click when you want to move the students annotations from that hidden mode to the revealed mode. At this point, I'll add an instructor annotation, a question I'd like my students to answer. Now we'll add some student notes. Here is my student Allen. When he opens the assignment, he sees the document and the sidebar as usual. He can also see the instructor's annotation. He has a top bar as well. In the top left, students see that there's a checkpoint and that the annotations right now are hidden. So, when he annotates, his classmates won't see the annotations he creates for now. We'll let Alan add some of his own notes, replying to the professor and adding his own thoughts. That's a good start. Let's check back in as the instructor. I can see I've got some updates here. I can see Allen's annotation. I can see his reply to my annotation. As the instructor, I'll reply to Allan. Okay. What does my other student Becky see in all this? Just like Allan, Becky sees the text and the sidebar. She sees that instructor annotation. She sees the same checkpoint information that Allen got in the top bar, but that's all she sees. Allen's annotation, reply, and the instructor's reply to Allen are all hidden. [clears throat] Let's add some notes from Becky. There we go. Let's go over to the instructor's side and see Becky's notes from that perspective. Two more updates. Those are from Becky. The instructor is seeing all of the annotations in this assignment, even if the students aren't. I'll reply to Becky. Now, jumping back to Alen's view, I want to show you that as Alen, I can also see the instructor's reply to me. Even though Becky can't see this thread at all, and Becky's notes, of course, don't appear here yet. We're going to change all that now. As an instructor, I feel like we're in a good place as a class. Everyone's contributed their original thoughts, and it's time for them to see what each other has written, reflect on it, and reply to each other. So, I'll click reveal annotations. This action cannot be undone. We want to be very clear about that. So, we've added this little popup. Now that I've clicked reveal annotations, nothing has changed on the instructor's side because as an instructor, I could already see everything. You'll note that the reveal annotations button is gone. And now I have a little reminder about when I click that button in case there's any confusion. Let's go in and see what's happening on Allen's side. He'll launch that assignment again, maybe a few days later. And now there's a lot more information here. I can see in the top bar that annotations are now visible, so I know the checkpoint has passed. Here's my instructor's initial question, but now I see my reply and Becky's reply. I see my annotation and my instructor's reply, but I also see Becky's annotation and my instructor's reply to Becky. Oh, Becky's pointed out something much more interesting than I did. As Alan, I can see now that I need to work a little harder. Let's see what Becky's up to. Becky also sees everything now. She can still see the instructor's question. And now she can see Allen's reply. She can see Allen's annotation. And she can see her instructor's reply to Allen's annotation. Everything Allen writes from now on, Becky will see instantly. It's only prior to the checkpoint that Allan's work is hidden from Becky. Okay, this has been our deep dive into how to use paste social annotation. Thanks for watching. Okay. Wow, I sounded really enthusiastic in that video, which is just a reflection of how enthusiastic I am for this feature. Uh, I've seen some good chats happening. I want to answer the questions there. I saw Jean jumped into the Q&A and there's more questions going in. That's great. Um, so I will get to that in a moment, but I just want to talk through uh some of the ways that you we think you can use pace social annotation. One of the things I love at Hypothesis is learning from instructors how they use our app and finding that they found interesting pedagogies that we didn't imagine. So that's a type of feedback uh I I always want to hear. Um please feel free to reach out if you come up with something. But here are some kind of basic use cases. um even without a lot of instructor intervention. Uh we think it's valuable to have students create annotations without seeing their peers work up front. Uh and then that will also push students to revisit the text later after the checkpoint in order to see their peers notes and create their own replies. Um a benefit of that checkpoint is that students will have to actually create their annotations before the last minute before the assignment's due. Um giving their peers something to reply to as well. So, we're trying to build some good assignment habits here on the student side. Um, instructors also, as I pointed out now, I think twice, they don't have to use the reveal annotations option. They can just leave things uh private. In the past, we published some guides on how to make oneonone assignments that used a very complicated way of using the LMS groups feature. Uh, this this feature now should make those sorts of assignments much easier to make. Um, uh, there's some additional use cases here. Um depending on your class size admittedly and other factors um you can add questions as a form of scaffolding and before the checkpoint students will be answering them without seeing their peers responses to those questions. Then after the checkpoint students can review each other's answers and you can direct them to reply to peers with a supporting or invalidating evidence things like that. Um after the checkpoint you can also prompt students to find and reply to their peers annotations both to generate discussion but also to compare and contrast their peers work with their own. Um and then one idea here would be to maybe have the students then use the page notes feature in hypothesis and write a short analysis. What did they learn in that compare and contrast and let those page notes kind of pile up where everyone could see them and read each other's short analyses. um you know describing what they got right, what they missed, and uh maybe questions they had that they saw either other peers had or had or didn't have. Um so I do want to go I see so many awesome questions here in the Q&A and I want to go read it. So I I'm going to talk really quick about what we're planning on adding to this feature in case that gets to some of the Q&A questions and then I'm going to go through all your Q&A questions. Please feel free to keep adding them as we go. So, I will hang out and answer them for as long as we need. Um, so some things that we anticipate building here, uh, that that we're going to keep adding onto the future. Uh, we want to let students opt into email notifications, uh, in those schools where, um, we we are receiving student emails from the LMS. Uh, so that when the instructor does move past the checkpoint, um, the student can get an email notification that says, "Hey, you move past the checkpoint. Now's the time to go back into the assignment." just to make it one step easier on instructors so they don't have to um remind students and a little less cognitive load for students as well. Um another thing that we are currently working on actually right now is a new integration with autograding. So autograding as you're used to it if you've used it before uh works with paste social annotation. What we're going to add for pay social annotation assignments is the option to um create autograding targets and goals to uh sorry to separate targets and goals before the checkpoint and after the checkpoint and then average the two together into a final grade. So that you can actually enforce with with autograding you have to leave this many annotations before the checkpoint. You have to leave this many replies after the checkpoint. And in that case, if a student gets in late after the checkpoint and makes their annotations, those annotations won't count towards that goal anymore. So, just a way to make it easier for you to enforce some of the structure that you might be helping students with. Um, so we will definitely be letting folks know when that autograding integration is uh complete. Going along with that will be an optional for you inapp due date. So, I know you can oftenimes set due dates in your LMS's. those LMSs don't always send us the due date in a super helpful way. But if you'll be able to quickly set the due date inside our app on a pay social annotation assignment, then we'll know it and we could say stop the autograding count at a particular time so that late work won't be counted. Uh we'll see how people use that and then maybe refine it more in the future. Uh also the manual checkpoint is very manual. You have to click a button as you saw in in the demo. We anticipate adding additional checkpoint options along the way and after you've given it a shot. Um we would love to get your feedback on like what sort of checkpoint would have if manual worked for you or if something else would have worked better such as a calendar checkpoint or things like that. Um okay, I see lots of lots of great questions here and I'm just going to go through them all. Please if I miss something uh uh shout out in the chat or you know in in the Q&A or something and and I I do want to make sure I answer them all. So, I'm going to go through um for my team, I'm going to go through the open questions first in the Q&A, and I'm just going to click answer live. I might look at the answered questions as well, just to make sure that I in case I want to add a little flavor to something here. Um, right. So, how will this work with a class of 40 students? I mean, that's a great question. Um, one of the things I went by maybe kind of quick is that pay social annotation will still work with the LMS groups integration. So, if you're already using us with a class of 40 students, you might already be using our LMS groups integration. Uh how that works varies diff varies a little bit with LMS but on our end it's all the same. You define your group structure in the LMS and then when you go to make an assignment you say hey I defined this group structure in my LMS course use it for your assignment. And if you say let's say you put all of your students into groups of 10 uh in your LMS then in the assignment we would put those students into those exact groups of 10 and and you as an instructor would be able to flip between the groups. you'd view each group individually. Um, but within the group, students would only see annotations made within the group. They wouldn't see annotations made in other groups. That's the normal groups integration. All of that works with Pay Social as well. Annotations, even after being revealed, are still only visible within the group. Prior to the checkpoint, um, students still feel like they're annotating alone. You'll see all their annotations, albeit distributed between the groups you've assigned students to. after the checkpoint during the reveal, uh students will see their peers annotations within their group, but they will continue to not see their annotations outside of the group. So, um really the same way that we would uh normally handle it, but just with the uh checkpoint added. I hope that answers that question. If not, please feel free to give me some give me some nuance here. Um okay, the next one, uh every time I copy assignments over, I have to choose the external tool again. So, I'm guessing that you can I don't know if the choice comes when you choose the I seere answering that. Uh yeah, Jan. Um Johnre is going to type you an answer and I'll I'll check it and and he's going to be right, but I just want to read it myself. Um but you're also welcome to email our support team anytime. The answer to how that works in might involve a little back and forth because it depends a little bit on your LMS and sometimes it depends on LMS settings that your LMS admin controls that aren't always in our control. It's how our app can talk to your LMS and what it can and can't get back in terms of information. So, uh sometimes we put that in the support channel just because then we can ask you a bunch of stuff that's mildly personal to your class so that we can actually figure out an answer. Um but uh we'll we'll work on answering it. Um okay, Jennifer Howard, is it possible to designate a student as moderator? I like having students moderate the annotation discussion and could see how this could be helpful if you could designate a student that had access to all the comments for the checkpoint. That's an interesting idea. Um, uh, oh, and I see success team would like to answer this question. I'm going to chat a little bit, but I don't want to discourage my team from also answering. So, feel free to get in there and answer as well. Um, please write to us. I want to we'll capture that feature request internally now, but it might be nice for us to have a conversation. Uh, we have definitely been talking about a the possibility of a TA mode, either a formal kind of TA within your LMS. Maybe we can do it so that you can also nominate someone to be like a temporary TA within an assignment without making them one in the course. Um, lots of times we do tend to sort of uh mold oursel after whatever roles are in the course, but this is an interesting idea. So, and we've been talking about what might go into such a TA mode, someone who's not quite an instructor, not quite a student. Um, otherwise, a student moderator could also be a really interesting idea. I mean, I could see that being useful in pay social, but also just in our regular social annotation assignments. you might want someone in there. Um, I think it's Yeah, I'd love to learn more about this. So, maybe let's let's let's chat a little bit too. Um, I would love to learn more about what you think would be helpful here. Um, I could imagine a mode, for example, where all student annotations enter into a queue and none of them are visible to anybody and then they have to get approved or denied by a moderator that could be the instructor or could be student volunteers or a mix of both. So, we could we could definitely look into um something like that. Um is there a way to reveal the annotations after the checkpoint only to those students that added annotations? Not that's a really good question. Um Ashley, not at this time. That is one of the possible checkpoint modes we might add in the future depending on what we what we see people do. Um that would be closer to real discussion board functionality, right? Where um you actually say you can't see each other's posts until you've completed three posts. So it becomes more about hitting a specific goal and unlocking your view as opposed to hitting a particular time. Um, and that is definitely a checkpoint type that we debated. It wasn't feasible to build it for this initial release. Um, but I I would love to hear from everyone who's actually really interested in that functionality. Uh, more numbers sometimes gives an idea a little more weight and that could be super helpful. So yeah, thank you for that. Uh, it's not possible yet, but it but it's it's it's on our radar. Um, uh, can we have a different checkpoint times in the same assignment? I have a large class sections meeting on different days, so each will need a different checkpoint time expect. Yeah. Um, that's a really good idea, too. Um, you know, one thing we've seen with the with the alignment of like real life core sections [snorts] versus how something like Canvas sections or or you know, other sections and other LMSs get used. is that sometimes uh uh sometimes people will have whole different courses for sections. Sometimes they actually use these sections tool in their LMS to to designate sections. Uh I think that's really good piece of feedback as well. I'll have to think about that. It definitely it definitely um is trickier if you have a single Canvas course and a single assignment. Um, honestly, depending on your LMS, what you might have to do is uh like use the assign to feature in your L. This is a workaround for now, not something I'm saying you'd have to do permanently, but uh you might have to use the assign to feature in your LMS and then make like three assignments and give each assignment to a different section. And if you did that, you might need to combine that with LMS groups. Um, uh, Jean Ray or I could definitely help you with this in the support channel as well. So, if you want to write to us, we could think through a methodology you could use to make this kind of doable for you in the moment. In the meantime though, I will definitely take that feedback into consideration. I think it's a really good idea. Um, cool. Robin, Robin, uh, will the ability to stop counting late annotations also work in manual mode only if it works in the autograding mode? So, um, depends where you mean for counting. Right now, the only real Oh, I see. Yeah. So, like using the dashboard at all, whether or not autograding is turned on, will we stop counting annotations? Um, I'd like to hear from you on why you want that. I off the top of my head, maybe not only because I want to always be able to give you a count eventually of how many annotations got put on the thing. And then in that case, I guess, yeah, if you if we kept it to autograding, I could give you two counts. I could give you the sort of actual assignment count and then the ontime assignment count. Uh but if you can, you know, with the autograding feature turned on, grades are not automatically pushed to your LMS. We have a lot of people who turn autograding on just to kind of get the counts and the math done for them, but then they just never click the sync grades button and because they don't want those that's not their grading basis that they use in the LMS. So, I mean, I would probably keep the due date feature to auto just in autograding and just encourage people not to sync, but I'm open to hearing maybe why that's not feasible um or or what the use cases are to apply to sort of the whole count. So, yeah, thank you for that. Um Michelle Athetherton, will these changes roll out to all institutions at the same time or do institutions need to do work to get in front of these faculty? Uh do you have a timeline for the feature? Uh there is a small number of institutions that have specifically requested we don't turn this feature on yet. They want to complete some uh uh testing of it and then we'll turn it on for them. But for everyone else, it actually turned on today like an hour ago. So uh if you go into your LMS right now and you go to make a new hypothesis assignment, it's very likely that you will see the pace social annotation option. And if you don't see it yet, I would give some grace to your LMS testing teams. I know they work really hard to make sure that like what they're giving you is a well doumented experience and they probably just wanted a little extra time to fill that all out for you all. So, um but I I it should be there now in for like you know 90ish plus% of you? Um uh will the pay social annotation option show up in Canvas if the annotation assignment is imported from the previous semester? Yeah, someone has asked this. Well, it's a really good question. at this time. Uh, no, you have to create a new assignment to get to the pay social annotation feature. For technical reasons, it was difficult to like allow you to edit assignment, go back and change that initial setting uh on uh on a copy of an older assignment. Uh, but I think it's really good feedback that we should build a way to let people do that. Uh, which which I took from uh I can't remember if it was the chat chat or another Q&A, but um yeah, I would uh I would say uh is something that we should look to roll out in the future. Um if someone else let's see um pay social works with all source types I see genre entered this but yes everything every document type that already works in hypothesis um will work you know for for what we're calling social annotation now will also work in pay social annotation um and let's see uh yeah there's some things about course copy yeah please do write to our support team anytime with questions or just feedback or whatever even if you're just having a frustrating time or a super happy time uh it really helps us to know about it. Um, we our team has worked really hard in the past to try and get course copy to work correctly in a lot of LMS's in a lot of edge cases, but there just are a lot of edge cases. Uh, I'm going to read through the chat really quick here to make sure that um I haven't missed something that got put in the chat. Uh, grading rubrics. I see Joe got in there. Yeah. Um, we don't have an internal grading rubric. Uh in hypothesis we rely on the LMS grading rubrics which can be different per LMS. In at least one of the LMS's you their own guidance is create the assignment then come back edit it and add a grading rubric which can be a little confusing. Uh we do have some information up on our um help pages as well on our site. And you again you're always welcome to write to us and ask um just because you're not seeing it yet. So it's possible that you're at one of the um LMSs with the team is still reviewing which is fine. Uh if you again if you write to us we can we can we can walk you through it. Uh Caroline, multiple checkpoints is something we debated and I think is also a future possible piece I uh I I got to interview several people. Some of them are on this call uh about um what they'd like to see in this uh feature. And the idea of multiple checkpoints did come up. Um but it it was uh going to be technically challenging for the initial release. And also it's the kind of thing where uh we want to hear from people who want it. so we know just how badly it's wanted. Uh so we know to to spend the time on doing that. Um I do think that's a good idea and I'm looking at your other kind of yeah the discussion leaders thing is in there too. I think that's a good idea as well. Um um yeah past social annotation once you make a pay social annotation assignment next course copy that copied an assignment will stay paste social. So even though you can't edit your old social annotation assignments into pay social now um you can you know once you and I know once you go through the trouble of making some new assignments that use pay social when you go to copy those they will remain pay social after the copy um which was important to make sure we you know we do um uh autograding I see there's a question about when are some of these new features um going to be available autograding is uh available now it has been uh for a little bit uh a bunch of We we keep a help article if you look up like hypothesis LMS app and then change log. There's also maybe Jandre can drop a link to the change the LMS app change log in the chat. Um we list everything that we have made for the LMS app in that change log article which is just open. You don't have to be some kind of subscriber or give us an email or something. You can just go there and read it. So we just posted paste social on that um uh today and you'll see that we posted and we often link out to help articles as well. So, if you're like, I heard they did autograding. I don't know when they released it. How do I find an article on it? If you go to the change log, we'll link out to the the autograding help article that will explain how to use it. We link out to the pace social article, um import export, image annotation, all those things that we've all those things that we've made in the past are all linked there. It's a nice place to go and look at all the features um that you may or may not know about. Appment mentions is another one. Um, I want to preset question. If I h if I want to have preset questions at the beginning of the semester, will I be able to use the same questions from one semester to the next or do you need to update the questions every semester? Yeah, and I see Joe answered this. Uh, obviously Joe's correct. Um, yeah, this is why we built our import export feature. Go to that change log and it'll link out to our help article and teach you all about how to use it. And then what you would do, I think Joe said all this also, but you would go to the old assignment, export your annotations and then import your, you know, import those same annotations into the copied course and it'll just write them all for you. Also, if you're someone who has like a really big class and you have a large number of groups and you want to add scaffolding, questions, anything else, this is also an easy way to push that scaffolding to all the groups fairly quickly. We still don't have a way right now of saying add this to all the groups in this assignment at once. Um, but what you can instead of having to retype your annotations for every single uh group, you just have your one kind of export file and go group one import switch group port import switch group three import switch. A lot faster than retyping. Um, uh, uh, yeah, I see the plus one to the moderator leader idea. It's good to see that. It's good to see multiple people want that. U, that's super helpful to know. Um it's also it's also um super useful to get this up front. So thank you guys. Um if you want students to ask questions of the rest of the class. Yeah, maybe we could add that to the student moderator feature if that's something that we end up um depending on when we get around to it. Um I'll tell you that we already have a lot of many many months of work planned ahead of time, but we are I love accumulating these ideas and it might be the kind of thing we could roll in the future. Right now, Eric, um, for your question, sorry, for everyone else, the question is, what if students who want to ask questions to the rest of the class, um, will the checkpoint be possible for this feature? Um, right now, if students ask a question to the rest of the class, they won't see it until the reveal portion after the checkpoint. Um, it could be an interesting exercise actually to have students go through and draft questions about what they'd want to ask the class while they can't see each other's work. Um, you know, one of the things we one of the pieces of feedback we get is sometimes when students, you know, don't get in the assignment as soon as it opens, they feel that like all the good spots have been taken that people have annotated over just what they wanted to annotate over. And with Pay Social, whether that's an annotation or question prompt students are writing or anything else. Um, you know, one of the advantages here in Pay Social is students get to have that document all to themselves at first and then I think it's frankly an interesting exercise after the reveal to say, "Oh, like Alice and uh Bob both thought that this place would be a really good idea for a question prompt, but they actually wrote very different question prompts. Let's discuss like why you two wanted these, you know, to ask the class different questions." So, I could see that in any scenario, whether it's like a teacher prep course, um, or or any sort of it's an interesting form of scaffolding I'd like to see people do. So, that's cool. Uh, good. Laura Gail says it's there. Yes, people are seeing it. Wonderful. You guys are great. I want to I'm going to keep going through this. If you need to drop out, I just want to say thank you so much also for coming. I'm going to keep going through all the uh all the uh chats here and see if anything else comes into I see a few more things came in the Q&A. So, I'm going to keep going through and answering stuff. if you're welcome to stay, but also as we if we get past your use case and you want to drop off, um uh let me I want to ask my team I I we're definitely going to make the slides available. The slides will link to the demo video in it. Um uh I don't know that you need my my like a recording of this um thing here, but if you need any information from me, please reach out. Uh you can reach out through the support channel and I promise it'll get to me. Um it's super uh it's super helpful to hear from folks um with whatever you have to say. Um checkpoint feature sorry Joseph is saying is this only available in the LMS app or is also part of the browser extension? And I see just saying yeah this is an LMS app exclusive feature. we rely on certain information that we're getting from the from from people's LMS's and so it's not it's not part of the uh it's not part of the web app and I I let you all talk through um uh uh oh I see that there's a question about the browser extension not being supported actually there's uh some potential work coming to the browser extension in the future Um I don't know how much I want to say at this point but uh it it would be around it would be around group management um in the browser extension and making it um a little better supported for people especially in education but other environments as well. Um I will give you the heads up that um I if and when we build that it's likely to be a paid feature in the browser extension. The browser extension first uh paid feature. Um if you're not unfamiliar with the LMS app for the few of you who are you know um everyone here who's using the LMS app has uh institutional agreements with us or might be using our integration with um the digital textbook provider Vital Source. they have a way of enabling our app in classrooms as well that have vital source agreements um usually in conjunction with um kind of a bookstore thing something like that. So uh yeah um uh the multiple web pages thing is interesting actually um Jennifer I uh we are there's a possibility of like a multi-document assignment mode coming in the future uh not super soon but I I I appreciate hearing that if you want to reach out to us with your kind of use case here. Um, we have some temporary fixes too where we know folks who like will take multiple web pages and make a single kind of PDF out of them to use that in the LMS app. Um, uh, but also we think there's a like a like I said, yeah, like a multiple document, put multiple documents in an assignment and either have students access any of them for people who like to give their students uh, many document choices to choose from and just want them to complete one or even assigning specific documents to specific groups. So you could have all your different groups be in one assignment. Um that's uh uh farther in the future, but is definitely something that we started to kind of draft a little bit because we we we do hear about it. Um I see you missed my question about whether you can have two checkpoints. I apologize for that, Caroline. Yeah. So no, we don't have multiple checkpoints yet. Um but I think there's two versions of it. There was a version here where it was like, can I set different checkpoints for different groups? I think that's really interesting feedback and it's something I want to look at. We're also looking at the possibility of multiple checkpoints in that say like multiple hide and reveal sections. So you'd have checkpoints one and two and so you'd start with everything hidden. You'd hit checkpoint one and everything made prior to the checkpoint would get revealed but then future check future annotations would still be hidden and then you get to checkpoint two and everything would be revealed. Right now that's not how it works. I want to be clear. Right now, after you get to the checkpoint, um absolutely everything gets revealed uh from then on, but uh the multi-checkpoint option is something that that we've looked at as well that um that that might be in the future. When was it released? Like just today, you haven't missed anything. Um and I see Jean Ray linked to the Elements app change log. That's awesome. I'm getting caught up on the chat. Um oh, good. I see Joe said the recording of this call. Good, good, good, good, good, good, good, good, good, good, good. Uh maybe I should sing a little song. Um, oh, I see the Iris pages are interactive. Yeah. Um, well, multi-doc multi-doccument will be able to work with with URL as well. So, we'll check back in maybe in uh nine months or so. Uh, we'll see. We'll we'll see if that's that's where we're moving. Um, okay. I think I've gotten to everything. If I miss something, I apologize. I'm going to go back into these Q&A things. I see Jean has been very diligent answering that. Um, yeah. Awesome. Okay, Jeanre's got that one. Um, I'm just going to go to the end of the Q&A thing here. Um, yeah, very happy to help folks out. If you've had issues, whether it's with course copy, vital source, anything like that, um, we can usually help you fix it. Please do write to it's supporthypothes.is. You can also go to our website and we have a get help link in all of our help articles. So, just navigate over to our help articles and um, you know, write to the support team. We help admins, instructors, students, everybody. We get back to you super quick within our working hours. And uh I really like meeting people that way. I have had a lot of uh support tickets turned into screen shares and stuff like that. And I I then learn not only how you all are using it, which I then get to share with other instructors. Uh our sales and success people love to learn this stuff too and they share that information out and kind of build the community um a little bit. Uh but it also informs a lot of our thinking around new features. you know, you really can help power a lot of the new feature work we do when we um when we when we hear from you. So, please do hear from you. You should also probably receive a uh every half a year, 6 months or so, we send a little email that's just like a check-in. The emails like, "How are we doing?" Like 0 through 10, and there's an optional text field. Use that optional text field if you want and just say, "Hey, I'm having whatever time you choose to put in, good, bad, ugly." Um, but then you could say, "And what I'd really love is to see this and just write to just write to us that way, too. Um, it's super helpful. Um, I I go through all of our data periodically and just read everything that people have written to us. Um, if you attach your email to it, you often don't have to, but if you give us feedback with your email attached, I might end up reaching out to you. Uh like I said, there was a number of folks in this call today that I actually interviewed to learn about what what our users wanted before building paste social annotation. Uh and uh I knew who to contact because they attached their email to their feature request they sent to us. And when I said, "Oh, we should build this." And I said, "Let me find everyone who wrote to us and write back to them and say, "Are you available for an interview?" Um the interviews are some of uh some of my favorite things to do because I just I love working one-on-one with our users. Um, all right. I have talked so much to you all and you all have been super patient. So, thank you so much for your time. Uh, thanks for viewing this with us. Thanks for using the feature. Please do check it out. Send us, you know, send us feedback. Yeah. Have an have an have an excellent year. Um, I I hope your students are as diligent as you all are. Uh, because uh uh you deserve that. I don't know if anyone on my team wants to hop back on. Otherwise, >> this this was really great and the questions continue to come in. Uh feedback is a gift and we really appreciate it and uh happy annotating this semester. Thanks everyone.