{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ba6cddd-73db-5e29-85a8-8b837462505c","task_key":"default--validation--21790","task_revision_id":"1","upstream_id":"21790","short_description":"HellaSwag validation 21790","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to control your feelings around the person you like [title] Identify your feelings and their source. [step] This can help you figure out whether or not your feelings are a passing fancy or something more serious. It will also help you talk yourself through your feelings when you feel them.\",\"endings\":\"['Is this infatuation? Lust? When you feel a warm blush start to spread across your face or a similar feeling, acknowledge the emotion, and positively talk yourself through it. [substeps] \\\" i\\\\'m just nervous because i think he\\\\'s cute.', \\\"[substeps] When you're feeling in a critical way, be positive about it. If you don't like this person, try talking to them again.\\\", 'Finding the source of your feelings will make you feel more relaxed and less guilty about your interactions with this person. [substeps] For example, if you have an intense dislike of the person in front of you, consider asking for advice about being more comfortable around him or her.', 'This will lead to an easier conversation and insight for you and your partner. [substeps] Writing down thoughts and feelings about the person you like can also help, but be careful.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}