{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9fafeed4-4b0c-5fef-92b4-04627fa3a5e8","task_key":"default--validation--8695","task_revision_id":"1","upstream_id":"8695","short_description":"HellaSwag validation 8695","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to know if a man is interested in you [title] Look at how he acts towards you vs others. [step] Is he paying way more attention to you than other girls (or even his own friends)? Is he nicer or does he try to touch you more? These may be signs that he's interested in you. [title] Check the body language.\",\"endings\":\"['[step] He may be acting friendly towards you because he likes your body. If his body language is dismissive of some aspect of your body, his interest may start to decrease.', \\\"[step] Many men can communicate better when their partners are close. If you're taller, look for discomfort in your partner's body.\\\", \\\"[step] If you see a guy walking towards you with his open body language then he may like you. He may be interested in you but don't take the hint.\\\", '[step] Notice how, when, and how often he touches you. A touch to the cheek or neck is a dead giveaway, but a touch to the hand, arm, or lower back can also be a sign that he wants to get closer.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}