{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f0beaf01-8918-5d27-a0bd-b4bebf55f732","task_key":"default--validation--12154","task_revision_id":"1","upstream_id":"12154","short_description":"HellaSwag validation 12154","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to act around the girl you like [title] Build your confidence. [step] Confidence is one of the most attractive qualities a person can possess. You don't have to be super sexy or built like chris hemsworth, either.\",\"endings\":\"[\\\"Your poise, ability to adapt to situations and a certain amount of self-control is important for acting confident. Also, you don't have to sport an unkempt appearance to draw the girl to you.\\\", \\\"Come on, this girl really like you, at least if she isn't conceited. But embrace that little sassy girl who stands up for her friends, who stands up for those in the way she sees fit.\\\", \\\"Continue to show confidence and a bit of other things that'll make you feel attractive. [substeps] Don't try to be one of the girls everyone else thinks you are; put yourself out there, and the girl will notice.\\\", \\\"All confidence requires is a firm belief in your own self-worth. If you believe it, that girl you like? She's going to believe it, too.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}