{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"34dd02e5-6784-524e-a7f1-64cb3e18f03a","task_key":"default--validation--2867","task_revision_id":"1","upstream_id":"2867","short_description":"HellaSwag validation 2867","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to stop getting acne in the same spot [title] Limit what touches your skin. [step] If you repeatedly get acne on specific parts of your body, think about what touches that area regularly. You may find that your hands or an article of clothing may be touching that area and causing breakouts.\",\"endings\":\"[\\\"[substeps] Avoid going out in public, which could cause you to get acne. Instead, avoid wearing tight clothing, which may reduce your arm's ability to hold contact with the skin and other sensitive areas.\\\", 'To prevent this, avoid touching your face with dirty hands or wearing tight fitting or dirty clothes. [substeps] For example, if you wear a baseball cap and regularly get acne on your forehead, try not wearing the hat and see if the acne clears up.', '[substeps] Protect your skin from sensitive surfaces by exercising, going to the gym, or getting a haircut. Remove any clothing that may touch your skin.', 'Thus, limit where your hands and clothes touch and increase the likelihood of breakouts. [substeps] If your hand or clothing is touching something sensitive, try to resist the urge to touch it.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}