{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b72c5428-5b1f-5ea7-bf3b-a46a28dbb51b","task_key":"default--validation--25891","task_revision_id":"1","upstream_id":"25891","short_description":"HellaSwag validation 25891","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to prevent hair loss while on accutane [title] Take the lowest effective dose. [step] The more vitamin a you have in your body from accutane, the more likely you are to suffer from adverse side effects, including hair loss. Ask your doctor what the lowest dose is that would be effective for treating your condition.\",\"endings\":\"['[title] Talk to your doctor about vitamin supplements. [step] Accutane may cause vitamin deficiencies in some patients, so it may be a good idea to have some blood work done.', '[substeps] Since vitamin a is supposed to treat split ends, take it as directed. Most doctors recommend 24 doses of vitamin a every day at least 4 hours prior to exercise.', \\\"[title] Lubricate the area with a non-stick coating. [step] Don't use stiff-bristled brush to apply the medication.\\\", '[substeps] If you try treating your condition with other dosages, just stop taking the highest effective dose. [title] Identify doses, or reduce the dosage.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}