{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"53065daf-e1fd-5f1f-b815-e98d9ab63891","task_key":"default--validation--5304","task_revision_id":"1","upstream_id":"5304","short_description":"HellaSwag validation 5304","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to take cla supplements [title] Think about why you want to take cla. [step] There are number of claims made by people who manufacture and distribute cla supplements. The primary reason people buy cla is to lose weight.\",\"endings\":\"['But cla has also, in some studies, been linked to the prevention of heart disease, reduced likelihood for diabetes and various cancers, and stronger bones. [title] Get the right variety of cla.', 'Because of this, the person may be taking cla for a reason. Maybe the person seems to be taking it for personal gain.', 'These types of supplements are linked to specific health conditions, such as diabetes and heart disease. While many studies suggest eating cla may prevent irregular birth cycles and it can also prevent things like kidney issues, mood disorders and peptides.', 'Patients typically buy cla even if they need to eat the supplement-especially pregnant women. If you are supposed to lose weight, look into that issue.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}