{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"00fdc8c9-68c7-5566-a576-4de1f98501de","task_key":"default--validation--8207","task_revision_id":"1","upstream_id":"8207","short_description":"HellaSwag validation 8207","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to avoid unhealthy weight loss techniques [title] Do not aim for large quantities of weight loss in short periods of time. [step] A common claim made by some weight loss programs is \\\" fast weight loss \\\". They'll advertise that you can lose large quantities of weight very quickly.\",\"endings\":\"['This is a sure sign that this is not a safe program to follow. [substeps] Some dieting programs will market their program or product to those who are looking to lose weight quickly.', 'The initial weight loss is often the result of too much weight. For example, you can lose 100 pounds in a single month.', \\\"In particular, they'll say that you need to eat more calories than if you used to eat only a small amount and significantly lose your weight overall. [substeps] Eating at a certain level of rapid pace will mean that your eating is broken up into smaller, daily meals and snacks.\\\", \\\"You can save up to 35% or 45% of the weight you've lost while you're doing cardio or weight training. [substeps] Losing 130% of your weight quickly can damage your health and lead to poor body image.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}