{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"89873af9-88f8-5ab0-9762-0b3fa0206e51","task_key":"default--validation--44755","task_revision_id":"1","upstream_id":"44755","short_description":"HellaSwag validation 44755","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to figure out why you aren't losing weight [title] Do a 3 day food recall. [step] A food recall is very similar to a food diary. However, it's generally only kept for a certain amount of days and is very detailed.\",\"endings\":\"[\\\"A food recall is the one of the first places to start when you're not sure why you're not losing weight. [substeps] Doing a 3 day food recall will help you get a really good and solid idea of what you've been eating.\\\", \\\"It measures a food as visually as a diary, and then moves on to another food. It will mark the day and time of day when the food is likely to be the one you considered' right', but it does not mean it's' good' or' bad'.\\\", 'You decide what foods you need to be monitoring and use the recall to take those foods off of your body\\\\'s standardized list. For example, on this list you might write down \\\" ingredients, utensils, tools, freezer, refrigerator etc.', 'You can create a food recall by observing everything you ate as a person. You can ask your friends, family, partners, or coworkers what you ate.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}