{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cf2a2945-37df-5c81-a771-7a859e34dc6b","task_key":"default--validation--11858--variant-85227f6f9f21","task_revision_id":"1","upstream_id":"11858--variant-85227f6f9f21","short_description":"HellaSwag validation 11858","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to store baby food [title] Store unopened jars and pouches of baby food in a dry, dark location. [step] A pantry or cupboard works best. Look for a relatively cool location and avoid notably warm spots.\",\"endings\":\"['Store the food where your baby will be warm. [substeps] Tuck the material away in its appropriate spot beneath glass jars.', 'Even though the packaging should prevent the food from spoiling, prolonged heat still has the potential to spur bacteria growth. [title] Rotate jars and pouches out by expiration date.', \\\"[substeps] Avoid storing baby foods that are too hot or too cold as they'll quickly spoil. You may already have canned vegetables in one jar but keep these since baby food can lose flavor if it's killed with a heat source.\\\", \\\"[substeps] If you use containers and pouches of baby food, choose a place where you won't be disturbed. Lay out several unwashed dishes in your pantry or kitchen.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}