{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3bcccdff-d37a-5695-acf8-66d11f8cfe51","task_key":"default--validation--33935","task_revision_id":"1","upstream_id":"33935","short_description":"HellaSwag validation 33935","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to clean bottle nipples [title] Sterilize new bottle nipples. [step] Before using new nipples or bottles for the first time, submerge them in a pot of boiling water for at least ten minutes. Remove them from the pot with a clean pair of tongs and let them air dry on a clean towel.\",\"endings\":\"['[substeps] To sterilize new bottles in the meantime, squirt into high heat water for three minutes, when cooled down, at a temperature of about 200 ° f (58.7 ° c). Use a butter knife or a fork to loosen any stuck-on bacteria from the bottle nipple.', 'This method is safe on all kinds of baby bottles and will sanitize them and make them germ-free for the initial use. [title] Consider your water source when determining how often to sterilize your bottle nipples.', '[substeps] Wash the nipples with hot water and soap. Use a baby formula or baby detergent to wash.', \\\"[substeps] The way you sterilize new nipples will depend on the type of nipple you're using and whether you're using a bottle nipple or stick nipple. Some brands are intended for use only with sterile nipple, while others are suitable for people with sensitive nipples.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}