{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6e444dd6-3569-5a5f-963c-3dbb65735ae2","task_key":"default--validation--13744","task_revision_id":"1","upstream_id":"13744","short_description":"HellaSwag validation 13744","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use crystals for deodorant [title] Explore the benefits of using crystal deodorants. [step] The key ingredient for most crystal deodorants is salt, which when applied to the skin kills odor causing bacteria. It is a particularly good choice for those looking to avoid aluminum based deodorants.\",\"endings\":\"['[substeps] Look for emollients containing this ingredient. Consider adding a dab of epsom salt to your deodorants before each use.', 'This alone will kill off ionized sweat and other bad smell causing bacteria and reduce your body temperature. With this in mind, a more affordable choice of deodorant may be to apply it to your feet or underarms to treat sweat and bacteria, thereby defeating dirt and irritants.', '[substeps] Simply add one tablespoon of salt, massage it into the problem areas, then use warm water to rinse the salt off. Do not add too much salt or scrub the problem areas.', '[title] Consider using the stone form (either as a rock or a stick). [step] It is preferred by many because it is believed to be less altered by manufacturers than the other versions.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}