{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cde3afa0-fb02-5ae1-b4ee-13cf1eb571c7","task_key":"default--validation--4763","task_revision_id":"1","upstream_id":"4763","short_description":"HellaSwag validation 4763","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to keep a woman's underarms hairfree [title] Use a sharp razor. [step] Dull razors can cause nicks or cuts while shaving, due to the extra pressure you'll have to put on them to be effective. They can drag harder against skin and become irritating.\",\"endings\":\"['Razor blades will also dry out the oils from your hair after you rinse it off. [substeps] Avoid adding shaving products to the brush after showering.', '[substeps] Also remove jewelry that is too tight or otherwise uses too much force on your underarms-they can cut off your skin and cause further acne. [title] Wash your hair immediately after shaving.', 'Use a sharp, fresh, high-quality razor. Disposables with one blade might not be the best option.', 'Some razors have blades meant to glide instead of cut, which makes them best for underarms. [substeps] Avoid shaving on a loc if you have very thick underarms hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}