{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a9ab5e8b-5ec2-58a9-ab4c-4726c7f0f9b6","task_key":"default--validation--12209","task_revision_id":"1","upstream_id":"12209","short_description":"HellaSwag validation 12209","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to shave your face [title] Choose an appropriate razor. [step] You should take into account the coarseness of your beard hairs, the texture of your skin, your preferred shaving method, and other details when choosing a razor. Generally speaking, for heavy-bearded men with more sensitive skin, it is generally good to use a traditional multi-blade razor.\",\"endings\":\"['A more expensive variety, however, may suit you. [substeps] If possible, choose a razor with a finer blade, like the ninja rat razor (also known as ninja rat 4) or saber (also known as elderrawal 2).', '[substeps] Electric razors are convenient and quick, requiring less preparation before shaving than safety razors, and are somewhat gentler on sensitive skin. For some types of hair, however, they tend to leave an uneven or patchy shave on the face.', 'You may also want to check ahead of time which method is best for you. [substeps] Before shaving, you should consider using a traditional electric razor.', '[substeps] The point of a professional shave is to smooth the beard hair and keep your razor soft and and straight. Using a razor is not only effective, but to save yourself the stress of sawing through to scar a smooth, beautiful beard.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}