{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fe09fd54-8cf7-5109-b442-863ed77f79c6","task_key":"default--validation--44115--variant-1ba693512267","task_revision_id":"1","upstream_id":"44115--variant-1ba693512267","short_description":"HellaSwag validation 44115","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to shave your arms [title] Exfoliate your arms. [step] When shaving, the presence of dead skin cells can cause razor burn and ingrown hairs. It is possible to prevent razor burn and ingrown hairs by exfoliating the skin one to two days before shaving.\",\"endings\":\"['[substeps] First, take a loofah, washcloth, and warm water. Gently rub your clean skin until you are fully hydrated.', '[substeps] You should also exfoliate after you wash your hair. Use a natural facial cleanser and warm water to wash the dead skin surface and get rid of dead skin cells.', 'While in the shower or bath, apply a store bought or homemade scrub to your wet arms. Rub the scrub over your appendages several times and then rinse off the product.', '[substeps] Drink a glass of water three days before shaving for best results. [title] Get a waxing cream or balm.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}