{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1d88dbae-0233-52a4-b51a-c56283bda89e","task_key":"default--validation--27253","task_revision_id":"1","upstream_id":"27253","short_description":"HellaSwag validation 27253","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use an exfoliating foot peel [title] Wash your feet. [step] To ensure that there isn't any dirt, oil, or other residue that might prevent the peel's ingredients from penetrating your skin, you should wash your feet. Use warm water and your usual body wash or soap to get your feet clean.\",\"endings\":\"['[substeps] Be sure to wash them for about 20 minutes, as rinsing can irritate them. If your feet are particularly delicate, you might want to exfoliate them after being in the sun.', \\\"[substeps] It may be convenient to apply the exfoliating peel after a shower or bath because it's easier to wash your feet that way. [title] Soak your feet for several minutes.\\\", \\\"[substeps] You can use this rinse when you've washed and done a scrub. [title] Exfoliate on your feet when you're feeling rough.\\\", '[substeps] Especially if your feet are already quite dry, rubbing them with water or rubbing a soft washcloth on them may stimulate an exfoliating facial. [title] Exfoliate the skin on your feet.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}