{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c4dd141e-722b-5c12-a794-62a829f623ce","task_key":"default--validation--31734","task_revision_id":"1","upstream_id":"31734","short_description":"HellaSwag validation 31734","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to get healthy looking nails [title] Trim your nails regularly. [step] Use manicure clippers to trim your nails straight across and round the tips with a gentle curve. It's easier to trim your nails after a bath or shower since they are soft and more gentle to clip.\",\"endings\":\"[\\\"Don't file your nails immediately after exposure to water as this may weaken your nails. [title] Buff your nails for a healthy shine.\\\", \\\"Only clip down on the length of each nail. Don't trim straight across from the tip of your first one; you risk cutting yourself on this.\\\", \\\"[substeps] While you're in the shower, trim back the length of your nails according to your preference. This will give you an extra length for later.\\\", 'It may also work to file your nails so your nails are less curved. [substeps] To prevent staining your nails, add ice packs to help you keep the ice pack cool.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}