{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c800ef21-5030-5bcb-8c10-318e63d05a32","task_key":"default--validation--45805","task_revision_id":"1","upstream_id":"45805","short_description":"HellaSwag validation 45805","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use nail clippers [title] Use a smaller set of clippers. [step] Fingernail clippers are smaller than those used for toenails. Their cutting edge will also be curved slightly inwards to match the rounded shape of your fingernail tips.\",\"endings\":\"['[substeps] Toenail clippers are larger and have straight cutting edge. Using these on your fingernails can cause damage.', 'Nail clippers are meant to be used to trim smaller nails since their blades will cut better on larger nails. [title] Adjust the blade of your nail clippers.', 'This makes them great for small open cuts. [substeps] To cut through nail polish like glitter, hold one nail flat with your dominant hand and use the non-dominant hand to cut.', '[substeps] Instead of a fluffy, cushiony blunt clipper, try a rounded, tapered clipper. Sharp varieties will shave slower and are less comfortable, and wide clippers that go slightly up are better for toenails.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}