{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"67d3de8c-e2eb-5bc6-a837-834076becc91","task_key":"default--validation--19705","task_revision_id":"1","upstream_id":"19705","short_description":"HellaSwag validation 19705","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear rings [title] Use a ring-sizer to find the appropriate size for a ring. [step] Ring-sizers are plastic sheets with a variety of different sizes on them, which you can slide your finger into to find an appropriate fit. These are available at every jewelry counter for sizing rings.\",\"endings\":\"['[substeps] Your ring should fit your finger comfortably. It needs to be snug enough so that it stays on, but loose enough to slide off at the knuckle.', 'Use your ring-sizer to find a size that fits your finger size-which sounds easy. [substeps] A ring size 14-inch (27.6 cm) is approximately the ideal size, though it can add a mature look to a ring.', 'Many rings, especially those with 3 or more sizes, will fit comfortably onto your ring. [substeps] You can also do this freehand by simply finding a ring-sizer with a similar size.', 'When one is worn, do not buy one with rounded sides. This is likely to break or splinter, and it will probably have uva, bva, and uvb features of the ring.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}