{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"394ac5d6-9dca-535b-ad5c-3c3b371c42b8","task_key":"default--validation--25556","task_revision_id":"1","upstream_id":"25556","short_description":"HellaSwag validation 25556","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a crown braid [title] Part your hair in the middle. [step] Separate your hair into two sections, the left and right side. Secure one side while you work with the other, so they don't get mixed up.\",\"endings\":\"['[title] Start with the middle section, then work your way down to the crown. [step] Leave one section about third of the way from your roots; work smoothly from one end.', 'Most people prefer to braid with the left side. This is the left strand closest to the head and works best if you have straight hair.', '[title] Place your hair on a clean bed or mat to cover your crown-head. [step] Next, place the crown-head of your hair near the hairline, so your roots are in close touch.', \\\"You can do this by adding a scrunchy or a hair clip, so that the one side doesn't get in the way. Try your best at containing any loose hairs which might pop out.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}