{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"72b12a72-a9cd-5c1f-b0ad-b8f505b866f8","task_key":"default--validation--6731","task_revision_id":"1","upstream_id":"6731","short_description":"HellaSwag validation 6731","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use steam rollers for hair [title] Start with dry hair. [step] You can curl your hair just after you washed it, but it needs to be perfectly dry. Steam rollers will work the best on straight hair, but you can try using them to define curly or wavy hair.\",\"endings\":\"[\\\"Since hair can be dry, leave it down once you're out of the shower. [title] Use a hair-straightening comb to detangle your hair.\\\", 'Begin by pouring a small amount of water onto a foam brush. When your hair is moist and damp, focus on putting an extension under the roller.', 'Just curl your hair before washing your hair, or wet your hair. [title] Gather your hair into three high ponytails.', 'If you have natural or kinky hair, however, you will need to start with a blow-out. Otherwise, the curls will not have as much definition.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}