{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c3e9a52c-076c-59f5-83c2-253fd58037f8","task_key":"default--validation--9450","task_revision_id":"1","upstream_id":"9450","short_description":"HellaSwag validation 9450","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to straighten permed hair [title] Choose the right flat iron. [step] If you just want to temporarily remove your perm, a flat iron is the best route. It will not permanently remove the perm, but will allow your hair to temporarily straighten.\",\"endings\":\"['Make sure you select the right flat iron for your hair type. [substeps] If you have short, thick, or fine hair look for an iron with narrow plates.', 'Straightening permed hair can be left to rest for two or three days before completing the daily use. [substeps] Once your hair is relaxed, it should be straightened into a un-curly bun or poof to highlight your curls.', 'Select a flat iron with a satin or matte finish. You can also purchase a fixed or semi-soft iron with a different flat size.', 'Flat irons differ in the type of look you want to wear, though they can vary by body type, length, thickness, and order. [title] Grab a small container with a zipper.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}