{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0754c5c8-020e-52d6-9a34-f59ee23044c8","task_key":"default--validation--4624","task_revision_id":"1","upstream_id":"4624","short_description":"HellaSwag validation 4624","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style your hair for a workout [title] Try a simple high or low ponytail. [step] A staple of gym style is a simple ponytail. It keeps the hair out of your face during a vigorous workout.\",\"endings\":\"['Simply pull all your hair back and secure it using a hair tie. You can have your ponytail rest near the nape of your neck for a low ponytail or have it near the top of your head for a high ponytail.', 'Stop and look in the mirror and get a look that suits your workout. [substeps] Big ponytails are always a good option.', 'It goes like this : [substeps] Upwind of wind hair tends to be more fragile. Wind hair works to keep an area sealed off.', 'Make sure to brush or comb your hair in the morning or at night after a workout to tame split ends. This will help prevent frizz and an energy spike.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}