{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"42037d46-35e5-5afa-9fed-756377a10f72","task_key":"default--validation--12925","task_revision_id":"1","upstream_id":"12925","short_description":"HellaSwag validation 12925","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to achieve a messy hair effect [title] Determine your hair texture. [step] Depending on the texture of your hair, you may need to add some product to make sure your messy hair maintains the look you want all day long. It is important to have the proper tools of the trade before you get started.\",\"endings\":\"['[substeps] If your hair is thick, coarse, or curly, you are in luck. This look is going to be easy for you.', 'For medium to thick hair, spray hair products or clips directly onto your hair after showering, not once after rinsing. If you also have long hair, spray hair products in this fashion once or twice throughout the day.', '[substeps] Get a hand-held hair blender. It is important to have a hair blender made with a straw and you will need several straws.', \\\"To avoid damaging your hair, learn how to wash it every day. Avoid these tools when drying your hair: you don't need to use a blow dryer.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}