{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7a2be3d9-cf26-5f57-ba75-f83da8ea8664","task_key":"default--validation--48624","task_revision_id":"1","upstream_id":"48624","short_description":"HellaSwag validation 48624","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to make a baby's breath crown [title] Measure the circumference of your head. [step] Using a thin floral wire, measure the circumference of your head. Wrap the wire around the top of your head where you would like to crown to sit.\",\"endings\":\"['[substeps] For more precise measurements, use a ruler. [title] Cut off the shorter ends of the wire.', \\\"[substeps] If you'll be making a baby's breath crown, you can make the crown as wide or as narrow as you want, but for a younger child, you'll have to measure the size of their head. The rounder your child's head, the larger your crown will need to be.\\\", 'Then double the amount of wire and cut it using pliers. You want to double the wire in order to ensure that you have a sturdy base for the crown.', 'Then, place one end of the wire over the center part of your crown at 1/8 of an inch from your hairline. You should see that you have a roughly average head circumference.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}