{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"755bdf24-ff49-5769-80f5-c14aa9352014","task_key":"default--validation--30059","task_revision_id":"1","upstream_id":"30059","short_description":"HellaSwag validation 30059","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to lighten your backpack [title] Find the right fit for your body. [step] Visit a sporting goods store where you can be fitted for the right sized backpack by a professional. [substeps] Be sure the backpack has two wide, supportive shoulder straps, and sufficient back and strap padding.\",\"endings\":\"['Adjust the straps so that the backpack lays flat against your back. Both straps should be worn at the same time, to distribute the weight of the pack evenly.', 'As for straps, look closely at your backpack to make sure the straps fit snugly. Check the tensile belt straps that hang side-by-side.', 'Get the correct size at the store so you can gently and cheaply support your lower back when you sit. Your bag should not taper down to restrict your movement.', 'Any straps that are overly small can put a strain on your back when sitting. It will be a good idea to have a friend hold your backpack while you work on projects or other physical activities.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}