{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"905b2165-dbe0-50e9-ad94-16ccc7622334","task_key":"default--validation--40630","task_revision_id":"1","upstream_id":"40630","short_description":"HellaSwag validation 40630","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to choose an orthopedic dog bed [title] Determine what size bed you need. [step] The first factor to consider when selecting an orthopedic dog bed is size. A bed too small will not provide your dog enough space to spread out, while a bed too large can actually make your dog feel insecure.\",\"endings\":\"['[substeps] Dogs require to have a bed large enough to cover entirely their entire body. Too much space, and very little room, can possibly prevent the limbs from moving back and forth.', \\\"Consult the size charts of various beds to select the right size for your dog. Here is a guide : [substeps] Dog's weight = size of bed 1-10 lbs.\\\", \\\"[substeps] Getting a bigger dog bed (or bed for more than one) is ideal for a variety of reasons. You want your dog's main arch support to be strong, substantial, and steady.\\\", \\\"Make sure that the size fits your dog's needs before choosing an orthopedic dog bed. [substeps] This is important because most orthopedic dog beds have low sides for crawling on.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}