{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8aea69bf-07c2-5c1c-b81c-3a7f30b57b8f","task_key":"default--validation--45897","task_revision_id":"1","upstream_id":"45897","short_description":"HellaSwag validation 45897","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to cope with being sick [title] Take a break. [step] For many people, it can be difficult to take a time out from life when feeling under the weather. But trying to carry on with your daily routine when you are sick can have many negative impacts.\",\"endings\":\"[\\\"To alleviate this stress, return to your regular routine while you are sick. Make sure that you allow yourself 4-6 days' break every week to recover.\\\", 'Not only will you risk passing your illness to others, but you may end up feeling even more stressed. When you are sick, you need to take a break from your responsibilities as much as possible.', 'A break may seem like an impossible task at first, but as time progresses, it can drastically shift the way your body identifies symptoms. Rather than just give up on taking a break, take a first-come-first-served break.', 'Take a 1-2 weeks off from work and school to get better. Taking a 30-minute break might help you feel less overwhelmed and could speed the healing process.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}