{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"47ce91ce-3845-5bec-906c-8263fc7e6d5e","task_key":"default--validation--19859","task_revision_id":"1","upstream_id":"19859","short_description":"HellaSwag validation 19859","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to start writing [title] Target the cause. [step] Almost anything could be discouraging you from writing whether it is mental, emotional or physical. When you begin to write, jot down the thoughts that come to your mind even if they aren't related to what you need to write about.\",\"endings\":\"[\\\"Try to pinpoint where your thoughts came from as well. Also reflect on what else you're already prone to.\\\", 'Sometimes it helps to have a companion source to speak to. This can be a friends or family member or yourself.', '[substeps] Try to think of something you are doing that most potential readers would find interesting and appealing. Think of a reason why you want to write from that angle.', 'This exercise is known as free or random association will give you a clue towards what the problem is. Here are some common reasons to why people have trouble writing and some suggestions on how to overcome the hurdle.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}