{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0812e04f-d2d1-57a2-942b-8374911b9f8c","task_key":"default--validation--31844","task_revision_id":"1","upstream_id":"31844","short_description":"HellaSwag validation 31844","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to get an adrenaline rush [title] Watch a scary movie or tv show. [step] Scary movies are by nature designed to make people fearful. If you are bothered by frightening stimuli in a scary movie, this may encourage a fight or flight response.\",\"endings\":\"[\\\"[substeps] Read scary books or websites before an episode or watch scary movies. Don't do it until there has been a dramatic episode.\\\", 'Watch a scary film in the twilight or a scary sitcom. Watch a scary show with a parent or other family member to boost your adrenaline.', 'Watch a scary movie or tv show on television or research a motivational situation or story you are being helped create. This will help you to be more alert and to avoid an angry or defensive response.', 'This can cause your body to release epinephrine. If you want to get an adrenaline rush, watch a scary movie online or rent a dvd.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}