{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cbcd82ae-92b7-5710-99a9-5b254bfbcf63","task_key":"default--validation--22245","task_revision_id":"1","upstream_id":"22245","short_description":"HellaSwag validation 22245","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to spend quality time with a teen [title] Find out what they like to do as \\\" fun \\\". [step] Now this does not mean you have to start skateboarding just because it might be one of their top \\\" fun \\\" things to do. There are many other fun things they probably like to do.\",\"endings\":\"['Maybe they like indoor skating, maybe they like the beach, maybe they like to take a board ride. Do you ever try that? Too many ideas and they can get frustrated and lose interest.', 'For example, bike riding, playing games on the computer or xbox. Try to play games you both can do.', 'Recognize them as \\\" fun \\\" and even if you will not get interested in them, it\\\\'s still good if you think of them. [substeps] Many teens find that it is impolite to drag \\\" fun \\\" down their list and just drop by some skate shops.', \\\"Whether it's watching a new movie, going ice skating or taking your little brother to gymnastics practice, find out! [title] Figure out what age they are. [step] They might be around 18 or older, which means they are still much younger than you are (or maybe their child is too).\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}