{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a7ea9487-6c79-5e7c-a4f7-966bdd28473c","task_key":"default--validation--11517","task_revision_id":"1","upstream_id":"11517","short_description":"HellaSwag validation 11517","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to choose toys that get kids moving [title] Supply your kids with a variety of balls. [step] Soccer balls, basketballs, and baseballs are excellent toys to get your kids moving. You can also purchase soft and squishy balls for younger kids and indoor use.\",\"endings\":\"['[substeps] Keep in mind that kids can have many different toys at once. Try playdough, ramps, tennis balls, scooter, a handheld golf ball, and anything else that your kids like.', 'You can find super soft balls for play toys, but often cheaper ones have a more smaller, heavier ball or ball to play with. [substeps] Buy small balls like ground balls, kiddie cups, and there are also miniature balls or balls made to collect playing material.', 'Balls can be used to play traditional sports, or kids can use their imaginations and come up with a variety of games that will keep them active. [substeps] Balls can also help to develop kicking, throwing, running, and catching skills.', \\\"You can also purchase sporting balls with the love of playing with them. You can buy play balls from amazon or miley's or other sporting goods stores, or have your kids construct their own for you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}