{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c2c5ec85-0ef8-58d8-9f18-39a4f77c404e","task_key":"default--validation--10979","task_revision_id":"1","upstream_id":"10979","short_description":"HellaSwag validation 10979","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to turn man boobs into muscle [title] Interval running : [step] Take a run around the park for at least 30 minutes. Start out walking for two minutes then change it up and run for two, you can go five for five or one for one. Repeat this for 30 minutes.\",\"endings\":\"[\\\"[title] Try it for greater strength : [step] And for length. Then challenge yourself to say i won't ever be slow.\\\", 'This is really easy and like swimming, it gets your heart rate up and makes you breathe easier. [title] Fasting : [step] Plan for fast withdrawals.', 'Kickboxing: position one foot forward and the other foot on a bench-stand on a bench or chair with weight on both legs. To kick kick backwards, lift your foot forward and snap your foot downwards.', 'You want to elevate and normalize your heart rate. [title] Calisthenics : [step] Do some push ups, start with 3 sets of 10 push ups.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}