{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f22b1fff-6524-5f33-8afa-06e724564cb2","task_key":"default--validation--46995","task_revision_id":"1","upstream_id":"46995","short_description":"HellaSwag validation 46995","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to measure biceps [title] Measure before you weight lift. [step] If you've exercised your arms right before you measure your bicep size, you won't get an accurate bicep measurement. Working out forces blood into your muscles, which temporarily inflates the size of your biceps and triceps.\",\"endings\":\"['[substeps] Since biceps are the number one muscle group, there are some techniques you can do to properly measure the weight and height of your biceps before a weigh-in. For example, if your biceps are quite large, you can try heavy lifting instead of weighing yourself.', \\\"[substeps] If you're planning to measure your arms and work out in the same day, always take the measurements first. [title] Measure at the thickest part of both biceps.\\\", 'Rather than wasting time measuring the strength of your biceps, spend the time doing exercises that target your biceps. [substeps] Sit down on the floor and place your hands flat on the floor.', '[substeps] If possible, measure your biceps a few times throughout the day and after work to see how full they are. When you exercise, always place your hands on your upper arms.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}