{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e843a2b0-39b9-5be3-b929-d39e80f17c55","task_key":"default--validation--19077--variant-059d733e3a4a","task_revision_id":"1","upstream_id":"19077--variant-059d733e3a4a","short_description":"HellaSwag validation 19077","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to get skinny [title] Calculate your body mass index (bmi) before you lose weight. [step] Weight alone isn't an indication of overall health. Your age, height, and history of injury and illness all play a role in determining health.\",\"endings\":\"['What do you expect about yourself? A healthy weight depends on your age and health, but weight index studies have shown that men and women should gain about 20% of their body weight each week, while women can gain less. Bmi tests of body mass index are also an indicator to your race and physical status.', 'Bmi is a basic calculation of your weight in pounds/kilograms, divided by your height in feet/meters squared, which is used to determine whether or not you need to lose weight. Do the calculation yourself, or plug your number into a bmi calculator.', \\\"Bmi is the amount of weight you can lose (or increase) if you don't get regular exercise. [substeps] To calculate how many pounds you can lose in a day, use a bmi of 168.\\\", 'Determining your bmi is done by scanning your bmi profile. [substeps] Multiply your bmi by 340 to find out your weight.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}