{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"54d7e7ff-4e22-55dc-8ea9-db3401379ba7","task_key":"default--validation--7883","task_revision_id":"1","upstream_id":"7883","short_description":"HellaSwag validation 7883","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to eat like an olympian [title] Build a balanced plate for easy days. [step] On easy, low-intensity training days, you'll want to build a well-balanced plate at each meal. You should include foods and beverages from each major food group.\",\"endings\":\"['This will ensure that all of your meals are balanced. [title] Begin with easy meals right after a workout.', 'Your protein needs should be equal to your overall body weight. If you typically walk around on high-intensity training days, then construct a balanced plate to help get you in shape.', \\\"For example, you may want to include fish, poultry, and potatoes on those days when you're trying to lose weight, rather than loading up on dishes from every major meal group. [substeps] You should also try to consider moving into a sub-menu where you can have foods from all major food groups.\\\", '[substeps] About half of your plate should consist of vegetables (both raw and cooked), vegetable-based soups, and fresh fruit. Approximately one-quarter of your plate should consist of lean protein sources.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}