{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4c77d80e-83f7-5d69-b603-2c0af32f676d","task_key":"default--validation--8522","task_revision_id":"1","upstream_id":"8522","short_description":"HellaSwag validation 8522","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to workout at home using hand weights [title] Know what hand weights are good for. [step] Keep in mind that hand weights are also called dumbbells or free weights. Exercises that use hand weights are good for building up strength, increasing your endurance, and building muscle mass.\",\"endings\":\"['[substeps] Weights that use hand weights include dumbbells, wrist dumbbells, resistance bands, and straight-arm overhead or counter-weights. Safety equipment is also important in weight training.', '[substeps] For example, you can simply use a weighted barbell on one foot. The other foot is directly under the barbell.', 'For example, if you want to build a large log for your log bag, use hand weights that range from 15 to 30 percent of your body weight. [substeps] Hand weights that range in strength include bench presses, dumbbells, and triples.', '[title] Purchase a set of hand weights if possible. [step] It is good to buy varying dumbbell weights because you can then progressively challenge yourself as you progress with your weight training.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}