{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9a3565c9-af24-5699-badc-4498d92968b7","task_key":"default--validation--4091--variant-1679ba70109e","task_revision_id":"1","upstream_id":"4091--variant-1679ba70109e","short_description":"HellaSwag validation 4091","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a saree in bengali style [title] Tuck the saree in your waist. [step] Start the tuck on the right side of your waist, and wrap it all the way around your body until it comes back to the right side of your body. As the edge runs along your waist, you can gently tuck in the entire edge, so the saree has a secure fit.\",\"endings\":\"['[title] Use the saree throughout your workout. [step] If you want to look professional, keep the saree in place throughout your workout.', '[title] Pull the saree in a circle around your waist. [step] Next, look up at your back and try to take into account where the right side of your waist is.', '[substeps] The bottom border of the saree should graze the top of your feet, and should look horizontally straight and parallel to the ground. [title] Pleat the saree by tucking it back and forth.', '[substeps] This is also where the part of your saree that passes under your belly flap is referred to. [title] Gather the saree before putting on any jewelry.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}