{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f9ecf3bf-5901-5b86-aa86-c133010aeba4","task_key":"default--validation--45149","task_revision_id":"1","upstream_id":"45149","short_description":"HellaSwag validation 45149","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a large scarf [title] Choose an oversized infinity scarf for a thick, layered look. [step] Infinity scarves are a quick, easy option that involve barely any arranging! Just loop the oversized scarf around your neck, pull it into place, and you're all set. This way, you don't have to worry about tucking or dealing with long, loose scarf ends.\",\"endings\":\"['[substeps] If you want to save your layered scarf for special occasions, consider sewing over the top of your scarf instead. [title] Avoid other scarves with dangling or uneven ends.', '[title] Opt for a large blanket scarf for a variety of chic, wrapped styles. [step] The blank scarf style gives you lots of freedom, with countless ways to style and wrap it.', \\\"[substeps] Wear the scarves mostly around your neck on both sides to create more volume at the top and to add another sheer layer of scarf topping. [title] Don't wear them with loose-fitting tops.\\\", '[substeps] Create a mountain-image look by draping the oversized scarf over your neck like an shawl and tucking in your belly button. This option will help frame your face much more effectively.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}