{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"598bdf72-26f4-5ee3-8e32-de0a367d0c5c","task_key":"default--validation--39375--variant-f73a6012fd23","task_revision_id":"1","upstream_id":"39375--variant-f73a6012fd23","short_description":"HellaSwag validation 39375","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to buy a corset [title] Choose an overbust style for more coverage. [step] Overbust styles cover from the top of the breasts to just above the hips or to the lap and can have straps or be strapless. They are popular in costumes, lingerie, or as a fashion statement.\",\"endings\":\"['The corset styles can be somewhat overwhelming, but to a casual casual dressy attitude, they usually only cover less than the bra and get you out of your tops. [substeps] An overbust style can cover a lot of skin and incorporate some cleavage.', 'Select this style if you want a corset that covers more skin, or can be worn on its own. [title] Opt for an underbust for a more subtle look.', '[substeps] Try to choose a corset shape that flatters the midsection, while allowing coverage for the shoulders, chest, and back. [title] Cut the corset to the measurements you need.', '[substeps] Underbust styles tend to cover the core of the underbust while still allowing the natural parts and flesh. Especially when in a corset, underbust style tends to cover the scoop neck of the bra.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}