{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0c34d6f9-694d-5302-aa9c-0c0fabb93e9a","task_key":"default--validation--13207","task_revision_id":"1","upstream_id":"13207","short_description":"HellaSwag validation 13207","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply cologne [title] Wear cologne at the appropriate times. [step] Cologne is not necessary at work, but it's generally acceptable. A big event, such as a wedding, funeral, party, or night out on the town, might easily call for cologne.\",\"endings\":\"['You can reapply once a day. [title] Wear cologne when you get home from work.', \\\"[substeps] Be aware of how your body's oils interact with your cologne. If you're going clubbing, for example, it may not be the best idea to apply lots of cologne: your natural body odor mixed with cologne may be even worse smelling than just your natural body odor.\\\", 'However, it is important to give your cologne a try before the day of the event so it reaches every other part of your body. [substeps] If you are part of the band, or any other open mic ensemble, it is best to practice first before going out.', \\\"In this case, choose a cologne you genuinely like. Then, apply it at least 4 days before your event to reduce the chances of your scent getting into other people's pores.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}