{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c6e6d13b-5718-5353-bcc3-1db8134cadae","task_key":"default--validation--1424","task_revision_id":"1","upstream_id":"1424","short_description":"HellaSwag validation 1424","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to make eyebrows grow [title] Plan to wait for several months. [step] Eyebrows take a long time to grow back fully after they've been overplucked. For some people, it might only take six weeks, but others may have to wait a full year before their eyebrows regain their former shape.\",\"endings\":\"[\\\"Plan to wait anywhere from one year to three years to get your brows back in full condition. [substeps] If you have long, thick eyebrows that don't grow back completely, it's likely that you have a shorter time before your brows develop back.\\\", \\\"The best thing you can do for your brows is to be patient. Look at it this way: at least your brows won't need a lot of maintenance for a while.\\\", '[substeps] How long you wait varies among people. The exact number of weeks depends on what your eyebrow hairs are growing.', \\\"A bad wait may result in eyebrows growing back immediately after you pluck them. [substeps] Don't wait until your eyebrows have grown far enough in.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}