{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4443b83-9cb7-5b39-b0a8-2141b8f9f9b4","task_key":"default--validation--48190","task_revision_id":"1","upstream_id":"48190","short_description":"HellaSwag validation 48190","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to make a natural foot odor remedy [title] Start with an absorbent powder, like baking soda or cornstarch. [step] These products will absorb moisture from the surface of your feet, preventing the continued growth of odor-causing bacteria. Place 5-10 tablespoons of whichever powder product you choose into a dry container with a lid.\",\"endings\":\"['Store the container in a cool, dark place. Stir every day for the first few days, which will allow the powder to soak in and fill your feet with a strong smell.', 'Shake the container to mix it all up. Place the container in a warm or warm place where it will not be disturbed.', \\\"Place a tight lid or warm compress on the container until it is comfortably warm. [substeps] Keep in mind that even though you can use a fan and maintain your smell-reducing abilities, they will not indefinitely take effect, so don't put them to use.\\\", '[substeps] Other natural powders which could be substituted for baking soda or cornstarch include talcum powder, baby powder, or arrowroot powder. You can use a single absorbent powder, or a combination of two or several if you prefer.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}