{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9cfbf072-8f21-5d29-a5fc-4a098e42fc51","task_key":"default--validation--23108","task_revision_id":"1","upstream_id":"23108","short_description":"HellaSwag validation 23108","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean makeup sponges [title] Dampen the sponge with fresh water. [step] In order for the soap to work into a cleansing lather, your dirty sponge must be wet. Turn on your faucet and run your reusable sponge under warm water.\",\"endings\":\"[\\\"Be sure to take it out periodically to flush out any soap. [substeps] If your sponge doesn't have a handle, gently squeeze it dry with a soft, non-abrasive rag and hold it with both hands.\\\", 'Lather your sponge (or dishcloth) for about 30 seconds. This will start to rinse away any excess water, or at least begin to loosen up any dirt.', 'Squeeze the sponge to remove the excess water. [substeps] Your sponge should be damp, not soaking wet.', 'Do this gently with the sponge to make sure that all the soap is removed. [substeps] Remove as much of the makeup as possible using a soft, non-abrasive sponge.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}