{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3ac9df8e-eb59-5b9e-ab5b-526e403e09df","task_key":"default--validation--48346","task_revision_id":"1","upstream_id":"48346","short_description":"HellaSwag validation 48346","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to clean bathroom grout [title] Steam clean the grout. [step] One effective and environmentally friendly way of cleaning grout is to attack it with a steam cleaner. Outfit your steam cleaner with a thin and pointed nozzle, and a brush attachment if it's available.\",\"endings\":\"['Run your steam cleaner over the entire floor, making sure to scour the entire grout area. [substeps] However, if you cannot steam clean your grout by yourself, you can freeze grout at home and use the steam cleaner to scrub grout specific areas.', 'Swab some hot water into the steam cleaner and then rinse the grout clean with warm water. Tap the brush attachment onto the grout drain, and then unscrew and fill a bucket with warm water.', \\\"Aim the nozzle at the grout lines, apply continuous steam, and follow the grout lines with the steamer. [substeps] Even if the steam cleaner doesn't get the grout perfectly clean, it will clean it somewhat, and help loosen the rest of the dirt and debris to make it easier to clean with other products.\\\", 'Head over to your kitchen sink, and turn on the steam cleaner. You can also use a sponge or box brush to remove scum from your grout.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}