{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"894c257c-6caa-51d6-8198-097194eb6d3e","task_key":"default--validation--9863","task_revision_id":"1","upstream_id":"9863","short_description":"HellaSwag validation 9863","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to convert pierced earrings to clip on earrings [title] Purchase earring converters. [step] You can buy earring converters online or your local craft store. The converters are usually located in the jewelry making area.\",\"endings\":\"[\\\"[substeps] If you're looking for a quick way to convert earrings into clip-on earrings, pick the watch number one and two. Select the watch number two, then select the watch number three.\\\", \\\"Check chain stores and online shops for earring converters. [substeps] If you aren't able to find them online, you can find them at sewing stores or online stores that carry jewelry supplies.\\\", 'Look for a converter that has a small tube/barrel on the back. [substeps] Most posts will fit into the barrel of the converter, but check the size of your posts just to be sure.', 'You will need to take your earring size into account when selecting earring converters. [substeps] Consider always buying a size 3 earring converter.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}