{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"20ecda8d-72be-582c-a43d-f3ddb4ba9231","task_key":"default--validation--15290","task_revision_id":"1","upstream_id":"15290","short_description":"HellaSwag validation 15290","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stretch suede shoes [title] Try a spray solution to stretch your shoes 1/4 to 1/2 a size. [step] Spraying your shoes then wearing them for a few hours is a quick fix. If you only need to stretch them 1/4 to 1/2 a shoe size, a spray could do the trick.\",\"endings\":\"['[substeps] Spray solutions are also your most affordable option. [title] Purchase an immediate-use solution marked for suede shoes.', '[substeps] The spray can be purchased at a shoe store, at a department store and inside your shoes. Be sure to apply the solution before you bring your shoes inside and dry them before proceeding with your stretching.', 'You can also add plain water and a bit of superglue for extra grip, if you wish. [title] Try the \\\" flower \\\" method, this is done by squeezing the laces out with a tension wrench.', 'Skip the spraying procedure if you have shoes that require application. [substeps] Be aware that the spray solution should be more than enough when getting your shoes to fit you perfectly so that the spray can be applied more evenly.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}