{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b379ecb7-4299-5776-b98b-e4675fa4462a","task_key":"default--validation--9630","task_revision_id":"1","upstream_id":"9630","short_description":"HellaSwag validation 9630","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to fade out jeans [title] Put the jeans on. [step] Before trying to fade the jeans, you need to make sure that they fit comfortably and well. Mark with chalk where you want to fade the jeans.\",\"endings\":\"['If your jeans are not the exact same color, choose a different color for your jeans. [substeps] If you have a brush in a computer or an airbrush, you will need to prepare your brush.', \\\"The jeans usually fade over time at the areas around the knee or thigh, but you can fade them wherever you would like. Look in a mirror to check that you've marked the right spots.\\\", 'Then, take the hem of the jeans and work it along the ley line. [substeps] Do not make sharp marks right behind the button holes.', \\\"Use a permanent marker to make sure that your jeans are in place before committing to fading them. Some ideas for how to fade jeans with loose-fit jeans : [substeps] Use a ruler or tape measure to measure the length of your jeans, with the measurement you'll need to decide how wide of a cut you'd like to make.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}