{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4b7a7a58-f484-55ac-9262-524683951017","task_key":"default--validation--7137","task_revision_id":"1","upstream_id":"7137","short_description":"HellaSwag validation 7137","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get the right haircut [title] Get a short cut. [step] If you have a round face and want to go short, you should go very short. Get a pixie cut with spikey layers.\",\"endings\":\"[\\\"Coarse layers with knobs or spikes will make your hair look messy. If you don't want to have a look with bangs, try a faux side part or an eye touch with a fringe in the middle.\\\", 'How long your cut will be is entirely up to you. It should be short enough for you to get a full look without a lot of leeway.', 'A pixie cut can be as long or short as you want. Why? Width gives your face something to shape.', 'This will downplay the roundness of your face by adding height and emphasizing your eyes. If you have straight, fine hair this will work wonders.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}