{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"973db399-79db-5b72-9b7a-1c77ef9cdb08","task_key":"default--validation--26302","task_revision_id":"1","upstream_id":"26302","short_description":"HellaSwag validation 26302","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to repair nails after a gel manicure [title] Moisturize your nails. [step] Moisture will help your nails recover after a gel manicure, which strips them of a lot of their natural moisture. You can buy nail moisturizer at a local beauty supply store or department store.\",\"endings\":\"['You should apply a nail moisturizer each day. Apply it to your nails and the skin around them.', '[title] Choose a suitable nail polish color for your nails. [step] It can be any shade of nail polish you like, but a neutral or pastel shade is a good choice.', '[substeps] Make sure that you apply moisturizer daily. Avoid using antibacterial products, as this will actually make the nail polish growth weaker.', \\\"It should be applied well before you plan to have nail polish done at home. [substeps] If you've cut your nails yourself, ask a person to help you with the first step.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}