{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"de75e77c-cebc-58cb-bfe9-15c2021e91bb","task_key":"default--validation--35132--variant-4c35c96812e8","task_revision_id":"1","upstream_id":"35132--variant-4c35c96812e8","short_description":"HellaSwag validation 35132","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to paint your nails according to the time available [title] Use a cotton ball and nail polish remover to remove any old nail polish and oils. [title] Choose the color you want to use for your manicure. [title] Start with the painting.\",\"endings\":\"[\\\"[step] Its easier to paint if it's done by hand. You can learn how to paint anything you want, but this is the way to start! Be sure to use paint in the same color range, paint the darker end in and make sure you choose the darker end in.\\\", \\\"[step] There is no exact time it's safe to begin painting your nails; however, it should be safe to do between 6 and 8 months since the staining instructions specify this. Continue to paint along the sides and corners using a small brush to apply black polish.\\\", '[step] Add a layer of a base coat. This helps to protect your natural nails from staining and anchor the polish onto your nail.', '[step] Nail polish remover removes fine polish, but it also draws out the color, which may help you create a smile. [substeps] Red nails are more common, but you can use the gray polish when painting your nails.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}