{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"54d57507-b3c8-56d0-a0e1-9e32fe1bf01d","task_key":"default--validation--23290","task_revision_id":"1","upstream_id":"23290","short_description":"HellaSwag validation 23290","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dye black hair red [title] Pick the best color for your skin tone. [step] There are many different shades of red that you can dye your hair, including auburn, strawberry, brick, mahogany, and more. Try going with a shade of red that best compliments your complexion, whether you have cool-toned fair skin, warm-toned dark skin, or something in between.\",\"endings\":\"[\\\"[substeps] If you want to avoid having to dye your hair black, keep in mind that other shades are less common than yours. However, don't forget to select a dye that is close to your natural skin tone.\\\", \\\"Think about the color that's most closely mirrored your skin tone. This can help you match your hair more closely to your complexion.\\\", '[substeps] Hold a sample hair swatch close to your face to see if the color works with your skin tone. If you have pink, red, or bluish undertones, then you have a cool skin tone.', '[substeps] Try what looks like a hair color. Dark-toned, fair skinned people tend to have cool tones.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}