{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3da754a1-9e11-599a-a39a-3a2e484859b3","task_key":"default--validation--46686","task_revision_id":"1","upstream_id":"46686","short_description":"HellaSwag validation 46686","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to highlight natural freckles [title] Match your foundation to the skin between your freckles. [step] Never match your foundation to the shade of your freckles, because it will make your makeup look unnatural. Match your foundation to the lightest shade of skin on your face instead.\",\"endings\":\"['[title] Use a tinted moisturizer or bb cream. [step] Skip foundation altogether by wearing only a tinted moisturizer to even out dry skin patches and cover minor skin imperfections.', '[title] Keep your foundation perfect, but make sure it is hydrated and will keep your skin looking fresh. [step] Moisturize after your nightly skincare routine, as this will prevent dryness.', '[substeps] If you have freckles, select a classic color for your foundation which might be pinks, oranges, or peaches, and if your skin is light tan, choose black or another bright color like champagne. Your foundation will likely look too matte to be eye-catching, especially during the winter months.', 'Concealer and foundation should be used on only the pink and brown areas on the face in front of the freckles. [substeps] As a result, use your foundation alone.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}