{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e5d4ba8c-bbbf-5f82-a085-624f265ecf9b","task_key":"default--validation--37762","task_revision_id":"1","upstream_id":"37762","short_description":"HellaSwag validation 37762","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply concealer [title] Choose your shade. [step] Concealer comes in a variety of shapes and colors, so analyze your skin first to determine what you need. Are you trying to cover up acne? Under eye circles? Scars or birthmarks? Once you determine what you want to conceal, you can choose the appropriate color and shade.\",\"endings\":\"['[substeps] For example, you may choose shades of green for lighter skin tone and a shade of black for darker skin tone. If you have acne, use a shade of green that is twice as dark.', '[substeps] If you are applying concealer under eye circles, go with black or gray. These colors will make your skin appear smaller, which will still help the concealer to stick to the skin.', 'Use the color wheel to help you figure out which color corrector to use. Match the opposite color on the color wheel to cancel it out.', 'Here are some classic shades to choose from : [substeps] Red, rose gold, cobalt brown, blond, or green. Ivory, reddish brown, amber, purple, indigo, blond, olive, copper, jewel purple.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}