{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ed95cedb-23a3-5554-808f-92a7aec4c296","task_key":"default--validation--11310","task_revision_id":"1","upstream_id":"11310","short_description":"HellaSwag validation 11310","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get rosy cheeks [title] Choose the right rosy color. [step] You may be tempted to choose the brightest hot pink in an effort to make your cheeks look rosy. However, the color of your blush should complement your skin color; otherwise, it can end up looking clownish or too dark.\",\"endings\":\"['[substeps] All of the fruits and vegetables i eat should complement the colour of my blush. Fresh fruits and vegetables should be a natural blush, starting from the heels instead of in the middle.', \\\"Check out the blush section in your favorite makeup department and make your choice based on the color of your skin. Here's a guide : [substeps] For dark skin, choose a cranberry color.\\\", '[substeps] You can find many types of rosy blushes at most department stores. Nearly any blush color is appropriate for your skin type.', 'Select a natural rosy color, preferably from an artist. Also keep in mind that only many pinks are truly rosy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}