{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2842a12f-024e-54f2-831c-cbf5c760b1b6","task_key":"default--validation--21042","task_revision_id":"1","upstream_id":"21042","short_description":"HellaSwag validation 21042","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stack earrings [title] Wear only studs for a simple look. [step] If you want the simplest, most foolproof look for your stacked earrings, choose several pairs of stud earrings. Look for small, delicate studs that won't overpower one another.\",\"endings\":\"[\\\"[substeps] Stud earrings have a more relaxed look, so they're an ideal option when you're going for a more casual look. If you want your studs to have a more glamorous look, choose styles that features gemstones, such as rhinestones or pearls.\\\", 'Consider how you wear your jewelry and where it will be displayed. [substeps] You can buy new jewelry or have it altered by a jeweler.', 'The studs should match your earrings exactly so that they create a rosy, sophisticated look in addition to the sparkle and warmth provided by the earrings. [substeps] Wearing too many studs can create uneven or undone edges, which can make your earrings look lopsided.', 'Alternatively, use small, thin studs. The length of your earrings can affect the look, so select pairs that are cut to exactly the same length.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}