{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"781fc912-88c5-57a8-be6e-2165242c2d82","task_key":"default--validation--45185","task_revision_id":"1","upstream_id":"45185","short_description":"HellaSwag validation 45185","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to determine your dress size [title] Measure your bust. [step] You'll need to measure the fullest part of your bust to get the proper measurement. Make sure that the measuring tape (a dress maker's soft tape measure for preference) goes under your arms.\",\"endings\":\"[\\\"Place this tape on your small bust with a straight edge just below the bust measurement. [substeps] If you don't have a dress maker but the measuring tape came with you, then you may want to print out the measurements and letter the proper delivery address.\\\", \\\"You should feel the circumference of your bust underneath the arm holes. If you have an underbust, you'll usually need to measure the upper part of your chest, under your bust and above your breasts.\\\", \\\"[substeps] Keep the measuring tape snug but not too tight. If you do it too tight (if your bust is popping out over the tape) then you'll get the wrong measurements and your dress won't fit properly.\\\", \\\"Measure the length of your neck from top to bottom and side to side. [substeps] If you have a noticeable bust, the dress maker's soft tape measures out your girth.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}