{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"536d7337-97dd-599d-b20e-2272359619d4","task_key":"default--validation--20477","task_revision_id":"1","upstream_id":"20477","short_description":"HellaSwag validation 20477","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to measure chest size [title] Locate a fabric tape measure. [step] This type of tape measure is easy to wrap around your body, and accurately measuring curves. If you don't have one, you can instead wrap a string around your body, then measure that with a ruler.\",\"endings\":\"['[title] Find a friend to help you measure. [step] It can be a little tricky to take an accurate chest measurement on your own, so if possible, see if you can find a friend to help you.', 'Be sure to stand about 6 feet (1.8 m) behind any furniture you intend to walk on. [substeps] You can try double-sided tape for a stronger measurement.', 'Hang the tape tape down the front of your chest, rubbing its edge along your ribs. [substeps] Mark down the shirt width using an invisible pencil.', '[substeps] Some fabrics can be tested with built-in test tape, but other fabrics and materials can be found online or in craft stores. You might use test tape for smaller forms of chest measuring, such as sweaters, tutus, and shirts.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}