{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ede7f27a-bdb0-5321-9a85-7a9a51971fb3","task_key":"default--validation--19434","task_revision_id":"1","upstream_id":"19434","short_description":"HellaSwag validation 19434","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to part your hair for your face shape [title] Look at length versus width. [step] A deciding factor in finding your face shape is whether your face is longer than it is wide or wider than it is long. [substeps] Use a flexible measuring tape or string to measure.\",\"endings\":\"[\\\"If you know the exact width of your face, that's pretty much the only way to narrow your options. Try to figure out your face shape by looking through magazines or online to find how long you have hair.\\\", 'Run it down each section of hair from the hairline to the tips to find the exact measurements you need. Width is number one, width is number two, and width is number three.', \\\"Use a child's measure to measure from the top of your jawline to the tip of your nose. Use one foot to measure across the top of your head from the crown of your head to the tips of your eyebrows.\\\", 'Measure the length from the top of your hairline to your chin, and measure width all the way across your face at the level of the bridge of your nose. Also measure the width of the top of your hairline and the width across your jaw.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}