{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7fd95848-b26d-5897-9343-cf3ab5ed8526","task_key":"default--validation--48990","task_revision_id":"1","upstream_id":"48990","short_description":"HellaSwag validation 48990","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look beautiful at the beach [title] Go shopping for a swimsuit that suits your shape. [step] Every body type looks best in a different style of swimsuit. Whether you've got curves or a straighter waistline, purchasing a suit that flatters your figure is a guaranteed confidence builder.\",\"endings\":\"['[substeps] A swimsuit with a slick, plump bottom takes up less space, fits your waist, and makes you look skinnier. Cheaper plastic is a plus as long as the shape you choose is proportional to your body.', 'If possible, find something that works for your needs. [substeps] A bikini or similarly sexy swimsuit will both help lure you into the waves and support your self-esteem.', '[substeps] Bikinis are most likely to get at least some boobs. Swimsuits are generally made out of cuticle material that is grown from the coral reef and then launched through the ocean.', '[substeps] For a big bust, opt for a halter-style bikini top with cups or inner support or a bra top with underwire support. For a tummy, try a tankini, especially a-line style tankinis.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}