{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3cf318ad-5d3c-5073-a22d-70e0df1ca76b","task_key":"default--validation--29423","task_revision_id":"1","upstream_id":"29423","short_description":"HellaSwag validation 29423","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to accentuate your bust with swimsuit tops [title] Consider changing up the design of your swimsuit top. [step] If you usually wear halter tops, it's time to switch it up, as halters can often flatten you out. Try switching to a triangle top or a twist bandeau.\",\"endings\":\"[\\\"This is great if you prefer low-cut, high waisted bikinis; you don't really have to get into a swimsuit. Or, take a pair of bandeau tops and wear them to work and out.\\\", 'It is important to switch up your style, and to give yourself a natural glow. [title] Go for a texture-suit experience.', 'A triangle top is one of the skimpiest swimsuit tops there are, and they help create the illusion of beautiful cleavage. On the other hand, twist bandeau tops and bandeaus that dip in the middle create curvature up top, creating shape, volume and the illusion of a fuller bust.', '[substeps] Remember that flattering what you do have shows! [title] Wear your swimsuit under low to-the-ground cover ups. [step] When they are already in full effect, less will obstruct your bikini top and make your models look drab.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}