{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"109e6431-dea8-57a9-8283-8c1f7c3f2f1b","task_key":"default--validation--8987","task_revision_id":"1","upstream_id":"8987","short_description":"HellaSwag validation 8987","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to care for your micro bikini [title] Instructions. [step] Read and carefully follow any fabric care instructions that come with or are listed on your bikini wear. You don't want to ruin it and use something that's going to make the color fade or stain even more.\",\"endings\":\"[\\\"In order to be even more sure, determine how to care for it. The first thing to do is to take the time to familiarize yourself with the basic components of the bikini and decide if it's the right size.\\\", '[title] Carefully measure the waist and locate the cutout of the fabric on your bikini. [step] The waist is the point at which the cut is visible through the fabric.', 'The best tips for ensuring a color blooming, photogenic look to your bikini are that you can always paint and/or steam tan later. [title] Plan your trim after you have washed.', 'Determine if you are going to hand wash or machine wash your bikini wear. Take in consideration the fabric, texture and ornaments, if any, that may be affected.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}