{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4a18b7d9-4630-5b1b-87c1-ba05ebc7f342","task_key":"default--validation--39711","task_revision_id":"1","upstream_id":"39711","short_description":"HellaSwag validation 39711","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stop a bra from riding up [title] Get a professional fitting. [step] The best way to get a good fit is to have a professional take your measurements. Most lingerie stores will do a fitting for free.\",\"endings\":\"['[title] Look through your clothes for any apparel that relates to the condition of your garment. [step] Typically, the garment you choose should be a quality article or piece made from natural fibers.', \\\"To get a good fit, you'll need a fitted bra with adjustable cups. A professional will also be able to give you both of the necessary measurements as well as be honest about any other measurements that your friends are having.\\\", \\\"Be aware that a good bra fitting takes time (at least 15 minutes) and a bit of trial and error. Tell the fitter that you are looking for a bra that won't ride up in the back.\\\", 'This can save you a significant amount of money in the long run. However, many professional pieces can be found at retail stores or ikea, as well as some teen lingerie shops, used undergarments makers, and lingerie stores.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}