{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"70477089-7f58-539b-b711-e68bd6dbb119","task_key":"default--validation--37941","task_revision_id":"1","upstream_id":"37941","short_description":"HellaSwag validation 37941","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make jasmine scent using enfleurage [title] Obtain unscented moisturising cream. [step] Choose a good quality version, and look for a type suitable to your skin. [title] Smear the moisturising cream inside a jar.\",\"endings\":\"['[step] Cover all the inside sides of the jar with the moisturising cream in a thick layer. The jar must be wide enough for you to be able to get your hands inside and move them around.', '[step] This is the most crucial thing to do in addition to creating your signature jasmine fragrance. [title] Put the lotion on your skin.', '[step] For most scents, this method is very risky and should be used only if you have evidence of unwanted or an allergic reaction to the honey or menthol) that simply does not belong to what you are attempting to make. [substeps] She smells deliciously feminine and earthy.', '[step] Buy some enfleurage cream from a pharmacy or store. Stick with this around day one-the longer you wait, the easier the blend.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}