{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"04aafaf3-d62e-5223-aa0c-372e8aa975e3","task_key":"default--validation--49492--variant-f87243546570","task_revision_id":"1","upstream_id":"49492--variant-f87243546570","short_description":"HellaSwag validation 49492","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to increase fertility with hypnosis [title] Daily practice of self-hypnosis is invaluable in increasing your chances of conception. [step] Spend five minutes, once or twice each day, in this relaxed state with this new belief and it will begin to plant the seeds necessary to create success. [title] Find a place where you will not be disturbed for a while.\",\"endings\":\"['[step] This could be a bench, the floor of a street, the sofa or even your bed! Find somewhere completely private with no television and other distractions and lie down for a short period. Rediscover the aspects you already enjoy.', '[step] Do not sit in the privacy of your home, bathroom or living room for hours. Find somewhere quiet and solitary where no one will disturb you.', '[step] Settle yourself comfortably, either sitting or lying down. Close your eyes, get quiet and still, become aware of your breathing, relax....', \\\"[step] Because hypnosis can be performed in a variety of places, including small isolated areas, you will want to keep your activity private. Keep your noise to a minimum to safeguard yourself against loud music and' strange' people entering your home.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}