{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"249e9d7a-b830-5d59-88b0-b7bacff1aa9d","task_key":"default--validation--50068","task_revision_id":"1","upstream_id":"50068","short_description":"HellaSwag validation 50068","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to check out a gym daycare [title] Ask your local gym if they offer daycare services. [step] One way you can locate a gym daycare is to inquire if your regular gym has daycare services. Perhaps they have a daycare area in the back that you never noticed before.\",\"endings\":\"[\\\"[title] Inquire about annual discount on a regular gym visit. [step] While most gyms provide a discount, that doesn't mean the payout won't be good for the gym.\\\", 'If they do, ask them if you can come and help. Not everyone has this option, and many gyms only offer this option in certain circumstances.', 'Or maybe they recently expanded to include a daycare for their clients. Speak to a representative at your local gym to see if you can place your child in a daycare there.', \\\"Call their toll free number at 1-800-272-1211 and inquire whether they offer daycare services. If they don't, look them up on their website to find out.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}