{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c1622e1c-4d25-5946-961e-9c28da884371","task_key":"default--validation--45191","task_revision_id":"1","upstream_id":"45191","short_description":"HellaSwag validation 45191","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to deal with ivf failure [title] Change your perspective to deal with self-blame. [step] It's normal to blame yourself if ivf wasn't successful. But doing that will only cause you further distress.\",\"endings\":\"['Instead of blaming yourself, try looking at the bigger picture. [substeps] Remind yourself that ivf failure is the rule, not the exception.', 'The grief you feel when you find yourself thinking negatively about ivf will only make them worse. With just time, the chemicals in your blood will begin to break down and your thoughts will be clearer.', 'When the problem arises for you, resolve it as best as you can by restructuring your perspective. [substeps] Analyze and identify when you want to blame your partner.', 'Think about all the negative things that, in spite of the fact that ivf failed, others believe could have been done. [substeps] How does a doctor feel after a surgery? See a counselor.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}