{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"608e0602-3523-576d-9063-66e7ecdc028c","task_key":"default--validation--18616","task_revision_id":"1","upstream_id":"18616","short_description":"HellaSwag validation 18616","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to deal with female sexual dysfunction [title] Understand what female sexual dysfunction (fsd) means. [step] Fsd is only diagnosed if it is causing you significant distress about your sexuality. Fsd can cause problems, or interfere, with a woman's ability to respond sexually.\",\"endings\":\"['Fsd can be very difficult for a single woman to engage in communication and maintain when she has an emotional addiction. [substeps] Women who experience fsd are more likely to meet other women with more vivid, intense relationships.', '[substeps] Fsd can be generalized/global (e.g. happens during every sexual encounter) or situational (e.g.', \\\"However, it's important to understand that depression is a disease and not a disease; creating a healthy and happy lifestyle may help lower female prostate levels, as well as reduce transverse scarring. [substeps] Fsd determines women' bodies within a 90-80% body image.\\\", 'Again, health problems are common when a woman is diagnosed with fsd. Normal women experience over 16% of women who exhibit fsd.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}