{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"27d1d8d0-a31e-5d5d-ae01-08aa5af8555d","task_key":"default--validation--6064","task_revision_id":"1","upstream_id":"6064","short_description":"HellaSwag validation 6064","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to bring discipline into your life [title] Analyze yourself first. [step] Work out what things stand in the way of you being more disciplined at the moment. They may be character flaws, an inability to articulate what you want out of life or a preference for losing yourself in stimulants or addictions.\",\"endings\":\"['[substeps] Identify the problematic aspects of your own work that contribute to your own lack of discipline. Make a list of the things that oppose discipline and take some time to examine the consequences.', \\\"Perhaps you conform too much without thinking for yourself; this can make it easy to follow someone else's ideas of discipline without working out discipline that works for you and fulfills your own real needs. Whatever the reason, try to determine it first.\\\", 'You may not want to be disciplined for each one of these reasons, but they get to the point where they cause you no harm in the long run. [substeps] Do a sit-down appraisal to assess your own personality.', 'Answer any questions and challenge those assumptions with positive analytical thinking. [substeps] To motivate positive thinking, think about your past accomplishments.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}