{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7cd7c2d2-f3e0-5992-884e-1563bbc2efab","task_key":"default--validation--1615","task_revision_id":"1","upstream_id":"1615","short_description":"HellaSwag validation 1615","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to stop having tics [title] Identify the preemptive urge. [step] Many people with tics have an \\\" urge \\\" before the tic onset, sort of like an itch that you need to scratch. In some way, the tic onset relieves that urge.\",\"endings\":\"[\\\"In particular, the urge is what causes you to stutter. [substeps] This urge can be triggered by a variety of things, including negative reactions, you've held back, or other behaviors such as anorexia.\\\", 'If you can identify what happens right before you tic, you can take steps to suppress the tic. [substeps] For instance, maybe you feel a certain tension in the area before the tic, and the tic relieves that tension.', '[substeps] For instance, an automatic urge may apply because the urge seems like an impulse. Impulse is because a trigger is somewhere in your mind, but often, is directed to something else.', 'It also helps them get rid of it. [substeps] Try mentally remembering the pattern of five or more tic apps or the number of times a day a three-dimensional tic occurs.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}