{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a14d7c05-b26d-5340-acdb-2f9129522680","task_key":"default--validation--31694","task_revision_id":"1","upstream_id":"31694","short_description":"HellaSwag validation 31694","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to treat psoriasis with biologics [title] Identify different biologics. [step] Biologics are protein-based drugs derived from living cells cultured in a laboratory. There are a large number of biologics used to treat psoriasis.\",\"endings\":\"['These include salicylic acid, varnitytethionine (alpha), colantin, and calcium. Some are also effective in treating \\\" temporary bleeding \\\" infection.', 'Some biologics are known as autoimmune response therapies. [substeps] Autoimmune response therapies are the most likely treatments for psoriasis, especially those used to treat retinopathy or implantation or regeneration issues.', 'Five biologics that you should consult with a doctor include : [substeps] Ubifidothionine hypooxin banuric acid atom activates the immune response by converting oxygen from the dna in the cells. Your body sends signals into the nervous system that produce \\\" spikes \\\" that run up and down your body.', 'These drugs target different aspects of psoriasis. Your doctor will decide on your treatment based on your symptoms.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}