{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dd0956f0-5c8f-51d7-b05c-4227ea2dc7bc","task_key":"default--validation--32873","task_revision_id":"1","upstream_id":"32873","short_description":"HellaSwag validation 32873","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to get rid of a pimple [title] Apply a hydrocortisone cream. [step] Hydrocortisone cream is the next-best thing to cortisone injections. Directions will vary depending on which hydrocortisone cream you use.\",\"endings\":\"['[substeps] You can apply the cream 1 hour before the procedure, or use it right before your procedure. Cortisone cream, which will provide additional relief from an acne outbreak, will work to clear up cystic pimples.', 'Generally, though, you can apply the cream directly to your pimple up to twice daily. [substeps] Hydrocortisone cream can, if used excessively, thin the skin and lead to more breakouts.', \\\"Read the product's label closely to find out how much to use. [substeps] Dermabrasion occurs when someone wraps something between their thumb and index finger and squamous matter forms.\\\", '[substeps] Hydrocortisone cream is a cream that contains an active substance called oxyfluit (hydrocortisone). This dead herpetic gas is growing within the lining of the pimple, causing inflammation.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}