{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be9b5bf1-2dc4-5ac8-b5cb-e6027cc09aed","task_key":"default--validation--8647","task_revision_id":"1","upstream_id":"8647","short_description":"HellaSwag validation 8647","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to learn to fence [title] Decide why you want to fence. [step] Is it for, competition, or for historical appeal? All of these are legitimate reasons, and each leads to a different type of fencing and training. Fencing is an old art that has great traditions and cultures, so you may find it more enjoyable if you immerse yourself in it.\",\"endings\":\"['[title] Know your subjects/fields and places. [step] The smell or taste of old fencing is still delicious.', 'If you are ready to learn, you may find your interest takes you out of your comfort zone as you get to know the boundaries. [substeps] For example, some schools forbid the use of fencing in historic areas.', \\\"Fencing is a great way to learn both mental and physical skill and discipline. But it's also great exercise and great fun for the more casual fencer too! [title] Research different types of fencing.\\\", 'If you want to strike a balance between visual and physical fencing, then you may want to consider your cultural background and your community. [substeps] Your community might not accept any sponsored competitions through which you can actually compete.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}