{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f0e14a0e-8f51-571d-96ef-0e22263290d8","task_key":"default--validation--12546","task_revision_id":"1","upstream_id":"12546","short_description":"HellaSwag validation 12546","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to set up international mail forwarding services [title] Assess your needs. [step] There are many options when it comes to mail forwarding services. Each company offers the same basic services, but there are often customizable factors that might make one service plan preferable over another.\",\"endings\":\"[\\\"[substeps] Many companies offer package tracking, though the tracking options may be limited to the country of origin or the country where you'll be receiving your package. Most services will forward letters and correspondences.\\\", 'Generally, you need to decide how much time you want to spend reading each email. [substeps] Think about what physical space you want to use for your information.', 'For example, you might consider an air carrier server when you work on a small local business, and one remote server to operate out of. For example, direct carriers may be better, but same basic things are still held by most independent email providers, as these providers do not need to be registered.', 'If you need to reserve an internet connection and your internet connection is a cellular/landline connection it will be much easier for you to monitor that internet connection, such as content from the blogger page. [substeps] Consider online plans such as a group chat, digital chat, and instant messaging.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}