Biber et al.'s (2016) set of 150 BNC items for the analysis of dispersion measures: Dataset for "Evaluation of text-level measures of lexical dispersion"

Version 1.0
Sönning, Lukas, 2025, "Biber et al.'s (2016) set of 150 BNC items for the analysis of dispersion measures: Dataset for "Evaluation of text-level measures of lexical dispersion"", https://doi.org/10.18710/ATCQZW, DataverseNO, V1
Learn about Data Citation Standards.
Contact Owner Share
Dataset Metrics
0 Downloads
Description
This dataset contains frequencies for a set of 150 word forms in the BNC. The set of items was compiled by Biber et al. (2016) for the purpose of analyzing the behavior of dispersion measures in different distributional settings. It was therefore assembled to cover a broad range of frequency and dispersion levels. For each form, the dataset lists (i) the number occurrences in each of the 4049 text files in the BNC, including zero counts; and (ii) the length of each text file, i.e. the number of word tokens it contains. (2022-07-08)
Subject Arts and Humanities
Keyword BNC, dispersion measures, lexical dispersion, word importance, vocabulary lists, word frequency lists, corpus, corpus linguistics, corpus design, methodology, frequency, text-level analysis, Juilland's D, Gries' DP, DA, English
Related Publication Sönning, L. (2022). Evaluation of text-level measures of lexical dispersion: Robustness and consistency. PsyArXiv. https://doi.org/10.31234/osf.io/h9mvs doi: 10.31234/osf.io/h9mvs
License/Data Use Agreement

Custom Dataset Terms

Filter by
1 to 10 of 152 Files
00_ReadMe_BNC150.txt
Plain Text - 9.5 KB
Published Jan 7, 2025
0 Downloads
MD5: ccb5e103ba3aa94f96920d9055bb1906
Documentation file describing the dataset
Preview "00_ReadMe_BNC150.txt"
01_R_script_BNC150_extraction.Rmd
Unknown - 60.2 KB
Published Jan 7, 2025
0 Downloads
MD5: c469736f0cfdf40fea3642bbd574c816
R script documenting data retrieval from the BNC
a.csv
Comma Separated Values - 65.3 KB
Published Jan 7, 2025
0 Downloads
MD5: a86b1292135f9ad3bf27c375a9adb265
Preview "a.csv"
able.csv
Comma Separated Values - 58.8 KB
Published Jan 7, 2025
0 Downloads
MD5: 55ffb900d21a8f3a7c8c75c1cc0d5f22
Preview "able.csv"
actually.csv
Comma Separated Values - 58.4 KB
Published Jan 7, 2025
0 Downloads
MD5: 00d40ce936cfb56dd30e1267772d799c
Preview "actually.csv"
after.csv
Comma Separated Values - 60.1 KB
Published Jan 7, 2025
0 Downloads
MD5: d1600715802e06177a40afc712ed7e27
Preview "after.csv"
against.csv
Comma Separated Values - 59.3 KB
Published Jan 7, 2025
0 Downloads
MD5: 252d51254bd31e7fed3a2a4804062b44
Preview "against.csv"
ah.csv
Comma Separated Values - 57.9 KB
Published Jan 7, 2025
0 Downloads
MD5: 4f0bb57f67c48aa1b9f002f2acf50842
Preview "ah.csv"
aha.csv
Comma Separated Values - 57.7 KB
Published Jan 7, 2025
0 Downloads
MD5: 45faf2ecd23e64ad82d665bb03117d51
Preview "aha.csv"
all.csv
Comma Separated Values - 62.0 KB
Published Jan 7, 2025
0 Downloads
MD5: f81d5f7ba528e975627f3c03ffc48c27
Preview "all.csv"
Edit File

This file has already been deleted (or replaced) in the current version. It may not be edited.

Restrict Access

Restricting limits access to published files. People who want to use the restricted files can request access by default. If you disable request access, you must add information about access to the Terms of Access field.

Learn about restricting files and dataset access in the User Guide.

Enable access request
You must enable request access or add terms of access to restrict file access.
Save Changes
Edit Embargo

The selected file or files have already been published. Contact an administrator to change the embargo date or reason of the file or files.
Edit Retention Period

The selected file or files have already been published. Contact an administrator to change the retention period date or reason of the file or files.
Delete Files

The file will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Select File(s)

Please select one or more files.

Share Dataset

Share this dataset on your favorite social media networks.

Continue
Dataset Citations

Citations for this dataset are retrieved from Crossref via DataCite using Make Data Count standards. For more information about dataset metrics, please refer to the User Guide.

Sorry, no citations were found.
Inaccessible Files Selected

The selected file(s) may not be downloaded because you have not been granted access or the file(s) have a retention period that has expired or the files can only be transferred via Globus.

You may request access to any restricted file(s) by clicking the Request Access button.

Ineligible Files Selected

The selected file(s) may not be transferred because you have not been granted access or the file(s) have a retention period that has expired or the files are not Globus accessible.

You may request access to any restricted file(s) by clicking the Request Access button.

Download Options

The files selected are too large to download as a ZIP.

You can select individual files that are below the 4.7 GB download limit from the files table, or use the Data Access API for programmatic access to the files.

Select File(s)

Please select a file or files to be downloaded.

Inaccessible Files Selected

The selected file(s) may not be downloaded because you have not been granted access or the file(s) have a retention period that has expired.

Click Continue to download the files you have access to download.

Ineligible Files Selected

Some file(s) cannot be transferred. (They are restricted, embargoed, with an expired retention period, or not Globus accessible.)

Click Continue to transfer the elligible files.

Delete Dataset

Are you sure you want to delete this dataset and all of its files? You cannot undelete this dataset.

Delete Draft Version

Are you sure you want to delete this draft version? Files will be reverted to the most recently published version. You cannot undelete this draft.

Unpublished Dataset Private URL

Private URL can only be used with unpublished versions of datasets.

Unpublished Dataset Private URL

Are you sure you want to disable the Private URL? If you have shared the Private URL with others they will no longer be able to use it to access your unpublished dataset.

Delete Files

The file(s) will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Compute

This dataset contains restricted files you may not compute on because you have not been granted access.

Deaccession Dataset

Are you sure you want to deaccession? This is permanent and the selected version(s) will no longer be viewable by the public.

Deaccession Dataset

Are you sure you want to deaccession this dataset? This is permanent an it will no longer be viewable by the public.

Version Differences Details

Please select two versions to view the differences.

Version Differences Details
 
Version:
Last Updated:
Version:
Last Updated:
Select File(s)

Please select a file or files for access request.

Select File(s)

Embargoed files cannot be accessed. Please select an unembargoed file or files for your access request.

Edit Tags

Select existing file tags or create new tags to describe your files. Each file can have more than one tag.

Request Access

  You need to Log In to request access.

Dataset Terms

Please confirm and/or complete the information needed below in order to request access to files in this dataset.

This dataset is made available under the following terms. Please confirm and/or complete the information needed below in order to continue.

Our Community Norms as well as good scientific practices expect that proper credit is given via citation. Please use the data citation shown on the dataset page.

Custom Dataset Terms — the following Custom Dataset Terms have been defined for this dataset.

This Dataset, Biber et al.'s (2016) set of 150 BNC items for the analysis of dispersion measures: Dataset for "Evaluation of text-level measures of lexical dispersion" (hereafter: Dataset), may be reused according to the CLARIN PUB+BY+LRT license as described below:

Copyright holder: Lukas Sönning

Resource: Biber et al.'s (2016) set of 150 BNC items for the analysis of dispersion measures: Dataset for "Evaluation of text-level measures of lexical dispersion"

The Copyright holders grant the End-User a free, non-exclusive and perpetual (for the duration of the copyright) right to use and make copies of the Resource, distribute copies and present the Resource in public as such, as modified, or as part of a compilation or derived work. The permission applies to all known or future modes and means of communication and includes a right to make modifications enabling the use of the Resource on other devices and in other formats.

Additional license terms as defined in the Condition Definitions section below:

  • General Use conditions: BY, LRT

Condition Definitions:

  • BY: Attribution, i.e. acknowledgement of authorship, is required.
  • LRT: The content is available only for language research and technology development.

This license has been made in compliance with copyright agreements by WIPO – the World Intellectual Property Organization. The rights granted in this license shall be so interpreted that in case applicable intellectual property laws grant rights not mentioned in this license, they are also regarded as part of the rights to be licensed; the purpose of this license is not to restrict any rights intended to be licensed within different legal systems. Additional rights to the Resource may be agreed separately in writing.

Reused sources:

This Dataset contains analyses of data, but no actual text excerpts, from the following source:

Preview Guestbook

Upon downloading files the guestbook asks for the following information.

Account Information

Package File Download

Use the Download URL in a Wget command or a download manager to download this package file. Download via web browser is not recommended. User Guide - Downloading a Dataverse Package via URL

https://dataverse.no/api/access/datafile/

Compute Batch
Clear Batch
Dataset Persistent Identifier Change Compute Batch
Compute Batch
Submit for Review

You will not be able to make changes to this dataset while it is in review.

Publish Dataset

Are you sure you want to republish this dataset?

Select if this is a minor or major version update.

Publish Dataset

This dataset cannot be published until TROLLing is published by its administrator.

Publish Dataset

This dataset cannot be published until TROLLing and DataverseNO are published.

Return to Author

Return this dataset to contributor for modification.