OpenLexicon: Easy access to lexical databases
At OpenLexicon, you will find:
- a directory of lexical databases
- scripts to query, manipulate or create lexical databases.
- apps to create dynamic graphical interfaces to the lexical databases. Some of the apps provide the infrastructure of http://www.lexique.org where many of lexical databases are hosted and can be queried on-line — check out, for example, http://www.lexique.org/shiny/openlexicon.
- documents of interest related to the processing of lexical resources.
Downloading a database to work locally (on your computer)
You can download datasets directly from the links provided in the README files. Then you would open them with Python, R, or Excel:
import pandas as pd lex = pd.read_csv(‘http://www.lexique.org/databases/Lexique383/Lexique383.tsv’, sep=’\t’) lex.head()
library(readr) lex = read_tsv(‘http://www.lexique.org/databases/Lexique383/Lexique383.tsv’) head(lex)
However, in R, there is a better way. You should use the R dataset fetcher, which has several advantages:
- it avoids having to specify the location of the dataset on the web
- it will always point to the latest version of a dataset if it has been updated
- it provides a caching mechanism: the dataset will be downloaded only if necessary, otherwise a local copy will be used.
- it checks the sumfile of the dataset to make sure that you have the correct version.
For example, to download the table of Lexique383:
require(tidyverse) require(rjson) source('https://raw.githubusercontent.com/chrplr/openlexicon/master/datasets-info/fetch_datasets.R') lexique383 <- get_lexique383()
Everybody is warmly encouraged to contribute, by adding new databases (To add a new dataset, you must create a
.json file in
datasets-info/_json. Check out How-to-install-a-new-dataset), an app, or a script.
First, check out Lexique’s google-group at https://groups.google.com/forum/#!forum/lexiqueorg. You can then contact
email@example.com privately, or, much better, fork the
openlexicon repository (see How to fork a repo) and issue a pull request (see Creating a pull request from a fork).
Check out the TODO list
Most databases have associated publications listed in their respective
files. They must be cited in any derivative work! The same goes for some of the
scripts (read their documentation for instructions).
If needed, you can cite this repository as:
- Pallier, Christophe & New, Boris (2019** Openlexicon, GitHub repository, https://github.com/chrplr/openlexicon
The files in this repository are distributed under a CC BY-SA 4.0 LICENSE (see https://creativecommons.org/licenses/by-sa/4.0/).
Time-stamp: <2019-10-05 09:48:32 firstname.lastname@example.org>