This is the repository for the RepL4NLP workshop 2023 paper "Friendly Neighbors: Contextualized Sequence-to-Sequence Link Prediction".
It is a simple extension of the verbalization of KGT5 with the 1-hop neighborhood of the query entity as context.
KGT5 trained a T5 Transformer for link prediction over knowledge graphs (given a head/tail entity and relation, predict the tail/head entity). Input to the model is a verbalized query using mentions of the query-entity and relation, and expected output is the mention of the target entity.
Example input/output:
input: predict tail: Yambáo | genre
expected output: Drama
KGT5-context is a simple extension of KGT5. We additionally provide the model with the 1-hop neighborhood around the input entity.
Example input/output:
input:
query: Yambáo | genre
context:
instance of | film
country of origin | Mexico
reverse of directed | Alfredo B. Crevenna
...
expected output: Drama
git clone git@github.com:uma-pi1/kgt5-context.git
cd kgt5-context
conda create -n kgt5 python==3.10
conda activate kgt5
pip install -r requirements.txt
Note: the dataset is called wikidata5m_v3 as this is the final version of the dataset published with the third arxiv version of the Kepler paper. The second arxiv version had a slightly different split.
mkdir data
cd data
curl -O https://web.informatik.uni-mannheim.de/pi1/kge-datasets/wikidata5m_v3.tar.gz
tar -zxvf wikidata5m_v3.tar.gz
To train the KGT5-context on Wikidata5M, run the following command.
Note, this library will automatically use all available GPUs.
You can control the GPUs used with the environment variable CUDA_VISIBLE_DEVICES=0,1,2,3
python main.py dataset.name=wikidata5m_v3 train.max_epochs=6
If you want to utilize descriptions (provided with Wikidata5M), run
python main.py dataset.name=wikidata5m_v3 train.max_epochs=6 descriptions.use=True
If you want to train the original KGT5 without context use
python main.py dataset.name=wikidata5m_v3 dataset.v1=True
To evaluate a trained model run
python eval.py --config <path to config> --model <path to trained model>
This library supports logging via wandb.
If you want to use it, use the option use_wandb=True
Note, output directory and wandb project name are defined in the file conf/config.yaml.
Unfortunately, QA is not supported by this repository. For QA, please visit the original KGT5 repository.