Description
when I run the code:
from jsonformer import Jsonformer
from transformers import AutoModelForCausalLM, AutoTokenizer, AutoModel
model = AutoModel.from_pretrained("models--THUDM--chatglm2-6b", trust_remote_code=True).half().cuda()
tokenizer = AutoTokenizer.from_pretrained("models--THUDM--chatglm2-6b", trust_remote_code=True)
json_schema = {
"type": "object",
"properties": {
"name": {"type": "string"},
"age": {"type": "number"},
"is_student": {"type": "boolean"},
"courses": {
"type": "array",
"items": {"type": "string"}
}
}
}
prompt = "Generate a person's information based on the following schema:"
jsonformer = Jsonformer(model, tokenizer, json_schema, prompt)
generated_data = jsonformer()
print(generated_data)
It happens some error:
Traceback (most recent call last):
File "/root/home/cds/Langchain/test_json.py", line 25, in
jsonformer = Jsonformer(model, tokenizer, json_schema, prompt)
File "/data/anaconda3/envs/Langchainrag/lib/python3.9/site-packages/jsonformer/main.py", line 36, in init
self.number_logit_processor = OutputNumbersTokens(self.tokenizer, self.prompt)
File "/data/anaconda3/envs/Langchainrag/lib/python3.9/site-packages/jsonformer/logits_processors.py", line 78, in init
self.allowed_mask[token_id] = True
IndexError: index 64793 is out of bounds for dimension 0 with size 64787
How do I solve it?