-
Notifications
You must be signed in to change notification settings - Fork 73
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
你好,我��一些关于KGEditor的问题想请教一下 #52
Comments
你好,感谢你对我们工作的关注!我在这里解答你的疑问。
|
感谢您的回复,我还有一个问题,在运行结果中Eval/hits5,Eval/hits3,Eval/hits1,Eval/mean_rank,Eval/mrr,Eval/loc_hits1,Eval/loc_hits3, Eval/loc_hits5, Eval/loc_mean_rank,Eval/loc_mrr这些分别指什么呢 |
你好,这些指标分别对应于论文中的succ@k和RK@k。比如Eval/hits1对应的是succ@1,loc_hits3对应RK@3,mean_rank和loc_mean_rank用于计算ER_roc和RK_roc。计算方式在论文的Methodology章节中有详细说明。 |
抱歉,请问一下Eval/mrr,Eval/loc_mrr是什么呢 |
抱歉,这个指标不应该出现在这里,和我们的实验metrics是没有关系的。这个MRR指标是KGC任务中的指标,全称是Mean Reciprocal Ranking,代表平均倒数排名,具体可以参考查询一些相关文章。 |
好的,非常感谢 |
1.在演示中,input为Jane Wyman|/people/person/places_lived./people/place_lived/location|[MASK],Inductive Entity为Palm Springs,Origin Results为New York City United States of America United States Department of Housing and Urban Development,Add Results为Palm Springs Toy Story Emir Kusturica,增加了实体Palm Springs,输出为什么会多出来Toy Story和Emir Kusturica?
2.https://drive.google.com/drive/folders/1K1gag6eTCJ-x7WM-zbn6IRGX_B9fy4hD?usp=share_link和https://huggingface.co/datasets/zjunlp/KGEditor/tree/main/A-FB15k237这两个网址的数据集结构并不完全一样,我想要构建��己的数据集,应该参照哪一个呢?
The text was updated successfully, but these errors were encountered: