8000 Evaluator running over pipelines & TEDS by JaMe76 · Pull Request #38 · deepdoctection/deepdoctection · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Evaluator running over pipelines & TEDS #38

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 31 commits into from
Jun 30, 2022
Merged

Evaluator running over pipelines & TEDS #38

merged 31 commits into from
Jun 30, 2022

Conversation

JaMe76
Copy link
Contributor
@JaMe76 JaMe76 commented Jun 29, 2022

This PR adds two features regarding general evaluation purposes:

  • TEDS metric: TEDS has been proposed in https://arxiv.org/abs/1911.10683 and allows comparing table recognition using tree edit distance of html structures.
  • Running Evaluators over pipelines: Composing html requires results of several pipeline components which is why it necessary to allow evaluating pipeline results instead of pipeline components. The Evaluators run method has therefore been extended to accept pipelines.
  • In addition to that some meta data gathering methods for predictors, pipeline components and pipelines have been added to simplify the customization of the Evaluator and to handle more easily upcoming features.

This features closes #6

JaMe76 added 30 commits June 22, 2022 15:12
@JaMe76
update evaluator [eval]
5f181d6
@JaMe76
let evaluator run on a pipeline [eval]
f57b219
@JaMe76
start teds [eval]
8f18706
@JaMe76
add dd_pipe_like arg for pubtabnet [dataset]
cf68002
@JaMe76
provide meta data from predictors and components [pipe][extern]
b91496a
@JaMe76
update meta annotations [pipe]
8d88468
@JaMe76
update evaluator [eval]
9a29815
@JaMe76
continue with teds [eval]
332b0df
@JaMe76
update docs [docs]
ef0e19b
@JaMe76
update evaluator [eval]
96225ca
@JaMe76
let evaluator run on a pipeline [eval]
307cbde
@JaMe76
start teds [eval]
38b7787
@JaMe76
add dd_pipe_like arg for pubtabnet [dataset]
d0cc38c
@JaMe76
provide meta data from predictors and components [pipe][extern]
94d5616
@JaMe76
update meta annotations [pipe]
447d6b3
@JaMe76
update evaluator [eval]
924dd70
@JaMe76
continue with teds [eval]
c641a08
@JaMe76
update docs [docs]
43a8090
@JaMe76
update -gitignore [gitignore]
275c7f7
@JaMe76
update eval testing [tests]
3fa34ab
@JaMe76
fix lint issues [lint]
4f4ad88
@JaMe76
fix mypy [mypy]
57dfba6
@JaMe76
fix test issues [tests]
7b115c8
@JaMe76
Merge remote-tracking branch 'origin/eval' into eval
a1691c1 
# Conflicts:
#	deepdoctection/datasets/instances/fintabnet.py
#	deepdoctection/datasets/instances/pubtabnet.py
#	deepdoctection/eval/accmetric.py
#	deepdoctection/eval/cocometric.py
#	deepdoctection/eval/eval.py
#	deepdoctection/eval/tedsmetric.py
#	deepdoctection/extern/hflayoutlm.py
#	deepdoctection/extern/texocr.py
#	deepdoctection/mapper/cats.py
#	deepdoctection/mapper/misc.py
#	deepdoctection/mapper/pubstruct.py
#	deepdoctection/pipe/base.py
#	deepdoctection/pipe/cell.py
#	deepdoctection/pipe/common.py
#	deepdoctection/pipe/language.py
#	deepdoctection/pipe/layout.py
#	deepdoctection/pipe/refine.py
#	deepdoctection/pipe/segment.py
#	deepdoctection/pipe/text.py
#	deepdoctection/pipe/tokenclass.py
#	deepdoctection/train/d2_frcnn_train.py
#	setup.py
#	tests/mapper/test_cats.py
#	tests/mapper/test_pubstruct.py
@JaMe76
fix test issues [test]
b6c1324
@JaMe76
fix test issues [test]
62c61a6 8000
@JaMe76
fix test issues [test]
a11d8fa
@JaMe76
fix test issues [test]
8e1aa93
@JaMe76
fix test issues [test]
90abea8
@JaMe76
fix test issues [test]
73192b0
@JaMe76 JaMe76 self-assigned this Jun 29, 2022
@JaMe76 JaMe76 merged commit 5dc7c4d into master Jun 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@JaMe76 JaMe76

Labels
None yet
Projects
None yet
Milestone
No milestone