8000 Commits · aws/fmeval · GitHub

More Web Proxy on the site http://driver.im/

Commits

Commits on Apr 4, 2025

add-workflow-approval (#345)

zicanl-amazon
and
Satish615
authored

Commits on Apr 3, 2025

build: update tornado to 6.4.2 (#346)

Satish615
and
satish gollaprolu
authored

Commits on Apr 2, 2025

fix: remove deprecated proprietary model id (#347)

shrestha-bikash
and
Bikash Shrestha
authored

Commits on Jan 13, 2025

Add Ignore type check for Mypy error (#341)

Satish615
and
satish gollaprolu
authored

Commits on Jan 11, 2025

add Fmeval support for python 3.11 and 3.12 (#339)

Satish615
and
satish gollaprolu
authored

Commits on Oct 15, 2024

build: bump fmeval version to 1.2.1 (#329)

shrestha-bikash
and
Bikash Shrestha
authored

Commits on Aug 26, 2024

build(deps) bump nltk from 3.8.1 to 3.9.1 (#327)
danielezhu
authored

Commits on Aug 21, 2024

build: bump fmeval version to 1.2.0 (#326)

kirupang-code
and
xiaoyi-cheng
authored

Commits on Aug 15, 2024

feat: add `BERT_SCORE` to `QAAccuracySemanticRobustness` (#315)
kirupang-code
authored

Commits on Aug 12, 2024

Commits on Aug 8, 2024

refactor: `SummarizationAccuracyMetrics` transform to handle multiple target outputs more efficiently (#317)
kirupang-code
authored

Commits on Jul 18, 2024

Commits on Jul 16, 2024

feat: add configurable param logical_operator (OR/AND) to factual knowledge (#307)
kirupang-code
authored

Commits on Jul 12, 2024

feat: update context to use lists (#305)
oyangz
authored

Commits on Jul 11, 2024

fix: update how default payloads get extracted from model spec (#309)
danielezhu
authored

Commits on Jul 10, 2024

feat: add `quasi_exact_inclusion` metric to factual knowledge; change `factual_knowledge` score name to `exact_inclusion` (#302)
kirupang-code
authored

Commits on Jul 9, 2024

build(deps): bump certifi from 2024.2.2 to 2024.7.4 (#303)
dependabot[bot]
authored

Commits on Jul 2, 2024

fix: register placeholder_to_record_key in GeneratePrompt transform (#301)
xiaoyi-cheng
authored

Commits on Jul 1, 2024

feat: add validate_prompt_template util (#300)
xiaoyi-cheng
authored

Commits on Jun 29, 2024

build(deps-dev): bump pdoc from 14.5.0 to 14.5.1 (#296)
dependabot[bot]
authored

Commits on Jun 27, 2024

feat: add error field in EvalScore (#297)
xiaoyi-cheng
authored

Commits on Jun 24, 2024

Commits on Jun 20, 2024

Commits on Jun 14, 2024

feat: Support multiple data configs in evaluate (#283)
athewsey
authored

Commits on Jun 10, 2024

feat: modify GeneratePrompt transform to take placeholder_dict (#288)
xiaoyi-cheng
authored

0