8000 [SPEC] Automated scoring of AI generated blueprint runs · Issue #936 · tangle-network/blueprint · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

[SPEC] Automated scoring of AI generated blueprint runs #936

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
2 tasks
drewstone opened this issue Apr 29, 2025 · 0 comments
Open
2 tasks

[SPEC] Automated scoring of AI generated blueprint runs #936

drewstone opened this issue Apr 29, 2025 · 0 comments
Assignees
@drewstone @shekohex @Tjemmmic @Serial-ATA @1xstj

Comments

@drewstone
Copy link
Contributor

Overview

How should we score and automate scoring so we can compare quickly and save time improving the prompts.

  • Created all jobs
  • Created the contracts
  • Created the TOMLs correctly, proper dependencies
  • Overall implementation
  • Did it build

Checklist

  • Create a CLI tool / library to apply to a repo (also integrateable into the AI product)
  • Make it easy to execute, report a score for generations.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@drewstone drewstone

@shekohex shekohex

@Tjemmmic Tjemmmic

@Serial-ATA Serial-ATA

@1xstj 1xstj

Labels
None yet
Projects
4729
Tangle Universe
Status: Planning 🗺️
Milestone
No milestone
Development

No branches or pull requests
5 participants
@drewstone @shekohex @Tjemmmic @Serial-ATA @1xstj
0