8000 Implement Custom Task Runner · Issue #35 · wizenheimer/cyyrus · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Implement Custom Task Runner #35

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up fo 8000 r GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
1 task
wizenheimer opened this issue Aug 18, 2024 · 0 comments
Open
1 task

Implement Custom Task Runner #35

wizenheimer opened this issue Aug 18, 2024 · 0 comments
Assignees
@wizenheimer

Comments

@wizenheimer
Copy link
Owner
wizenheimer commented Aug 18, 2024 •
edited
Loading

Summary

Enhance task running capabilities by implementing an asynchronous task runner and exploring a Ray-based task runner, with reference to Prefect’s implementation.

Pain Points

What challenges are users encountering without this feature?

  1. Current task runners may not handle asynchronous operations efficiently, leading to potential bottlenecks and performance issues.
  2. There might be limitations in scalability and parallelism with the existing task runner, affecting overall system performance.

Current Workarounds

Have you come across any alternatives or tried any workarounds?

  1. Users might implement custom asynchronous handling or rely on synchronous task runners, which could be less efficient.
  2. Some may use external tools or libraries to achieve better performance but face integration challenges.

Solution

What solution would you like to see?

  1. Reference the implementation from Prefect to understand best practices and integrate similar approaches.
  2. Implement an asynchronous task runner to improve efficiency and responsiveness in task execution.
  3. Explore and evaluate a Ray-based task runner for potential enhancements in scalability and parallelism.

References

Have you seen similar solutions or examples elsewhere?

  1. Review Prefect’s task runner implementation for insights and best practices.
  2. Investigate Ray-based task runners and their capabilities for scalable and efficient task management.

Additional Notes

Is there anything else you’d like us to know?

  1. Ensuring robust support for asynchronous operations and exploring advanced task runners will significantly enhance performance and scalability.

Contribution

  • I’d love help with this if needed!
@wizenheimer wizenheimer self-assigned this Aug 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@wizenheimer wizenheimer

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@wizenheimer
0