8000 Refactor LocalModelNodeAgent by sivanantha321 · Pull Request #4431 · kserve/kserve · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Refactor LocalModelNodeAgent #4431

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 14 commits into
base: master
Choose a base branch
from

Conversation

sivanantha321
Copy link
Member
@sivanantha321 sivanantha321 commented Apr 28, 2025

What this PR does / why we need it:

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #4402

Type of changes
Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

Feature/Issue validation/testing:

Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so it can be reproduced.
Please also list any relevant details for your test configuration.

  • Test A

  • Test B

  • Logs

Special notes for your reviewer:

  1. Please confirm that if this PR changes any image versions, then that's the sole change this PR makes.

Checklist:

  • Have you added unit/e2e tests that prove your fix is effective or that this feature works?
  • Has code been commented, particularly in hard-to-understand areas?
  • Have you made corresponding changes to the documentation?

Release note:


Re-running failed tests

  • /rerun-all - rerun all failed workflows.
  • /rerun-workflow <workflow name> - rerun a specific failed workflow. Only one workflow name can be specified. Multiple /rerun-workflow commands are allowed per comment.

@yuzisun yuzisun requested a review from greenmoon55 April 28, 2025 15:06
@sivanantha321 sivanantha321 force-pushed the localmodel-agent-local-volume branch from 022e432 to 379ec65 Compare April 29, 2025 06:09
@sivanantha321 sivanantha321 force-pushed the localmodel-agent-local-volume branch 2 times, most recently from 7442f9d to 5568a54 Compare May 7, 2025 16:49
@sivanantha321 sivanantha321 marked this pull request as ready for review May 7, 2025 16:58
@sivanantha321 sivanantha321 force-pushed the localmodel-agent-local-volume branch 4 times, most recently from 5493152 to 15558b5 Compare May 8, 2025 08:15
@sivanantha321 sivanantha321 force-pushed the localmodel-agent-local-volume branch 4 times, most recently from 9a06037 to 42828da Compare May 21, 2025 09:52
@sivanantha321 sivanantha321 mentioned this pull request Jun 6, 2025
9 tasks
- Removed the DaemonSet configuration for the local model node agent from the default and test overlays.
- Introduced a new ConfigMap for resolving the local model node agent image in the development overlay.
- Updated the kustomization files to reflect the removal of local model node agent configurations.
- Enhanced the InferenceService configuration to include resource requests and limits for the local model agent.
- Added a new controller for LocalModelNodeGroup to manage the lifecycle of local model node agents.
- Updated the OpenAPI and Python model definitions to include new fields for local model agent configuration.
- Improved RBAC permissions for managing daemonsets and service accounts related to local model nodes.

Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
…el role; refactor persistent volume and claim creation to use constants for labels

Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
…el configuration to disable it

Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
…onSet

Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
…PVC creation

Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
@sivanantha321 sivanantha321 force-pushed the localmodel-agent-local-volume branch from 8d3715c to dcae3c0 Compare June 12, 2025 07:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Severe security issue in local-node-agent
1 participant
0