Updated imodel - event.streaming #544

ohdearquant · 2025-01-23T15:18:46Z

PR 1: Updated iModel2

Summary of Changes:

Introduced a new streaming property on Event and a corresponding stream() method.
Enhanced the Processor logic to distinguish between streaming and non-streaming events:
- If event.streaming is True, the processor calls event.stream() instead of event.invoke().
- Applied concurrency control when concurrency_limit is set.
Modified APICalling to support both normal invocation and streaming within the same class.
Unified error-handling logic for both invoke and stream paths (logging errors, updating event status, etc.).
Minor refactoring to better align code across the codebase (e.g., file structure and imports).

Why This PR?

Needed an integrated way to handle streaming responses within the same queue/processor flow used for standard requests.
Simplifies code by adding a single attribute (streaming = True) on an event rather than creating a separate streaming event class.
Improves reliability, as both invoke() and stream() now share a consistent state and error-handling approach.

Testing:

Verified that queue-based processing respects concurrency limits for streaming.
Manually tested both normal invocation and streaming across various endpoints.
Ensured the updated logic did not break existing rate-limit features or event statuses.

…rocessor initialization

…dAPIExecutor

…rror handling

… API calls

…ss methods

ohdearquant and others added 10 commits January 23, 2025 07:46

refactor: rename reader module and update import paths

54c3fa2

fix: improve API call handling with status checks and timeout

2d04618

fix: allow additional keyword arguments in Branch class methods

bfd8ca6

feat: add streaming support to Event class and concurrency limit to P…

950c78e

…rocessor initialization

feat: add concurrency limit to RateLimitedAPIProcessor and RateLimite…

8f149ac

…dAPIExecutor

feat: implement streaming support in APICalling class with enhanced e…

de0a56c

…rror handling

feat: enhance iModel with streaming support and concurrency limit for…

93fd393

… API calls

fix: add missing comma for additional keyword arguments in Branch cla…

47f7450

…ss methods

chore: bump version to 0.8.8 in version.py and pyproject.toml

dea33f9

fb627ac

ohdearquant merged commit 30a1416 into main Jan 23, 2025

ohdearquant changed the title ~~Updated imodel2~~ Updated imodel - event.streaming Jan 29, 2025