Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add functionality to stream or poll events from the build process #5940

Open
wants to merge 75 commits into
base: main
Choose a base branch
from
Open

feat: add functionality to stream or poll events from the build process #5940

Show file tree
Hide file tree
Changes from 56 commits
Commits
Show all changes
75 commits
Select commit Hold shift + click to select a range
af9738f
refactor: simplify TaskService by removing Celery integration
ogabrielluiz Jan 24, 2025
f5aac07
refactor: enhance AnyIO backend task management and error handling
ogabrielluiz Jan 24, 2025
9241367
refactor: restructure flow building process and enhance event handling
ogabrielluiz Jan 24, 2025
aa5f0c6
feat: implement QueueService for managing job queues and tasks
ogabrielluiz Jan 25, 2025
0bf7e39
feat: Add QueueService for managing job queues and task lifecycle
ogabrielluiz Jan 25, 2025
4f50235
feat!: Enhance flow building with QueueService integration for job ma…
ogabrielluiz Jan 25, 2025
9a5d246
revert changes to async session
ogabrielluiz Jan 25, 2025
a5a69e9
feat: Integrate QueueService into lifespan management for task handling
ogabrielluiz Jan 26, 2025
178a2f8
refactor: Enhance QueueService with robust lifecycle management and c…
ogabrielluiz Jan 26, 2025
2c8d8f7
refactor: Simplify docstring for get_queue_service function
ogabrielluiz Jan 26, 2025
84f6a09
refactor: Update import statements in queue factory for clarity
ogabrielluiz Jan 26, 2025
ba524b6
test: Improve chat endpoint tests with comprehensive build flow scena…
ogabrielluiz Jan 26, 2025
9fb899f
refactor: Streamline flow build event generation and queue management
ogabrielluiz Jan 26, 2025
a57ba68
refactor: Improve flow build process with modular event handling and …
ogabrielluiz Jan 26, 2025
88742f4
test: Enhance loop component tests with flow build and event handling…
ogabrielluiz Jan 26, 2025
51b0b56
fix: Improve transaction logging with null flow_id handling and debug…
ogabrielluiz Jan 26, 2025
2fa3ec5
fix: Remove unnecessary db.refresh() in transaction logging
ogabrielluiz Jan 27, 2025
5571c13
feat: Add polling mode for build events with optional streaming
ogabrielluiz Jan 27, 2025
75b9a87
feat: Add event delivery configuration option to settings
ogabrielluiz Jan 27, 2025
49d70a6
feat: Implement polling for build events with configuration-driven st…
ogabrielluiz Jan 27, 2025
8c7fe38
refactor: Enhance queue cleanup with improved logging and error handling
ogabrielluiz Jan 27, 2025
c006a92
test: Improve build event stream assertion with detailed error reporting
ogabrielluiz Jan 27, 2025
6047051
test: Add benchmark test for build flow polling mechanism
ogabrielluiz Jan 27, 2025
aea1696
refactor: Remove redundant end event in flow event generation
ogabrielluiz Jan 27, 2025
caa7f5f
Merge branch 'main' into refactor-build-flow
ogabrielluiz Feb 10, 2025
808cf2e
test: Update test_component_tool_with_api_key to use async flow
ogabrielluiz Feb 10, 2025
15ef73a
test: Add session ID generation in agent component test
ogabrielluiz Feb 10, 2025
77d3f6b
fix: Enhance error handling in LCAgentComponent for ExceptionWithMess…
ogabrielluiz Feb 10, 2025
f55f2e3
test: Refactor test assertion for model name options in agent component
ogabrielluiz Feb 10, 2025
d462910
refactor: Improve type hints and imports in AnyIOTaskResult
ogabrielluiz Feb 10, 2025
d52a565
fix: Add null checks for event task in build events streaming
ogabrielluiz Feb 10, 2025
d401ae6
refactor: Extract build and disconnect handling into separate modules
ogabrielluiz Feb 10, 2025
39905d9
refactor: Extract flow build and event handling methods in build API
ogabrielluiz Feb 10, 2025
894beb4
Merge branch 'main' into refactor-build-flow
ogabrielluiz Feb 10, 2025
ad4d0a3
refactor: Deprecate /task endpoint and add informative error message
ogabrielluiz Feb 10, 2025
93798f6
refactor: Update log_transaction function return type annotation
ogabrielluiz Feb 10, 2025
ef667ce
feat: Add configurable event delivery streaming option
ogabrielluiz Feb 11, 2025
12b3b74
fix: Add null check for flow_id in log_transaction function
ogabrielluiz Feb 11, 2025
08a35cf
chore: Update changes-filter to include chat API path
ogabrielluiz Feb 11, 2025
d8436a1
fix: Add error handling and null checks in flow transaction deletion
ogabrielluiz Feb 11, 2025
f9d0bc0
fix: Remove redundant commit in vertex builds deletion
ogabrielluiz Feb 11, 2025
a60b3e6
fix: Improve transaction logging with debug message and return value
ogabrielluiz Feb 11, 2025
aad9fe9
fix: Improve error handling and transaction cleanup in active_user fi…
ogabrielluiz Feb 11, 2025
c091b68
propagate parent task CancelledError instead of supressing it
ogabrielluiz Feb 11, 2025
1ef2fa4
refactor: Rename queue service to job queue service
ogabrielluiz Feb 11, 2025
e61c11a
fix: Correct ServiceType enum reference for job queue service
ogabrielluiz Feb 11, 2025
5a4ec04
refactor: Enhance JobQueueService with comprehensive logging and docu…
ogabrielluiz Feb 11, 2025
6c4799b
docs: Improve stop method docstring for JobQueueService
ogabrielluiz Feb 11, 2025
8d3d46f
fix: Properly handle task cancellation and propagate exceptions in Jo…
ogabrielluiz Feb 11, 2025
d6e8f17
fix: Enhance error handling and raise appropriate exceptions in JobQu…
ogabrielluiz Feb 11, 2025
0a19e51
improve docstring
ogabrielluiz Feb 11, 2025
be40fff
fix: Remove redundant exception raises in JobQueueService methods and…
ogabrielluiz Feb 11, 2025
d6876a1
fix: Improve logging during job cleanup and handle exceptions more ap…
ogabrielluiz Feb 11, 2025
8a62f86
Merge branch 'main' into refactor-build-flow
ogabrielluiz Feb 11, 2025
b92c465
feat: add utility to run tests with multiple event delivery modes
ogabrielluiz Feb 11, 2025
bef6fbc
feat: integrate withEventDeliveryModes utility in multiple test files
ogabrielluiz Feb 11, 2025
01b1ebe
refactor: replace status code assertions with httpx codes for clarity
ogabrielluiz Feb 12, 2025
544a660
Merge branch 'main' into refactor-build-flow
ogabrielluiz Feb 12, 2025
da2b60a
remove noqa comment and change argument name
ogabrielluiz Feb 12, 2025
b3abceb
refactor: streamline event polling logic in get_flow_events_response
ogabrielluiz Feb 12, 2025
751ade4
refactor: use getattr for safer session attribute access
ogabrielluiz Feb 12, 2025
b3e3a60
feat: add is_started method to JobQueueService
ogabrielluiz Feb 12, 2025
0345edc
refactor: modify JobQueueService start method and main.py queue servi…
ogabrielluiz Feb 12, 2025
c035a1a
feat: add ready state and teardown method to JobQueueService
ogabrielluiz Feb 12, 2025
38f151a
refactor: simplify job queue cleanup logic in JobQueueService
ogabrielluiz Feb 12, 2025
5c00060
refactor: improve error logging in active_user fixture
ogabrielluiz Feb 12, 2025
c45ffdb
refactor: improve AnyIO task management with TaskGroup and CancelScope
ogabrielluiz Feb 12, 2025
cf5961a
refactor: Implement LimitedBackgroundTasks for controlled vertex buil…
ogabrielluiz Feb 13, 2025
d8a5ee1
refactor: improve task cancellation error handling in JobQueueService
ogabrielluiz Feb 13, 2025
6984de6
refactor: Rename LimitedBackgroundTasks to LimitVertexBuildBackground…
ogabrielluiz Feb 14, 2025
9b73831
feat: Add EventDeliveryType enum for event delivery methods
ogabrielluiz Feb 14, 2025
cbf4d94
feat: Add polling constants for endpoint and streaming status
ogabrielluiz Feb 14, 2025
e8ed910
refactor: Update buildFlowVerticesWithFallback to use polling constants
ogabrielluiz Feb 14, 2025
08ee0b2
refactor: Update event delivery handling to use EventDeliveryType enum
anovazzi1 Feb 14, 2025
4b4e43f
[autofix.ci] apply automated fixes
autofix-ci[bot] Feb 14, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/changes-filter.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,7 @@ starter-projects:
- "src/backend/base/langflow/components/**"
- "src/backend/base/langflow/services/**"
- "src/backend/base/langflow/custom/**"
- "src/backend/base/langflow/api/v1/chat.py"
- "src/frontend/src/pages/MainPage/**"
- "src/frontend/src/utils/reactflowUtils.ts"
- "src/frontend/tests/extended/features/**"
Expand Down
Loading
Loading