feat: jigsawstack bundle integration #8832

Khurdhula-Harshavardhan · 2025-07-02T16:33:06Z

This pull request integrates the jigsawstack library into the project, introducing several new components to enhance functionality for web scraping, web search, file storage operations, and more. The changes include updating dependencies, adding new component files, and implementing methods for interacting with the jigsawstack API.

Dependency Update:

Added jigsawstack==0.2.7 to the dependencies in pyproject.toml. This library is now required for the new components.

New Components for AI and File Operations:

AI Web Scraping and Search:

src/backend/base/langflow/components/jigsawstack/ai_scrape.py: Added the JigsawStackAIScraperComponent for AI-powered web scraping with structured data extraction. Includes input validation for parameters like url, html, and element_prompts.
src/backend/base/langflow/components/jigsawstack/ai_web_search.py: Added the JigsawStackAIWebSearchComponent for AI-enhanced web search, supporting features like safe search, spell check, and AI-generated overviews.

File Storage Operations:

src/backend/base/langflow/components/jigsawstack/file_read.py: Added the JigsawStackFileReadComponent for retrieving files from JigsawStack File Storage. Includes functionality to save files locally with appropriate extensions based on content.
src/backend/base/langflow/components/jigsawstack/file_upload.py: Added the JigsawStackFileUploadComponent for uploading files to JigsawStack File Storage, with options for overwriting existing files and generating temporary public URLs.

Component Initialization:

src/backend/base/langflow/components/jigsawstack/__init__.py: Registered all new JigsawStack components for use in the application.

Summary by CodeRabbit

New Features
- Introduced a suite of JigsawStack AI components, including AI-powered web scraping, web search, file upload/download, image generation, NSFW detection, object detection, sentiment analysis, text-to-SQL conversion, text translation, and vision OCR.
- Added JigsawStack as a new icon in the frontend, with support for eager and lazy loading.
- Updated the sidebar to include JigsawStack for easier access.
Chores
- Added the JigsawStack dependency to the project configuration.

coderabbitai · 2025-07-02T16:33:13Z

Important

Review skipped

Auto incremental reviews are disabled on this repository.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Walkthrough

This change introduces JigsawStack integration throughout both backend and frontend. On the backend, new components are added for various JigsawStack AI services (web scraping, search, file storage, image generation, NSFW detection, object detection, sentiment analysis, text-to-SQL, translation, and VOCR). On the frontend, a new JigsawStack icon is implemented and integrated into icon mappings and sidebar bundles. The JigsawStack Python package is added as a dependency.

Changes

File(s)	Change Summary
pyproject.toml	Added `jigsawstack==0.2.7` to dependencies.
src/backend/base/langflow/components/jigsawstack/init.py	Created module exporting all JigsawStack component classes.
src/backend/base/langflow/components/jigsawstack/ai_scrape.py	Added `JigsawStackAIScraperComponent` for AI-powered web scraping via JigsawStack API.
src/backend/base/langflow/components/jigsawstack/ai_web_search.py	Added `JigsawStackAIWebSearchComponent` for AI web search functionality.
src/backend/base/langflow/components/jigsawstack/file_read.py	Added `JigsawStackFileReadComponent` to read files from JigsawStack File Storage.
src/backend/base/langflow/components/jigsawstack/file_upload.py	Added `JigsawStackFileUploadComponent` to upload files to JigsawStack File Storage.
src/backend/base/langflow/components/jigsawstack/image_generation.py	Added `JigsawStackImageGenerationComponent` for image generation via JigsawStack API.
src/backend/base/langflow/components/jigsawstack/nsfw.py	Added `JigsawStackNSFWComponent` for NSFW content detection in media.
src/backend/base/langflow/components/jigsawstack/object_detection.py	Added `JigsawStackObjectDetectionComponent` for object detection in images.
src/backend/base/langflow/components/jigsawstack/sentiment.py	Added `JigsawStackSentimentComponent` for sentiment analysis using JigsawStack AI.
src/backend/base/langflow/components/jigsawstack/text_to_sql.py	Added `JigsawStackTextToSQLComponent` converting natural language prompts to SQL queries.
src/backend/base/langflow/components/jigsawstack/text_translate.py	Added `JigsawStackTextTranslateComponent` for text translation via JigsawStack API.
src/backend/base/langflow/components/jigsawstack/vocr.py	Added `JigsawStackVOCRComponent` for document data extraction using vision language models.
src/frontend/src/icons/JigsawStack/JigsawStackIcon.jsx	Added new React SVG icon component `JigsawStackIconSVG` for JigsawStack.
src/frontend/src/icons/JigsawStack/index.tsx	Added `JigsawStackIcon` React component with forwarded ref wrapping `JigsawStackIconSVG`.
src/frontend/src/icons/eagerIconImports.ts	Imported and added `JigsawStackIcon` to eager icon mappings.
src/frontend/src/icons/lazyIconImports.ts	Added lazy-loaded import entry for `JigsawStack` icon.
src/frontend/src/utils/styleUtils.ts	Added `JigsawStack` entry to `SIDEBAR_BUNDLES` for sidebar display integration.

Sequence Diagram(s)

sequenceDiagram
    participant User
    participant Frontend
    participant Backend
    participant JigsawStackAPI

    User->>Frontend: Initiate JigsawStack feature (e.g., AI web search)
    Frontend->>Backend: Send request with user input and API key
    Backend->>JigsawStackAPI: Call corresponding JigsawStack API endpoint
    JigsawStackAPI-->>Backend: Return API response (success or error)
    Backend-->>Frontend: Respond with processed data or error message
    Frontend-->>User: Display results or error

Possibly related PRs

feat: add servers persistence to MCP connection component, add MCP connections settings page #8388: Both PRs add or refactor backend components interacting with external APIs; this PR introduces JigsawStack components, while feat: add servers persistence to MCP connection component, add MCP connections settings page #8388 adds MCP server persistence backend API router and refactors MCPToolsComponent.

Suggested labels

lgtm

Suggested reviewers

mfortman11
Cristhianzl

✨ Finishing Touches

🧪 Generate Unit Tests

Create PR with Unit Tests
Post Copyable Unit Tests in a Comment

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

Review comments: Directly reply to a review comment made by CodeRabbit. Example:
- I pushed a fix in commit <commit_id>, please review it.
- Explain this complex logic.
- Open a follow-up GitHub issue for this discussion.
Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
- @coderabbitai explain this code block.
- @coderabbitai modularize this function.
PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
- @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
- @coderabbitai read src/utils.ts and explain its main purpose.
- @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.
- @coderabbitai help me debug CodeRabbit configuration file.

Support

Need help? Create a ticket on our support page for assistance with any issues or questions.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (Invoked using PR comments)

@coderabbitai pause to pause the reviews on a PR.
@coderabbitai resume to resume the paused reviews.
@coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
@coderabbitai full review to do a full review from scratch and review all the files again.
@coderabbitai summary to regenerate the summary of the PR.
@coderabbitai generate docstrings to generate docstrings for this PR.
@coderabbitai generate sequence diagram to generate a sequence diagram of the changes in this PR.
@coderabbitai auto-generate unit tests to generate unit tests for this PR.
@coderabbitai resolve resolve all the CodeRabbit review comments.
@coderabbitai configuration to show the current CodeRabbit configuration for the repository.
@coderabbitai help to get help.

Other keywords and placeholders

Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
Add @coderabbitai anywhere in the PR title to generate the title automatically.

Documentation and Community

Visit our Documentation for detailed information on how to use CodeRabbit.
Join our Discord Community to get help, request features, and share feedback.
Follow us on X/Twitter for updates and announcements.

autofix-ci · 2025-07-02T16:37:00Z

Hi! I'm autofix.ci, a bot that automatically fixes trivial issues such as code formatting in pull requests.

I would like to apply some automated changes to this pull request, but it looks like I don't have the necessary permissions to do so. To get this pull request into a mergeable state, please do one of the following two things:

Allow edits by maintainers for your pull request, and then re-trigger CI (for example by pushing a new commit).
Manually fix the issues identified for your pull request (see the GitHub Actions output for details on what I would like to change).

coderabbitai

Actionable comments posted: 13

🔭 Outside diff range comments (1)

src/frontend/src/icons/JigsawStack/JigsawStackIcon.jsx (1)

1-31: Missing isdark prop support for theme compatibility

The icon component doesn't implement the required isdark prop for supporting both light and dark modes. According to the coding guidelines, all custom icons must adapt to the theme.

Apply this diff to implement theme support:

-const JigsawStackIconSVG = (props) => (
+const JigsawStackIconSVG = ({ isdark, ...props }) => (
   <svg
     xmlns="http://www.w3.org/2000/svg"
     width="278"
     height="278"
     fill="none"
     viewBox="0 0 278 278"
     {...props}
   >
     <path
-      fill="url(#paint0_linear_102_21)"
+      fill={isdark ? "url(#paint0_linear_102_21_dark)" : "url(#paint0_linear_102_21)"}
       d="M137.362 262.02c-7.072-4.084-14.015-8.403-21.241-12.189-9.857-5.162-10.456-18.679-.674-23.989 5.93-3.217 10.307-7.977 12.023-14.746 2.414-9.503.058-17.739-7.334-24.089-7.243-6.213-15.746-7.815-24.674-4.145-9.01 3.697-13.87 10.731-14.673 20.486-.086.992-.035 1.993-.062 2.985-.28 10.578-10.759 16.642-19.988 11.398-14.83-8.429-29.553-17.029-44.314-25.577a17 17 0 0 1-2.237-1.535c-8.53-7.04-10.771-18.266-5.282-27.934a3227 3227 0 0 1 25.18-43.611c5.674-9.654 17.976-9.411 23.608.306 8.99 15.517 29.838 16.883 40.16 2.508 5.436-7.567 6.094-15.876 2.007-24.197S88.796 85.04 79.503 84.426c-2.508-.163-5.18-.16-7.455-1.063-7.475-2.947-10.588-11.369-6.572-18.529 8.512-15.193 17.135-30.348 26.172-45.23 5.842-9.623 17.467-12.541 27.69-7.78a48 48 0 0 1 3.609 1.906c13.592 7.84 27.271 15.543 40.725 23.622 4.269 2.566 8.677.123 8.526-4.968-.407-13.953 8.484-26.283 21.361-30.628 13.382-4.523 27.891-.117 36.253 11.007 8.417 11.19 8.922 26.459.582 37.806-2.763 3.753-6.601 7.086-10.641 9.43-4.087 2.367-4.235 7.378.112 9.795 14.03 7.807 27.873 15.951 41.755 24.016 9.273 5.388 13.664 14.085 11.698 23.596-.558 2.7-1.621 5.411-2.983 7.815-7.967 14.047-16.252 27.919-24.125 42.02-5.866 10.508-19.253 10.034-24.462.066-4.683-8.975-14.458-13.377-24.273-11.865-9.472 1.458-17.344 8.81-19.485 18.203-2.157 9.467 1.726 19.333 9.945 24.977 3.992 2.74 8.508 4.357 13.321 3.989 11.701-.896 18.42 11.212 12.146 21.51-8.257 13.561-15.939 27.463-23.897 41.203-7.022 12.134-19.534 15.497-31.651 8.535-6.839-3.931-13.67-7.892-20.502-11.837z"
     ></path>
     <defs>
       <linearGradient
         id="paint0_linear_102_21"
         x1="-2.153"
         x2="368.564"
         y1="42.449"
         y2="304.786"
         gradientUnits="userSpaceOnUse"
       >
         <stop offset="0.184" stopColor="#FA242D"></stop>
         <stop offset="0.958" stopColor="#EF5B3C"></stop>
       </linearGradient>
+      <linearGradient
+        id="paint0_linear_102_21_dark"
+        x1="-2.153"
+        x2="368.564"
+        y1="42.449"
+        y2="304.786"
+        gradientUnits="userSpaceOnUse"
+      >
+        <stop offset="0.184" stopColor="#FA242D"></stop>
+        <stop offset="0.958" stopColor="#EF5B3C"></stop>
+      </linearGradient>
     </defs>
   </svg>
 );

Additionally, ensure the parent index.tsx file passes the isdark prop correctly.

🧹 Nitpick comments (7)

src/backend/base/langflow/components/jigsawstack/text_translate.py (1)
65-66: Fix incorrect comment

The comment references web scraping but this is a translation component.
-            # Call web scraping
+            # Call text translation
             response = client.translate.text(params)
src/backend/base/langflow/components/jigsawstack/file_read.py (1)

97-98: Consider differentiating between ZIP and Office files.

The comment mentions that ZIP magic bytes also apply to DOCX/XLSX files, but the method returns .zip for all. Consider checking for Office-specific patterns within ZIP files if differentiation is needed.

Would you like me to implement logic to differentiate between generic ZIP files and Office documents?
src/backend/base/langflow/components/jigsawstack/ai_web_search.py (1)
127-129: Remove unnecessary exception instantiation.

Creating a new JigsawStackError from a string message is unnecessary since you can directly raise a ValueError or return an error message.
-            request_failed_msg = "Request Failed"
             if not response.get("success", False):
-                raise JigsawStackError(request_failed_msg)
+                return Message(text="Error: Request Failed")
src/backend/base/langflow/components/jigsawstack/vocr.py (1)
92-93: Consider supporting partial page range specification.

Currently, page range is only added if both start and end are specified. Consider allowing users to specify only start (process from start to end) or only end (process from beginning to end).
-            if self.page_range_start and self.page_range_end:
-                params["page_range"] = [self.page_range_start, self.page_range_end]
+            if self.page_range_start is not None or self.page_range_end is not None:
+                params["page_range"] = [
+                    self.page_range_start if self.page_range_start is not None else 1,
+                    self.page_range_end if self.page_range_end is not None else -1  # -1 could indicate "to end"
+                ]
src/backend/base/langflow/components/jigsawstack/file_upload.py (2)
84-86: Complete the truncated comment.

The comment on line 86 is incomplete and ends abruptly.
-            # if temp_public_url is provided, use it to determine if a temporary public URL should
+            # if temp_public_url is provided, use it to determine if a temporary public URL should be returned
61-94: Consider implementing async methods for better scalability.

The coding guidelines recommend using async methods for components. Since this involves network I/O operations, an async implementation would improve scalability.

Would you like me to help refactor this to use async/await patterns for the file upload operation?
src/backend/base/langflow/components/jigsawstack/object_detection.py (1)
112-113: Fix incorrect comment.

The comment refers to "web scraping" but this is actually calling the object detection API.
-            # Call web scraping
+            # Call object detection

📜 Review details

Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between a99b1ff and 433df04.

⛔ Files ignored due to path filters (1)

src/frontend/src/icons/JigsawStack/jigsawstack-icon.svg is excluded by !**/*.svg

📒 Files selected for processing (18)

pyproject.toml (1 hunks)
src/backend/base/langflow/components/jigsawstack/__init__.py (1 hunks)
src/backend/base/langflow/components/jigsawstack/ai_scrape.py (1 hunks)
src/backend/base/langflow/components/jigsawstack/ai_web_search.py (1 hunks)
src/backend/base/langflow/components/jigsawstack/file_read.py (1 hunks)
src/backend/base/langflow/components/jigsawstack/file_upload.py (1 hunks)
src/backend/base/langflow/components/jigsawstack/image_generation.py (1 hunks)
src/backend/base/langflow/components/jigsawstack/nsfw.py (1 hunks)
src/backend/base/langflow/components/jigsawstack/object_detection.py (1 hunks)
src/backend/base/langflow/components/jigsawstack/sentiment.py (1 hunks)
src/backend/base/langflow/components/jigsawstack/text_to_sql.py (1 hunks)
src/backend/base/langflow/components/jigsawstack/text_translate.py (1 hunks)
src/backend/base/langflow/components/jigsawstack/vocr.py (1 hunks)
src/frontend/src/icons/JigsawStack/JigsawStackIcon.jsx (1 hunks)
src/frontend/src/icons/JigsawStack/index.tsx (1 hunks)
src/frontend/src/icons/eagerIconImports.ts (2 hunks)
src/frontend/src/icons/lazyIconImports.ts (1 hunks)
src/frontend/src/utils/styleUtils.ts (1 hunks)

🧰 Additional context used

📓 Path-based instructions (12)

`{uv.lock,pyproject.toml}`: Use uv (>=0.4) as the Python package manager for dependency management

{uv.lock,pyproject.toml}: Use uv (>=0.4) as the Python package manager for dependency management

📄 Source: CodeRabbit Inference Engine (.cursor/rules/backend_development.mdc)