Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add scrapegraph request to template #6337

Open
wants to merge 14 commits into
base: main
Choose a base branch
from

Conversation

VinciGit00
Copy link
Contributor

@VinciGit00 VinciGit00 commented Feb 13, 2025

This pull request introduces a new starter project template for web scraping using ScrapeGraph AI. The template is designed to extract structured data from any website by inputting a URL, a prompt, and an API key.

New starter project template:

  • Added a new JSON template file Scraping website.json in src/backend/base/langflow/initial_setup/starter_projects/ that includes nodes for URL input, scraping prompt, API key input, ScrapeGraph scraper, and text output. The template also defines the edges connecting these nodes to facilitate the data flow.

@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. enhancement New feature or request labels Feb 13, 2025
Copy link
Contributor

@ogabrielluiz ogabrielluiz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @VinciGit00

Thank you for the template!

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is won't work. You should remove this.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@edwinjosechittilappilly told me to do that

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@VinciGit00 I believe it was a miscommunication.
Suggestion for the templates: We only need the JSON files.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@edwinjosechittilappilly take a look now and let me know if it is ok

Copy link
Collaborator

@edwinjosechittilappilly edwinjosechittilappilly left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

suggestions added

Co-authored-by: Edwin Jose <[email protected]>
@VinciGit00
Copy link
Contributor Author

@edwinjosechittilappilly Did it

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Feb 14, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 18, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 18, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 18, 2025
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Feb 18, 2025
@edwinjosechittilappilly
Copy link
Collaborator

@ogabrielluiz Langflow fails to start with the template.
I am going to manually test the template and update the template file accordingly!.
Shall keep you posted on the progress.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request lgtm This PR has been approved by a maintainer size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants