Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Contributing to task page for any-to-any #1011

Open
wants to merge 10 commits into
base: main
Choose a base branch
from
15 changes: 15 additions & 0 deletions packages/tasks/src/tasks/any-to-any/about.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
## Use Cases

You can contribute this area with common use cases of the task!

## Task Variants

This place can be filled with variants of this task if there's any.

## Inference

This section should have useful information about how to pull a model from Hugging Face Hub that is a part of a library specialized in a task and use it.

## Useful Resources

In this area, you can insert useful resources about how to train or use a model for this task.
33 changes: 33 additions & 0 deletions packages/tasks/src/tasks/any-to-any/data.ts
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
import type { TaskDataCustom } from "..";

const taskData: TaskDataCustom = {
datasets: [{
description: "All-Modality Alignment Dataset with Fine-grained Preference Annotations and Language Feedback.",
id: "PKU-Alignment/align-anything-400k",
},],
demo: {
inputs: [],
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

would you like to add a demo as well? maybe image/text input to image/text output

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added one!

outputs: [],
},
metrics: [],
models: [
{
description: "A next token prediction model.",
id: "BAAI/Emu3-Gen",
},
{
description: "Janus is a versatile multimodal framework that decouples visual encoding for superior understanding and generation across tasks.",
id: "deepseek-ai/Janus-1.3B",
},
], spaces: [
{
description: "Janus is a versatile multimodal framework that decouples visual encoding for superior understanding and generation across tasks.",
id: "deepseek-ai/Janus-1.3B",
},
],
summary: "Any-to-Any can leverage any combination of input and output types to such as text, image, and video. It may combine other datasets to train a comprehensive LLM.",
widgetModels: [],
youtubeId: "",
};

export default taskData;