Skip to content

Commit e6a0237

Browse files
committed
Add documentation and updates for various storage and service tools
- Create a new document for PhotoPrism with configuration options and Docker usage. - Update rclone README to include a command for checking bucket size. - Add Aliyun S3 endpoint information to the S3 storage README. - Create a new document for Samba with comprehensive configuration and usage instructions. - Enhance the storage-awesome document with additional distributed storage options and S3-compatible tools. - Add a new torrent client to the torrent-awesome document. - Include Inkscape and RapidRAW in the software-awesome document. - Add a new section for shaders in the design-awesome document. - Update ESBuild documentation to remove outdated information about decorators. - Add key code references in the DOM event documentation. - Include focus-related event listeners in the DOM FAQ. - Update editor-awesome to reflect the correct repository for Milkdown. - Add flamegraph profiling tool to Node.js debugging documentation. - Include new lightweight S3 clients in the JavaScript awesome document. - Update JavaScript FAQ with detailed information on Number properties. - Enhance JavaScript I/O documentation with notes on stream usage. - Add FAQ section comparing orpc and trpc in the orpc documentation. - Update TypeScript README with commands for file listing and explanation. - Add text-overflow behavior explanation in the CSS FAQ. - Include a FAQ section for menu icons in the icon-awesome document.
1 parent d1d6167 commit e6a0237

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

78 files changed

+1089
-157
lines changed

notes/ai/ai-awesome.md

Lines changed: 19 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,14 @@ tags:
2020
- LLM Observability, Prompt Management, LLM Evaluations, Datasets, LLM Metrics, Prompt Playground
2121
- https://openrouter.io
2222
- https://together.ai
23+
- Engine
24+
- MLX
25+
- tinygrad
26+
- PyTorch
27+
- llama.cpp
28+
- stablediffusion.cpp
29+
- Accelerators
30+
- [huggingface/optimum](https://github.com/huggingface/optimum)
2331
- Search/RAG
2432
- Perplexity
2533
- [ItzCrazyKns/Perplexica](https://github.com/ItzCrazyKns/Perplexica)
@@ -30,7 +38,7 @@ tags:
3038
- MIT, TS
3139
- MiniPerplx -> scira
3240
- minimalistic AI-powered search engine
33-
- Client/Desktop/App
41+
- Client/Desktop/App/Runner/Server
3442
- [chatbox](./service/chatbox.md)
3543
- GPLv3, TypeScript, React, Electron
3644
- 支持 Desktop, iOS, Android, Web
@@ -39,8 +47,12 @@ tags:
3947
- MIT
4048
- [CherryHQ/cherry-studio](https://github.com/CherryHQ/cherry-studio)
4149
- ~~Apache-2.0~~, TS
50+
- 聚合客户端 / Service Aggregator
4251
- 功能更加全面、综合
4352
- 桌面端为主
53+
- [lmstudio](https://lmstudio.ai/)
54+
- LM Runner/Server
55+
- 闭源
4456
- [mainframecomputer/fullmoon-ios](https://github.com/mainframecomputer/fullmoon-ios)
4557
- MIT, Swift
4658
- [languine-ai/languine](https://github.com/languine-ai/languine)
@@ -124,6 +136,8 @@ tags:
124136
- Agent/MCP
125137
- [microsoft/autogen](https://github.com/microsoft/autogen)
126138
- Multi Agent
139+
- [FoundationAgents/OpenManus](https://github.com/FoundationAgents/OpenManus)
140+
- MIT, Python
127141
- [magnitudedev/magnitude](https://github.com/magnitudedev/magnitude)
128142
- Aapche-2.0, TS
129143
- browser automation framework
@@ -287,11 +301,15 @@ tags:
287301

288302
## Reading
289303

304+
- from scratch
305+
- [jsbaan/transformer-from-scratch](https://github.com/jsbaan/transformer-from-scratch)
306+
- [GeeeekExplorer/nano-vllm](https://github.com/GeeeekExplorer/nano-vllm)
290307
- https://github.com/microsoft/generative-ai-for-beginners
291308
- https://www.promptingguide.ai/zh/readings
292309
- https://jalammar.github.io/
293310
- https://karpathy.ai/zero-to-hero.html
294311
- https://github.com/premAI-io/state-of-open-source-ai
312+
- https://theaisummer.com/diffusion-models/
295313

296314
## Prompt
297315

notes/ai/ai-glossary.md

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -72,6 +72,22 @@ tags:
7272
- 用于可视化卷积神经网络(CNN)在图像分类任务中关注的区域
7373
- 通过将特定类别的预测与输入图像的特征图进行关联,生成热力图,显示模型在做出决策时关注的图像区域
7474
- 模型可解释性
75+
- diffusion
76+
- 一种技术范式,广义概念
77+
- 扩散过程
78+
- 加噪-去噪
79+
- High Concentration -> Low Concentration
80+
- 物理上: Passive, Concentration Gradient, Temperature, Surface Area
81+
- 通常在像素空间 (Pixel Space) 直接操作
82+
- Stable Diffusion
83+
- 一种特定的扩散模型/应用,专注于图像生成任务
84+
- 在潜空间 (Latent Space) 中操作
85+
- e.g. 512x512 pixels -> 64x64 latent
86+
- 引入 VAE
87+
- 引入 文本引导(Text-Conditioning) - CLIP
88+
- VAE - Variational Autoencoder - 变分自编码器
89+
- ControlNet
90+
- [lllyasviel/ControlNet](https://github.com/lllyasviel/ControlNet)
7591

7692
| en | cn |
7793
| ---------------- | -------- |

notes/ai/dev/comfyui.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -12,14 +12,15 @@ title: ComfyUI
1212
- Control Net
1313
- SD 1.5
1414
- Juggernaut
15-
- 参考
16-
- https://github.com/Comfy-Org/ComfyUI-Manager
1715
- 生产部署
1816
- ComfyDeploy
1917
- 另存 (API 格式)
2018
- 调用 /prompt
2119
- 参考
20+
- [BennyKok/comfyui-deploy](https://github.com/BennyKok/comfyui-deploy)
21+
- [Comfy-Org/ComfyUI-Manager](https://github.com/Comfy-Org/ComfyUI-Manager)
2222
- https://docs.comfy.org/tutorials/
23+
- Transform Your Videos with Professional Quality: WAN-VACE V2V Complete Workflow for ComfyUI https://civitai.com/articles/16401
2324

2425
:::caution
2526

notes/ai/dev/rag.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
---
2+
title: RAG
3+
---
4+
5+
# RAG
6+
7+
- [chonkie-inc/chonkie](https://github.com/chonkie-inc/chonkie)
8+
- MIT, Python
9+
- RAG chunking library

notes/ai/inference.md

Lines changed: 11 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -31,10 +31,9 @@ title: 推理
3131

3232
## Service
3333

34+
- toruchrun
3435
- vLLM
35-
- Text
3636
- SGLang
37-
- Text, Image
3837
- Image
3938
- ComfyUI
4039
- SD
@@ -43,6 +42,16 @@ title: 推理
4342
- Embeddings
4443
- [michaelfeil/infinity](https://github.com/michaelfeil/infinity)
4544
- MIT, Python
45+
- [exo-explore/exo](https://github.com/exo-explore/exo)
46+
- GPLv3, Python
47+
- [Tencent/ncnn](https://github.com/Tencent/ncnn)
48+
- [InternLM/lmdeploy](https://github.com/InternLM/lmdeploy)
49+
- Apache-2.0, Python, C++
50+
- based on [MMRazor](https://github.com/open-mmlab/mmrazor) and [MMDeploy](https://github.com/open-mmlab/mmdeploy)
51+
- [mit-han-lab/nunchaku](https://github.com/mit-han-lab/nunchaku)
52+
- Apache-2.0, Python, C++
53+
- Nunchaku is a high-performance inference engine optimized for 4-bit neural networks
54+
- SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models
4655

4756
## 模型大小 {#model-size}
4857

notes/ai/ml/label-studio.md

Lines changed: 55 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -13,10 +13,11 @@ title: Label Studio
1313
- 参考
1414
- https://labelstud.io/
1515
- 前端 https://github.com/HumanSignal/label-studio/tree/develop/web/libs/editor
16+
- /Users/wener/Library/Application Support/label-studio
1617

1718
```bash
18-
pip install -U label-studio
19-
label-studio
19+
uv pip install -U label-studio
20+
LOCAL_FILES_SERVING_ENABLED=true uv run label-studio
2021

2122
# https://hub.docker.com/r/heartexlabs/label-studio
2223
# https://github.com/HumanSignal/label-studio/blob/develop/docker-compose.yml
@@ -28,8 +29,8 @@ docker run --rm -it \
2829
# label-studio --log-level DEBUG
2930

3031
LABEL_STUDIO_BASE_DATA_DIR=$PWD/data \
31-
LABEL_STUDIO_LOCAL_FILES_SERVING_ENABLED=true \
32-
LABEL_STUDIO_LOCAL_FILES_DOCUMENT_ROOT=$PWD/files \
32+
LABEL_STUDIO_LOCAL_FILES_SERVING_ENABLED=true \
33+
LABEL_STUDIO_LOCAL_FILES_DOCUMENT_ROOT=$PWD/files \
3334
label-studio start
3435
```
3536

@@ -50,7 +51,6 @@ LABEL_STUDIO_LOCAL_FILES_DOCUMENT_ROOT=$PWD/files \
5051

5152
## tags
5253

53-
5454
```xml
5555
<View>
5656
<TimeSeriesLabels name="label" toName="ts">
@@ -81,22 +81,70 @@ ts.brushRange.map(n=>(+n).toFixed(2));_=r();setInterval($=>r().some((n,i)=>n!==_
8181
interface Obj {
8282
id: string;
8383

84-
data:any
85-
value:any
84+
data: any;
85+
value: any;
8686

8787
from_name: string;
8888
to_name: string;
8989
type: string;
9090
}
9191
```
9292

93+
- Label Studio Common Format
94+
9395
## ML Backend
9496

9597
- https://github.com/HumanSignal/label-studio-ml-backend
9698
- https://github.com/seblful/label-studio-yolov8-backend
9799

100+
## Template
101+
102+
- data 是静态的、被观察的对象
103+
- annotations 是动态的、被创建的结果
104+
- value 绑定 data
105+
- 控制标签创建 annotations
106+
107+
```tsx
108+
<Text name='text' value='$prediction' />
109+
```
110+
111+
- name 是内部名字
112+
- value
113+
114+
---
115+
116+
- 参考
117+
- https://labelstud.io/tags/
118+
119+
## Storage
120+
121+
```
122+
/project-folder/
123+
├── images/
124+
│ ├── image1.jpg
125+
│ ├── image2.png
126+
│ └── subfolder/
127+
│ └── image3.gif
128+
└── my_tasks.json
129+
```
130+
131+
- Treat every bucket object as a source file
132+
- 本地存储
133+
- `LABEL_STUDIO_LOCAL_FILES_SERVING_ENABLED=true`
134+
- LABEL_STUDIO_LOCAL_FILES_DOCUMENT_ROOT
135+
- 限定访问目录
136+
- `/data/local-files?d=ds/images/1.jpg`
137+
- 实际相当于访问 `http://localhost:8080/data/local-files?d=ds/images/1.jpg`
138+
- 上传存储
139+
- `/data/upload/$PROJECT_ID/`
140+
- https://labelstud.io/guide/storage.html
141+
98142
# FAQ
99143

144+
- OCR 指标
145+
- 字符错误率 (CER)
146+
- 词错误率 (WER)
147+
100148
## video frameCount
101149

102150
- framerate 默认 24

notes/ai/ml/labeling.md

Lines changed: 12 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -21,13 +21,19 @@ tags:
2121
- 参考
2222
- https://github.com/KKKSQJ/DeepLearning/tree/master/others/label_convert
2323
- https://openvinotoolkit.github.io/datumaro/latest/docs/data-formats/formats/index.html
24+
- [A Guide to Bounding Box Formats](https://dragoneye.ai/blog/a-guide-to-bounding-box-formats)
2425
- [datumaro](./datumaro.md)
25-
- box
26-
- xywh
27-
- xywhn
28-
- xyxy
29-
- xyxyn
30-
- cycywh
26+
27+
| format | spec | adopted by |
28+
| ------- | --------------------------------- | -------------- |
29+
| xyxy | left, top, right, bottom | Pascal VOC |
30+
| xyxyn | | Albumentations |
31+
| xywh | left, top, width, height | COCO |
32+
| xywhn | | |
33+
| cxcywh | center x, center y, width, height | CreateML |
34+
| cxcywhn | | YOLO |
35+
36+
- n -> Normalized
3137

3238
## YOLO
3339

notes/ai/ml/ml-dataset.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,7 @@ title: Dataset
2020
- 增值税发票数据集-适配PaddleOCR https://aistudio.baidu.com/datasetdetail/165561
2121
- [huggingface/datasets](https://huggingface.co/docs/datasets/index)
2222
- [ConardLi/easy-dataset](https://github.com/ConardLi/easy-dataset)
23+
- AGPLv3, JS
2324
- creating fine-tuning datasets for LLM
2425
- 不支持 图片数据集
2526
- [open-sciencelab/GraphGen](https://github.com/open-sciencelab/GraphGen)
@@ -31,6 +32,18 @@ cd easy-dataset
3132
pnpm i
3233
pnpm run build
3334
pnpm run start
35+
36+
37+
#
38+
docker cp easy-dataset:/app/prisma/db.sqlite easy-dataset/prisma/
39+
40+
docker run --rm -it \
41+
-p 1717:1717 \
42+
-v $PWD/easy-dataset/data:/app/local-db \
43+
-v $PWD/easy-dataset/prisma:/app/prisma \
44+
--name easy-dataset ghcr.io/conardli/easy-dataset
45+
46+
# docker exec -it easy-dataset npx prisma db push
3447
```
3548

3649
- 数据集格式

notes/ai/ml/onnx/onnx-runtime.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
tags:
3-
- Runtime
3+
- Runtime
44
---
55

66
# ONNX Runtime
@@ -17,6 +17,8 @@ tags:
1717
- [oramasearch/onnx-go](https://github.com/oramasearch/onnx-go)
1818
- [AdvancedClimateSystems/gonnx](https://github.com/AdvancedClimateSystems/gonnx)
1919
- https://onnxruntime.ai/
20+
- https://github.com/Aimol-l/OrtInference
21+
- yolov10,yolov10+SAM ,yolov10+bytetrack , SAM2, paddleOCR
2022
- Inferencing
2123
- [Generative AI](https://github.com/microsoft/onnxruntime-genai) 实验阶段
2224

notes/ai/ml/paddle/README.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -113,6 +113,26 @@ docker run --rm -it \
113113
--name paddlex ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/paddle:3.0.0b2 /bin/bash
114114
```
115115

116+
## hpip
117+
118+
```py
119+
from paddlex import create_pipeline
120+
121+
pipeline = create_pipeline(
122+
pipeline="OCR",
123+
use_hpip=True,
124+
hpi_config={"backend": "onnxruntime"}
125+
)
126+
```
127+
128+
- backend
129+
- paddle_infer
130+
- openvino
131+
- onnx_runtime
132+
- tensorrt
133+
- High-Performance Inference
134+
- https://paddlepaddle.github.io/PaddleX/3.0/pipeline_deploy/high_performance_inference.html
135+
116136
## Paddle2ONNX
117137

118138
- https://github.com/PaddlePaddle/PaddleOCR/blob/main/deploy/paddle2onnx/readme_ch.md

0 commit comments

Comments
 (0)