You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+59-16
Original file line number
Diff line number
Diff line change
@@ -9,13 +9,6 @@
9
9
10
10
Marsjs is the browser client for Mars@Home. Currently this extension labels image from [Unsplash](https://unsplash.com) in browser - using MobileNet on Tensorflow.Js. Install [Mars@Home from Chrome Store](https://chrome.google.com/webstore/detail/marshome/dikaddifgkonkicimbgikbcbaagajjhj)
11
11
12
-
## Project Structure
13
-
14
-
*[`captioner`](./captioner): Contains MobileNet & TensorflowJs code for Image Labeling
15
-
*[`extension`](./extension): Contains code of Chrome Extension
16
-
*[`images`](./images): Screenshots & media files for the README
17
-
*[`logo-files`](./logo-files): Logo files for [Mars@Home](https://github.com/MarsAtHome/)
18
-
19
12
## Non-Developer quickstart
20
13
Install [Mars@Home for Google Chrome](https://chrome.google.com/webstore/detail/marshome/dikaddifgkonkicimbgikbcbaagajjhj)
21
14
@@ -27,6 +20,14 @@ Clone this project
27
20
$ git clone https://github.com/MarsAtHome/marsjs
28
21
```
29
22
23
+
### Project Structure
24
+
25
+
*[`captioner`](./captioner): Contains MobileNet & TensorflowJs code for Image Labeling
26
+
*[`extension`](./extension): Contains code of Chrome Extension
27
+
*[`images`](./images): Screenshots & media files for the README
28
+
*[`logo-files`](./logo-files): Logo files for [Mars@Home](https://github.com/MarsAtHome/)
**Check the Current task by clicking <imgsrc="./logo-files/MarsAtHome.png?raw=true"width="24"height="24"> in your browser's url bar**
43
44
45
+
## Model (MobileNet)
46
+
Taken straight from [tfjs-converter](https://github.com/tensorflow/tfjs-converter/tree/master/demo/mobilenet) MobileNet model is served from Google Cloud as 4MB chunks and is cacheable by browser.
47
+
48
+
The model takes 224x224 image, so Unsplash images are fetched in 224x224 size with `crop=face` URL parameter.
49
+
50
+
After changing files in `captioner/mobilenet/`, run
51
+
52
+
```
53
+
$ cd captioner
54
+
$ rmdir dist; # OR rm -rf dist
55
+
$ parcel build mobilenet/index.html
56
+
```
57
+
58
+
[Parcel](https://parceljs.org/) must be installed globally.
59
+
60
+
Copy all files except `index.html` from `dist` to `extension` directory. Copy the content of `dist/index.html` and paste it in `extension/popup.html` title & subtitle. Remove old code pointing to old build after pasting.
61
+
62
+
## Design
63
+
64
+
On clicking <imgsrc="./logo-files/MarsAtHome.png?raw=true"width="24"height="24"> the extension appears as a box of 300x600. Shows the link to current photo being processed. Once the labels assigned, shows top 3 labels with their Confidence score on the left.
[Mars@Home](https://marsathome.org/) says it's a public volunteer computing project committed to solving real life problems. Then why the first client labels images instead of ["computing climate simulations"](https://marsathome.org/faqs.html)?
78
+
79
+
With this first version, we want to find out that *would people participate in a modern volunteer computing project for real life problems*? Keeping that in mind, we designed it so that, with other things, it has a small fun element to it. We wanted maximum people and developers to join the movement. Because the real development is yet to happen!
80
+
81
+
<hr>
82
+
83
+
### BTW I have to confess that building this project was such a joy! But watching the MobileNet model assign labels to beautiful Unsplash photos was equally entertaining. So here's more
0 commit comments