Releases: bio-guoda/preston
Releases · bio-guoda/preston
0.1.2
0.1.1
0.1.0
Features
- support for remote gzipped tarballs . To help publish many files to existing publication platforms (e.g., Internet Archive, Zenodo), data dirs can be put into tar balls like preston-aa.tar.gz , where "aa" are the first two characters of a content hash of files contained in the tar ball. For example publication, see Poelen, Jorrit H. (2019). A biodiversity dataset graph: Biodiversity Heritage Library (BHL) (Version 0.0.1) [Data set]. Zenodo. http://doi.org/10.5281/zenodo.3251134 and https://archive.org/details/preston-bhl .
- command line progress bar. To help indicate that stuff is being downloaded show a progress bar like:
$ preston clone https://archive.org/download/preston-bhl
[https://archive.org/download/preston-bhl/2a5de79372318317a382ea9a2cef069780b852b01210ef59e06b640a3539cb5a] 100.0% of 78 bytes at 0.07 MB/s completed in < 1 minute
[https://archive.org/download/preston-bhl/89926f33157c0ef057b6de73f6c8be0060353887b47db251bfd28222f2fd801a] 0.8% of 236 MB at 0.43 MB/s ETA: +9 minutes
- introduce
clone
command to explicitly clone a remote Preston repository. Can be chained to include many repositories. E.g.,
$ preston clone https://example.org https://archive.org/download/preston-bhl
would first try to get index / provenance and associated content via https://example.org
, then try https://archive.org/download/preston-bhl
. Allows for distributing content across arbitrary number of remotes.
- make local data/tmp dir configurable. Local data/tmp dir can now be configured with option
--data-dir
and--tmp-dir
respectively.
Improvements
- stop processing when downstream pipe has closed (see #13)
Bugs
0.0.16
Features
Improvements
- support multiple Preston remotes using
--remotes
to allow for cascading retrieval of provenance record history, provenance records and tracked content. Provides a solution for #8 . Examplepreston history --remotes https://example.org/prov/,https://deeplinker.bio
, would first attempt to find a Preston provenance history at https://example.org/prov/ , then try https://deeplinker.bio
Bugs
0.0.15
0.0.14
0.0.13
0.0.12
Alpha version
Features
Improvements
- first pass at enabling remotes to improve data mobility using things like
preston history --remote https://deeplinker.bio/
Bugs
Alpha version
Features
Improvements
- make
copyTo
command compatible with both 3 and 5 level hash directory structure.