Merge pull request #948 from saulpw/develop

VisiData v2.4

Author: saulpw

CHANGELOG.md

@@ -1,5 +1,33 @@
 # VisiData version history
 
+# v2.4 (2021-04-11)
+
+- [splitwindow] stabilize sheet stack associations
+    - `Shift+Z` pushes 'under sheet' (if any) onto other stack
+    - `Shift+Z` does not swap panes anymore
+    - `g Tab` swaps panes
+    - `options.disp_splitwin_pct` is always not sheet-specific
+
+- [status] show nSelectedRows on rstatus
+
+- [color] remove `options.use_default_colors` (thanks @lxcode #939)
+    - `options.color_default` can now have both fg and bg
+    - other color options which do not specify fg or bg will use the missing component from `color_default`
+    - to use terminal default colors, set `options.color_default=""`
+
+## Bugfixes
+
+- [loaders gzip] fix progress bar when opening gzip (thanks @geekscrapy #925)
+- [loaders http] fix loading files from url without specifying filetype
+- [loaders sqlite] use `TABLE_XINFO` for hidden/virtual columns (thanks @dotcs #945)
+- [loaders sqlite] perf improvement: do not pre-count rows (required full table scan)
+- [loaders vds] save typed values instead of formatted display values (thanks @frosencrantz #885)
+- [loaders xlsx] stringify "header" row values for column names (thanks @davidwales #921)
+- [pyobj-show-hidden] grab visibility lvl from sheet specific option (thanks @frosencrantz #947)
+- [splitwin] prevent flickering-on-full-window
+- [splitwin] if top sheet quit, keep bottom sheet in bottom pane
+- [splitwin] full-screen/splitwin close all sheets should be part of the same stack
+
 # v2.3 (2021-04-03)
 
 ## Features

Dockerfile.alpine

@@ -0,0 +1,11 @@
+FROM python:3.8-alpine
+
+RUN pip install requests python-dateutil wcwidth
+
+RUN mkdir -p /opt/visidata
+WORKDIR /opt/visidata
+COPY . ./
+RUN sh -c 'yes | pip install -vvv .'
+
+ENV TERM="xterm-256color"
+ENTRYPOINT bin/vd

Dockerfile.darkdraw.alpine

@@ -0,0 +1,8 @@
+FROM visidata
+
+RUN apk add git
+RUN pip install git+https://github.com/devottys/darkdraw.git@master
+RUN sh -c "echo >>~/.visidatarc import darkdraw"
+
+ENV TERM="xterm-256color"
+ENTRYPOINT ["/opt/visidata/bin/vd", "-f", "ddw"]

README.md

@@ -1,5 +1,5 @@
 
-# VisiData v2.3 [![twitter @VisiData][1.1]][1] [![CircleCI](https://circleci.com/gh/saulpw/visidata/tree/stable.svg?style=svg)](https://circleci.com/gh/saulpw/visidata/tree/stable) [![Gitpod ready-to-code](https://img.shields.io/badge/Gitpod-ready--to--code-blue?logo=gitpod)](https://gitpod.io/#https://github.com/saulpw/visidata)
+# VisiData v2.4 [![twitter @VisiData][1.1]][1] [![CircleCI](https://circleci.com/gh/saulpw/visidata/tree/stable.svg?style=svg)](https://circleci.com/gh/saulpw/visidata/tree/stable) [![Gitpod ready-to-code](https://img.shields.io/badge/Gitpod-ready--to--code-blue?logo=gitpod)](https://gitpod.io/#https://github.com/saulpw/visidata)
 
 A terminal interface for exploring and arranging tabular data.
 

dev/build-container

@@ -0,0 +1,7 @@
+#!/usr/bin/env sh
+
+set -u
+
+cd "$(git rev-parse --show-toplevel)" # begin in project root
+docker build -f Dockerfile.alpine -t visidata .
+docker build -f Dockerfile.darkdraw.alpine -t darkdraw .

dev/checklists/manual-tests.md

@@ -57,8 +57,44 @@
 14. Testing the starting position syntax
 15. Test loading url
 16. Split window
+    - make sure that if you exit split window, all the sheets from both panes can be accessible on the resulting stack
+    - test 1
+        - open 2 files
+        - Z
+        - first window should be active
+        - Tab between
+        - close top one, then redo and test closing bottom one
+            - bug?
+                - does not fullsize
+            - when top pane is quit, bottom pane is moved to the top
+    - test 2
+        - open 2 files
+        - Z
+        - open columns sheet in one
+        - Z
+        - inspect sheet stack
+            - columns sheet should remain where it is, and the source sheet below gets moved to the top of the other window
+        - redo with opening the columns sheet on the other
+            - bug
+                - when Shift+Z is done on bottom pane, its second sheet becomes the second sheet of the top stack, isntead of the first sheet of the top stack
+        - test 3
+            - Shift+Z with only one file
+            - Shift+Z with two panes, each pane's stack only has one file
     - gZ
+        - test both panes
+        - move around, should be no flickering
+        - press Z again
+        - test both panes
     - zZ
-    - Z
-    - various active panes
+        - should change window size, without changing anything else
+        - test for both panes
+        - test negative and positive
+            - bug?
+                - negative switches the windows they belong to
+    - gTab
+        - should window swap
+        - test both panes
+            - bug?
+                - if the second window is a smaller size, should it orient around the cursor position
     - using cursor in active pane
+        - test both panes

dev/debian/changelog

@@ -1,3 +1,15 @@
+visidata (2.3-1) unstable; urgency=low
+
+  * Update package to 2.3
+
+ -- Anja Boskovic <[email protected]>  Sun, 04 Apr 2021 18:08:17 -0700
+
+visidata (2.2.1-1) unstable; urgency=low
+
+  * Update package to 2.2.1
+
+ -- Anja Boskovic <[email protected]>  Sun, 07 Feb 2021 22:19:38 -0800
+
 visidata (2.2-1) unstable; urgency=low
 
   * Update package to 2.2

dev/debian/compat

@@ -0,0 +1,51 @@
+# Viewing two sheets simultaneously
+
+VisiData supports the viewing of two sheets simultaneously with a feature called split screen.
+
+## Entering split screen mode
+
+Keystroke(s)        Action
+------------        ------
+`Shift+Z`           split screen in half, placing second sheet on stack visibly in the second pane
+`z Shift+Z` *n*     split screen, setting the height of the second screen to *n*
+
+
+When there is a single pane, all currently-open sheets are situated within the same sheets stack. The more recent that sheet was viewed, the higher it is in the [stack](https://jsvine.github.io/intro-to-visidata/basics/understanding-sheets/#how-to-use-the-sheets-sheet).
+
+Split-pane opens a second window, and creates a second stack for it. This keeps the sheet stably within a specific window.
+
+For instance, pressing `Shift+C` on the [sample.tsv]() will give us a stack with two columns, the sample **Sheet** and its **Columns Sheet**.
+
+![]
+
+Pressing `Shift+Z` will now give us a view of them both, with the sample **Sheet** moved to the second window.
+
+![]
+
+## Split screen mode specific commands
+
+While in split screen mode, you can move between windows, adjust the sheets that appear in the current window, and full-screen the current pane.
+
+Keystroke(s)        Action
+------------        ------
+`z Shift+Z` *n*     adjust the height of the second window to *n*
+`g Shift+Z`         full screen the current window
+`Tab`               make the other window the active window
+`Ctrl+^`            swap top two sheets in stack in current window, second sheet in stack is now visible
+`g Ctrl+^`          cycle through sheets in stack in current window
+
+For instance, we can use `Tab` to make the sample **Sheet** the active window.
+
+![]
+
+Moving around it, we can see the **Columns Sheet** in the top window continuing to be updated.
+
+We can press `Shift+F` on the **Item** column to view its [Frequency Table]().
+
+Now, the visible sheet of the second window has changed, while the visible sheet on the top window has stayed the same.
+
+![]
+
+We can use `^^`, so that sample **Sheet** is once again visible, and full-screen it with `g Shift+Z`, effectively leaving split screen mode.
+
+![]

docs/split.md

@@ -6,9 +6,9 @@
 {"name": "rownum", "description": "add column of original row ordering", "maintainer": "Saul Pwanson @saulpw", "latest_release": "2019-11-07", "url": "https://raw.githubusercontent.com/saulpw/visidata/dd3aaa4a01e5116c8cd25a30a36bf39756a719b6/plugins/rownum.py", "latest_ver": "0.9", "visidata_ver": "2.0", "pydeps": "", "vdplugindeps": "", "sha256": "41dd84ce3b62504e9c7f40e3ace2285330431d6b46f2f17498ee7e00cb9d8907"}
 {"name": "vmailcap", "description": "add mailcap-view(-selected) commands to DirSheet", "maintainer": "Saul Pwanson @saulpw", "latest_release": "2020-10-06", "url": "https://raw.githubusercontent.com/saulpw/visidata/0d8af5a226818aa2f99a2f74e08543152b22a36d/plugins/vmailcap.py", "latest_ver": "0.9", "visidata_ver": "2.0", "pydeps": "", "vdplugindeps": "", "sha256": "b8aa66821dfa38107ee45fe49a5262e766cc23a0ff362ce5aea5aa6e9b8e6fb0"}
 {"name": "vmutagen", "description": "add mp3 metadata columns to DirSheet", "maintainer": "Saul Pwanson @saulpw", "latest_release": "2019-09-25", "url": "https://raw.githubusercontent.com/saulpw/visidata/v2.-2/plugins/vmutagen.py", "latest_ver": "0.1", "visidata_ver": "2.0", "pydeps": "mutagen", "vdplugindeps": "", "sha256": "de9429e6de46d130f1149d2d8834d8b3bbb55e523acefd735bf101384ebfab07"}
-{"name": "vds3", "description": "add support for Amazon S3 paths", "maintainer": "AJ Kerrigan @ajkerrigan", "latest_release": "2020-10-10", "url": "https://raw.githubusercontent.com/ajkerrigan/visidata-plugins/vds3-0.5/plugins/vds3.py", "latest_ver": "0.5", "visidata_ver": "2.0", "pydeps": "s3fs", "vdplugindeps": "", "sha256": "294eb799aefcd713877e2c2402b3fdd5922fb3488a4e6326907502a98fb03551"}
+{"name": "vds3", "description": "add support for Amazon S3 paths", "maintainer": "AJ Kerrigan @ajkerrigan", "latest_release": "2021-04-08", "url": "https://raw.githubusercontent.com/ajkerrigan/visidata-plugins/vds3-0.6/plugins/vds3.py", "latest_ver": "0.6", "visidata_ver": "2.0", "pydeps": "s3fs", "vdplugindeps": "", "sha256": "0c8f48880b67e8ec33baa84a686d62f198d251b760c71e170ae92f068b778cbf"}
 {"name": "genericSQL", "description": "add loaders for SQL databases (Oracle, MySQL)", "maintainer": "Andrew Swanson @aswan89", "latest_release": "2020-04-15", "url": "https://raw.githubusercontent.com/aswan89/visidata_plugin_genericSQL/1.0.0/generic_sql.py", "latest_ver": "1.0.0", "visidata_ver": "2.-3", "pydeps": "sqlalchemy cx_oracle mysqlclient pyodbc", "vdplugindeps": "", "sha256": "71bbaabaa4ffb973ef7745dc3eadca108b34a7e0f0bf6cf6631eca3fa4532513"}
 {"name": "diff", "description": "adds command to create diff sheets", "maintainer": "Anja Kefala @anjakefala", "latest_release": "2020-10-09", "url": "https://raw.githubusercontent.com/saulpw/visidata/492d558ff4aba55a192965a27ae6499f8d219072/plugins/diff.py", "latest_ver": "0.9", "visidata_ver": "2.0", "sha256": "0085bf8afdc9abf74b7dd52c251f7b7f7befc507aae262bbb656c2ab7379ddd1"}
 {"name": "marks", "description": "adds commands for marking selected rows, and selecting + viewing marked rows", "maintainer": "Saul Pwanson @saulpw", "latest_release": "2020-10-09", "url": "https://raw.githubusercontent.com/saulpw/visidata/54e49feee97a607cce5355bf0e3a79b2466c3d8a/plugins/marks.py", "latest_ver": "0.1", "visidata_ver": "2.0", "sha256": "f15977f327ccc387be208922b66afe4b65666912e8066d02352c53b1aaff941f"}
 {"name": "conll", "description": "CoNLL data loader", "maintainer": "Paul McCann <[email protected]>", "latest_release": "2020-12-07", "url": "https://raw.githubusercontent.com/polm/visidata-conll/1bc43a825b329c833ff3f9eb8377d850d58ec4cd/conll.py", "latest_ver": "v0.1.1", "visidata_ver": "v2.1", "pydeps": "pyconll", "sha256": "7a89537e1ad173d9cf8ec934cb81836be2e4ddcdc06c7632af92e6754594285c"}
-{"name": "darkdraw", "description": "textart and animation for the terminal, in the terminal", "maintainer": "devottys @devottys", "latest_release": "2021-04-04", "url": "git+https://github.com/devottys/darkdraw.git@master", "latest_ver": "0.2", "visidata_ver": "v2.3"}
+{"name": "darkdraw", "description": "textart and animation for the terminal, in the terminal", "maintainer": "devottys @devottys", "latest_release": "2021-04-04", "url": "git+https://github.com/devottys/darkdraw.git@v0.2", "latest_ver": "0.2", "visidata_ver": "v2.3"}