v0.11.2-rc6

lnav v0.11.2

Features:

• A "cursor" mode has been added to the main view that can
  be toggled by pressing CTRL-X. While in cursor mode, any
  operations that would normally work on the "top" line will
  now operate on the focused line instead.
• Added CTRL-D and CTRL-U hotkeys to move down/up by half
  a page.
• Added an auto-width flag to the elements of the
  line-format array that indicates that the width of the
  field should automatically be determined by the observed
  values.
• Added bunyan log format from Tobias Gruetzmacher.
• Added cloudlare log format from @minusf.
• Number fields used in a JSON log format line-format
  array now default to being right-aligned. Also, added
  prefix and suffix to line-format elements so a
  string can optionally be prepended/appended if the value
  is not empty.
• JSON log format detection has been improved to not rely
  on matching the file name. All possible formats are
  tried and the one with the most available fields for a
  given line-format is used. For example, if the first
  log message has 8 fields and format A contains 5 of
  those fields in its line-format while format B only
  contains 2 of those fields in its line-format, format
  A will be used for the file.

Changes:

• For JSON-lines logs, line-feeds at the end of a value are
  automatically stripped.

Bug Fixes:

• Hidden values in JSON logs are now hidden by default.
• Text with ANSI-escapes is now filtered properly.

v0.11.2-rc5

lnav v0.11.2

Features:

• A "cursor" mode has been added to the main view that can
  be toggled by pressing CTRL-X. While in cursor mode, any
  operations that would normally work on the "top" line will
  now operate on the focused line instead.
• Added CTRL-D and CTRL-U hotkeys to move down/up by half
  a page.
• Added an auto-width flag to the elements of the
  line-format array that indicates that the width of the
  field should automatically be determined by the observed
  values.
• Added bunyan log format from Tobias Gruetzmacher.
• Added cloudlare log format from @minusf.
• Number fields used in a JSON log format line-format
  array now default to being right-aligned. Also, added
  prefix and suffix to line-format elements so a
  string can optionally be prepended/appended if the value
  is not empty.

Changes:

• For JSON-lines logs, line-feeds at the end of a value are
  automatically stripped.

Bug Fixes:

• Hidden values in JSON logs are now hidden by default.
• Text with ANSI-escapes is now filtered properly.

v0.11.2-rc3

lnav v0.11.2

Features:

• A "cursor" mode has been added to the main view that can
  be toggled by pressing CTRL-X. While in cursor mode, any
  operations that would normally work on the "top" line will
  now operate on the focused line instead.
• Added CTRL-D and CTRL-U hotkeys to move down/up by half
  a page.
• Added an auto-width flag to the elements of the
  line-format array that indicates that the width of the
  field should automatically be determined by the observed
  values.
• Added bunyan log format from Tobias Gruetzmacher.
• Number fields used in a JSON log format line-format
  array now default to being right-aligned. Also, added
  prefix and suffix to line-format elements so a
  string can optionally be prepended/appended if the value
  is not empty.

Bug Fixes:

• Hidden values in JSON logs are now hidden by default.
• Text with ANSI-escapes is now filtered properly.

v0.11.2-rc2

lnav v0.11.2

Features:

• A "cursor" mode has been added to the main view that can
  be toggled by pressing CTRL-X. While in cursor mode, any
  operations that would normally work on the "top" line will
  now operate on the focused line instead.
• Added CTRL-D and CTRL-U hotkeys to move down/up by half
  a page.
• Added an auto-width flag to the elements of the
  line-format array that indicates that the width of the
  field should automatically be determined by the observed
  values.
• Number fields used in a line-format now default to
  being right-aligned.

Bug Fixes:

• Hidden values in JSON logs are now hidden by default.
• Text with ANSI-escapes is now filtered properly.

v0.11.2-rc1

lnav v0.11.2

Features:

• A "cursor" mode has been added to the main view that can
  be toggled by pressing CTRL-X. While in cursor mode, any
  operations that would normally work on the "top" line now
  operate on the selected line instead.
• Added CTRL-D and CTRL-U hotkeys to move down/up by half
  a page.
• Added an auto-width flag to the elements of the
  line-format array that indicates that the width of the
  field should automatically be determined by the observed
  values.
• Number fields used in a line-format now default to
  being right-aligned.

Bug Fixes:

• Hidden values in JSON logs are now hidden by default.
• Text with ANSI-escapes is now filtered properly.

lnav v0.11.1

lnav v0.11.1

Features:

• Additional validation checks for log formats have been
  added and will result in warnings. Pass -W on the
  command-line to view the warnings. The following new
  check have been added:
  • Each regex must have a corresponding sample log message
    that it matches.
  • Each sample must be matched by only one regex.
• Added built-in support for anonymizing content. The
  :write-* commands now accept an --anonymize option
  and there is an anonymize() SQL function. The
  anonymization process will try to replace identifying
  information with random data. For example, IPv4 addresses
  are replaced with addresses in the 10.0.0.0/8 range.
  (This feature is mainly intended to help with providing
  information to lnav support that does not have sensitive
  values.)
• Added parse_url() and unparse_url() SQL functions for
  parsing URLs into a JSON object and then back again. Note
  that the implementation relies on libcurl which has some
  limitations, like not supporting all types of schemes
  (e.g. mailto:).
• Added the subsecond-field and subsecond-units log
  format properties to allow for specifying a separate
  field for the sub-second portion of a timestamp.
• Added a keymap for Swedish keyboards.

Breaking changes:

• The regexp_capture() table-valued-function now returns NULL
  instead of an empty string for the capture_name column if
  the capture is not named.

Fixes:

• Reduce the "no patterns have a capture" error to a warning
  so that it doesn't block lnav from starting up.
• Some ANSI escape sequences will now be removed before testing
  regexes against a log message.
• If a line in a JSON-lines log file does not start with a
  {, it will now be shown as-is and will not have the JSON
  parse error.

Cost of Doing Business:

• Migrated from pcre to pcre2.

lnav v0.11.1-rc1

lnav v0.11.1

Features:

• Additional validation checks for log formats have been
  added and will result in warnings. Pass -W on the
  command-line to view the warnings. The following new
  check have been added:
  • Each regex must have a corresponding sample log message
    that it matches.
  • Each sample must be matched by only one regex.
• Added built-in support for anonymizing content. The
  :write-* commands now accept an --anonymize option
  and there is an anonymize() SQL function. The
  anonymization process will try to replace identifying
  information with random data. For example, IPv4 addresses
  are replaced with addresses in the 10.0.0.0/8 range.
  (This feature is mainly intended to help with providing
  information to lnav support that does not have sensitive
  values.)
• Added parse_url() and unparse_url() SQL functions for
  parsing URLs into a JSON object and then back again. Note
  that the implementation relies on libcurl which has some
  limitations, like not supporting all types of schemes
  (e.g. mailto:).
• Added the subsecond-field and subsecond-units log
  format properties to allow for specifying a separate
  field for the sub-second portion of a timestamp.
• Added a keymap for Swedish keyboards.

Breaking changes:

• The regexp_capture() table-valued-function now returns NULL
  instead of an empty string for the capture_name column if
  the capture is not named.

Fixes:

• Reduce the "no patterns have a capture" error to a warning
  so that it doesn't block lnav from starting up.
• Some ANSI escape sequences will now be removed before testing
  regexes against a log message.
• If a line in a JSON-lines log file does not start with a
  {, it will now be shown as-is and will not have the JSON
  parse error.

Cost of Doing Business:

• Migrated from pcre to pcre2.

lnav v0.11.1-beta1

lnav v0.11.1

Features:

• Additional validation checks for log formats have been
  added and will result in warnings. Pass -W on the
  command-line to view the warnings. The following new
  check have been added:
  • Each regex must have a corresponding sample log message
    that it matches.
  • Each sample must be matched by only one regex.
• Added built-in support for anonymizing content. The
  :write-* commands now accept an --anonymize option
  and there is an anonymize() SQL function. The
  anonymization process will try to replace identifying
  information with random data. For example, IPv4 addresses
  are replaced with addresses in the 10.0.0.0/8 range.
  (This feature is mainly intended to help with providing
  information to lnav support that does not have sensitive
  values.)
• Added parse_url() and unparse_url() SQL functions for
  parsing URLs into a JSON object and then back again. Note
  that the implementation relies on libcurl which has some
  limitations, like not supporting all types of schemes
  (e.g. mailto:).

Breaking changes:

• The regexp_capture() table-valued-function now returns NULL
  instead of an empty string for the capture_name column if
  the capture is not named.

Fixes:

• Reduce the "no patterns have a capture" error to a warning
  so that it doesn't block lnav from starting up.
• Some ANSI escape sequences will now be removed before testing
  regexes against a log message.

Cost of Doing Business:

• Migrated from pcre to pcre2.

lnav v0.11.1

lnav v0.11.1

Features:

• Additional validation checks for log formats have been
  added and will result in warnings. Pass -W on the
  command-line to view the warnings. The following new
  check have been added:
  • Each regex must have a corresponding sample log message
    that it matches.
  • Each sample must be matched by only one regex.
• Added built-in support for anonymizing content. The
  :write-* commands now accept an --anonymize option
  and there is an anonymize() SQL function. The
  anonymization process will try to replace identifying
  information with random data. For example, IPv4 addresses
  are replaced with addresses in the 10.0.0.0/8 range.
  (This feature is mainly intended to help with providing
  information to lnav support that does not have sensitive
  values.)
• Added parse_url() and unparse_url() SQL functions for
  parsing URLs into a JSON object and then back again. Note
  that the implementation relies on libcurl which has some
  limitations, like not supporting all types of schemes
  (e.g. mailto:).

Breaking changes:

• The regexp_capture() table-valued-function now returns NULL
  instead of an empty string for the capture_name column if
  the capture is not named.

Fixes:

• Reduce the "no patterns have a capture" error to a warning
  so that it doesn't block lnav from starting up.

Cost of Doing Business:

• Migrated from pcre to pcre2.

lnav v0.11.0

lnav is an advanced log file viewer for the terminal. It can quickly parse and index log files and display them in a single combined view with syntax highlighting.

Downloads

• Linux
  lnav-0.11.0-musl-64bit.zip - A statically linked 64-bit musl binary for linux.
  You can also install via Snap on Linux:

  $ snap install lnav

• MacOS
  lnav-0.11.0-os-x.zip - A statically linked binary for MacOS.

  You can also install via brew:

  brew install lnav

New in this release

Features

• Redesigned the top status area to allow for user-specified
  messages and added a second line that displays an interactive
  breadcrumb bar. The top status line now shows the clock and
  the remaining area displays whatever messages are inserted
  into the lnav_user_notifications table. The information that
  was originally on top is now in a second line and organized
  as breadcrumbs. Pressing ENTER will activate the breadcrumb bar
  and the left/right cursor keys can be used to select a particular
  crumb while the up/down keys can select a value to switch to.
  While a crumb is selected, you can also type in some text to do
  a fuzzy search on the possibilities or, if the crumb represents
  an array of values, enter the index to jump to.
• The pretty-print view will now show breadcrumbs that indicate the
  location of the top line in the view with the prettified structure.
• Markdown files (those with a .md extension) are now rendered in the
  TEXT view. The breadcrumb bar at the top will also be updated
  depending on the section of the document that you are in and you
  can use it to jump to different parts of the doc.
• The ":goto" command will now accept anchor links (i.e. #section-id)
  as an argument when the text file being viewed has sections. You
  can also specify an anchor when opening a file by appending
  "#". For example, "README.md#screenshot".
• Log message comments are now treated as markdown and rendered
  accordingly in the overlay. Multi-line comments are now supported
  as well.
• Metadata embedded in files can now be accessed by the
  "lnav_file_metadata" table. Currently, only the front-matter in
  Markdown files is supported.
• Added an integration with regex101.com to make it easier to edit
  log message regular expressions. Using the new "management CLI"
  (activated by the -m option), a log format can be created from
  a regular expression entry on regex101.com and existing patterns
  can be edited.
• In the spectrogram view, the selected value range is now shown by
  an overlay that includes a summary of the range and the number of
  values that fall in that range. There is also a detail panel at
  the bottom that shows the log-messages/DB-rows whose values are in
  that range. You can then press TAB to focus on the detail view
  and scroll around.
• Add initial support for pcap(3) files using tshark(1).
• SQL statement execution can now be canceled by pressing CTRL+]
  (same as canceling out of a prompt).
• To make it possible to automate some operations, there is now an
  "lnav_events" table that is updated when internal events occur
  within lnav (e.g. opening a file, format is detected). You
  can then add SQLite TRIGGERs to this table that can perform a
  task by updating other tables.
• Tags can automatically be added to messages by defining a pattern
  in a log format. Under a format definition, add the tag name
  into the "tags" object in a format definition. The "pattern"
  property specifies the regular expression to match against a line
  in a file that matches the format. If a match is found, the tag
  will be applied to the log message. To restrict matches to
  certain files, you can add a "paths" array whose object elements
  contain a "glob" property that will be matched against file names.
• Log messages can now be detected automatically via "watch
  expressions". These are SQL expressions that are executed for
  each log message. If the expressions evaluates to true, an
  event is published to the "lnav_events" table that includes the
  message contents.
• Added the "regexp_capture_into_json()" table-valued-function that
  is similar to "regexp_capture()", but returns a single row with a
  JSON value for each match instead of a row for each capture.
• Added a "top_meta" column to the lnav_views table that contains
  metadata related to the top line in the view.
• Added a "log_opid" hidden column to all log tables that contains
  the "operation ID" as specified in the log format.
• Moved the "log_format" column from the all_logs table to a hidden
  column on all tables.
• Add format for UniFi gateway.
• Added a "glob" property to search tables defined in log formats
  to constrain searches to log messages from files that have a
  matching log_path value.
• Initial indexing of large files should be faster. Decompression
  and searching for line-endings are now pipelined, so they happen
  in a thread that is separate from the regular expression matcher.
• Writing to the clipboard now falls back to OSC 52 escape sequence
  if none of the clipboard commands could be detected. Your
  terminal software will need to support the sequence and you may
  need to explicitly enable it in the terminal.
• Added the ":export-session-to " command that writes the
  current session state to a file as a list of commands/SQL
  statements. This script file can be executed to restore the
  majority of the current state.
• Added the "echoln()" SQL function that behaves similarly to the
  ":echo" command, writing its first argument to the current
  output.
• Added "encode()" and "decode()" SQL functions for transcoding
  blobs or text values using one of the following algorithms:
  base64, hex, or uri.
• In regular expressions, capture group names are now semantically
  highlighted (e.g. in the capture, (?\w+), "name" would
  have a unique color). Also, operations or previews that use
  that regular expression will highlight the matched data with
  the same color.
• Added an lnav_views_echo table that is a real SQLite table that
  you can create TRIGGERs on in order to perform actions when
  scrolling in a view.
• Added a "yaml_to_json()" SQL function that converts a YAML
  document to the equivalent JSON.

Breaking Changes

• Formats definitions are now checked to ensure that values have a
  corresponding capture in at least one pattern.
• Added a 'language' column to the lnav_view_filters table that
  specifies the language of the 'pattern' column, either 'regex'
  or 'sql'.
• Timestamps that do not have a day or month are rewritten to a
  full timestamp like YYYY-MM-DD HH:MM:SS.
• Removed the summary overlay at the bottom of the log view that
  displayed things like "Error rate" and the time span. It doesn't
  seem like anyone used it.
• Removed the "log_msg_instance" column from the logline and search
  tables since it causes problems with performance.
• Search tables now search for multiple matches within a message
  instead of stopping at the first hit. Each additional match is
  returned as a separate row. A "match_index" column has been
  added to capture the index of the match within the message.
  The table regex is also compiled with the "multiline" flag enabled
  so the meaning of the '^' and '$' metacharacters are changed
  to match the start/end of a line instead of the start/end of
  the entire message string.
• Search tables defined in formats are now constrained to only
  match log messages that are in that log format instead of all
  log messages. As a benefit, the search table now includes
  the columns that are defined as part of the format.
• The lnav_view_filters table will treats the tuple of
  (view_name, type, language, pattern) as a UNIQUE index and
  will raise a conflict error on an INSERT. Use "REPLACE INTO"
  instead of "INSERT INTO" to ignore conflict error.
• The types of SQL values stored as local variables in scripts
  is now preserved when used as bound variables at a later point
  in the script.

Fixes

• Toggling enabled/disabled filters when there is a SQL expression
  no longer causes a crash.
• Fix a crash related to long lines that are word wrapped.
• Multiple SQL statements in a SQL block of a script are now
  executed instead of just the first one.
• In cases where there were many different colors on screen, some
  text would be colored incorrectly.
• The pretty-print view now handles ANSI escape sequences.
• The "overstrike" convention for doing bold and underline is now
  supported. (Overstrike is a character followed by a backspace
  and then the same character for bold or an underscore for
  underline.)
• The ":eval" command now works with searching (using the '/'
  prefix).