5.5.3 (21 May 2018)

Short release cycle here specifically to address the Snapshot restore issue
raised in #1192

Changes

• By default, filter out indices with index.lifecycle.name set. This can
  be overridden with the option allow_ilm_indices with the caveat that
  you are on your own if there are conflicts. NOTE: The Index Lifecycle
  Management feature will not appear in Elasticsearch until 6.4.0
• Removed some unused files from the repository.

Bug Fixes

• Fix an ambiguously designed Alias test (untergeek)
• Snapshot action will now raise an exception if the snapshot does not
  complete with state SUCCESS. Reported in #1192 (untergeek)
• The show_indices and show_snapshots singletons were not working within the
  new framework. They've been fixed now.

5.5.2 (14 May 2018)

Changes

• The alias, restore, rollover, and shrink actions have been
  added to curator_cli, along with a revamped method to manage/add
  actions in the future.
• Updated certifi dependency to 2018.4.16
• Added six dependency
• Permit the use of versions 6.1 and greater of the elasticsearch python
  module. There are issues with SSL contexts in the 6.0 release that prevent
  Curator from being able to use this version. Currently the requirement
  version string is elasticsearch>=5.5.2,!=6.0.0,<7.0.0
• Start of pylint cleanup, and use of six string_types. (untergeek)

Bug Fixes

• unit_count_pattern setting can cause indices to mistakenly be included
  in an index filter. Fixed in #1206 (soenkeliebau)
• Fix rollover _check_max_size() call. Reported in #1202 by @diranged
  (untergeek).
• Update tested versions of Elasticsearch. (untergeek).
• Update setup.cfg to install dependencies during source install. (untergeek)
• Fix reference to unset variable name in log output at
  https://github.com/elastic/curator/blob/v5.5.1/curator/actions.py#L2145
  It should be idx instead of index. (untergeek).
• Alias action should raise NoIndices exception if warn_if_no_indices is
  True, and no add or remove sub-actions are found, rather than raising
  an ActionError. Reported in #1209 (untergeek).

Documentation

• Clarify inclusive filtering for allocated filter. Fixed in #1203 (geekpete)
• Fix Kibana filter description. #1199 (quartett-opa)
• Add missing documentation about the new_name option for rollover.
  Reported in #1197 (untergeek)

5.5.1 (22 March 2018)

Bug Fixes

• Fix pip installation issues for older versions of Python #1183 (untergeek)

5.5.0 (21 March 2018)

New Features

• Add wait_for_rebalance as an option for shrink action. By default
  the behavior remains unchanged. You can now set this to False though to
  allow the shrink action to only check that the index being shrunk has
  finished being relocated and it will not wait for the cluster to
  rebalance. #1129 (tschroeder-zendesk)
• Work around for extremely large cluster states. #1142 (rewiko)
• Add CI tests for Elasticsearch versions 6.1 and 6.2 (untergeek)
• Add Elasticsearch datemath support for snapshot names #1078 (untergeek)
• Support max_size as a rollover condition for Elasticsearch versions
  6.1.0 and up. #1140 (untergeek)
• Skip indices with a document count of 0 when using source: field_stats
  to do age or period type filtering. #1130 (untergeek)

Bug Fixes

• Fix missing node information in log line. #1142 (untergeek)
• Fix default options in code that were causing schema validation errors
  after voluptuous upgrade to 0.11.1. Reported in #1149, fixed in #1156 (untergeek)
• Disallow empty lists as reindex source. Raise exception if that happens.
  Reported in #1139 (untergeek)
• Set a timeout_override for delete_snapshots to catch cases where
  slower repository network and/or disk access can cause a snapshot delete
  to take longer than the default 30 second client timeout. #1133 (untergeek)
• Add AWS ES 5.1 support. #1172 (wanix)
• Add missing period filter arguments for delete_snapshots. Reported in
  #1173 (untergeek)
• Fix kibana filtertype to catch newer index names. Reported in #1171 (untergeek)
• Re-order the closed indices filter for the Replicas action to take place
  before the empty list check. Reported in #1180 by @agomerz (untergeek)

General

• Deprecate testing for Python 3.4. It is no longer being supported by Python.
• Increase logging to show error when master_only is true and there are
  multiple hosts.

Documentation

• Correct a misunderstanding about the nature of rollover conditions. #1144 (untergeek)
• Correct links to the field_stats API, as it is non-existent in Elasticsearch
  6.x. (untergeek)
• Add a warning about using forcemerge on active indices. #1153 (untergeek)
• Fix select URLs in pip installation from source to not be 404 #1133 (untergeek)
• Fix an error in regex filter documentation #1138 (arne-cl)

5.4.1 (6 December 2017)

Bug Fixes

• Improve Dockerfile to build from source and produce slimmer image
  #1111 (mikn)
• Fix filter_kibana to correctly use exclude argument
  #1116 (cjuroz)
• Fix ssl_no_validate behavior within AWS ES #1118 (igalarzab)
• Improve command-line exception management #1119 (4383)
• Make alias action always process remove before add
  to prevent undesired alias removals. #1120 (untergeek)

General

• Bump ES versions in Travis CI

Documentation

• Remove unit_count parameter doc for parameter that no longer
  exists #1107 (dashford)
• Add missing exclude: True in timestring docs #1117 (GregMefford)

5.4.0 (13 November 2017)

Announcement

• Support for Elasticsearch 6.0!!! Yes!

New Features

• The field_stats API may be gone from Elasticsearch, but its utility
  cannot be denied. And so, Curator has replaced the field_stats API
  call with a small aggregation query. This will be perhaps a bit more
  costly in performance terms, as this small aggregation query must be made
  to each index in sequence, rather than as a one-shot call, like the
  field_stats API call. But the benefit will remain available, and
  it's the only major API that did not persevere between Elasticsearch 5.x
  and 6.x that was needed by Curator.

5.3.0 (31 October 2017)

New Features

• With the period filter and field_stats, it is useful to match indices
  that fit within the period, rather than just their start dates. This
  is now possible with intersect. See more in the documentation.
  Requested in #1045. (untergeek)
• Add a restore function to curator_cli singleton. Mentioned in
  #851 (alexef)
• Add pattern to the count filter. This is particularly useful
  when working with rollover indices. Requested in #1044 (untergeek)
• The es_repo_mgr create command now can take skip_repo_fs_check as
  an argument (default is False) #1072 (alexef)
• Add pattern_type feature expansion to the period filter. The
  default behavior is pattern_type='relative', which preserves existing
  behaviors so users with existing configurations can continue to use them
  without interruption. The new pattern_type is absolute, which
  allows you to specify hard dates for date_from and date_to, while
  date_from_format and date_to_format are strftime strings to
  interpret the from and to dates. Requested in #1047 (untergeek)
• Add copy_aliases option to the shrink action. So this option is
  only set in the shrink action. The default value of the option is
  copy_aliases: 'False' and it does nothing. If you set to
  copy_aliases: 'True', you could copy the aliases from the source index
  to the target index. Requested in #1060 (monkey3199)
• IAM Credentials can now be retrieved from the environment using the Boto3
  Credentials provider. #1084 (kobuskc)

Bug Fixes

• Delete the target index (if it exists) in the event that a shrink fails.
  Requested in #1058 (untergeek)
• Fixed an integration test that could fail in the waning days of a month.
• Fix build system anomalies for both unix and windows.

Documentation

• Set repository access to be https by default.
• Add documentation for copy_aliases option.

5.3.0 RC1 (30 October 2017)

New Features

• With the period filter and field_stats, it is useful to match indices
  that fit within the period, rather than just their start dates. This
  is now possible with intersect. See more in the documentation.
  Requested in #1045. (untergeek)
• Add a restore function to curator_cli singleton. Mentioned in
  #851 (alexef)
• Add pattern to the count filter. This is particularly useful
  when working with rollover indices. Requested in #1044 (untergeek)
• The es_repo_mgr create command now can take skip_repo_fs_check as
  an argument (default is False) #1072 (alexef)
• Add pattern_type feature expansion to the period filter. The
  default behavior is pattern_type='relative', which preserves existing
  behaviors so users with existing configurations can continue to use them
  without interruption. The new pattern_type is absolute, which
  allows you to specify hard dates for date_from and date_to, while
  date_from_format and date_to_format are strftime strings to
  interpret the from and to dates. Requested in #1047 (untergeek)
• Add copy_aliases option to the shrink action. So this option is
  only set in the shrink action. The default value of the option is
  copy_aliases: 'False' and it does nothing. If you set to
  copy_aliases: 'True', you could copy the aliases from the source index
  to the target index. Requested in #1060 (monkey3199)
• IAM Credentials can now be retrieved from the environment using the Boto3
  Credentials provider. #1084 (kobuskc)

Bug Fixes

• Delete the target index (if it exists) in the event that a shrink fails.
  Requested in #1058 (untergeek)
• Fixed an integration test that could fail in the waning days of a month.
• Fix build system anomalies for both unix and windows.

Documentation

• Set repository access to be https by default.
• Add documentation for copy_aliases option.

5.3.0b2 (26 October 2017)

New Features

• With the period filter and field_stats, it is useful to match indices
  that fit within the period, rather than just their start dates. This
  is now possible with intersect. See more in the documentation.
  Requested in #1045. (untergeek)
• Add a restore function to curator_cli singleton. Mentioned in
  #851 (alexef)
• Add pattern to the count filter. This is particularly useful
  when working with rollover indices. Requested in #1044 (untergeek)
• The es_repo_mgr create command now can take skip_repo_fs_check as
  an argument (default is False) #1072 (alexef)
• Add pattern_type feature expansion to the period filter. The
  default behavior is pattern_type='relative', which preserves existing
  behaviors so users with existing configurations can continue to use them
  without interruption. The new pattern_type is absolute, which
  allows you to specify hard dates for date_from and date_to, while
  date_from_format and date_to_format are strftime strings to
  interpret the from and to dates. Requested in #1047 (untergeek)
• Add copy_aliases option to the shrink action. So this option is
  only set in the shrink action. The default value of the option is
  copy_aliases: 'False' and it does nothing. If you set to
  copy_aliases: 'True', you could copy the aliases from the source index
  to the target index. Requested in #1060 (monkey3199)
• IAM Credentials can now be retrieved from the environment using the Boto3
  Credentials provider. #1084 (kobuskc)

Bug Fixes

• Delete the target index (if it exists) in the event that a shrink fails.
  Requested in #1058 (untergeek)
• Fixed an integration test that could fail in the waning days of a month.
• Fix build system anomalies for both unix and windows.

Documentation

• Set repository access to be https by default.

5.3.0b1 (26 October 2017)

New Features

• With the period filter and field_stats, it is useful to match indices
  that fit within the period, rather than just their start dates. This
  is now possible with intersect. See more in the documentation.
  Requested in #1045. (untergeek)
• Add a restore function to curator_cli singleton. Mentioned in
  #851 (alexef)
• Add pattern to the count filter. This is particularly useful
  when working with rollover indices. Requested in #1044 (untergeek)
• The es_repo_mgr create command now can take skip_repo_fs_check as
  an argument (default is False) #1072 (alexef)
• Add pattern_type feature expansion to the period filter. The
  default behavior is pattern_type='relative', which preserves existing
  behaviors so users with existing configurations can continue to use them
  without interruption. The new pattern_type is absolute, which
  allows you to specify hard dates for date_from and date_to, while
  date_from_format and date_to_format are strftime strings to
  interpret the from and to dates. Requested in #1047 (untergeek)
• Add copy_aliases option to the shrink action. So this option is
  only set in the shrink action. The default value of the option is
  copy_aliases: 'False' and it does nothing. If you set to
  copy_aliases: 'True', you could copy the aliases from the source index
  to the target index. Requested in #1060 (monkey3199)
• IAM Credentials can now be retrieved from the environment using the Boto3
  Credentials provider. #1084 (kobuskc)

Bug Fixes

• Delete the target index (if it exists) in the event that a shrink fails.
  Requested in #1058 (untergeek)
• Fixed an integration test that could fail in the waning days of a month.
• Fix build system anomalies for both unix and windows.

Documentation

• Set repository access to be https by default.