(#476) C locale is now en_US_POSIX; warn if an explicitly set locale ends up with ICU's returning a resource bundle from the root locale

Author: gagolews

.devel/sphinx/install.md

@@ -101,7 +101,7 @@ Some environment variables:
 
 
 
-## Final Notes
+## Getting Help
 
 If you do not manage to set up a successful build, do not
 hesitate to [file a bug report](https://github.com/gagolews/stringi/issues).

.devel/sphinx/news.md

@@ -1,26 +1,36 @@
 # Changelog
 
 
-## 1.8.1 (2023-11-08)
+## 1.8.1 (2023-11-09)
 
 * [GENERAL] ICU bundle updated to version 74.1 (Unicode 15.1, CLDR 44).
 
-* [BACKWARD INCOMPATIBLE] [BUILD TIME] Support for Solaris has now been dropped.
-  The package is no longer shipped with the very outdated ICU55 bundle.
+* [BACKWARD INCOMPATIBILITY] [BUILD TIME] Support for Solaris has now been
+  dropped. The package is no longer shipped with the very outdated ICU55 bundle.
   A compiler supporting at least C++11 as well as ICU >= 61 are now required.
 
-* [BACKWARD INCOMPATIBLE] #469: Missing date-time fields in
+* [BACKWARD INCOMPATIBILITY] #469: Missing date-time fields in
   `stri_datetime_parse` and `stri_datetime_create` now default to today's
   midnight local time.
 
+* [BACKWARD INCOMPATIBILITY] Removed the long-deprecated and defunct
+  `fallback_encoding` parameter of `stri_read_lines` and the ellipsis
+  parameter of `stri_opts_collator`, `stri_opts_regex`, `stri_opts_fixed`,
+  and `stri_opts_regex`.
+
 * [BUILD TIME] As per the suggestion of Prof. Brian Ripley, `icudt74l`
   (ICU data - little endian) is now included in the source tarball (compressed
   with xz to save space). This allows for building *stringi* on systems with
   no internet access.
 
-* [NEW FEATURE] #476: A warning is emitted when selecting an unknown locale
-  for collation as it most likely indicates that a wrong resource is being
-  returned.
+* [NEW FEATURE] #476: In break iterator-, date-time-, and collator-based
+  operations (e.g., `stri_sort`), a warning is emitted when the *root* ICU
+  resource bundle is returned when using an *explicitly* requested locale.
+  This might happen when we pass an 'unknown' `locale` argument to these
+  functions. Note that when relying on the default `locale=NULL` argument,
+  no warning is emitted. In such a case, checking
+  if the default locale as returned by `stri_enc_get` is amongst
+  those listed in `stri_enc_list` is recommended.
 
 * [NEW FEATURE] The `C` locale identifier now resolves to `en_US_POSIX`.
 

.devel/sphinx/rapi/about_locale.md

@@ -34,7 +34,7 @@ Your program should avoid changing the default locale. All locale-sensitive func
 
 One of many examples of locale-dependent services is the Collator, which performs a locale-aware string comparison. It is used for string comparing, ordering, sorting, and searching. See [`stri_opts_collator`](stri_opts_collator.md) for the description on how to tune its settings, and its `locale` argument in particular.
 
-When choosing a resource bundle that is not available in the requested locale nor in its more general variants (e.g., \'es_ES\' vs \'es\'), a warning is emitted.
+When choosing a resource bundle that is not available in the explicitly requested locale (but not when using the default locale) nor in its more general variants (e.g., \'es_ES\' vs \'es\'), a warning is emitted.
 
 Other locale-sensitive functions include, e.g., [`stri_trans_tolower`](stri_trans_casemap.md) (that does character case mapping).
 

.devel/sphinx/rapi/stri_datetime_add.md

@@ -68,15 +68,15 @@ print(x)
 ```
 
 ```
-## [1] "2024-01-08 17:00:48 AEDT"
+## [1] "2024-01-09 11:24:49 AEDT"
 ```
 
 ```r
 stri_datetime_add(x, -2, units='months')
 ```
 
 ```
-## [1] "2023-11-08 17:00:48 AEDT"
+## [1] "2023-11-09 11:24:49 AEDT"
 ```
 
 ```r

.devel/sphinx/rapi/stri_datetime_create.md

@@ -96,5 +96,5 @@ stri_datetime_create(hour=15, minute=59)
 ```
 
 ```
-## [1] "2023-11-08 15:59:00 AEDT"
+## [1] "2023-11-09 15:59:00 AEDT"
 ```

.devel/sphinx/rapi/stri_datetime_fields.md

@@ -77,9 +77,9 @@ stri_datetime_fields(stri_datetime_now())
 
 ```
 ##   Year Month Day Hour Minute Second Millisecond WeekOfYear WeekOfMonth
-## 1 2023    11   8   17      0     49         139         46           2
+## 1 2023    11   9   11     24     49         982         46           2
 ##   DayOfYear DayOfWeek Hour12 AmPm Era
-## 1       312         4      5    2   2
+## 1       313         5     11    1   2
 ```
 
 ```r
@@ -88,9 +88,9 @@ stri_datetime_fields(stri_datetime_now(), locale='@calendar=hebrew')
 
 ```
 ##   Year Month Day Hour Minute Second Millisecond WeekOfYear WeekOfMonth
-## 1 5784     2  24   17      0     49         148          9           4
+## 1 5784     2  25   11     24     49         986          9           4
 ##   DayOfYear DayOfWeek Hour12 AmPm Era
-## 1        54         4      5    2   1
+## 1        55         5     11    1   1
 ```
 
 ```r

.devel/sphinx/rapi/stri_datetime_format.md

@@ -221,5 +221,5 @@ stri_datetime_format(stri_datetime_now(), 'datetime_relative_medium')
 ```
 
 ```
-## [1] "today, 5:00:49 pm"
+## [1] "today, 11:24:50 am"
 ```

.devel/sphinx/rapi/stri_enc_detect2.md

@@ -12,10 +12,10 @@ stri_enc_detect2(str, locale = NULL)
 
 ## Arguments
 
-|          |                                                                                                                         |
-|----------|-------------------------------------------------------------------------------------------------------------------------|
-| `str`    | character vector, a raw vector, or a list of `raw` vectors                                                              |
-| `locale` | `NULL` or `''` for default locale, `NA` for just checking the UTF-\* family, or a single string with locale identifier. |
+|          |                                                                                   |
+|----------|-----------------------------------------------------------------------------------|
+| `str`    | character vector, a raw vector, or a list of `raw` vectors                        |
+| `locale` | `NULL` or `''` for the default locale, or a single string with locale identifier. |
 
 ## Details
 

.devel/sphinx/rapi/stri_opts_brkiter.md

@@ -18,8 +18,7 @@ stri_opts_brkiter(
   skip_line_soft,
   skip_line_hard,
   skip_sentence_term,
-  skip_sentence_sep,
-  ...
+  skip_sentence_sep
 )
 ```
 
@@ -38,7 +37,6 @@ stri_opts_brkiter(
 | `skip_line_hard`     | logical; perform no action for hard, or mandatory line breaks                                                                                                                                                  |
 | `skip_sentence_term` | logical; perform no action for sentences ending with a sentence terminator (\'`.`\', \'`,`\', \'`?`\', \'`!`\'), possibly followed by a hard separator (`CR`, `LF`, `PS`, etc.)                                |
 | `skip_sentence_sep`  | logical; perform no action for sentences that do not contain an ending sentence terminator, but are ended by a hard separator or end of input                                                                  |
-| `...`                | \[DEPRECATED\] any other arguments passed to this function generate a warning; this argument will be removed in the future                                                                                     |
 
 ## Details
 

.devel/sphinx/rapi/stri_opts_collator.md

@@ -16,8 +16,7 @@ stri_opts_collator(
   case_level = FALSE,
   normalization = FALSE,
   normalisation = normalization,
-  numeric = FALSE,
-  ...
+  numeric = FALSE
 )
 
 stri_coll(
@@ -29,8 +28,7 @@ stri_coll(
   case_level = FALSE,
   normalization = FALSE,
   normalisation = normalization,
-  numeric = FALSE,
-  ...
+  numeric = FALSE
 )
 ```
 
@@ -47,7 +45,6 @@ stri_coll(
 | `normalization`     | single logical value; if `TRUE`, then incremental check is performed to see whether the input data is in the FCD form. If the data is not in the FCD form, incremental NFD normalization is performed                                                                       |
 | `normalisation`     | alias of `normalization`                                                                                                                                                                                                                                                    |
 | `numeric`           | single logical value; when turned on, this attribute generates a collation key for the numeric value of substrings of digits; this is a way to get \'100\' to sort AFTER \'2\'; note that negative or non-integer numbers will not be ordered properly                      |
-| `...`               | \[DEPRECATED\] any other arguments passed to this function generate a warning; this argument will be removed in the future                                                                                                                                                  |
 
 ## Details