RaspberryMatic 3.59.6.20210703

[jens-maus]

This is release 3.59.6.20210703 of RaspberryMatic which is a major release with bugfixes and feature changes including the following changes:

_{Hier klicken für deutschsprachige 🇩🇪🇦🇹🇨🇭 Version des ChangeLogs/Diskussionsbeitrag}

🚧 Changes:

_{For all changes, see the full commit log.}

CCU/HomeMatic service changes:

• updated OCCU version to 3.59.6-1 integrating full compatibility to the CCU3 3.59.6 firmware which comes with the following changes:
  • An obsolete code passage was removed since it allowed to perform unauthorized "remote code executions" imposing a severe security whole.
  • HmIP-FSI16 - Instead of showing "Buttonpress short/long" the text "This channel has no functionality here" will be shown under "Status/Usage".
  • After performing changes to a heating group the WebUI will now return to the group display instead of returning to the general device overview.
  • Fixed a bug in the use of the config parameter "Action on powerup".
  • The ramp time of HmIP dimm actors could not be changed within WebUI programs if no switchon time was modified as well.
  • Bugfix of stalling WebUI dialog when swapping homematic devices via the WebUI.
  • Added support for new "Homematic IP Türschlossantrieb (HmIP-DLD)" device type.
  • Updated integrated HmIPW-DRAP firmware to version 2.2.24.
  • HmIP-WRC6 - For channels 1 to 6 a new config parameter ABORT_EVENT_SENDING_CHANNELS was added.
  • The text field for entering the frost control temperature was changed to a combobox for the HmIP BWTH, FAL and FALMOT devices.
  • The minimal temperature value was changed from 6.0 °C to 5.0 °C for certain HmIP thermostat devices.
  • The WebUI of entering the week program of HmIP dimmers was changed from using a combobox with fixes brightness values (in 5% steps) to using a text field. This should allow to enter brightness values from 0% to 100%.
  • The config parameter "valve switchover value" can now only be activated/changed for a HmIP-FALMOT in case the parameter "automatic switch from continious to PWM" is enabled.
  • HmIP-MP3P - Added the easymode profile "MP3 - on" for direct connections with push button devices. Now it is more easily possible to use this device as a simple door bell.
  • On easy mode connections between a HmIP dimm/switching actor and a HmIP motion sensor the type of retention time can now be selected.
• added network port settings to the Home Assistant Add-on for enabling a potentially installed CCU historian add-on to work correctly within Home Assistant (Historian in Respberrymatic in einer Homeassistant Umgebung #1313).
• fixed an issue where in case a /etc/config/rfd.conf file does not contain any [Interface 0] section while however a local rf module was found, rfd would never pickup the rf module for BidCos communication. Thus, we add a fresh "[Interface 0]" section in these cases now to get BidCos-RF running (cf. https://homematic-forum.de/forum/viewtopic.php?f=65&t=68169).
• added a bugfix in the Home Assistant ingress proxy (/bin/ha-proxy.js) which checks for the used character encoding in the response and then either converts the buffer stream to a string using utf8 or latin1 (Encoding Errors in HomeAssistant Addon #1264).

WebUI changes:

• added new 0124-WebUI-Fix-ShowMultipleSpacesInSysVar WebUI bug fix patch (add 0124-WebUI-Fix-ShowMultipleSpacesInSysVar #1311, WebUI: SysVar of type STRING with more than one consecutive space characters in its value is shown trimmed #1310, @jp112sdl)
• added new WebUI bugfix patch which fixes an issue with not allowing to enter 31 seconds or 31 minutes in the duration set dialog in webui due to a missing durationUnit check (Kanalaktion mit Einschaltdauer 31 Minuten nicht möglich #1306).
• added a sanitizing check for the /etc/config/firmware directory content so that invalid device firmware sub-directories won't result in a stalling WebUI anymore (Device Firmware Page stalls with invalid directories in place #1302, cf. https://homematic-forum.de/forum/viewtopic.php?p=667022).
• fixed issue in the 0097-WebUI-SetSysvarValueByUser WebUI patch which resulted in "malformed URI sequence" error messages to popup if a system variable contained some special characters and which requires to use unescape() accordingly (Systemvariable Typ String, lässt sich nicht korrekt bearbeiten wenn der String das Gradzeichen " ° " enthält #1286).
• we always use /usr/local/sdcard as a storagePath in the oci platform because there is no way in HA to mount an USB stick within an add-on due to hardware access restrictions.
• added some missing english translations for certain WebUI patches (At the General device settings there are some untranslated text. #1296).
• integrated new 0121-WebUI-ManualProgramExecutionWithConditionCheck (add 0121-WebUI-ManualProgramExecutionWithConditionCheck #1291, @jp112sdl, @Baxxy13).
• integrated a fix in the 0119-WebUI-Fix-ProofAndSetValue WebUI patch which should fix issues with displaying the device parameters for a HM-ES-TX-WM device due to incorrect getMin/MaxValue() function definitions (HM-ES-TX-WM - keine Parameter einstellbar #1290).
• added new 0121-WebUI-Fix-verifysid WebUI patch which fixes a potential security issue with verifysid.cgi being still available thought it is largely obsolete. Now the whole verifysid.cgi together with the only function in session.tcl still using it being retired for an improved security.

Operating system changes:

• updated the rpi-userland-aarch64 buildroot patch to latest HEAD version of the rpi-userland repository.
• added max filedescriptor checks to standard watchdog config so that monit will regularly check if a common process is about to exhaust its max. filedescriptor limit (Too many open files #1322).
• added more default MIB modules to the netsnmp build including the agent/extend module which should allow users to integrate extend based snmp definitions for various purposes (enhance net-snmp build options #1312).
• added filesystem flags checks for userfs and usb1 WatchDog checks so that upon a changed filesystem check an alarm will be triggered informing about a potential disk error (Watchdog-Alarm für schreibgeschütztes (möglicherweise defektes?) USB-Speichermedium integrieren #1320).
• added set -e to let createBackup.sh exit immediately upon an error. Furthermore cronBackup.sh now triggers a WebUI alarm in case the target dir could not be created if the executed createBackup.sh exits wit an error (Watchdog-Alarm für schreibgeschütztes (möglicherweise defektes?) USB-Speichermedium integrieren #1320).
• updated wiringpi-rpi package to use latest master sources which comes with compatibility for latest RaspberryPi Compute Module 4 hardware.
• added config options for improved compute module compatibility and added necessary device tree parameters/overlay for supporting the RTC of a CM4IO board as well.
• Updated generic_raw_uart module to latest version to integrated fixes and mitigate the unfaithful use of certain USB based rf module mockups like PB-HUL/PB-HULIP/HB-OCCU-USB/TRXC2-USB which are just commercialized clones of OpenHardware-based hardware solutions (Update generic_raw_uart module to latest version #1314, Update generic_raw_uart module to latest version #1304, @alexreinert, cf. https://homematic-forum.de/forum/viewtopic.php?f=65&t=68238, https://twitter.com/RaspberryMatic/status/1404782083793358849)
• added more RaspberryPi models to S01InitHost for proper recognition of the underlying hardware platform.
• bumped upstream kernel to 5.10.45
• added CONFIG_DAX and some other kernel options to enhance support for virtio-fs (cf. pc/ova: support virtio-fs home-assistant/operating-system#1400)
• removed the own copy of a aarch64/v8 binary of libNRJavaSerialv8.so since the HMIPServer.jar in OCCU 3.59.x+ now comes with the latest version of NRJavaSerial, thus also includes a 64bit aarch64 version of libNRJavaSerial. Thus, our workaround is not necessary anymore.
• slightly increased the minimal fan speed for >= 55 deg for the ArgonFAN to get rid of potential high frequency noises.
• updated RaspberryPi kernel+firmware to latest 1.20210527-1 tagged version.
• updated buildroot to latest 2021.05 and adapted patches accordingly.
• added iomem=relaxed to kernel bootargs of all platforms coming with wiringpi. This should fix Operation not permitted issues since we hardended the kernels for more secure DEVMEM. Now wiringpi should work again while still ensuring a high access security.
• added new rpi-rf-mod-rpi1 device tree overlay to rpi-rf-mod package and added it to our rpi0 platform generation. This should fix issues were on a RaspberryPi1 system no act-led (led0) node was generated in /sys/class/leds because of the default rpi-rf-mod.dtbo device tree overlay being partly invalid for a RaspberryPi1 due to the missing GPIO pins (LEDs (Heartbeat/SD access) not working as expected on Pi 1B (without "+") #1284).
• added support for /sys/fs/cgroup/cpu/cpu.rt_runtime_us checking to deploy.sh so that runtime shares will be added enough in the docker run.

👪 Contributors (alphabetically):

• @alexreinert
• @Baxxy13
• @jens-maus
• @jp112sdl

📝 Support:

For support on installation and help please visit the following web pages:

RaspberryMatic - Documentation 🇺🇸
RaspberryMatic - Discussions 🇺🇸
RaspberryMatic - Dokumentation 🇩🇪
RaspberryMatic - Forum 🇩🇪

📦 Download:

The following installation archives can be downloaded for different hardware platforms. To verify their integrity a sha256 checksum is provided as well. You can either upload these files using the WebUI-based update mechanism or unarchive them to e.g. flash the included *.img files on a fresh installation media (e.g. microSD card):

• RaspberryPi4 Model B, RaspberryPi Compute Module 4, RaspberryPi 400 – (installation):
  _{📦 RaspberryMatic-3.59.6.20210703-rpi4.zip
  SHA256: 6742db4519c28540d8cf22b9f64bb18df47f90ae59ae5b63050d52b169e2aa1f}

• CCU3, ELV-Charly, RaspberryPi3 Model B+, RaspberryPi3 Model B, RaspberryPi3 Model A+, RaspberryPi Compute Module 3, RaspberryPi Compute Module 3 lite – (installation):
  _{📦 RaspberryMatic-3.59.6.20210703-rpi3.zip
  SHA256: b5461200901820aed6028981b6d1b04594fbf931ecd87c0361ac328862b6cdce
  📦 RaspberryMatic-3.59.6.20210703-ccu3.tgz (only for initial CCU3 Firmware -> RaspberryMatic Upgrade)
  SHA256: 9cb072c51fe0702ff89b985fa5f5fa7015b01b957930249e9fefffea65bb94e8}

• RaspberryPi2 Model B – (installation):
  _{📦 RaspberryMatic-3.59.6.20210703-rpi2.zip
  SHA256: c76ae37fd411d6220144773617179b58e9c264b9e9e61ab85d31c28a5a918250}

• RaspberryPi Zero W, RaspberryPi Zero, RaspberryPi Compute Module 1, RaspberryPi1 (A+/B+) – (installation):
  _{📦 RaspberryMatic-3.59.6.20210703-rpi0.zip
  SHA256: 49c332966b47c649e77ede0fd907f339b3813dc80db27f1a48a44490c1ffe4c2}

• TinkerBoard S, TinkerBoard – (installation):
  _{📦 RaspberryMatic-3.59.6.20210703-tinkerboard.zip
  SHA256: f28039617c062e0feec0d9df7b32f63519fc61fd0af0e256478000e49b068ccc}

• ODROID-N2/N2+/C4/C2 – (installation):
  _{📦 RaspberryMatic-3.59.6.20210703-odroid-n2.zip
  SHA256: 518a60ce60b34e9a0e2720ba27459f8799752cb7be5159e1804ac78ca9a5f003
  📦 RaspberryMatic-3.59.6.20210703-odroid-c4.zip
  SHA256: 661de460c1e7135f42bc41e17bf6e6123d6e9860da8fbb6a930f4eb3514ec5a1
  📦 RaspberryMatic-3.59.6.20210703-odroid-c2.zip
  SHA256: 1d56cd0530d02f680fa6bf7379a896dd736cfb3f96c66fbf1f18d3acdebd1d1c}

• Intel NUC – (installation):
  _{📦 RaspberryMatic-3.59.6.20210703-intelnuc.zip
  SHA256: 5dc2d29a31cef5086c99ef873c4076b3b16f82da95b819a7a8ecfb5b58cbe87c}

• Open Virtual Appliance (OVA) – (ESXi, Proxmox, VirtualBox, Synology, QNAP, Workstation Player, QEmu, HyperV):
  _{📦 RaspberryMatic-3.59.6.20210703-ova.zip
  SHA256: e5f4144a9cff37edc68eb137b8b937e8c716ffe125cee3992e410704104fcd54
  📦 RaspberryMatic-3.59.6.20210703.ova (only for initial OVA installation)
  SHA256: f37eae07eb696a52c56366735b242c3abb97bff2b2b73f7ad0458656daa10391}

• Docker / Open Container Initiative (OCI) – virtual appliance (installation):
  _{📦 RaspberryMatic-3.59.6.20210703-oci_amd64.tgz (amd64/x86_64)
  SHA256: 10809869e9b98723c100267773134c38e2aa3ccae643e50a067226ea2104dada
  📦 RaspberryMatic-3.59.6.20210703-oci_arm64.tgz (arm64/aarch64)
  SHA256: 6954cf55493e6abf82790a19622e612def4170b5658c49109833464bf6c7b1fd
  📦 RaspberryMatic-3.59.6.20210703-oci_arm.tgz (arm/armhf)
  SHA256: 04c0dcdb4cb9a00402df2b483997ea1eace2727b2853b92cc0f1503f77963f6f}

• Kubernetes / K8s – virtual appliance:
  _{see install documentation}

• Home Assistant Add-on – virtual appliance:
  _{see install documentation}

---

This discussion was created from the release RaspberryMatic 3.59.6.20210703.