13.0.8

Home Assistant MQTT Discovery Support

Update Procedure

‼️ Make sure to read the instructions below carfully!

1. Backup your configuration (use the System -> Backup/Restore page)!

2. You should update to 12.0.1 before you update to this release. All other migrations are untested.

3. Upload and update the update-*.zip file from this release.

4. Let it restart and check on the System -> Info page that the Firmware as well as the Web UI got updated. If only one got updated, redo the update. If it fails several times, you also can update the Firmware and the Web UI separately.

5. Safe way:

   1. Update first the firmware.bin (extract it from one of the provided zip files) and do the Reboot
   2. Update with the full zip file (update-*.zip, ignore the version warning after the reboot)

6. Please go to Settings -> Configuration and address the changed parameters:

   • DataLogging (storing the values for data graph)
   • Debug (extended by different debug reporting levels)

7. Make sure it starts to do the digitalization (check the Error field on the overview page). If it does not start a round within a minute, restart the device.

If anything breaks you can try to enforce manual update as following:

OTA:
1. Make sure the last run of the update completed the Uploading step.
1. Call http://<IP>/ota?task=update&file=<UPLOAD_FILENAME> to enforce the extraction/flashing.

Initial Setup:
1. Use the initial_esp32_setup.zip ( https://github.com/jomjol/AI-on-the-edge-device/wiki/Installation ) as alternative to have a clean install.

Added

• Implementation of Home Assistant MQTT Discovery

• Improved ROIs configuration: locked ROI geometry, equidistant delta x

• Improved OTA Update mechanism (only working after installation for next update)

• Added data logging in /log/data - One day per file and each measurement is on one line

  • Format: csv - comma separated
  • Content: time, name-of-number, raw-value, return-value, pre-value, change-rate, change-absolute, error-text, cnn-digital, cnn-analog

• Show graph of values direct in the user interface (thanks to @rdmueller)

  • Using new data logging (see above)
  • Possibility to choose different values and switch between different numbers (if present)

  Note: You need to activate data logging for this feature to work, see above!

• PreValue is now contained in /json (#1154)

• SD card info into the System>Info menu (thanks to @Slider007)

• Version check (Firmware vs. Web UI)

• Various minor new features

Changed

• Updated tflite (dig-cont_0600_s3.tflite)
• Updated OTA functionality (more robust, but not fully bullet prove yet)
• Updated Espressif library to [email protected]
• #1176 accept minor negative values (-0.2) if extended resolution is enabled
• #1143 added config parameter AnalogDigitalTransitionStart. It can setup very early and very late digit transition starts.
• New version of dig-class100 (v1.4.0): added images of heliowatt powermeter
• NEW v13.0.2: Update Tool "Logfile downloader and combiner" to handle the new csv file format.
• NEW v13.0.2: MQTT: Added MQTT topic status (Digitalization Status), Timezone to MQTT topic timestamp.#
• NEW v13.0.2: Logging: Disable heap logs by default, cleanup
• NEW v13.0.7:
  • log NTP server name
  • Improved log messages
  • Various preparations for next release
• NEW v13.0.8:
  • Continue booting on PSRAM issues, Web UI will show an error
  • Updated models
  • Various UI enhancements
  • Various internal improvements
  • Show uptime in log
  • Show uptime and round on overview page

Fixed

• #1116 precision problem at setting prevalue
• #1119 renamed firmware.bin not working in OTA
• #1143 changed postprocess for analog->digit (lowest digit processing)
• #1280 check ROIs name for unsupported characters
• #983 old log files did not get deleted
• Failed NTP time sync during startup gets now retried every round if needed
• Whitespaces and = in MQTT and InfluxDB passwords
• Various minor fixes and improvements
• NEW v13.0.2: Corrected Version comparison between firmware and Web UI.
• NEW v13.0.3: Re-updated build environment to v5.2.0 (from accidental downgrad to v4.4.0)
• NEW v13.0.4: Fix for reboot in case of MQTT not used
• NEW v13.0.5: No reboot in case of missing NTP-connection
• NEW v13.0.7:
  • Prevent autoreboot on cam framebuffer init error
  • Properly protect wlan.ini against deletion
  • Fixed various MQTT topic content issues
  • Fix Digit detected as 10 (#1525)
  • Fix frozen time in datafile on error
  • Various minor fixes
• NEW v13.0.8:
  • Fix Rate Problem (#1578, #1572)
  • Stabilized MQTT
  • Fixed redundant calls in OTA
  • Block REST API calls till resource is ready
  • Fixed number renaming (#1635)

Removed

• n.a.

12.0.1

Improve user experience

‼️ The release breaks a few things in OTA update ‼️

Make sure to read the instructions below carfully!.

1. Backup your configuration (use the System > Backup/Restore page)!
2. You should update to 11.3.1 before you update to this release. All other migrations are not tested.
   Rolling newer than 11.3.1 can also be used, but no guaranty.
3. Upload and update the firmware.bin file from this release. but do not reboot
4. Upload the html-from-11.3.1.zip in html upload and update the web interface.
5. Now you can reboot.

If anything bricks you can try to

1. Call http://<IP>/ota?task=update&file=firmware.bin resp. http://<IP>/ota?task=update&file=html.zip if the upload successed but the extraction failed.
2. Use the initial_esp32_setup.zip ( https://github.com/jomjol/AI-on-the-edge-device/wiki/Installation ) as alternative.

Added

• Automatic release creation
• Newest firmware of rolling branch now automatically built and provided in Github Actions Output (developers only)
• #1068 New update mechanism:
  • Handling of all files (zip, tfl, tflite, bin) within in one common update interface
  • Using the update.zip from the Release page
  • Status (upload, processing, ...) displayed on Web Interface
  • Automatical detection and suggestion for reboot where needed (Web Interface updates only need a page refresh)
  • ‼️ Best for OTA use Firefox. Chrome works with warnings. Safari stuck in upload.

Changed

• Integrated version info better shown on the Info page and in the log
• Updated menu
• Update used libraries (tflite, esp32-cam, esp-nn, as of 20220924)

Fixed

• #1092 censor passwords in log outputs
• #1029 wrong change of checkDigitConsistency now working like releases before 11.3.1
• Spelling corrections (cristianmitran)

Removed

• Remove the folder /firmware from GitHub repository.
  If you want to get the latest firmware.bin and html.zip files, please download from the automated build action or release page

11.3.1 - Intermediate Digits

‼️ ATTENTION ‼️

1. First update the 'firmware.bin' and ensure that the new version is running.
2. Only afterwards update the 'html.zip'.

Otherwise the downwards compatibility of the new counter clockwise feature is not given and you end in a reboot loop, that needs manual flashing!

Changes

• NEW v11.3.1: corrected corrupted asset firmware.bin (v11.3.0).
• Increased precision (more than 6-7 digits)
• Implements Counter Clockwise Analog Pointers
• Improved post processing algorithm
• Debugging: intensive use of testcases
• MQTT: improved handling, extended logging, automated reconnect
• HTML: Backup Option for Configuration
• HTML: Improved Reboot
• HTML: Update WebUI (Reboot, Infos, CPU Temp, RSSI)
• This version is largely also based on the work of caco3, adellafave, haverland, stefanbode, PLCHome

Looking for the partition.bin or bootloader.bin?

Use the ones from https://github.com/jomjol/AI-on-the-edge-device/releases/tag/v11.2.0

11.2.0 - Intermediate Digits

• Updated Tensorflow / TFlite to newest tflite (version as of 2022-07-27)
• Updated analog neural network file (ana-cont_11.3.0_s2.tflite - default, ana-class100_0120_s1_q.tflite)
• Updated digital neural network file (dig-cont_0570_s3.tflite - default, dig-class100_0120_s2_q.tflite)
• Added automated filtering of tflite-file in the graphical configuration (thanks to @caco3)
• Updated consistency algorithm & test cases
• HTML: added favicon and system name, Improved reboot dialog (thanks to @caco3)

11.1.1 - Intermediate Digits

• New and improved consistency check (especially with analog and digital counters mixed)
• Bug Fix: digital counter algorithm

11.0.1 - Intermediate Digits

• NEW v11.0.1: Bug Fix InfluxDB configuration (only update of html.zip necessary)
• Implementation of new CNN types to detect intermediate values of digits with rolling numbers
  • By default the old algo (0, 1, ..., 9, "N") is active (due to the limited types of digits trained so far)
  • Activation can be done by selection a tflite file with the new trained model in the 'config.ini'
  • Details can be found in the wiki (different types, trained image types, naming convention)
• Updated neural network files (and adaption to new naming convention)
• Published a tool to download and combine log files - **Thanks to **
  • Files see '/tools/logfile-tool', How-to see wiki
• Bug Fix: InfluxDB enabling in grahic configuration

10.6.1 - Stability Increase

• NEW 10.6.1: Revoke esp32cam & tflite update
• NEW 10.6.1: Bug Fix: tflite-filename with ".", HTML spelling error
• IndluxDB: direct injection into InfluxDB - thanks to wetneb
• MQTT: implemented "Retain Flag" and extend with absolute Change (in addition to rate)
• config.ini: removal of modelsize (readout from tflite)
• Updated analog neural network file (ana1000s2.tflite) & digital neural network file (dig1400s2q.tflite)
• TFMicro/Lite: Update (espressif Version 20220716)
• Updated esp32cam (v20220716)
• ESP-IDF: Update to 4.4
• Internal update (CNN algorithm optimizations, reparation for new neural network type)
• Bug Fix: no time with fixed IP, Postprocessing, MQTT

10.6.0 - Stability Increase

• InfluxDB: direct injection into InfluxDB - thanks to wetneb
• MQTT: implemented "Retain Flag" and extend with absolute Change (in addition to rate)
• config.ini: removal of modelsize (readout from tflite)
• Updated analog neural network file (ana1000s2.tflite) & digital neural network file (dig1400s2q.tflite)
• TFMicro/Lite: Update (espressif Version 20220716)
• Updated esp32cam (v20220716)
• ESP-IDF: Update to 4.4
• Internal update (CNN algorithm optimizations, reparation for new neural network type)
• Bug Fix: no time with fixed IP, Postprocessing, MQTT

10.5.2 - Stability Increase

• NEW 10.5.2: Bug Fix: wrong firmware.bin (no rate update)
• NEW 10.5.1: Bug Fix: wrong return value, rate value & PreValue status, HTML: SSID & IP were not displayed
• MQTT: changed wifi naming to "wifiRSSI"
• HTML: check select able values for consistency
• Refactoring of check postprocessing consistency (e.g. max rate, negative rate, ...)
• Bug Fix: corrected error in "Check Consistency Increase"

10.4.0 - Stability Increase

• Graphical configuration: select available neural network files (*.tfl, *.tflite) from drop down menu
  • OTA-update: add option to upload tfl / tflite files to the correct locatioin (/config/)
• Added Wifi RSSI to MQTT information
• Updated analog neural network file (ana-s3-q-20220105.tflite)
• Updated digital neural network file (dig-s1-q-20220102.tflite)
• Updated build environment to Espressif 3.5.0