Skip to content

1.4 gets rounded to 0 #3946

@jonasborneland

Description

@jonasborneland

The Problem

menu -> data -> recognition: Recognized Digit ROIs (previous round): 0.0, 0.0, 3.0, 1.0, 5.0, 1.4, 9.8, 9.6
So it recognized 1.4 correctly but Raw reads 00315.099
What is causing the 1.4 to be rounded to 0 ? and not 1

Version

v16.0.0

Logfile

[0d23h27m05s] 2025-10-21T17:11:36 <ERR> [POSTPROC] main: Raw: 00315.099, Value: , Status: Neg. Rate - Read: - Raw: 00315.099 - Pre: 315.176

Expected Behavior

menu -> data -> recognition: Recognized Digit ROIs (previous round): 0.0, 0.0, 3.0, 1.0, 5.0, 1.4, 9.8, 9.6
Expected Raw: 00315.199

Screenshots

No response

Additional Context

Config:
[PostProcessing]
main.DecimalShift = -3
;main.AnalogToDigitTransitionStart =
main.ChangeRateThreshold = 1
PreValueUse = true
PreValueAgeStartup = 720
main.AllowNegativeRates = false
main.MaxRateValue = 1
;main.MaxRateType = AbsoluteChange
main.ExtendedResolution = false
main.IgnoreLeadingNaN = false
ErrorMessage = true
main.CheckDigitIncreaseConsistency = false

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions