Cumulative measurement

bdm · March 16, 2024, 11:19pm

hi,

I am trying to sum up the total hours spent in a geofence by a worker so i am measuring difference between each geofence out and geofence in and to have the cumulative result for the whole day i am using discrete statistics but the result coming out of discrete statistics is not logic, is there any other way to sump up multiple values received during the day other than discrete statistics?

Harald_Meyer · March 17, 2024, 8:20am

Hi,

you could create custom block that does the sum. This would be a fairly simple block. But Discrete Statistics is actually also quite simple. Here you can see an open-source version of the block:

github.com

SoftwareAG/analytics-builder-blocks-contrib/blob/master/blocks/DiscreteStatistics.mon

/*
 * $Copyright (c) 2020-2021 Software AG, Darmstadt, Germany and/or Software AG USA Inc., Reston, VA, USA, and/or its subsidiaries and/or its affiliates and/or their licensors.$
 * Use, reproduction, transfer, publication or disclosure is prohibited except as specifically provided for in your License Agreement with Software AG
 */

/*********
 * Note: this block is now available in 10.9.0.x or later of Analytics Builder as
 * part of the product.  The below is for reference use only, we recommend using
 * the product block where applicable.
 ********/

package apamax.analyticsbuilder.blocks;

using apama.analyticsbuilder.BlockBase;
using apama.analyticsbuilder.Activation;
using apama.analyticsbuilder.Value;
using apama.analyticsbuilder.TimerParams;
using com.apama.exceptions.Exception;
using apama.analyticsbuilder.L10N;
using apama.analyticsbuilder.Promise;

This file has been truncated. show original

Can you share how your model looks like? The “sample” and “reset” behavior of the block is a bit confusing so this could be the reason for the unexpected results

bdm · March 17, 2024, 9:51am

thanks, the model building blocks are:

duration: calculated the difference in seconds between one location update event and its next one (I added a measurement for testing for this phase and the numbers are accurate)
this number is converted into minutes using an expression and compared to a threshold (above 3), this one is also working correctly and breached is occurring correctly
If breached is true, a gate opens and the number in minutes of #2 will be an input to ‘discrete statistics’ providing SUM in order to have cumulation of inputs. ‘discrete statistics’ sample is not connected and reset is connected to a crontimer which resets it end of day (2AM UTC). The output is an accurate number the 1st time it is used and then it starts missbehaving when cumulating more inputs and ‘discrete statistics’ are greater than expected . Sometimes it seems adding a single input twice and sometimes the number is completely weird and unexpected.

Harald_Meyer · March 17, 2024, 10:45am

Could you share the exported model via a private message?

bdm · March 17, 2024, 7:40pm

I shared it now

bdm · March 24, 2024, 3:36pm

Hello, by the way we have a new finding related to the same model built in analytics builder:

we were facing inaccurate numbers (this time much less than expected) and after a long troubleshooting we found the following conclusion based on our simulations that we created for location updates

- if time of alarm (received from device and mentioned as “device time”) is greater than time of platform then the alarm is being processed by analytics model
- if time of alarm (received from device and mentioned as device time) is less than time of platform the alarm is discarded and not being processed by analytics model as if it happened in the past

it seems analytics model is processing alarms synchronously and when alarm time is before ‘cumulocity platform current time’ it is being dropped. Is it an accurate conclusion? and how much delay in seconds does cumulocity tolerate as an alarm delay? and how to tune it?