metadata broker feedback

[paromarc]

Hi,

I have been playing around with the metadata broker API and wanted to report some feedback.

Starting with the API docs --> https://axiscommunications.github.io/acap-documentation/docs/api/src/api/metadata-broker/html/standard_topics.html

The payload doesn't start with the "data" property --> {
"data": {
"frame": {
"timestamp": "2023-03-08T09:00:19.320111Z",
"observations": [

but instead from the "frame" property
"frame": {
"timestamp": "2023-03-08T09:00:19.320111Z",
"observations": [

I see my P3265 fw 11.9.60 is detecting Human, Cars but also Face.

In my app I am parsing the json payload --> ** Message: 12:59:31.623: type Face: bottom 0.127300, left 0.208600, right 0.224700, top 0.098600

I have also been playing around with the 'BestShot' feature and uploading the base64 image to an S3 bucket for testing.
My P3265 is facing a display looping the same image, but the best shot seems to be inconsistent. Sometimes I get the back of my body, sometimes the front, sometimes just my face (even though my app is specifying only 'human' type and not 'face').

I am attaching a quick video showing the behavior after watching the same video twice and getting different results.

Thanks!
Marco

MetadataBroker_BestShot.mp4

[pataxis]

Hi @paromarc , thanks for your feedback! Will send this to the team working with this API.

[kevin-barudde-work]

Hi i will summarise the meting notes here for other that have the same questions,

1. The documentation was wrong and is now fixed. (The data field was removed)
2. You can get other classes than what the documentation example show
3. The best snapshot feature is not deterministic for tracks

[Cacsjep]

Hey,

My camera has two producers, according to vapix list producers.
VideoMotionTracker and AnalyticsSceneDescription (ASD)

Since there are only topic for ASD I can only subscribe to this so the questions would be for ASD.

Questions:
1.Are this model runs 24/7 or only when I subscribe?
2. The accuracy of the scene model feels unreliable, as it often loses track when I remain seated in the scene for an extended period. Are there any improvements planned?

Thanks

[kevin-barudde-work]

Hi @Cacsjep!

1. The model only runs when someone want to use it, for example you subscribing
2. Currently stationary object in the scene are filtered

[Cacsjep]

@kevin-barudde-work thank you for your fast Response.

1. perfect made sense
2. In such a case, should "Consolidated" be used instead? Also, I’ve never come across this in the documentation—did I miss it, or is it just undocumented? this would imply that when i start subscription and there is a car or person in scene this is not detected because its stationary right? Is there a plan to made this opt out?

Thank u

[sguaqueta-work]

Hi @Cacsjep!

The information about the data payload only including moving objects is documented in the integration guidelines, but it should be more explicitly stated in other places as well. Thank you for the feedback.

The payload of consolidated metadata only includes moving items as well. Having said that, there are plans to include stationary objects in the output. May I ask you to share a bit more about the use case you are working with? Is there anything else apart from stationary objects that is missing?

[Cacsjep]

Hey @sguaqueta-work,

Thanks for clarifying that this currently only tracks moving objects. It wasn’t entirely clear to me initially, so updating the documentation would definitely be helpful.

It’s exciting to hear about plans to include stationary objects as well! Right now, I’m just estimating MDB and was curious why it loses tracks. Adding stationary object tracking would open up a lot of possibilities, like counting specific object classes in a scene, among other things.

I believe it would be great to give developers the flexibility to choose between tracking only moving objects or including stationary ones as well.

Do you have any information on when the MDB will move out of beta?

Thanks a lot!

[Cacsjep]

Is there a plan in future for a radar topic to subscribe?

[rywager]

Is there a plan to allow us to use MDB to detect only specific items like a face, and then be able to use a lower res larod and save resources, thus hopefully increasing it's efficacy?

Because as it stands, the latest MDB is very spotty with coverage, sometimes it reports a moving face then it ignores others, you restart and you get a burst of them, then it goes away etc..

I always notice whenever "top" load starts to grow to say 2+, or when vmem goes up is when you don't see anything from the MDB which makes it very unreliable.

[sguaqueta-work]

Hello @rywager ,
Thank you for reporting these issues. We would like to obtain some additional information from you to better understanding what might be causing the behaviors described. Could you please create a support case and include a complete server report from your device?

We are interested in obtaining some details from the device such as the camera model, AXIS OS version, and an image of the scene to understand the environment and placement of the camera.