SMR-CZ-040W-WIF-16A-POW-US - Have 12 on Networks, but latest additions not seen

[MarkCupitt]

Hi All, I have a bunch of Switches SMR-CZ-040W-WIF-16A-POW-US on my network. Up until recently, I have been seeing them in tiny-tuya.

I started adding additional switches last couple of days, SmartLife sees and controls them happily, they are in iot.tuya.com quite happily, they are downloaded in devices.json, I see them with an Ip Address in my DHCP Server quite happily, but the tinytuya scan does not see the newer Ones

I have tried using a 120 second timeout

It seems that all newer ones are not seen, and a couple of older ones are not seen by tinytuya

I double checked taht all my devices were on the same subnet as well

Here are two screenshots of the same model, one that is seen and one that is not

Its almost like there is a limit on the number of a specific model that can be scanned, but I cannot see anything like that in the code

Any thoughts, happy to debug, but not quite sure where to start

Many thanks

[MarkCupitt]

This is the JSON from devices.json for the device that is not seen by the scan

    {
        "name": "Fridge Main",
        "id": "ebcc2d8e4d9b52cc22eeq1",
        "key": "y7omD3+e09m.fBx2",
        "mac": "c4:82:e1:4f:80:2a",
        "uuid": "f623f3641a809b39",
        "category": "cz",
        "product_name": "smart plug",
        "product_id": "uqehhcrmk5depvtl",
        "biz_type": 18,
        "model": "\u767e\u89c6\u76fe\u8ba1\u91cf",
        "sub": false,
        "icon": "https://images.tuyaus.com/smart/icon/ay15107356719526e3ps/f1d0c8ad0822636028bd9117522687db.png",
        "mapping": {
            "1": {
                "code": "switch_1",
                "type": "Boolean",
                "values": {}
            },
            "9": {
                "code": "countdown_1",
                "type": "Integer",
                "values": {
                    "unit": "s",
                    "min": 0,
                    "max": 86400,
                    "scale": 0,
                    "step": 1
                }
            },
            "17": {
                "code": "add_ele",
                "type": "Integer",
                "values": {
                    "unit": "kwh",
                    "min": 0,
                    "max": 50000,
                    "scale": 3,
                    "step": 100
                }
            },
            "18": {
                "code": "cur_current",
                "type": "Integer",
                "values": {
                    "unit": "mA",
                    "min": 0,
                    "max": 80000,
                    "scale": 0,
                    "step": 1
                }
            },
            "19": {
                "code": "cur_power",
                "type": "Integer",
                "values": {
                    "unit": "W",
                    "min": 0,
                    "max": 200000,
                    "scale": 1,
                    "step": 1
                }
            },
            "20": {
                "code": "cur_voltage",
                "type": "Integer",
                "values": {
                    "unit": "V",
                    "min": 0,
                    "max": 5000,
                    "scale": 1,
                    "step": 1
                }
            },
            "38": {
                "code": "relay_status",
                "type": "Enum",
                "values": {
                    "range": [
                        "power_off",
                        "power_on",
                        "last"
                    ]
                }
            },
            "39": {
                "code": "light_mode",
                "type": "Enum",
                "values": {
                    "range": [
                        "relay",
                        "pos",
                        "none"
                    ]
                }
            },
            "40": {
                "code": "child_lock",
                "type": "Boolean",
                "values": {}
            },
            "41": {
                "code": "cycle_time",
                "type": "String",
                "values": "{}"
            },
            "42": {
                "code": "random_time",
                "type": "String",
                "values": "{}"
            },
            "43": {
                "code": "switch_inching",
                "type": "String",
                "values": "{}"
            },
            "51": {
                "code": "overcharge_switch",
                "type": "Boolean",
                "values": {}
            }
        },
        "ip": "",
        "version": ""
    },
    ```
    
    This is the JSON for the same model Plug, bought together that IS seen in the scan
    
    ```
        {
        "name": "Fridge Backup",
        "id": "eb462657f66ad83c67avat",
        "key": "^uxEG^oFsKI-j/a'",
        "mac": "c4:82:e1:96:43:7d",
        "uuid": "732c330c2d9a647c",
        "category": "cz",
        "product_name": "Smart plug",
        "product_id": "o7ve1lp3gfjvsvyo",
        "biz_type": 18,
        "model": "BP20V4",
        "sub": false,
        "icon": "https://images.tuyaus.com/smart/icon/non-session-user/1655258627f3c9dadb5e2.png",
        "mapping": {
            "1": {
                "code": "switch_1",
                "type": "Boolean",
                "values": {}
            },
            "9": {
                "code": "countdown_1",
                "type": "Integer",
                "values": {
                    "unit": "s",
                    "min": 0,
                    "max": 86400,
                    "scale": 0,
                    "step": 1
                }
            },
            "17": {
                "code": "add_ele",
                "type": "Integer",
                "values": {
                    "min": 0,
                    "max": 50000,
                    "scale": 3,
                    "step": 100
                }
            },
            "18": {
                "code": "cur_current",
                "type": "Integer",
                "values": {
                    "unit": "mA",
                    "min": 0,
                    "max": 30000,
                    "scale": 0,
                    "step": 1
                }
            },
            "19": {
                "code": "cur_power",
                "type": "Integer",
                "values": {
                    "unit": "W",
                    "min": 0,
                    "max": 80000,
                    "scale": 1,
                    "step": 1
                }
            },
            "20": {
                "code": "cur_voltage",
                "type": "Integer",
                "values": {
                    "unit": "V",
                    "min": 0,
                    "max": 5000,
                    "scale": 1,
                    "step": 1
                }
            },
            "38": {
                "code": "relay_status",
                "type": "Enum",
                "values": {
                    "range": [
                        "power_off",
                        "power_on",
                        "last"
                    ]
                }
            },
            "39": {
                "code": "overcharge_switch",
                "type": "Boolean",
                "values": {}
            },
            "40": {
                "code": "light_mode",
                "type": "Enum",
                "values": {
                    "range": [
                        "relay",
                        "pos",
                        "none"
                    ]
                }
            },
            "41": {
                "code": "child_lock",
                "type": "Boolean",
                "values": {}
            },
            "42": {
                "code": "cycle_time",
                "type": "String",
                "values": "{}"
            },
            "43": {
                "code": "random_time",
                "type": "String",
                "values": "{}"
            },
            "44": {
                "code": "switch_inching",
                "type": "String",
                "values": "{}"
            }
        },
        "ip": "192.168.2.182",
        "version": "3.4"
    },
    ```
    
    I checked My DHCP Server (using the MAC Addresses)
    
   Fridge Main has an IP address of 192.168.2.173
   Fridge Backup has an Ip address of  192.168.2.182
   
    

[uzlonewolf]

Hi @MarkCupitt,

First, have you made sure the Smart Life app and any other Tuya implementations (LocalTuya, HomeAssistant, etc) are closed? A lot of devices stop broadcasting once a connection is established.

What version of TinyTuya do you have? python3 -m tinytuya -h will tell you.

Have you tried running a force scan? python3 -m tinytuya scan -f

If those don't work then does a scan with debug enabled show anything? python3 -m tinytuya scan -d

[MarkCupitt]

@uzlonewolf .. Yes to all except the debug, here are the results

Sent error output to a file then searched the file for the device id ebcc2d8e4d9b52cc22eeq1 (Which is the Fridge Main in devices.json) and that string is not shown in the output at all

Coudl it be that tinytuya is ignoring it form the devices.json??

I notice that it does not have a "version" attribute in the json which is a little weird as others that work do

[MarkCupitt]

@uzlonewolf I also did the same process with the -force option, that device id does not appear in the output anywhere

[uzlonewolf]

So, what version of TinyTuya do you have? Nvm, I see in the screenshot it's 1.14.0

Does the debug output say anything about "Unexpected payload from ...", "Invalid UDP Packet from ...", or being unable to decode something?

[MarkCupitt]

Ill check that tomorrow, thanks

[MarkCupitt]

@uzlonewolf I noticed this in tinytuya scanner.,py, shodul I uncomment?

# Optional libraries required for forced scanning
#try:
#    from getmac import get_mac_address
#    SCANLIBS = True
#except:
#    SCANLIBS = False

[MarkCupitt]

Did a pip install getmac and uncommented, then did a force scan again, same result, taht device id is not in teh output

[uzlonewolf]

That was from an attempt at finding the MAC address for discovered devices. It was removed because it was extremely slow and didn't really work well with some of the new options such as force scanning. I should probably delete it completely...

[MarkCupitt]

@uzlonewolf

Scanner.py, around line 182, Im wondering if teh empty version is forcing a "3.1" an dit needs a 3.5

        if not self.deviceinfo['version']:
            self.deviceinfo['version']  = 3.1

[MarkCupitt]

Tried forcing the versions .. 3.1, 3.2, 3.3, 3.4, also added in the actual Ip address in devices.json from DHCP, like this,

        "ip": "192.168.2.173",
        "version": "3.4"

No Joy

[uzlonewolf]

The scanner does not read "ip" or "version" from devices.json, it tries to detect both via device broadcast packets and/or a force scan.

Since you already know the IP and version, does the monitor example https://github.com/jasonacox/tinytuya/blob/master/examples/monitor.py work?

[MarkCupitt]

Ill try this tomorrow .. Thanks

[MarkCupitt]

@uzlonewolf I have two Public Ip addresses, (2 Starlinks on a LB Router), I see the Fridge backup is on a 14.1.64.* address when I check teh network on teh app, nut the Fridge Main which tinytuya cannot see is on a 65.* network

Im not sure how the UDP listening is configured, but there would be different gateways I guess

COudl this be related??

[MarkCupitt]

ANother thing I noticed is that of all teh same devices I purchased, soe are showing in devices.json as Version 3.4, amd sopm,e are showing as version "", however the ones taht tinytuya sees, seems ot be detecting V 3.5

[MarkCupitt]

Ok, cool, Ill try that now @uzlonewolf thanks on the force scan .. I did not realize that .. good info

[uzlonewolf]

If you want a fixed force-scan you can check out #511

[MarkCupitt]

@uzlonewolf OK, I ran monitor.py and was able to get a status from a device that does not show in the web app as On Line, here is the config I used ..

d = tinytuya.OutletDevice('eb52c2498cf7af8fdeq7p2', '192.168.2.106', '-4[<i7I}B+3.jO:4', version=3.5, persist=True)

V3.4 returned an error to check the device key and version

Given the number of non alpha chars in the device key, could that be the issue, tinytyua does not deal with them, or one of them, maybe the colon is upsetting it??

I don't quite understand it all, I presume the scan just looks for packets on the way out, but the force will try and actively ping the device direct, if force is not working, then maybe why we did not see the devices..

I'm still a little confused, given that the device is emitting a status when asked so why is it not being seen? Version issue??

[MarkCupitt]

@uzlonewolf I picked up your forcescan fixes, and gave it a try, and no change on my issue, HOWEVER ... I noticed this

Versions: 3.1: 1, 3.3: 8, 3.4: 22 in the output

I know for a fact that the devices with issues are V 3.5 (there are 5 of them) and it seems to be either not trying that version, or getting some error that is not reported in the logs

The Web Interface reports Versions: 3.1: 1, 3.3: 8, 3.4: 22 Force Scan reports Scan Complete! Found 31 devices., the difference is, TaDa, 5 devices short in the force scan

Log FIle
force.log

[MarkCupitt]

@jasonacox @uzlonewolf Yep, I actually had disabled wifi for my phone with Smartlife on it, and restarted all the devices.

The pull request does address the 3.5 issue which was the root cause of my issue, and I accept that the devices are "different" and do something different with Broadcast packets.

Ill adjust my use case to work with this approach as I will know the IP addresses and can access them directly. Im comfortable with that, so I would say the PR is Ok

Thanks for the prompt fixes and responses, they are very much appreciated

[jasonacox]

Thanks, I'm going to merge and publish. Thanks for raising this @MarkCupitt and for your tests and collaboration!

[MarkCupitt]

Just FYI, my approach will be something like the following:

Add New Device
Make DHCP allocated device IP static, so it is always known, and have a map of devices to IPs somewhere
Use TinyTuya Wizard to scan and get active devices, continually, so snapshot.json is always current
Any devices showing offline, ie: is not in snapshot.json (or grab list via an API call to tinytuya) use something like monitor.py to actively poll the device to determine if it is on line

There may be a need to access the Tuya API directly for some devices, like sensors that only emit occasionally, I am still looking into this

I will probably need another map file to keep this all together

Once I am able to access all the known devices, I will poll them on specific intervals, with the interval determined by a value in the map file to get status and publish to MQTT for consumption in my Farm Management System

I am doing this because I have Weather, Solar Inverter, and Battery Systems I also monitor via MQTT and want to build an integrated management system. I was using HA, but I have not found it to be too unreliable for my needs

Ill likely share what I have done via PR's, Ill try an bundle it as a separate service, if any interest you will be welcome to include it in tinytuya

[uzlonewolf]

Just curious, if you run this in one terminal:

import tinytuya
import socket
import time

bcast = b'{"from":"app","ip":"192.168.2.1"}'


bcast_port = 7000
bcast_to = '255.255.255.255'
bcast_idx = 0
bcast_cmd = 0x25
bcast_retcode = None

bsock = socket.socket(socket.AF_INET, socket.SOCK_DGRAM) # UDP
bsock.setsockopt(socket.SOL_SOCKET, socket.SO_BROADCAST, 1)

while True:
    bcast_msg = tinytuya.TuyaMessage( bcast_idx, bcast_cmd, bcast_retcode, bcast, 0, True, tinytuya.PREFIX_6699_VALUE, True )
    bcast_data = tinytuya.pack_message( bcast_msg, hmac_key=tinytuya.udpkey )
    print("broadcast encrypted=%r" % bcast_data.hex() )
    bsock.sendto( bcast_data, (bcast_to, bcast_port) )
    time.sleep(5)

Does python3 -m tinytuya scan in another then pick up those missing devices?