If the device is new, or you have the box, you can check for the following sticker on the packaging, as well as inserts in the box.
Under "Device Info" the non-WiFi device will display Not Supported for the Wifi Version. The device with Wifi will list the actual version.
If you select display device settings and serial number > copy to clipboard in Device updater you will only see one difference. The WiFi version.
The WIFI and Non-WIFI devices are exactly the same with the exception of being able to update over WIFI.