Esquemas

bigquery

[
  {
    "name": "name_str",
    "mode": "NULLABLE",
    "type": "STRING",
    "description": null,
    "fields": []
  },
  {
    "name": "date_dt",
    "mode": "NULLABLE",
    "type": "DATE",
    "description": null,
    "fields": []
  },
  {
    "name": "count_str",
    "mode": "NULLABLE",
    "type": "STRING",
    "description": null,
    "fields": []
  },
  {
    "name": "count_int",
    "mode": "NULLABLE",
    "type": "INTEGER",
    "description": null,
    "fields": []
  }
]

firestore

{
    "fields": {
        "count_int": {
            "integerValue": 0
        },
        "count_str": {
            "stringValue": "0"
        },
        "date_dt": {
            "stringValue": "2024 at 1:12:54.005 PM UTC-5"
        },
        "name_str": {
            "stringValue": "name"
        },
    }
}

BASH

python3 -m virtualenv venv;
source venv/bin/activate;

pip install -r requirements.txt;

gcloud auth print-access-token;

python main.py;

• Test:

for i in {0..100};do python bq_main.py >> bq_responses.txt & sleep 0.5 ;done
for i in {0..100};do python fs_main.py >> fs_responses.txt & sleep 0.5 ;done

Resultados

• Biguqery rest -- US (100 en 5:39): 3.39s (read, update, read) 1s by one --- De 100 solo hizo update en 4 y muchas salieron con error -- US (100 en 4:10): 2.5s (read, update, read) 0.8s by one
• Firestore rest overflow -- nam5 (100 en 1:10): 0.7s (read, update, read) 0.2s by one -- us-east1 (100 en 0:26): 0.26s (read, update, read) 0.085s by one