get_entity_list should ignore bad entity if the validation is failing

[djs0109]

Filip will validate every entity in the returned list against 1) data value and type 2) unit specified as metadata. If any of this validation does not work, filip will abort and raise an error.

Expected behavior

Filip can give a warning, on what entity is failing the validation, and still return the rest valid entities.

To reproduce

import json
import requests
from filip.clients.ngsi_v2 import ContextBrokerClient
from filip.models.base import FiwareHeader
from filip.models.ngsi_v2 import ContextEntity
from filip.utils.cleanup import clear_context_broker

orion_url = "http://...:1026"

fiware_header = FiwareHeader(service="filip_374", service_path="/")
cbc = ContextBrokerClient(
    url=orion_url,
    fiware_header=fiware_header)
clear_context_broker(cb_client=cbc)

# Send bad entities to the Context Broker
entity_wrong_value_type = {
    "id": "test:weather_station_1",
    "type": "WeatherStation",
    "temperature": {"type": "Number", "value": "Error"}
}

entity_wrong_unit = {
    "id": "test:weather_station_2",
    "type": "WeatherStation",
    "temperature": {"type": "Number",
                    "value": 20,
                    "metadata":
                        {"unitCode":
                             {"type": "Text",
                              "value": "Error"}
                         }
                    }
}

headers = {
  'fiware-service': 'filip_374',
  'fiware-servicepath': '/',
  'Content-Type': 'application/json'
}

for entity in [entity_wrong_value_type, entity_wrong_unit]:
    payload = json.dumps(entity)
    url = f"{orion_url}/v2/entities"
    response = requests.request("POST", url, headers=headers, data=payload)
    print(response.text)

# send dummy valid entities to the Context Broker
entities_valid = [ContextEntity(id=f"test374:Entity:{i}", type="Test") for i in range(10)]
cbc.update(entities=entities_valid, action_type="append")

# TODO the bad entities will block the whole request
entities = cbc.get_entity_list()

[github-actions]

Branch 374-get_entity_list-should-ignore-bad-entity-if-the-validation-is-failing created!

[djs0109]

The ignore validation feature should also be added to "delete" endpoint