Alpheios.net.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Alpheios.net implementation demo\n",
    "===\n",
    "\n",
    "The Alpheios.net implementation runs on Capitains.org software suite using [Nautilus](http://github.com/capitains/nautilus).\n",
    "\n",
    "## Configuration\n",
    "\n",
    "The following cells are used to avoid rewriting too many cells if the address of the DTS API were to change.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "import requests\n",
    "import requests_cache\n",
    "from urllib.parse import urljoin\n",
    "\n",
    "URI = \"http://texts.alpheios.net/api/dts\""
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Getting the available endpoints\n",
    "\n",
    "DTS entry point is a listing of the available endpoints and their URLs. This means that for each implementation of DTS, this single URL will give you all the information you need to perform arbitrary queries. The Alpheios Capitains implementation provides the three endpoints :"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'@context': 'dts/EntryPoint.jsonld',\n",
       " '@type': 'EntryPoint',\n",
       " 'navigation': '/api/dts/navigation',\n",
       " 'collections': '/api/dts/collections',\n",
       " '@id': '/api/dts',\n",
       " 'documents': '/api/dts/document'}"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "entry_request = requests.get(URI)\n",
    "ENDPOINTS = entry_request.json()\n",
    "ENDPOINTS"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As you can see, all three endpoints have been given URIs. Because we do not know the text we want to see, we'll browse from here :"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Browsing the root of the catalog\n",
    "\n",
    "The root of the data catalog is the result of the basic GET request on the `collections` endpoint :"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'@context': {'dts': 'https://w3id.org/dts/api#',\n",
       "  '@vocab': 'https://www.w3.org/ns/hydra/core#'},\n",
       " '@type': 'Collection',\n",
       " 'totalItems': 3,\n",
       " 'title': 'None',\n",
       " '@id': 'default',\n",
       " 'member': [{'totalItems': 3,\n",
       "   'title': 'Classical Latin',\n",
       "   '@id': 'urn:alpheios:latinLit',\n",
       "   '@type': 'Collection'},\n",
       "  {'totalItems': 4,\n",
       "   'title': 'Ancient Greek',\n",
       "   '@id': 'urn:alpheios:greekLit',\n",
       "   '@type': 'Collection'},\n",
       "  {'totalItems': 3,\n",
       "   'title': 'Classical Arabic',\n",
       "   '@id': 'urn:alpheios:arabicLit',\n",
       "   '@type': 'Collection'}]}"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ROOT_COLLECTION  = requests.get(urljoin(URI, ENDPOINTS[\"collections\"])).json()\n",
    "ROOT_COLLECTION"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The root collection has 3 items : 1 in Ancient Greek, 1 in Classical Arabic, 1 in Classical Latin. Let's go see the one for Classical Latin."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Requesting a specific collection\n",
    "\n",
    "Requesting a specific collection is simple : you go to the Collections endpoint, add the parameter `id` with the `@id` property of your item.\n",
    "\n",
    "### LatinLit\n",
    "\n",
    "We first want to get the LatinLit collection : it will be at the URI http://texts.alpheios.net/api/dts/collections?id=urn:alpheios:latinLit"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'dts:extensions': {'ns2:prefLabel': [{'@value': 'Classical Latin',\n",
       "    '@language': 'eng'},\n",
       "   {'@value': 'Latin Classique', '@language': 'fre'}]},\n",
       " '@context': {'dts': 'https://w3id.org/dts/api#',\n",
       "  'ns2': 'http://www.w3.org/2004/02/skos/core#',\n",
       "  '@vocab': 'https://www.w3.org/ns/hydra/core#'},\n",
       " '@type': 'Collection',\n",
       " 'totalItems': 3,\n",
       " 'title': 'Classical Latin',\n",
       " '@id': 'urn:alpheios:latinLit',\n",
       " 'member': [{'totalItems': 1,\n",
       "   'title': 'Catullus',\n",
       "   '@id': 'urn:cts:latinLit:phi0472',\n",
       "   '@type': 'Collection'},\n",
       "  {'totalItems': 1,\n",
       "   'title': 'Propertius, Sextus',\n",
       "   '@id': 'urn:cts:latinLit:phi0620',\n",
       "   '@type': 'Collection'},\n",
       "  {'totalItems': 1,\n",
       "   'title': 'Ovid',\n",
       "   '@id': 'urn:cts:latinLit:phi0959',\n",
       "   '@type': 'Collection'}]}"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "LatinLit  = requests.get(urljoin(URI, ENDPOINTS[\"collections\"]+\"?id=urn:alpheios:latinLit\")).json()\n",
    "LatinLit"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Ovid\n",
    "\n",
    "See the `dts:extensions` property ? It seems that our collection has 2 `skos:prefLabel` in two languages : Classical Latin for English, Latin Classique in French !\n",
    "\n",
    "But wait ! Another collection"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'dts:extensions': {'ns1:prefLabel': [{'@value': 'Ovid', '@language': 'eng'}],\n",
       "  'cts:groupname': [{'@value': 'Ovid', '@language': 'eng'}]},\n",
       " '@context': {'ns1': 'http://www.w3.org/2004/02/skos/core#',\n",
       "  '@vocab': 'https://www.w3.org/ns/hydra/core#',\n",
       "  'dts': 'https://w3id.org/dts/api#',\n",
       "  'cts': 'http://chs.harvard.edu/xmlns/cts/'},\n",
       " '@type': 'Collection',\n",
       " 'totalItems': 1,\n",
       " 'title': 'Ovid',\n",
       " '@id': 'urn:cts:latinLit:phi0959',\n",
       " 'member': [{'totalItems': 1,\n",
       "   'title': 'Metamorphoses',\n",
       "   '@id': 'urn:cts:latinLit:phi0959.phi006',\n",
       "   '@type': 'Collection'}]}"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Ovid_Collection  = requests.get(urljoin(URI, ENDPOINTS[\"collections\"]+\"?id=urn:cts:latinLit:phi0959\")).json()\n",
    "Ovid_Collection"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Metamorphoses\n",
    "\n",
    "Wait, it has again another collection. Let's go ! Let's see where this ends !"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'dts:extensions': {'ns1:prefLabel': [{'@value': 'Metamorphoses',\n",
       "    '@language': 'eng'}],\n",
       "  'ns3:language': 'lat',\n",
       "  'cts:title': [{'@value': 'Metamorphoses', '@language': 'eng'}]},\n",
       " '@context': {'ns1': 'http://www.w3.org/2004/02/skos/core#',\n",
       "  'ns3': 'http://purl.org/dc/elements/1.1/',\n",
       "  'dts': 'https://w3id.org/dts/api#',\n",
       "  'cts': 'http://chs.harvard.edu/xmlns/cts/',\n",
       "  '@vocab': 'https://www.w3.org/ns/hydra/core#'},\n",
       " '@type': 'Collection',\n",
       " 'totalItems': 1,\n",
       " 'title': 'Metamorphoses',\n",
       " '@id': 'urn:cts:latinLit:phi0959.phi006',\n",
       " 'member': [{'dts:citeDepth': 2,\n",
       "   'dts:passage': '/api/dts/document?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1',\n",
       "   'dts:citeStructure': {'dts:citeStructure': [{'dts:citeType': 'line'}],\n",
       "    'dts:citeType': 'book'},\n",
       "   'dts:extensions': {'ns1:prefLabel': [{'@value': 'Metamorphoses',\n",
       "      '@language': 'lat'}],\n",
       "    'ns3:language': 'lat',\n",
       "    'cts:description': [{'@value': 'TEI XML Edition Enhanced with Syntax Diagrams for 1.1-1.9 and 1.163-1.773. Ovid. Metamorphoses. Hugo Magnus.\\n      Gotha (Germany). Friedr. Andr. Perthes. 1892',\n",
       "      '@language': 'eng'}],\n",
       "    'cts:label': [{'@value': 'Metamorphoses', '@language': 'lat'}]},\n",
       "   '@type': 'Resource',\n",
       "   'dts:references': '/api/dts/navigation?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1',\n",
       "   'totalItems': 0,\n",
       "   'title': 'Metamorphoses',\n",
       "   '@id': 'urn:cts:latinLit:phi0959.phi006.alpheios-text-lat1'}]}"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Metamorphoses_Collection  = requests.get(\n",
    "    urljoin(URI, ENDPOINTS[\"collections\"]+\"?id=urn:cts:latinLit:phi0959.phi006\")\n",
    ").json()\n",
    "Metamorphoses_Collection"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Alpheios Edition of the Metamorphoses\n",
    "\n",
    "Wait, the next one seems more complicated, let's request this single collection and read what's in there :"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'dts:citeDepth': 2,\n",
       " 'dts:passage': '/api/dts/document?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1',\n",
       " 'dts:citeStructure': {'dts:citeStructure': [{'dts:citeType': 'line'}],\n",
       "  'dts:citeType': 'book'},\n",
       " 'dts:extensions': {'ns1:prefLabel': [{'@value': 'Metamorphoses',\n",
       "    '@language': 'lat'}],\n",
       "  'ns3:language': 'lat',\n",
       "  'cts:description': [{'@value': 'TEI XML Edition Enhanced with Syntax Diagrams for 1.1-1.9 and 1.163-1.773. Ovid. Metamorphoses. Hugo Magnus.\\n      Gotha (Germany). Friedr. Andr. Perthes. 1892',\n",
       "    '@language': 'eng'}],\n",
       "  'cts:label': [{'@value': 'Metamorphoses', '@language': 'lat'}]},\n",
       " '@type': 'Resource',\n",
       " 'dts:references': '/api/dts/navigation?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1',\n",
       " 'totalItems': 0,\n",
       " 'title': 'Metamorphoses',\n",
       " '@id': 'urn:cts:latinLit:phi0959.phi006.alpheios-text-lat1',\n",
       " '@context': {'ns1': 'http://www.w3.org/2004/02/skos/core#',\n",
       "  'ns3': 'http://purl.org/dc/elements/1.1/',\n",
       "  '@vocab': 'https://www.w3.org/ns/hydra/core#',\n",
       "  'dts': 'https://w3id.org/dts/api#',\n",
       "  'cts': 'http://chs.harvard.edu/xmlns/cts/'}}"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Metamorphoses_Edition_Collection  = requests.get(\n",
    "    urljoin(URI, ENDPOINTS[\"collections\"]+\"?id=urn:cts:latinLit:phi0959.phi006.alpheios-text-lat1\")\n",
    ").json()\n",
    "Metamorphoses_Edition_Collection"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So, there are a few things we can see:\n",
    "\n",
    "- There is prefLabels again, and some values for `cts` ontology properties.\n",
    "- More importantly, the `@type` is not `Collection` anymore ! This means the current Collection can actually be read, it's not only metadata. Good to know hmm ?\n",
    "- You see the `dts:citeDepth` ? It means the text has two levels of citation. In the context of this collection, the data curator actually specified them in `dts:citeStructure` :\n",
    "    1. The first level has the name `poem`. This level has a second level:\n",
    "        1. The second of the level inside poem has the name `line`\n",
    "\n",
    "Now, we have two really interesting links, let's go see what's in there !"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## What are the passages that I can single out in the Alpheios Edition of Metamorphoses ?\n",
    "\n",
    "To reply to this long but quite clear title, there is only one thing to do : go to the `dts:references` URI we see here.\n",
    "\n",
    "But wait, see the URI ? It's actually a simple construction :\n",
    "\n",
    "- We use `navigation` from `ENDPOINTS`.\n",
    "- We add the `@id` of the Resource we are interested in !\n",
    "\n",
    "### All the Poems !"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'citeType': 'book',\n",
       " 'hydra:member': [{'ref': '1'},\n",
       "  {'ref': '2'},\n",
       "  {'ref': '3'},\n",
       "  {'ref': '4'},\n",
       "  {'ref': '5'},\n",
       "  {'ref': '6'},\n",
       "  {'ref': '7'},\n",
       "  {'ref': '8'},\n",
       "  {'ref': '9'},\n",
       "  {'ref': '10'},\n",
       "  {'ref': '11'},\n",
       "  {'ref': '12'},\n",
       "  {'ref': '13'},\n",
       "  {'ref': '14'},\n",
       "  {'ref': '15'}],\n",
       " '@context': {'hydra': 'https://www.w3.org/ns/hydra/core#',\n",
       "  '@vocab': 'https://w3id.org/dts/api#'},\n",
       " 'citeDepth': 2,\n",
       " 'level': 1,\n",
       " '@id': '/api/dts/navigation?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1&groupBy=1&level=1',\n",
       " 'passage': '/api/dts/document?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1{&ref}{&start}{&end}'}"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Ovid_Poems = requests.get(\n",
    "    urljoin(URI, Metamorphoses_Edition_Collection[\"dts:references\"])).json()\n",
    "Ovid_Poems"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Bummer ! There seems to be a single poem, here in `member`.\n",
    "\n",
    "### Well, then all the lines of Poem 1!\n",
    "\n",
    "But wait, didn't we say there was a second level ? To go see what's in there, we can simply go check the same URI, adding the ref we want to look into : `&ref=1`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'citeType': 'line',\n",
       " 'hydra:member': [{'ref': '1.1'},\n",
       "  {'ref': '1.2'},\n",
       "  {'ref': '1.3'},\n",
       "  {'ref': '1.4'},\n",
       "  {'ref': '1.5'},\n",
       "  {'ref': '1.6'},\n",
       "  {'ref': '1.7'},\n",
       "  {'ref': '1.8'},\n",
       "  {'ref': '1.9'},\n",
       "  {'ref': '1.10'},\n",
       "  {'ref': '1.11'},\n",
       "  {'ref': '1.12'},\n",
       "  {'ref': '1.13'},\n",
       "  {'ref': '1.14'},\n",
       "  {'ref': '1.15'},\n",
       "  {'ref': '1.16'},\n",
       "  {'ref': '1.17'},\n",
       "  {'ref': '1.18'},\n",
       "  {'ref': '1.19'},\n",
       "  {'ref': '1.20'},\n",
       "  {'ref': '1.21'},\n",
       "  {'ref': '1.22'},\n",
       "  {'ref': '1.23'},\n",
       "  {'ref': '1.24'},\n",
       "  {'ref': '1.25'},\n",
       "  {'ref': '1.26'},\n",
       "  {'ref': '1.27'},\n",
       "  {'ref': '1.28'},\n",
       "  {'ref': '1.29'},\n",
       "  {'ref': '1.30'},\n",
       "  {'ref': '1.31'},\n",
       "  {'ref': '1.32'},\n",
       "  {'ref': '1.33'},\n",
       "  {'ref': '1.34'},\n",
       "  {'ref': '1.35'},\n",
       "  {'ref': '1.36'},\n",
       "  {'ref': '1.37'},\n",
       "  {'ref': '1.38'},\n",
       "  {'ref': '1.39'},\n",
       "  {'ref': '1.40'},\n",
       "  {'ref': '1.41'},\n",
       "  {'ref': '1.42'},\n",
       "  {'ref': '1.43'},\n",
       "  {'ref': '1.44'},\n",
       "  {'ref': '1.45'},\n",
       "  {'ref': '1.46'},\n",
       "  {'ref': '1.47'},\n",
       "  {'ref': '1.48'},\n",
       "  {'ref': '1.49'},\n",
       "  {'ref': '1.50'},\n",
       "  {'ref': '1.51'},\n",
       "  {'ref': '1.52'},\n",
       "  {'ref': '1.53'},\n",
       "  {'ref': '1.54'},\n",
       "  {'ref': '1.55'},\n",
       "  {'ref': '1.56'},\n",
       "  {'ref': '1.57'},\n",
       "  {'ref': '1.58'},\n",
       "  {'ref': '1.59'},\n",
       "  {'ref': '1.60'},\n",
       "  {'ref': '1.61'},\n",
       "  {'ref': '1.62'},\n",
       "  {'ref': '1.63'},\n",
       "  {'ref': '1.64'},\n",
       "  {'ref': '1.65'},\n",
       "  {'ref': '1.66'},\n",
       "  {'ref': '1.67'},\n",
       "  {'ref': '1.68'},\n",
       "  {'ref': '1.69'},\n",
       "  {'ref': '1.70'},\n",
       "  {'ref': '1.71'},\n",
       "  {'ref': '1.72'},\n",
       "  {'ref': '1.73'},\n",
       "  {'ref': '1.74'},\n",
       "  {'ref': '1.75'},\n",
       "  {'ref': '1.76'},\n",
       "  {'ref': '1.77'},\n",
       "  {'ref': '1.78'},\n",
       "  {'ref': '1.79'},\n",
       "  {'ref': '1.80'},\n",
       "  {'ref': '1.81'},\n",
       "  {'ref': '1.82'},\n",
       "  {'ref': '1.83'},\n",
       "  {'ref': '1.84'},\n",
       "  {'ref': '1.85'},\n",
       "  {'ref': '1.86'},\n",
       "  {'ref': '1.87'},\n",
       "  {'ref': '1.88'},\n",
       "  {'ref': '1.89'},\n",
       "  {'ref': '1.90'},\n",
       "  {'ref': '1.91'},\n",
       "  {'ref': '1.92'},\n",
       "  {'ref': '1.93'},\n",
       "  {'ref': '1.94'},\n",
       "  {'ref': '1.95'},\n",
       "  {'ref': '1.96'},\n",
       "  {'ref': '1.97'},\n",
       "  {'ref': '1.98'},\n",
       "  {'ref': '1.99'},\n",
       "  {'ref': '1.100'},\n",
       "  {'ref': '1.101'},\n",
       "  {'ref': '1.102'},\n",
       "  {'ref': '1.103'},\n",
       "  {'ref': '1.104'},\n",
       "  {'ref': '1.105'},\n",
       "  {'ref': '1.106'},\n",
       "  {'ref': '1.107'},\n",
       "  {'ref': '1.108'},\n",
       "  {'ref': '1.109'},\n",
       "  {'ref': '1.110'},\n",
       "  {'ref': '1.111'},\n",
       "  {'ref': '1.112'},\n",
       "  {'ref': '1.113'},\n",
       "  {'ref': '1.114'},\n",
       "  {'ref': '1.115'},\n",
       "  {'ref': '1.116'},\n",
       "  {'ref': '1.117'},\n",
       "  {'ref': '1.118'},\n",
       "  {'ref': '1.119'},\n",
       "  {'ref': '1.120'},\n",
       "  {'ref': '1.121'},\n",
       "  {'ref': '1.122'},\n",
       "  {'ref': '1.123'},\n",
       "  {'ref': '1.124'},\n",
       "  {'ref': '1.125'},\n",
       "  {'ref': '1.126'},\n",
       "  {'ref': '1.127'},\n",
       "  {'ref': '1.128'},\n",
       "  {'ref': '1.129'},\n",
       "  {'ref': '1.130'},\n",
       "  {'ref': '1.131'},\n",
       "  {'ref': '1.132'},\n",
       "  {'ref': '1.133'},\n",
       "  {'ref': '1.134'},\n",
       "  {'ref': '1.135'},\n",
       "  {'ref': '1.136'},\n",
       "  {'ref': '1.137'},\n",
       "  {'ref': '1.138'},\n",
       "  {'ref': '1.139'},\n",
       "  {'ref': '1.140'},\n",
       "  {'ref': '1.141'},\n",
       "  {'ref': '1.142'},\n",
       "  {'ref': '1.143'},\n",
       "  {'ref': '1.144'},\n",
       "  {'ref': '1.145'},\n",
       "  {'ref': '1.146'},\n",
       "  {'ref': '1.147'},\n",
       "  {'ref': '1.148'},\n",
       "  {'ref': '1.149'},\n",
       "  {'ref': '1.150'},\n",
       "  {'ref': '1.151'},\n",
       "  {'ref': '1.152'},\n",
       "  {'ref': '1.153'},\n",
       "  {'ref': '1.154'},\n",
       "  {'ref': '1.155'},\n",
       "  {'ref': '1.156'},\n",
       "  {'ref': '1.157'},\n",
       "  {'ref': '1.158'},\n",
       "  {'ref': '1.159'},\n",
       "  {'ref': '1.160'},\n",
       "  {'ref': '1.161'},\n",
       "  {'ref': '1.162'},\n",
       "  {'ref': '1.163'},\n",
       "  {'ref': '1.164'},\n",
       "  {'ref': '1.165'},\n",
       "  {'ref': '1.166'},\n",
       "  {'ref': '1.167'},\n",
       "  {'ref': '1.168'},\n",
       "  {'ref': '1.169'},\n",
       "  {'ref': '1.170'},\n",
       "  {'ref': '1.171'},\n",
       "  {'ref': '1.172'},\n",
       "  {'ref': '1.173'},\n",
       "  {'ref': '1.174'},\n",
       "  {'ref': '1.175'},\n",
       "  {'ref': '1.176'},\n",
       "  {'ref': '1.177'},\n",
       "  {'ref': '1.178'},\n",
       "  {'ref': '1.179'},\n",
       "  {'ref': '1.180'},\n",
       "  {'ref': '1.181'},\n",
       "  {'ref': '1.182'},\n",
       "  {'ref': '1.183'},\n",
       "  {'ref': '1.184'},\n",
       "  {'ref': '1.185'},\n",
       "  {'ref': '1.186'},\n",
       "  {'ref': '1.187'},\n",
       "  {'ref': '1.188'},\n",
       "  {'ref': '1.189'},\n",
       "  {'ref': '1.190'},\n",
       "  {'ref': '1.191'},\n",
       "  {'ref': '1.192'},\n",
       "  {'ref': '1.193'},\n",
       "  {'ref': '1.194'},\n",
       "  {'ref': '1.195'},\n",
       "  {'ref': '1.196'},\n",
       "  {'ref': '1.197'},\n",
       "  {'ref': '1.198'},\n",
       "  {'ref': '1.199'},\n",
       "  {'ref': '1.200'},\n",
       "  {'ref': '1.201'},\n",
       "  {'ref': '1.202'},\n",
       "  {'ref': '1.203'},\n",
       "  {'ref': '1.204'},\n",
       "  {'ref': '1.205'},\n",
       "  {'ref': '1.206'},\n",
       "  {'ref': '1.207'},\n",
       "  {'ref': '1.208'},\n",
       "  {'ref': '1.209'},\n",
       "  {'ref': '1.210'},\n",
       "  {'ref': '1.211'},\n",
       "  {'ref': '1.212'},\n",
       "  {'ref': '1.213'},\n",
       "  {'ref': '1.214'},\n",
       "  {'ref': '1.215'},\n",
       "  {'ref': '1.216'},\n",
       "  {'ref': '1.217'},\n",
       "  {'ref': '1.218'},\n",
       "  {'ref': '1.219'},\n",
       "  {'ref': '1.220'},\n",
       "  {'ref': '1.221'},\n",
       "  {'ref': '1.222'},\n",
       "  {'ref': '1.223'},\n",
       "  {'ref': '1.224'},\n",
       "  {'ref': '1.225'},\n",
       "  {'ref': '1.226'},\n",
       "  {'ref': '1.227'},\n",
       "  {'ref': '1.228'},\n",
       "  {'ref': '1.229'},\n",
       "  {'ref': '1.230'},\n",
       "  {'ref': '1.231'},\n",
       "  {'ref': '1.232'},\n",
       "  {'ref': '1.233'},\n",
       "  {'ref': '1.234'},\n",
       "  {'ref': '1.235'},\n",
       "  {'ref': '1.236'},\n",
       "  {'ref': '1.237'},\n",
       "  {'ref': '1.238'},\n",
       "  {'ref': '1.239'},\n",
       "  {'ref': '1.240'},\n",
       "  {'ref': '1.241'},\n",
       "  {'ref': '1.242'},\n",
       "  {'ref': '1.243'},\n",
       "  {'ref': '1.244'},\n",
       "  {'ref': '1.245'},\n",
       "  {'ref': '1.246'},\n",
       "  {'ref': '1.247'},\n",
       "  {'ref': '1.248'},\n",
       "  {'ref': '1.249'},\n",
       "  {'ref': '1.250'},\n",
       "  {'ref': '1.251'},\n",
       "  {'ref': '1.252'},\n",
       "  {'ref': '1.253'},\n",
       "  {'ref': '1.254'},\n",
       "  {'ref': '1.255'},\n",
       "  {'ref': '1.256'},\n",
       "  {'ref': '1.257'},\n",
       "  {'ref': '1.258'},\n",
       "  {'ref': '1.259'},\n",
       "  {'ref': '1.260'},\n",
       "  {'ref': '1.261'},\n",
       "  {'ref': '1.262'},\n",
       "  {'ref': '1.263'},\n",
       "  {'ref': '1.264'},\n",
       "  {'ref': '1.265'},\n",
       "  {'ref': '1.266'},\n",
       "  {'ref': '1.267'},\n",
       "  {'ref': '1.268'},\n",
       "  {'ref': '1.269'},\n",
       "  {'ref': '1.270'},\n",
       "  {'ref': '1.271'},\n",
       "  {'ref': '1.272'},\n",
       "  {'ref': '1.273'},\n",
       "  {'ref': '1.274'},\n",
       "  {'ref': '1.275'},\n",
       "  {'ref': '1.276'},\n",
       "  {'ref': '1.277'},\n",
       "  {'ref': '1.278'},\n",
       "  {'ref': '1.279'},\n",
       "  {'ref': '1.280'},\n",
       "  {'ref': '1.281'},\n",
       "  {'ref': '1.282'},\n",
       "  {'ref': '1.283'},\n",
       "  {'ref': '1.284'},\n",
       "  {'ref': '1.285'},\n",
       "  {'ref': '1.286'},\n",
       "  {'ref': '1.287'},\n",
       "  {'ref': '1.288'},\n",
       "  {'ref': '1.289'},\n",
       "  {'ref': '1.290'},\n",
       "  {'ref': '1.291'},\n",
       "  {'ref': '1.292'},\n",
       "  {'ref': '1.293'},\n",
       "  {'ref': '1.294'},\n",
       "  {'ref': '1.295'},\n",
       "  {'ref': '1.296'},\n",
       "  {'ref': '1.297'},\n",
       "  {'ref': '1.298'},\n",
       "  {'ref': '1.299'},\n",
       "  {'ref': '1.300'},\n",
       "  {'ref': '1.301'},\n",
       "  {'ref': '1.302'},\n",
       "  {'ref': '1.303'},\n",
       "  {'ref': '1.304'},\n",
       "  {'ref': '1.305'},\n",
       "  {'ref': '1.306'},\n",
       "  {'ref': '1.307'},\n",
       "  {'ref': '1.308'},\n",
       "  {'ref': '1.309'},\n",
       "  {'ref': '1.310'},\n",
       "  {'ref': '1.311'},\n",
       "  {'ref': '1.312'},\n",
       "  {'ref': '1.313'},\n",
       "  {'ref': '1.314'},\n",
       "  {'ref': '1.315'},\n",
       "  {'ref': '1.316'},\n",
       "  {'ref': '1.317'},\n",
       "  {'ref': '1.318'},\n",
       "  {'ref': '1.319'},\n",
       "  {'ref': '1.320'},\n",
       "  {'ref': '1.321'},\n",
       "  {'ref': '1.322'},\n",
       "  {'ref': '1.323'},\n",
       "  {'ref': '1.324'},\n",
       "  {'ref': '1.325'},\n",
       "  {'ref': '1.326'},\n",
       "  {'ref': '1.327'},\n",
       "  {'ref': '1.328'},\n",
       "  {'ref': '1.329'},\n",
       "  {'ref': '1.330'},\n",
       "  {'ref': '1.331'},\n",
       "  {'ref': '1.332'},\n",
       "  {'ref': '1.333'},\n",
       "  {'ref': '1.334'},\n",
       "  {'ref': '1.335'},\n",
       "  {'ref': '1.336'},\n",
       "  {'ref': '1.337'},\n",
       "  {'ref': '1.338'},\n",
       "  {'ref': '1.339'},\n",
       "  {'ref': '1.340'},\n",
       "  {'ref': '1.341'},\n",
       "  {'ref': '1.342'},\n",
       "  {'ref': '1.343'},\n",
       "  {'ref': '1.344'},\n",
       "  {'ref': '1.345'},\n",
       "  {'ref': '1.346'},\n",
       "  {'ref': '1.347'},\n",
       "  {'ref': '1.348'},\n",
       "  {'ref': '1.349'},\n",
       "  {'ref': '1.350'},\n",
       "  {'ref': '1.351'},\n",
       "  {'ref': '1.352'},\n",
       "  {'ref': '1.353'},\n",
       "  {'ref': '1.354'},\n",
       "  {'ref': '1.355'},\n",
       "  {'ref': '1.356'},\n",
       "  {'ref': '1.357'},\n",
       "  {'ref': '1.358'},\n",
       "  {'ref': '1.359'},\n",
       "  {'ref': '1.360'},\n",
       "  {'ref': '1.361'},\n",
       "  {'ref': '1.362'},\n",
       "  {'ref': '1.363'},\n",
       "  {'ref': '1.364'},\n",
       "  {'ref': '1.365'},\n",
       "  {'ref': '1.366'},\n",
       "  {'ref': '1.367'},\n",
       "  {'ref': '1.368'},\n",
       "  {'ref': '1.369'},\n",
       "  {'ref': '1.370'},\n",
       "  {'ref': '1.371'},\n",
       "  {'ref': '1.372'},\n",
       "  {'ref': '1.373'},\n",
       "  {'ref': '1.374'},\n",
       "  {'ref': '1.375'},\n",
       "  {'ref': '1.376'},\n",
       "  {'ref': '1.377'},\n",
       "  {'ref': '1.378'},\n",
       "  {'ref': '1.379'},\n",
       "  {'ref': '1.380'},\n",
       "  {'ref': '1.381'},\n",
       "  {'ref': '1.382'},\n",
       "  {'ref': '1.383'},\n",
       "  {'ref': '1.384'},\n",
       "  {'ref': '1.385'},\n",
       "  {'ref': '1.386'},\n",
       "  {'ref': '1.387'},\n",
       "  {'ref': '1.388'},\n",
       "  {'ref': '1.389'},\n",
       "  {'ref': '1.390'},\n",
       "  {'ref': '1.391'},\n",
       "  {'ref': '1.392'},\n",
       "  {'ref': '1.393'},\n",
       "  {'ref': '1.394'},\n",
       "  {'ref': '1.395'},\n",
       "  {'ref': '1.396'},\n",
       "  {'ref': '1.397'},\n",
       "  {'ref': '1.398'},\n",
       "  {'ref': '1.399'},\n",
       "  {'ref': '1.400'},\n",
       "  {'ref': '1.401'},\n",
       "  {'ref': '1.402'},\n",
       "  {'ref': '1.403'},\n",
       "  {'ref': '1.404'},\n",
       "  {'ref': '1.405'},\n",
       "  {'ref': '1.406'},\n",
       "  {'ref': '1.407'},\n",
       "  {'ref': '1.408'},\n",
       "  {'ref': '1.409'},\n",
       "  {'ref': '1.410'},\n",
       "  {'ref': '1.411'},\n",
       "  {'ref': '1.412'},\n",
       "  {'ref': '1.413'},\n",
       "  {'ref': '1.414'},\n",
       "  {'ref': '1.415'},\n",
       "  {'ref': '1.416'},\n",
       "  {'ref': '1.417'},\n",
       "  {'ref': '1.418'},\n",
       "  {'ref': '1.419'},\n",
       "  {'ref': '1.420'},\n",
       "  {'ref': '1.421'},\n",
       "  {'ref': '1.422'},\n",
       "  {'ref': '1.423'},\n",
       "  {'ref': '1.424'},\n",
       "  {'ref': '1.425'},\n",
       "  {'ref': '1.426'},\n",
       "  {'ref': '1.427'},\n",
       "  {'ref': '1.428'},\n",
       "  {'ref': '1.429'},\n",
       "  {'ref': '1.430'},\n",
       "  {'ref': '1.431'},\n",
       "  {'ref': '1.432'},\n",
       "  {'ref': '1.433'},\n",
       "  {'ref': '1.434'},\n",
       "  {'ref': '1.435'},\n",
       "  {'ref': '1.436'},\n",
       "  {'ref': '1.437'},\n",
       "  {'ref': '1.438'},\n",
       "  {'ref': '1.439'},\n",
       "  {'ref': '1.440'},\n",
       "  {'ref': '1.441'},\n",
       "  {'ref': '1.442'},\n",
       "  {'ref': '1.443'},\n",
       "  {'ref': '1.444'},\n",
       "  {'ref': '1.445'},\n",
       "  {'ref': '1.446'},\n",
       "  {'ref': '1.447'},\n",
       "  {'ref': '1.448'},\n",
       "  {'ref': '1.449'},\n",
       "  {'ref': '1.450'},\n",
       "  {'ref': '1.451'},\n",
       "  {'ref': '1.452'},\n",
       "  {'ref': '1.453'},\n",
       "  {'ref': '1.454'},\n",
       "  {'ref': '1.455'},\n",
       "  {'ref': '1.456'},\n",
       "  {'ref': '1.457'},\n",
       "  {'ref': '1.458'},\n",
       "  {'ref': '1.459'},\n",
       "  {'ref': '1.460'},\n",
       "  {'ref': '1.461'},\n",
       "  {'ref': '1.462'},\n",
       "  {'ref': '1.463'},\n",
       "  {'ref': '1.464'},\n",
       "  {'ref': '1.465'},\n",
       "  {'ref': '1.466'},\n",
       "  {'ref': '1.467'},\n",
       "  {'ref': '1.468'},\n",
       "  {'ref': '1.469'},\n",
       "  {'ref': '1.470'},\n",
       "  {'ref': '1.471'},\n",
       "  {'ref': '1.472'},\n",
       "  {'ref': '1.473'},\n",
       "  {'ref': '1.474'},\n",
       "  {'ref': '1.475'},\n",
       "  {'ref': '1.476'},\n",
       "  {'ref': '1.477'},\n",
       "  {'ref': '1.478'},\n",
       "  {'ref': '1.479'},\n",
       "  {'ref': '1.480'},\n",
       "  {'ref': '1.481'},\n",
       "  {'ref': '1.482'},\n",
       "  {'ref': '1.483'},\n",
       "  {'ref': '1.484'},\n",
       "  {'ref': '1.485'},\n",
       "  {'ref': '1.486'},\n",
       "  {'ref': '1.487'},\n",
       "  {'ref': '1.488'},\n",
       "  {'ref': '1.489'},\n",
       "  {'ref': '1.490'},\n",
       "  {'ref': '1.491'},\n",
       "  {'ref': '1.492'},\n",
       "  {'ref': '1.493'},\n",
       "  {'ref': '1.494'},\n",
       "  {'ref': '1.495'},\n",
       "  {'ref': '1.496'},\n",
       "  {'ref': '1.497'},\n",
       "  {'ref': '1.498'},\n",
       "  {'ref': '1.499'},\n",
       "  {'ref': '1.500'},\n",
       "  {'ref': '1.501'},\n",
       "  {'ref': '1.502'},\n",
       "  {'ref': '1.503'},\n",
       "  {'ref': '1.504'},\n",
       "  {'ref': '1.505'},\n",
       "  {'ref': '1.506'},\n",
       "  {'ref': '1.507'},\n",
       "  {'ref': '1.508'},\n",
       "  {'ref': '1.509'},\n",
       "  {'ref': '1.510'},\n",
       "  {'ref': '1.511'},\n",
       "  {'ref': '1.512'},\n",
       "  {'ref': '1.513'},\n",
       "  {'ref': '1.514'},\n",
       "  {'ref': '1.515'},\n",
       "  {'ref': '1.516'},\n",
       "  {'ref': '1.517'},\n",
       "  {'ref': '1.518'},\n",
       "  {'ref': '1.519'},\n",
       "  {'ref': '1.520'},\n",
       "  {'ref': '1.521'},\n",
       "  {'ref': '1.522'},\n",
       "  {'ref': '1.523'},\n",
       "  {'ref': '1.524'},\n",
       "  {'ref': '1.525'},\n",
       "  {'ref': '1.526'},\n",
       "  {'ref': '1.527'},\n",
       "  {'ref': '1.528'},\n",
       "  {'ref': '1.529'},\n",
       "  {'ref': '1.530'},\n",
       "  {'ref': '1.531'},\n",
       "  {'ref': '1.532'},\n",
       "  {'ref': '1.533'},\n",
       "  {'ref': '1.534'},\n",
       "  {'ref': '1.535'},\n",
       "  {'ref': '1.536'},\n",
       "  {'ref': '1.537'},\n",
       "  {'ref': '1.538'},\n",
       "  {'ref': '1.539'},\n",
       "  {'ref': '1.540'},\n",
       "  {'ref': '1.541'},\n",
       "  {'ref': '1.542'},\n",
       "  {'ref': '1.543'},\n",
       "  {'ref': '1.544'},\n",
       "  {'ref': '1.545'},\n",
       "  {'ref': '1.546'},\n",
       "  {'ref': '1.547'},\n",
       "  {'ref': '1.548'},\n",
       "  {'ref': '1.549'},\n",
       "  {'ref': '1.550'},\n",
       "  {'ref': '1.551'},\n",
       "  {'ref': '1.552'},\n",
       "  {'ref': '1.553'},\n",
       "  {'ref': '1.554'},\n",
       "  {'ref': '1.555'},\n",
       "  {'ref': '1.556'},\n",
       "  {'ref': '1.557'},\n",
       "  {'ref': '1.558'},\n",
       "  {'ref': '1.559'},\n",
       "  {'ref': '1.560'},\n",
       "  {'ref': '1.561'},\n",
       "  {'ref': '1.562'},\n",
       "  {'ref': '1.563'},\n",
       "  {'ref': '1.564'},\n",
       "  {'ref': '1.565'},\n",
       "  {'ref': '1.566'},\n",
       "  {'ref': '1.567'},\n",
       "  {'ref': '1.568'},\n",
       "  {'ref': '1.569'},\n",
       "  {'ref': '1.570'},\n",
       "  {'ref': '1.571'},\n",
       "  {'ref': '1.572'},\n",
       "  {'ref': '1.573'},\n",
       "  {'ref': '1.574'},\n",
       "  {'ref': '1.575'},\n",
       "  {'ref': '1.576'},\n",
       "  {'ref': '1.577'},\n",
       "  {'ref': '1.578'},\n",
       "  {'ref': '1.579'},\n",
       "  {'ref': '1.580'},\n",
       "  {'ref': '1.581'},\n",
       "  {'ref': '1.582'},\n",
       "  {'ref': '1.583'},\n",
       "  {'ref': '1.584'},\n",
       "  {'ref': '1.585'},\n",
       "  {'ref': '1.586'},\n",
       "  {'ref': '1.587'},\n",
       "  {'ref': '1.588'},\n",
       "  {'ref': '1.589'},\n",
       "  {'ref': '1.590'},\n",
       "  {'ref': '1.591'},\n",
       "  {'ref': '1.592'},\n",
       "  {'ref': '1.593'},\n",
       "  {'ref': '1.594'},\n",
       "  {'ref': '1.595'},\n",
       "  {'ref': '1.596'},\n",
       "  {'ref': '1.597'},\n",
       "  {'ref': '1.598'},\n",
       "  {'ref': '1.599'},\n",
       "  {'ref': '1.600'},\n",
       "  {'ref': '1.601'},\n",
       "  {'ref': '1.602'},\n",
       "  {'ref': '1.603'},\n",
       "  {'ref': '1.604'},\n",
       "  {'ref': '1.605'},\n",
       "  {'ref': '1.606'},\n",
       "  {'ref': '1.607'},\n",
       "  {'ref': '1.608'},\n",
       "  {'ref': '1.609'},\n",
       "  {'ref': '1.610'},\n",
       "  {'ref': '1.611'},\n",
       "  {'ref': '1.612'},\n",
       "  {'ref': '1.613'},\n",
       "  {'ref': '1.614'},\n",
       "  {'ref': '1.615'},\n",
       "  {'ref': '1.616'},\n",
       "  {'ref': '1.617'},\n",
       "  {'ref': '1.618'},\n",
       "  {'ref': '1.619'},\n",
       "  {'ref': '1.620'},\n",
       "  {'ref': '1.621'},\n",
       "  {'ref': '1.622'},\n",
       "  {'ref': '1.623'},\n",
       "  {'ref': '1.624'},\n",
       "  {'ref': '1.625'},\n",
       "  {'ref': '1.626'},\n",
       "  {'ref': '1.627'},\n",
       "  {'ref': '1.628'},\n",
       "  {'ref': '1.629'},\n",
       "  {'ref': '1.630'},\n",
       "  {'ref': '1.631'},\n",
       "  {'ref': '1.632'},\n",
       "  {'ref': '1.633'},\n",
       "  {'ref': '1.634'},\n",
       "  {'ref': '1.635'},\n",
       "  {'ref': '1.636'},\n",
       "  {'ref': '1.637'},\n",
       "  {'ref': '1.638'},\n",
       "  {'ref': '1.639'},\n",
       "  {'ref': '1.640'},\n",
       "  {'ref': '1.641'},\n",
       "  {'ref': '1.642'},\n",
       "  {'ref': '1.643'},\n",
       "  {'ref': '1.644'},\n",
       "  {'ref': '1.645'},\n",
       "  {'ref': '1.646'},\n",
       "  {'ref': '1.647'},\n",
       "  {'ref': '1.648'},\n",
       "  {'ref': '1.649'},\n",
       "  {'ref': '1.650'},\n",
       "  {'ref': '1.651'},\n",
       "  {'ref': '1.652'},\n",
       "  {'ref': '1.653'},\n",
       "  {'ref': '1.654'},\n",
       "  {'ref': '1.655'},\n",
       "  {'ref': '1.656'},\n",
       "  {'ref': '1.657'},\n",
       "  {'ref': '1.658'},\n",
       "  {'ref': '1.659'},\n",
       "  {'ref': '1.660'},\n",
       "  {'ref': '1.661'},\n",
       "  {'ref': '1.662'},\n",
       "  {'ref': '1.663'},\n",
       "  {'ref': '1.664'},\n",
       "  {'ref': '1.665'},\n",
       "  {'ref': '1.666'},\n",
       "  {'ref': '1.667'},\n",
       "  {'ref': '1.668'},\n",
       "  {'ref': '1.669'},\n",
       "  {'ref': '1.670'},\n",
       "  {'ref': '1.671'},\n",
       "  {'ref': '1.672'},\n",
       "  {'ref': '1.673'},\n",
       "  {'ref': '1.674'},\n",
       "  {'ref': '1.675'},\n",
       "  {'ref': '1.676'},\n",
       "  {'ref': '1.677'},\n",
       "  {'ref': '1.678'},\n",
       "  {'ref': '1.679'},\n",
       "  {'ref': '1.680'},\n",
       "  {'ref': '1.681'},\n",
       "  {'ref': '1.682'},\n",
       "  {'ref': '1.683'},\n",
       "  {'ref': '1.684'},\n",
       "  {'ref': '1.685'},\n",
       "  {'ref': '1.686'},\n",
       "  {'ref': '1.687'},\n",
       "  {'ref': '1.688'},\n",
       "  {'ref': '1.689'},\n",
       "  {'ref': '1.690'},\n",
       "  {'ref': '1.691'},\n",
       "  {'ref': '1.692'},\n",
       "  {'ref': '1.693'},\n",
       "  {'ref': '1.694'},\n",
       "  {'ref': '1.695'},\n",
       "  {'ref': '1.696'},\n",
       "  {'ref': '1.697'},\n",
       "  {'ref': '1.698'},\n",
       "  {'ref': '1.699'},\n",
       "  {'ref': '1.700'},\n",
       "  {'ref': '1.701'},\n",
       "  {'ref': '1.702'},\n",
       "  {'ref': '1.703'},\n",
       "  {'ref': '1.704'},\n",
       "  {'ref': '1.705'},\n",
       "  {'ref': '1.706'},\n",
       "  {'ref': '1.707'},\n",
       "  {'ref': '1.708'},\n",
       "  {'ref': '1.709'},\n",
       "  {'ref': '1.710'},\n",
       "  {'ref': '1.711'},\n",
       "  {'ref': '1.712'},\n",
       "  {'ref': '1.713'},\n",
       "  {'ref': '1.714'},\n",
       "  {'ref': '1.715'},\n",
       "  {'ref': '1.716'},\n",
       "  {'ref': '1.717'},\n",
       "  {'ref': '1.718'},\n",
       "  {'ref': '1.719'},\n",
       "  {'ref': '1.720'},\n",
       "  {'ref': '1.721'},\n",
       "  {'ref': '1.722'},\n",
       "  {'ref': '1.723'},\n",
       "  {'ref': '1.724'},\n",
       "  {'ref': '1.725'},\n",
       "  {'ref': '1.726'},\n",
       "  {'ref': '1.727'},\n",
       "  {'ref': '1.728'},\n",
       "  {'ref': '1.729'},\n",
       "  {'ref': '1.730'},\n",
       "  {'ref': '1.731'},\n",
       "  {'ref': '1.732'},\n",
       "  {'ref': '1.733'},\n",
       "  {'ref': '1.734'},\n",
       "  {'ref': '1.735'},\n",
       "  {'ref': '1.736'},\n",
       "  {'ref': '1.737'},\n",
       "  {'ref': '1.738'},\n",
       "  {'ref': '1.739'},\n",
       "  {'ref': '1.740'},\n",
       "  {'ref': '1.741'},\n",
       "  {'ref': '1.742'},\n",
       "  {'ref': '1.743'},\n",
       "  {'ref': '1.744'},\n",
       "  {'ref': '1.745'},\n",
       "  {'ref': '1.746'},\n",
       "  {'ref': '1.747'},\n",
       "  {'ref': '1.748'},\n",
       "  {'ref': '1.749'},\n",
       "  {'ref': '1.750'},\n",
       "  {'ref': '1.751'},\n",
       "  {'ref': '1.752'},\n",
       "  {'ref': '1.753'},\n",
       "  {'ref': '1.754'},\n",
       "  {'ref': '1.755'},\n",
       "  {'ref': '1.756'},\n",
       "  {'ref': '1.757'},\n",
       "  {'ref': '1.758'},\n",
       "  {'ref': '1.759'},\n",
       "  {'ref': '1.760'},\n",
       "  {'ref': '1.761'},\n",
       "  {'ref': '1.762'},\n",
       "  {'ref': '1.763'},\n",
       "  {'ref': '1.764'},\n",
       "  {'ref': '1.765'},\n",
       "  {'ref': '1.766'},\n",
       "  {'ref': '1.767'},\n",
       "  {'ref': '1.768'},\n",
       "  {'ref': '1.769'},\n",
       "  {'ref': '1.770'},\n",
       "  {'ref': '1.771'},\n",
       "  {'ref': '1.772'},\n",
       "  {'ref': '1.773'},\n",
       "  {'ref': '1.774'},\n",
       "  {'ref': '1.775'},\n",
       "  {'ref': '1.776'},\n",
       "  {'ref': '1.777'},\n",
       "  {'ref': '1.778'}],\n",
       " '@context': {'hydra': 'https://www.w3.org/ns/hydra/core#',\n",
       "  '@vocab': 'https://w3id.org/dts/api#'},\n",
       " 'citeDepth': 2,\n",
       " 'level': 2,\n",
       " '@id': '/api/dts/navigation?ref=1&groupBy=1&level=1&id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1',\n",
       " 'passage': '/api/dts/document?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1{&ref}{&start}{&end}'}"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Ovid_Poem_1_Lines = requests.get(\n",
    "    urljoin(URI, Metamorphoses_Edition_Collection[\"dts:references\"]+\"&ref=1\")).json()\n",
    "Ovid_Poem_1_Lines"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "That's quite a lot of references. All are lines, that's interesting. **We can even see that this edition is lacking the lines 10 to 162 !**\n",
    "\n",
    "### TLDR : GROUPS !\n",
    "\n",
    "But I don't want to check each line one by one. So, let's group them :"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'citeType': 'line',\n",
       " 'hydra:member': [{'start': '1.1', 'end': '1.20'},\n",
       "  {'start': '1.21', 'end': '1.40'},\n",
       "  {'start': '1.41', 'end': '1.60'},\n",
       "  {'start': '1.61', 'end': '1.80'},\n",
       "  {'start': '1.81', 'end': '1.100'},\n",
       "  {'start': '1.101', 'end': '1.120'},\n",
       "  {'start': '1.121', 'end': '1.140'},\n",
       "  {'start': '1.141', 'end': '1.160'},\n",
       "  {'start': '1.161', 'end': '1.180'},\n",
       "  {'start': '1.181', 'end': '1.200'},\n",
       "  {'start': '1.201', 'end': '1.220'},\n",
       "  {'start': '1.221', 'end': '1.240'},\n",
       "  {'start': '1.241', 'end': '1.260'},\n",
       "  {'start': '1.261', 'end': '1.280'},\n",
       "  {'start': '1.281', 'end': '1.300'},\n",
       "  {'start': '1.301', 'end': '1.320'},\n",
       "  {'start': '1.321', 'end': '1.340'},\n",
       "  {'start': '1.341', 'end': '1.360'},\n",
       "  {'start': '1.361', 'end': '1.380'},\n",
       "  {'start': '1.381', 'end': '1.400'},\n",
       "  {'start': '1.401', 'end': '1.420'},\n",
       "  {'start': '1.421', 'end': '1.440'},\n",
       "  {'start': '1.441', 'end': '1.460'},\n",
       "  {'start': '1.461', 'end': '1.480'},\n",
       "  {'start': '1.481', 'end': '1.500'},\n",
       "  {'start': '1.501', 'end': '1.520'},\n",
       "  {'start': '1.521', 'end': '1.540'},\n",
       "  {'start': '1.541', 'end': '1.560'},\n",
       "  {'start': '1.561', 'end': '1.580'},\n",
       "  {'start': '1.581', 'end': '1.600'},\n",
       "  {'start': '1.601', 'end': '1.620'},\n",
       "  {'start': '1.621', 'end': '1.640'},\n",
       "  {'start': '1.641', 'end': '1.660'},\n",
       "  {'start': '1.661', 'end': '1.680'},\n",
       "  {'start': '1.681', 'end': '1.700'},\n",
       "  {'start': '1.701', 'end': '1.720'},\n",
       "  {'start': '1.721', 'end': '1.740'},\n",
       "  {'start': '1.741', 'end': '1.760'},\n",
       "  {'start': '1.761', 'end': '1.778'}],\n",
       " '@context': {'hydra': 'https://www.w3.org/ns/hydra/core#',\n",
       "  '@vocab': 'https://w3id.org/dts/api#'},\n",
       " 'citeDepth': 2,\n",
       " 'level': 2,\n",
       " '@id': '/api/dts/navigation?ref=1&groupBy=20&level=1&id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1',\n",
       " 'passage': '/api/dts/document?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1{&ref}{&start}{&end}'}"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Ovid_Poem_1_Lines_Grouped = requests.get(\n",
    "    urljoin(URI, Metamorphoses_Edition_Collection[\"dts:references\"]+\"&ref=1&groupBy=20\")).json()\n",
    "Ovid_Poem_1_Lines_Grouped"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### What's inside that group ?\n",
    "\n",
    "So, we have group now. But how do I know, if there is missing lines, what's forming my group ? \n",
    "\n",
    "Answer : By doing the same query, but using the `start` and `end` parameter, specifying that I want things inside this range adding `&level=0`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "http://texts.alpheios.net/api/dts/navigation?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1&start=1.1&end=1.173&level=0\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "{'citeType': 'line',\n",
       " 'hydra:member': [{'ref': '1.1'},\n",
       "  {'ref': '1.2'},\n",
       "  {'ref': '1.3'},\n",
       "  {'ref': '1.4'},\n",
       "  {'ref': '1.5'},\n",
       "  {'ref': '1.6'},\n",
       "  {'ref': '1.7'},\n",
       "  {'ref': '1.8'},\n",
       "  {'ref': '1.9'},\n",
       "  {'ref': '1.10'},\n",
       "  {'ref': '1.11'},\n",
       "  {'ref': '1.12'},\n",
       "  {'ref': '1.13'},\n",
       "  {'ref': '1.14'},\n",
       "  {'ref': '1.15'},\n",
       "  {'ref': '1.16'},\n",
       "  {'ref': '1.17'},\n",
       "  {'ref': '1.18'},\n",
       "  {'ref': '1.19'},\n",
       "  {'ref': '1.20'},\n",
       "  {'ref': '1.21'},\n",
       "  {'ref': '1.22'},\n",
       "  {'ref': '1.23'},\n",
       "  {'ref': '1.24'},\n",
       "  {'ref': '1.25'},\n",
       "  {'ref': '1.26'},\n",
       "  {'ref': '1.27'},\n",
       "  {'ref': '1.28'},\n",
       "  {'ref': '1.29'},\n",
       "  {'ref': '1.30'},\n",
       "  {'ref': '1.31'},\n",
       "  {'ref': '1.32'},\n",
       "  {'ref': '1.33'},\n",
       "  {'ref': '1.34'},\n",
       "  {'ref': '1.35'},\n",
       "  {'ref': '1.36'},\n",
       "  {'ref': '1.37'},\n",
       "  {'ref': '1.38'},\n",
       "  {'ref': '1.39'},\n",
       "  {'ref': '1.40'},\n",
       "  {'ref': '1.41'},\n",
       "  {'ref': '1.42'},\n",
       "  {'ref': '1.43'},\n",
       "  {'ref': '1.44'},\n",
       "  {'ref': '1.45'},\n",
       "  {'ref': '1.46'},\n",
       "  {'ref': '1.47'},\n",
       "  {'ref': '1.48'},\n",
       "  {'ref': '1.49'},\n",
       "  {'ref': '1.50'},\n",
       "  {'ref': '1.51'},\n",
       "  {'ref': '1.52'},\n",
       "  {'ref': '1.53'},\n",
       "  {'ref': '1.54'},\n",
       "  {'ref': '1.55'},\n",
       "  {'ref': '1.56'},\n",
       "  {'ref': '1.57'},\n",
       "  {'ref': '1.58'},\n",
       "  {'ref': '1.59'},\n",
       "  {'ref': '1.60'},\n",
       "  {'ref': '1.61'},\n",
       "  {'ref': '1.62'},\n",
       "  {'ref': '1.63'},\n",
       "  {'ref': '1.64'},\n",
       "  {'ref': '1.65'},\n",
       "  {'ref': '1.66'},\n",
       "  {'ref': '1.67'},\n",
       "  {'ref': '1.68'},\n",
       "  {'ref': '1.69'},\n",
       "  {'ref': '1.70'},\n",
       "  {'ref': '1.71'},\n",
       "  {'ref': '1.72'},\n",
       "  {'ref': '1.73'},\n",
       "  {'ref': '1.74'},\n",
       "  {'ref': '1.75'},\n",
       "  {'ref': '1.76'},\n",
       "  {'ref': '1.77'},\n",
       "  {'ref': '1.78'},\n",
       "  {'ref': '1.79'},\n",
       "  {'ref': '1.80'},\n",
       "  {'ref': '1.81'},\n",
       "  {'ref': '1.82'},\n",
       "  {'ref': '1.83'},\n",
       "  {'ref': '1.84'},\n",
       "  {'ref': '1.85'},\n",
       "  {'ref': '1.86'},\n",
       "  {'ref': '1.87'},\n",
       "  {'ref': '1.88'},\n",
       "  {'ref': '1.89'},\n",
       "  {'ref': '1.90'},\n",
       "  {'ref': '1.91'},\n",
       "  {'ref': '1.92'},\n",
       "  {'ref': '1.93'},\n",
       "  {'ref': '1.94'},\n",
       "  {'ref': '1.95'},\n",
       "  {'ref': '1.96'},\n",
       "  {'ref': '1.97'},\n",
       "  {'ref': '1.98'},\n",
       "  {'ref': '1.99'},\n",
       "  {'ref': '1.100'},\n",
       "  {'ref': '1.101'},\n",
       "  {'ref': '1.102'},\n",
       "  {'ref': '1.103'},\n",
       "  {'ref': '1.104'},\n",
       "  {'ref': '1.105'},\n",
       "  {'ref': '1.106'},\n",
       "  {'ref': '1.107'},\n",
       "  {'ref': '1.108'},\n",
       "  {'ref': '1.109'},\n",
       "  {'ref': '1.110'},\n",
       "  {'ref': '1.111'},\n",
       "  {'ref': '1.112'},\n",
       "  {'ref': '1.113'},\n",
       "  {'ref': '1.114'},\n",
       "  {'ref': '1.115'},\n",
       "  {'ref': '1.116'},\n",
       "  {'ref': '1.117'},\n",
       "  {'ref': '1.118'},\n",
       "  {'ref': '1.119'},\n",
       "  {'ref': '1.120'},\n",
       "  {'ref': '1.121'},\n",
       "  {'ref': '1.122'},\n",
       "  {'ref': '1.123'},\n",
       "  {'ref': '1.124'},\n",
       "  {'ref': '1.125'},\n",
       "  {'ref': '1.126'},\n",
       "  {'ref': '1.127'},\n",
       "  {'ref': '1.128'},\n",
       "  {'ref': '1.129'},\n",
       "  {'ref': '1.130'},\n",
       "  {'ref': '1.131'},\n",
       "  {'ref': '1.132'},\n",
       "  {'ref': '1.133'},\n",
       "  {'ref': '1.134'},\n",
       "  {'ref': '1.135'},\n",
       "  {'ref': '1.136'},\n",
       "  {'ref': '1.137'},\n",
       "  {'ref': '1.138'},\n",
       "  {'ref': '1.139'},\n",
       "  {'ref': '1.140'},\n",
       "  {'ref': '1.141'},\n",
       "  {'ref': '1.142'},\n",
       "  {'ref': '1.143'},\n",
       "  {'ref': '1.144'},\n",
       "  {'ref': '1.145'},\n",
       "  {'ref': '1.146'},\n",
       "  {'ref': '1.147'},\n",
       "  {'ref': '1.148'},\n",
       "  {'ref': '1.149'},\n",
       "  {'ref': '1.150'},\n",
       "  {'ref': '1.151'},\n",
       "  {'ref': '1.152'},\n",
       "  {'ref': '1.153'},\n",
       "  {'ref': '1.154'},\n",
       "  {'ref': '1.155'},\n",
       "  {'ref': '1.156'},\n",
       "  {'ref': '1.157'},\n",
       "  {'ref': '1.158'},\n",
       "  {'ref': '1.159'},\n",
       "  {'ref': '1.160'},\n",
       "  {'ref': '1.161'},\n",
       "  {'ref': '1.162'},\n",
       "  {'ref': '1.163'},\n",
       "  {'ref': '1.164'},\n",
       "  {'ref': '1.165'},\n",
       "  {'ref': '1.166'},\n",
       "  {'ref': '1.167'},\n",
       "  {'ref': '1.168'},\n",
       "  {'ref': '1.169'},\n",
       "  {'ref': '1.170'},\n",
       "  {'ref': '1.171'},\n",
       "  {'ref': '1.172'},\n",
       "  {'ref': '1.173'}],\n",
       " '@context': {'hydra': 'https://www.w3.org/ns/hydra/core#',\n",
       "  '@vocab': 'https://w3id.org/dts/api#'},\n",
       " 'citeDepth': 2,\n",
       " 'level': 2,\n",
       " '@id': '/api/dts/navigation?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1&start=1.1&end=1.173&groupBy=1',\n",
       " 'passage': '/api/dts/document?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1{&ref}{&start}{&end}'}"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "print(\n",
    "    urljoin(URI, Metamorphoses_Edition_Collection[\"dts:references\"]+\"&start=1.1&end=1.173&level=0\")\n",
    ")\n",
    "Ovid_Poem_1_Lines_First_Group = requests.get(\n",
    "    urljoin(URI, Metamorphoses_Edition_Collection[\"dts:references\"]+\"&start=1.1&end=1.173&level=0\")\n",
    ").json()\n",
    "Ovid_Poem_1_Lines_First_Group"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Getting the text\n",
    "\n",
    "Now that we can see what the available passages are, why not get to the text passages ?\n",
    "\n",
    "Let see... We build this the same way than the Navigation query ! But instead, we use `document` from the entry point !\n",
    "\n",
    "### Getting an excerpt\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "http://texts.alpheios.net/api/dts/document?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1&start=1.1&end=1.173\n",
      "<TEI xmlns=\"http://www.tei-c.org/ns/1.0\" xmlns:py=\"http://codespeak.net/lxml/objectify/pytype\" py:pytype=\"TREE\"><dts:fragment xmlns:dts=\"https://w3id.org/dts/api#\"><text><body n=\"urn:cts:latinLit:phi0959.phi006.alpheios-text-lat1\"><div type=\"edition\" xml:lang=\"lat\" n=\"urn:cts:latinLit:phi0959.phi006.alpheios-text-lat1\"><div type=\"textpart\" subtype=\"book\" n=\"1\"><l n=\"1\"><w ana=\"1-1\">In</w><w ana=\"1-2\">nova</w><w ana=\"1-3\">fert</w><w ana=\"1-4\">animus</w><w ana=\"1-5\">mutatas</w><w ana=\"1-6\">dicere</w><w ana=\"1-7\">formas</w></l><l n=\"2\"><w ana=\"1-8\">corpora</w>; <w ana=\"2-1\">di</w>, <w ana=\"2-3\">coeptis</w> (<w ana=\"2-5\">nam</w> \n",
      "               <w ana=\"2-6\">vos</w> \n",
      "               <w ana=\"2-7\">mutastis</w> \n",
      "               <w ana=\"2-8\">et</w> \n",
      "               <w ana=\"2-9\">illas</w>)</l><l n=\"3\"><w ana=\"2-11\">adspirate</w><w ana=\"2-12\">meis</w><w ana=\"2-13 2-14\">primaque</w><w ana=\"2-15\">ab</w><w ana=\"2-16\">origine</w><w ana=\"2-17\">mundi</w></l><l n=\"4\"><w ana=\"2-18\">ad</w><w ana=\"2-19\">mea</w><w ana=\"2-20\">perpetuum</w><w ana=\"2-21\">deducite</w><w ana=\"2-22\">tempora</w><w ana=\"2-23\">carmen</w>.</l><milestone n=\"5\" unit=\"card\"/><milestone ed=\"Magnus\" n=\"Mundi origo.\" unit=\"tale\"/><milestone ed=\"P\" unit=\"para\"/><l n=\"5\"><w ana=\"3-1\">Ante</w><w ana=\"3-2\">mare</w><w ana=\"3-3\">et</w><w ana=\"3-4\">terras</w><w ana=\"3-5\">et</w><w ana=\"3-6\">quod</w><w ana=\"3-7\">tegit</w><w ana=\"3-8\">omnia</w><w ana=\"3-9\">caelum</w></l><l n=\"6\"><w ana=\"3-10\">unus</w><w ana=\"3-11\">erat</w><w ana=\"3-12\">toto</w><w ana=\"3-13\">naturae</w><w ana=\"3-14\">vultus</w><w ana=\"3-15\">in</w><w ana=\"3-16\">orbe</w>,</l><l n=\"7\"><w ana=\"3-18\">quem</w><w ana=\"3-19\">dixere</w><w ana=\"3-20\">chaos</w>: <w ana=\"4-1\">rudis</w><w ana=\"4-2 4-3 4-4 4-5 4-6\">indigestaque</w><w ana=\"4-2 4-3 4-4 4-5 4-6\">moles</w></l><l n=\"8\"><w ana=\"4-2 4-3 4-4 4-5 4-6\">nec</w><w ana=\"4-7\">quicquam</w><w ana=\"4-8\">nisi</w><w ana=\"4-9\">pondus</w><w ana=\"4-10\">iners</w><w ana=\"4-11 4-12\">congestaque</w><w ana=\"4-13\">eodem</w></l><l n=\"9\"><w ana=\"4-14\">non</w><w ana=\"4-15\">bene</w><w ana=\"4-16\">iunctarum</w><w ana=\"4-17\">discordia</w><w ana=\"4-18\">semina</w><w ana=\"4-19\">rerum</w>.</l><l n=\"10\">nullus adhuc mundo praebebat lumina Titan,</l><l n=\"11\">nec nova crescendo reparabat cornua Phoebe,</l><l n=\"12\">nec circumfuso pendebat in aere tellus</l><l n=\"13\">ponderibus librata suis, nec bracchia longo</l><l n=\"14\">margine terrarum porrexerat Amphitrite;</l><l n=\"15\">utque aer, tellus illic et pontus et aether.</l><l n=\"16\">Sic erat instabilis tellus, innabilis unda,</l><l n=\"17\">lucis egens aer: nulli sua forma manebat,</l><l n=\"18\">obstabatque aliis aliud, quia corpore in uno</l><l n=\"19\">frigida pugnabant calidis, umentia siccis,</l><l n=\"20\">mollia cum duris, sine pondere habentia pondus.</l><milestone ed=\"P\" unit=\"para\"/><l n=\"21\">Hanc deus et melior litem natura diremit.</l><l n=\"22\">Nam caelo terras et terris abscidit undas,</l><l n=\"23\">et liquidum spisso secrevit ab aere caelum.</l><l n=\"24\">Quae postquam evolvit caecoque exemit acervo,</l><l n=\"25\">dissociata locis concordi pace ligavit.</l><l n=\"26\">Ignea convexi vis et sine pondere caeli</l><l n=\"27\">emicuit summaque locum sibi fecit in arce:</l><l n=\"28\">proximus est aer illi levitate locoque:</l><l n=\"29\">densior his tellus, elementaque grandia traxit</l><l n=\"30\">et pressa est gravitate sua: circumfluus umor</l><l n=\"31\">ultima possedit solidumque coercuit orbem.</l><milestone ed=\"P\" unit=\"para\"/><l n=\"32\">Sic ubi dispositam quisquis fuit ille deorum</l><l n=\"33\">congeriem secuit sectamque in membra redegit,</l><l n=\"34\">principio terram, ne non aequalis ab omni</l><l n=\"35\">parte foret, magni speciem glomeravit in orbis.</l><l n=\"36\">Tum freta diffudit rapidisque tumescere ventis</l><l n=\"37\">iussit et ambitae circumdare litora terrae.</l><l n=\"38\">Addidit et fontes et stagna inmensa lacusque</l><l n=\"39\">fluminaque obliquis cinxit declivia ripis,</l><l n=\"40\">quae, diversa locis, partim sorbentur ab ipsa,</l><l n=\"41\">in mare perveniunt partim campoque recepta</l><l n=\"42\">liberioris aquae pro ripis litora pulsant.</l><l n=\"43\">Iussit et extendi campos, subsidere valles,</l><l n=\"44\">fronde tegi silvas, lapidosos surgere montes.</l><l n=\"45\">Utque duae dextra caelum totidemque sinistra</l><l n=\"46\">parte secant zonae, quinta est ardentior illis,</l><l n=\"47\">sic onus inclusum numero distinxit eodem</l><l n=\"48\">cura dei, totidemque plagae tellure premuntur.</l><l n=\"49\">Quarum quae media est, non est habitabilis aestu:</l><l n=\"50\">nix tegit alta duas: totidem inter utrumque locavit</l><l n=\"51\">temperiemque dedit mixta cum frigore flamma.</l><milestone ed=\"P\" unit=\"para\"/><l n=\"52\">Inminet his aer. Qui quanto est pondere terrae,</l><l n=\"53\">pondere aquae levior tanto est onerosior igni.</l><l n=\"54\">Illic et nebulas, illic consistere nubes</l><l n=\"55\">iussit et humanas motura tonitrua mentes</l><l n=\"56\">et cum fulminibus facientes fulgura ventos.</l><l n=\"57\">His quoque non passim mundi fabricator habendum</l><l n=\"58\">aera permisit: vix nunc obsistitur illis,</l><l n=\"59\">cum sua quisque regant diverso flamina tractu,</l><l n=\"60\">quin lanient mundum: tanta est discordia fratrum.</l><l n=\"61\">Eurus ad Auroram Nabataeaque regna recessit</l><l n=\"62\">Persidaque et radiis iuga subdita matutinis;</l><l n=\"63\">vesper et occiduo quae litora sole tepescunt,</l><l n=\"64\">proxima sunt Zephyro: Scythiam septemque triones</l><l n=\"65\">horrifer invasit Boreas: contraria tellus</l><l n=\"66\">nubibus adsiduis pluviaque madescit ab Austro.</l><l n=\"67\">Haec super inposuit liquidum et gravitate carentem</l><l n=\"68\">aethera nec quicquam terrenae faecis habentem.</l><l n=\"69\">Vix ita limitibus dissaepserat omnia certis,</l><l n=\"70\">cum, quae pressa diu massa latuere sub illa,</l><l n=\"71\">sidera coeperunt toto effervescere caelo.</l><milestone ed=\"P\" unit=\"para\"/><l n=\"72\">Neu regio foret ulla suis animalibus orba,</l><l n=\"73\">astra tenent caeleste solum formaeque deorum,</l><l n=\"74\">cesserunt nitidis habitandae piscibus undae,</l><l n=\"75\">terra feras cepit, volucres agitabilis aer.</l><milestone ed=\"P\" unit=\"para\"/><l n=\"76\">Sanctius his animal mentisque capacius altae</l><l n=\"77\">deerat adhuc et quod dominari in cetera posset.</l><l n=\"78\">Natus homo est, sive hunc divino semine fecit</l><l n=\"79\">ille opifex rerum, mundi melioris origo,</l><l n=\"80\">sive recens tellus seductaque nuper ab alto</l><l n=\"81\">aethere cognati retinebat semina caeli;</l><l n=\"82\">quam satus Iapeto mixtam pluvialibus undis</l><l n=\"83\">finxit in effigiem moderantum cuncta deorum.</l><l n=\"84\">Pronaque cum spectent animalia cetera terram,</l><l n=\"85\">os homini sublime dedit, caelumque videre</l><l n=\"86\">iussit et erectos ad sidera tollere vultus.</l><l n=\"87\">Sic, modo quae fuerat rudis et sine imagine, tellus</l><l n=\"88\">induit ignotas hominum conversa figuras.</l><milestone n=\"89\" unit=\"card\"/><milestone ed=\"Magnus\" n=\"Quattuor aetates. Gigantes.\" unit=\"tale\"/><milestone ed=\"P\" unit=\"para\"/><l n=\"89\">Aurea prima sata est aetas, quae vindice nullo,</l><l n=\"90\">sponte sua, sine lege fidem rectumque colebat.</l><l n=\"91\">Poena metusque aberant, nec verba minantia fixo</l><l n=\"92\">aere legebantur, nec supplex turba timebat</l><l n=\"93\">iudicis ora sui, sed erant sine vindice tuti.</l><l n=\"94\">Nondum caesa suis, peregrinum ut viseret orbem,</l><l n=\"95\">montibus in liquidas pinus descenderat undas,</l><l n=\"96\">nullaque mortales praeter sua litora norant.</l><l n=\"97\">Nondum praecipites cingebant oppida fossae;</l><l n=\"98\">non tuba directi, non aeris cornua flexi,</l><l n=\"99\">non galeae, non ensis erat: sine militis usu</l><l n=\"100\">mollia securae peragebant otia gentes.</l><l n=\"101\">ipsa quoque inmunis rastroque intacta nec ullis</l><l n=\"102\">saucia vomeribus per se dabat omnia tellus;</l><l n=\"103\">contentique cibis nullo cogente creatis</l><l n=\"104\">arbuteos fetus montanaque fraga legebant</l><l n=\"105\">cornaque et in duris haerentia mora rubetis</l><l n=\"106\">et quae deciderant patula Iovis arbore glandes.</l><l n=\"107\">Ver erat aeternum, placidique tepentibus auris</l><l n=\"108\">mulcebant zephyri natos sine semine flores.</l><l n=\"109\">Mox etiam fruges tellus inarata ferebat,</l><l n=\"110\">nec renovatus ager gravidis canebat aristis;</l><l n=\"111\">flumina iam lactis, iam flumina nectaris ibant,</l><l n=\"112\">flavaque de viridi stillabant ilice mella.</l><milestone ed=\"P\" unit=\"para\"/><l n=\"113\">Postquam, Saturno tenebrosa in Tartara misso,</l><l n=\"114\">sub Iove mundus erat, subiit argentea proles,</l><l n=\"115\">auro deterior, fulvo pretiosior aere.</l><l n=\"116\">Iuppiter antiqui contraxit tempora veris</l><l n=\"117\">perque hiemes aestusque et inaequalis autumnos</l><l n=\"118\">et breve ver spatiis exegit quattuor annum.</l><l n=\"119\">Tum primum siccis aer fervoribus ustus</l><l n=\"120\">canduit, et ventis glacies adstricta pependit.</l><l n=\"121\">Tum primum subiere domus (domus antra fuerunt</l><l n=\"122\">et densi frutices et vinctae cortice virgae).</l><l n=\"123\">Semina tum primum longis Cerealia sulcis</l><l n=\"124\">obruta sunt, pressique iugo gemuere iuvenci.</l><milestone ed=\"P\" unit=\"para\"/><l n=\"125\">Tertia post illam successit aenea proles,</l><l n=\"126\">saevior ingeniis et ad horrida promptior arma,</l><l n=\"127\">non scelerata tamen. De duro est ultima ferro.</l><l n=\"128\">Protinus inrupit venae peioris in aevum</l><l n=\"129\">omne nefas: fugere pudor verumque fidesque;</l><l n=\"130\">In quorum subiere locum fraudesque dolique</l><l n=\"131\">insidiaeque et vis et amor sceleratus habendi.</l><l n=\"132\">Vela dabat ventis (nec adhuc bene noverat illos)</l><l n=\"133\">navita; quaeque diu steterant in montibus altis,</l><l n=\"134\">fluctibus ignotis insultavere carinae,</l><l n=\"135\">communemque prius ceu lumina solis et auras</l><l n=\"136\">cautus humum longo signavit limite mensor.</l><l n=\"137\">Nec tantum segetes alimentaque debita dives</l><l n=\"138\">poscebatur humus, sed itum est in viscera terrae:</l><l n=\"139\">quasque recondiderat Stygiisque admoverat umbris,</l><l n=\"140\">effodiuntur opes, inritamenta malorum.</l><l n=\"141\">Iamque nocens ferrum ferroque nocentius aurum</l><l n=\"142\">prodierat: prodit bellum, quod pugnat utroque,</l><l n=\"143\">sanguineaque manu crepitantia concutit arma.</l><l n=\"144\">Vivitur ex rapto: non hospes ab hospite tutus,</l><l n=\"145\">non socer a genero; fratrum quoque gratia rara est.</l><l n=\"146\">Inminet exitio vir coniugis, illa mariti;</l><l n=\"147\">lurida terribiles miscent aconita novercae;</l><l n=\"148\">filius ante diem patrios inquirit in annos.</l><l n=\"149\">Victa iacet pietas, et virgo caede madentis,</l><l n=\"150\">ultima caelestum terras Astraea reliquit.</l><milestone ed=\"More\" n=\"Giants\" unit=\"tale\"/><milestone ed=\"P\" unit=\"para\"/><l n=\"151\">Neve foret terris securior arduus aether,</l><l n=\"152\">adfectasse ferunt regnum caeleste Gigantas</l><l n=\"153\">altaque congestos struxisse ad sidera montes.</l><l n=\"154\">Tum pater omnipotens misso perfregit Olympum</l><l n=\"155\">fulmine et excussit subiectae Pelion Ossae.</l><l n=\"156\">Obruta mole sua cum corpora dira iacerent,</l><l n=\"157\">perfusam multo natorum sanguine Terram</l><l n=\"158\">inmaduisse ferunt calidumque animasse cruorem,</l><l n=\"159\">et, ne nulla suae stirpis monimenta manerent,</l><l n=\"160\">in faciem vertisse hominum. Sed et illa propago</l><l n=\"161\">contemptrix superum saevaeque avidissima caedis</l><l n=\"162\">et violenta fuit: scires e sanguine natos.</l><milestone n=\"163\" unit=\"card\"/><milestone ed=\"Magnus\" n=\"Lycaon.\" unit=\"tale\"/><milestone ed=\"P\" unit=\"para\"/><l n=\"163\"><w ana=\"5-1\">Quae</w><w ana=\"5-2\">pater</w><w ana=\"5-3\">ut</w><w ana=\"5-4\">summa</w><w ana=\"5-5\">vidit</w><w ana=\"5-6\">Saturnius</w><w ana=\"5-7\">arce</w>,</l><l n=\"164\"><w ana=\"5-9\">ingemit</w><w ana=\"5-10\">et</w>, <w ana=\"5-12\">facto</w><w ana=\"5-13\">nondum</w><w ana=\"5-14\">vulgata</w><w ana=\"5-15\">recenti</w>,</l><l n=\"165\"><w ana=\"5-17\">foeda</w><w ana=\"5-18\">Lycaoniae</w><w ana=\"5-19\">referens</w><w ana=\"5-20\">convivia</w><w ana=\"5-21\">mensae</w>,</l><l n=\"166\"><w ana=\"5-23\">ingentes</w><w ana=\"5-24\">animo</w><w ana=\"5-25\">et</w><w ana=\"5-26\">dignas</w><w ana=\"5-27\">Iove</w><w ana=\"5-28\">concipit</w><w ana=\"5-29\">iras</w>,</l><l n=\"167\"><w ana=\"5-31 5-32\">conciliumque</w><w ana=\"5-33\">vocat</w>: <w ana=\"6-1\">tenuit</w><w ana=\"6-2\">mora</w><w ana=\"6-3\">nulla</w><w ana=\"6-4\">vocatos</w>.</l><milestone ed=\"P\" unit=\"para\"/><l n=\"168\"><w ana=\"7-1\">Est</w><w ana=\"7-2\">via</w><w ana=\"7-3\">sublimis</w>, <w ana=\"7-5\">caelo</w><w ana=\"7-6\">manifesta</w><w ana=\"7-7\">sereno</w>:</l><l n=\"169\"><w ana=\"8-1\">lactea</w><w ana=\"8-2\">nomen</w><w ana=\"8-3\">habet</w>, <w ana=\"8-5\">candore</w><w ana=\"8-6\">notabilis</w><w ana=\"8-7\">ipso</w>.</l><l n=\"170\"><w ana=\"9-1\">Hac</w><w ana=\"9-2\">iter</w><w ana=\"9-3\">est</w><w ana=\"9-4\">superis</w><w ana=\"9-5\">ad</w><w ana=\"9-6\">magni</w><w ana=\"9-7\">tecta</w><w ana=\"9-8\">Tonantis</w></l><l n=\"171\"><w ana=\"9-9 9-10 9-11 10-1 10-2 10-3\">regalemque</w><w ana=\"9-9 9-10 9-11 10-1 10-2 10-3\">domum</w>. <w ana=\"9-9 9-10 9-11 10-1 10-2 10-3\">Dextra</w><w ana=\"9-9 9-10 9-11 10-1 10-2 10-3\">laevaque</w><w ana=\"10-4\">deorum</w></l><l n=\"172\"><w ana=\"10-5\">atria</w><w ana=\"10-6\">nobilium</w><w ana=\"10-7\">valvis</w><w ana=\"10-8\">celebrantur</w><w ana=\"10-9\">apertis</w></l><l n=\"173\">(<w ana=\"10-11\">plebs</w> \n",
      "               <w ana=\"10-12\">habitat</w> \n",
      "               <w ana=\"10-13\">diversa</w> \n",
      "               <w ana=\"10-14\">locis</w>): <w ana=\"11-1\">hac</w> \n",
      "               <w ana=\"11-2\">parte</w> \n",
      "               <w ana=\"11-3\">potentes</w>\n",
      "            </l></div></div></body></text></dts:fragment></TEI>\n"
     ]
    }
   ],
   "source": [
    "Ovid_Poem_Text = requests.get(\n",
    "    urljoin(URI, Metamorphoses_Edition_Collection[\"dts:passage\"]+\"&start=1.1&end=1.173\")\n",
    ")\n",
    "print(\n",
    "    urljoin(URI, Metamorphoses_Edition_Collection[\"dts:passage\"]+\"&start=1.1&end=1.173\")\n",
    ")\n",
    "print(Ovid_Poem_Text.text)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Navigating in the Document Endpoint\n",
    "\n",
    "That's nice ! But how do I know where to go next ! I am lost !\n",
    "\n",
    "Wait no, because we thought about it ! Look at the headers !"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "</api/dts/navigation?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1&start=1.1&end=1.173>; rel=contents, </api/dts/collections?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1>; rel=collection, </api/dts/document?ref=1&id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1>; rel=up, </api/dts/document?id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1&start=1.174&end=1.346>; rel=next\n"
     ]
    }
   ],
   "source": [
    "print(Ovid_Poem_Text.headers[\"Link\"])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "See that sweet rel=next ? Let's go !"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "http://texts.alpheios.net/api/dts/document?end=1.193&id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1&start=1.174\n",
      "<TEI xmlns=\"http://www.tei-c.org/ns/1.0\" xmlns:py=\"http://codespeak.net/lxml/objectify/pytype\" py:pytype=\"TREE\"><dts:fragment xmlns:dts=\"https://w3id.org/dts/api#\"><text><body n=\"urn:cts:latinLit:phi0959.phi006.alpheios-text-lat1\"><div type=\"edition\" xml:lang=\"lat\" n=\"urn:cts:latinLit:phi0959.phi006.alpheios-text-lat1\"><div type=\"textpart\" subtype=\"book\" n=\"1\"><l n=\"174\"><w ana=\"11-4\">caelicolae</w><w ana=\"11-5 11-6\">clarique</w><w ana=\"11-7\">suos</w><w ana=\"11-8\">posuere</w><w ana=\"11-9\">penates</w>.</l><l n=\"175\"><w ana=\"12-1\">Hic</w><w ana=\"12-2\">locus</w><w ana=\"12-3\">est</w>, <w ana=\"12-5\">quem</w>, <w ana=\"12-7\">si</w><w ana=\"12-8\">verbis</w><w ana=\"12-9\">audacia</w><w ana=\"12-10\">detur</w>,</l><l n=\"176\"><w ana=\"12-12\">haud</w><w ana=\"12-13\">timeam</w><w ana=\"12-14\">magni</w><w ana=\"12-15\">dixisse</w><w ana=\"12-16\">Palatia</w><w ana=\"12-17\">caeli</w>.</l><milestone ed=\"P\" unit=\"para\"/><l n=\"177\"><w ana=\"13-1\">Ergo</w><w ana=\"13-2\">ubi</w><w ana=\"13-3\">marmoreo</w><w ana=\"13-4\">superi</w><w ana=\"13-5\">sedere</w><w ana=\"13-6\">recessu</w>,</l><l n=\"178\"><w ana=\"13-8\">celsior</w><w ana=\"13-9\">ipse</w><w ana=\"13-10\">loco</w><w ana=\"13-11 13-12\">sceptroque</w><w ana=\"13-13\">innixus</w><w ana=\"13-14\">eburno</w></l><l n=\"179\"><w ana=\"13-15\">terrificam</w><w ana=\"13-16\">capitis</w><w ana=\"13-17\">concussit</w><w ana=\"13-18 13-19 13-20 13-21\">terque</w><w ana=\"13-18 13-19 13-20 13-21\">quaterque</w></l><l n=\"180\"><w ana=\"13-22\">caesariem</w>, <w ana=\"13-24\">cum</w><w ana=\"13-25\">qua</w><w ana=\"13-26\">terram</w>, <w ana=\"13-28\">mare</w>, <w ana=\"13-30\">sidera</w><w ana=\"13-31\">movit</w>.</l><l n=\"181\"><w ana=\"14-1\">Talibus</w><w ana=\"14-2\">inde</w><w ana=\"14-3\">modis</w><w ana=\"14-4\">ora</w><w ana=\"14-5\">indignantia</w><w ana=\"14-6\">solvit</w>:</l><milestone ed=\"P\" unit=\"para\"/><l n=\"182\">â€œ<w ana=\"15-1\">Non</w> \n",
      "               <w ana=\"15-2\">ego</w> \n",
      "               <w ana=\"15-3\">pro</w> \n",
      "               <w ana=\"15-4\">mundi</w> \n",
      "               <w ana=\"15-5\">regno</w> \n",
      "               <w ana=\"15-6\">magis</w> \n",
      "               <w ana=\"15-7\">anxius</w> \n",
      "               <w ana=\"15-8\">illa</w>\n",
      "            </l><l n=\"183\"><w ana=\"15-9\">tempestate</w><w ana=\"15-10\">fui</w>, <w ana=\"15-12\">qua</w><w ana=\"15-13\">centum</w><w ana=\"15-14\">quisque</w><w ana=\"15-15\">parabat</w></l><l n=\"184\"><w ana=\"15-16\">inicere</w><w ana=\"15-17\">anguipedum</w><w ana=\"15-18\">captivo</w><w ana=\"15-19\">bracchia</w><w ana=\"15-20\">caelo</w>.</l><l n=\"185\"><w ana=\"16-1\">Nam</w><w ana=\"16-2\">quamquam</w><w ana=\"16-3\">ferus</w><w ana=\"16-4\">hostis</w><w ana=\"16-5\">erat</w>, <w ana=\"16-7\">tamen</w><w ana=\"16-8\">illud</w><w ana=\"16-9\">ab</w><w ana=\"16-10\">uno</w></l><l n=\"186\"><w ana=\"16-11\">corpore</w><w ana=\"16-12\">et</w><w ana=\"16-13\">ex</w><w ana=\"16-14\">una</w><w ana=\"16-15\">pendebat</w><w ana=\"16-16\">origine</w><w ana=\"16-17\">bellum</w>.</l><l n=\"187\"><w ana=\"17-1\">Nunc</w><w ana=\"17-2\">mihi</w>, <w ana=\"17-4\">qua</w><w ana=\"17-5\">totum</w><w ana=\"17-6\">Nereus</w><w ana=\"17-7\">circumsonat</w><w ana=\"17-8\">orbem</w>,</l><l n=\"188\"><w ana=\"17-10\">perdendum</w><w ana=\"17-11\">est</w><w ana=\"17-12\">mortale</w><w ana=\"17-13\">genus</w>: <w ana=\"18-1\">per</w><w ana=\"18-2\">flumina</w><w ana=\"18-3\">iuro</w></l><l n=\"189\"><w ana=\"18-4\">infera</w>, <w ana=\"18-6\">sub</w><w ana=\"18-7\">terras</w><w ana=\"18-8\">Stygio</w><w ana=\"18-9\">labentia</w><w ana=\"18-10\">luco</w>!</l><l n=\"190\"><w ana=\"19-1\">cuncta</w><w ana=\"19-2\">prius</w><w ana=\"19-3\">temptata</w>: <w ana=\"20-1\">sed</w><w ana=\"20-2\">inmedicabile</w><w ana=\"20-3\">corpus</w></l><l n=\"191\"><w ana=\"20-4\">ense</w><w ana=\"20-5\">recidendum</w><w ana=\"20-6\">est</w>, <w ana=\"20-8\">ne</w><w ana=\"20-9\">pars</w><w ana=\"20-10\">sincera</w><w ana=\"20-11\">trahatur</w>.</l><l n=\"192\"><w ana=\"21-1\">Sunt</w><w ana=\"21-2\">mihi</w><w ana=\"21-3\">semidei</w>, <w ana=\"21-5\">sunt</w><w ana=\"21-6\">rustica</w><w ana=\"21-7\">numina</w>, <w ana=\"21-9\">nymphae</w></l><l n=\"193\"><w ana=\"21-10\">faunique</w><w ana=\"21-11 21-12\">satyrique</w><w ana=\"21-13\">et</w><w ana=\"21-14\">monticolae</w><w ana=\"21-15\">silvani</w>:</l></div></div></body></text></dts:fragment></TEI>\n"
     ]
    }
   ],
   "source": [
    "Ovid_Poem_Text_Next = requests.get(\n",
    "    urljoin(URI, \"/api/dts/document?end=1.193&id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1&start=1.174\")\n",
    ")\n",
    "print(urljoin(URI, \"/api/dts/document?end=1.193&id=urn%3Acts%3AlatinLit%3Aphi0959.phi006.alpheios-text-lat1&start=1.174\"))\n",
    "print(Ovid_Poem_Text_Next.text)"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.0"
  },
  "toc": {
   "base_numbering": 1,
   "nav_menu": {},
   "number_sections": true,
   "sideBar": true,
   "skip_h1_title": false,
   "title_cell": "Table of Contents",
   "title_sidebar": "Contents",
   "toc_cell": false,
   "toc_position": {},
   "toc_section_display": true,
   "toc_window_display": true
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}