Tutorials/Barrier_Sequence_Database_Search.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "5ae448e2-2335-4418-83e3-74c285de93e1",
   "metadata": {},
   "source": [
    "# Tutorial notebook on how to search the barrier sequence database(s) to get sequences with specific attributes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "id": "0157e9e9-3c40-483d-bed5-7360e237e281",
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import sys\n",
    "sys.path.append(\"..\")  # Use sys to add the parent directory (where hex_maze_utils lives) to the path"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "bb791c6e-7c41-477f-8bc1-85af4c3283e5",
   "metadata": {},
   "source": [
    "## 1. Load a barrier sequence database\n",
    "\n",
    "There are a bunch of different databases in the [`Barrier_Sequence_Databases`](../Barrier_Sequence_Databases/) folder:\n",
    "\n",
    "`barrier_sequence_database` contains 3126 barrier sequences. This is a good place to start.\n",
    "- Sequences are 4-6 mazes long\n",
    "- Every barrier change results in at least one path getting shorter and one getting longer, AND the optimal path order changes (criteria_type=ALL)\n",
    "- There are at least 9 hexes different combined across all optimal paths for all mazes in a sequence (min_hex_diff=9)\n",
    "\n",
    "`barrier_sequences_starting_from_all_mazes` contains 55896 barrier sequences, each starting from a different maze in the `maze_configuration_database`.\n",
    "- Some of these \"sequences\" contain only one maze because no good barrier changes were found. These mazes are still included as they make good candidates for probability change experiments where barrier changes are not needed.\n",
    "- barrier_sequence_database (above) is the subset of this database where sequence_length >= 4\n",
    "\n",
    "`long_barrier_sequences` contains 438 long barrier sequences (generated by allowing get_barrier_sequence to make up to 200 recursive calls instead of the default 40).\n",
    "- Sequences are 6-7 mazes long\n",
    "- Every barrier change results in at least one path getting shorter and one getting longer, AND the optimal path order changes (criteria_type=ALL)\n",
    "- There are at least 9 hexes different combined across all optimal paths for all mazes in a sequence (min_hex_diff=9)\n",
    "\n",
    "`single_choice_point` contains 3720 barrier sequences where all mazes in the sequence have a single choice point.\n",
    "- All sequences are at least 3 mazes long\n",
    "- 104 sequences are 6 mazes long\n",
    "- Every barrier change results in at least one path getting shorter and one getting longer, AND the optimal path order changes (criteria_type=ALL)\n",
    "- There are at least 9 hexes different combined across all optimal paths for all mazes in a sequence (min_hex_diff=9)\n",
    "\n",
    "`criteria_type_any_long_sequences` contains 1734 barrier sequences 5+ mazes long, with relaxed criteria (criteria_type=ANY) to generate longer sequences.\n",
    "- All sequences are at least 5 mazes long\n",
    "- 1338 sequences are 6+ mazes long, 564 are 7+, 334 are 8+, 220 are 9\n",
    "- Every barrier change results in at least one path getting shorter and one getting longer, OR the optimal path order changes (criteria_type=ANY)\n",
    "- There are at least 16 hexes different combined across all optimal paths for all mazes in a sequence (min_hex_diff=16)\n",
    "\n",
    "`criteria_type_any_starting_from_all_mazes` contains 55896 barrier sequences, each starting from a different maze in the `maze_configuration_database`, with relaxed criteria (criteria_type=ANY) to generate longer sequences.\n",
    "- criteria_type_any_long_sequences (above) is the subset of this database where sequence_length >= 5\n",
    "- Some of these \"sequences\" contain only one maze because no good barrier changes were found. These mazes are still included as they make good candidates for probability change experiments where barrier changes are not needed.\n",
    "- Every barrier change results in at least one path getting shorter and one getting longer, OR the optimal path order changes (criteria_type=ANY)\n",
    "- There are at least 16 hexes different combined across all optimal paths for all mazes in a sequence (min_hex_diff=16)\n",
    "\n",
    "`1_choice_point_all_path_lengths_different_first5000` contains 112 barrier sequences where all mazes have a single choice point AND all 3 path lengths are different.\n",
    "- All sequences are at least 3 mazes long. 6 sequences are 4 mazes long\n",
    "- This was generated starting from the first 5000 mazes in the `maze_configuration_database`. To add to it, start from maze 5001\n",
    "\n",
    "\n",
    "As I add new databases, I will document them here (and if you generate a new database, please document it here as well!)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "id": "9438e15e-f6f3-41aa-b13a-701db955ca64",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>barrier_sequence</th>\n",
       "      <th>sequence_length</th>\n",
       "      <th>barrier_changes</th>\n",
       "      <th>reward_path_lengths</th>\n",
       "      <th>choice_points</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>[(39, 7, 10, 42, 18, 20, 23, 26, 30), (37, 39,...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[26, 37], [10, 17], [20, 24]]</td>\n",
       "      <td>[[25, 19, 17], [15, 19, 19], [25, 17, 19], [17...</td>\n",
       "      <td>[{29}, {17, 26, 29}, {29}, {26}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>[(34, 36, 37, 7, 45, 14, 17, 20, 28), (34, 36,...</td>\n",
       "      <td>6</td>\n",
       "      <td>[[17, 25], [36, 26], [26, 41], [41, 32], [34, ...</td>\n",
       "      <td>[[23, 19, 17], [15, 19, 23], [21, 19, 15], [15...</td>\n",
       "      <td>[{35}, {13}, {35}, {26, 35, 13}, {35, 36, 13},...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>45</th>\n",
       "      <td>[(32, 34, 11, 44, 13, 46, 15, 21, 30), (32, 34...</td>\n",
       "      <td>5</td>\n",
       "      <td>[[13, 16], [16, 10], [30, 20], [20, 36]]</td>\n",
       "      <td>[[21, 15, 19], [17, 25, 19], [19, 15, 19], [19...</td>\n",
       "      <td>[{24}, {31}, {16, 24, 31}, {31}, {16}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46</th>\n",
       "      <td>[(37, 7, 42, 44, 14, 20, 25, 28, 31), (37, 7, ...</td>\n",
       "      <td>5</td>\n",
       "      <td>[[31, 17], [17, 16], [16, 30], [37, 21]]</td>\n",
       "      <td>[[15, 17, 21], [23, 17, 17], [15, 19, 17], [15...</td>\n",
       "      <td>[{13}, {29}, {26}, {26, 13, 29}, {29}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>60</th>\n",
       "      <td>[(34, 37, 10, 45, 14, 15, 24, 25, 27), (34, 37...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[24, 39], [39, 28], [27, 36]]</td>\n",
       "      <td>[[19, 21, 15], [19, 15, 17], [19, 17, 15], [17...</td>\n",
       "      <td>[{36}, {16, 24, 36}, {16, 35, 36}, {16}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55834</th>\n",
       "      <td>[(39, 8, 42, 16, 19, 21, 25, 27, 30), (39, 8, ...</td>\n",
       "      <td>5</td>\n",
       "      <td>[[16, 10], [21, 36], [36, 17], [17, 24]]</td>\n",
       "      <td>[[17, 23, 17], [19, 15, 17], [17, 15, 19], [21...</td>\n",
       "      <td>[{31}, {16, 29, 31}, {16}, {29}, {31}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55848</th>\n",
       "      <td>[(7, 42, 44, 14, 20, 23, 28, 30, 31), (7, 42, ...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[31, 17], [17, 37], [30, 17]]</td>\n",
       "      <td>[[15, 17, 21], [23, 17, 17], [15, 17, 19], [23...</td>\n",
       "      <td>[{13}, {29}, {26, 13, 29}, {29}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55850</th>\n",
       "      <td>[(36, 39, 8, 10, 42, 19, 21, 24, 27), (39, 8, ...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[36, 30], [24, 17], [21, 24]]</td>\n",
       "      <td>[[19, 17, 23], [19, 25, 17], [21, 15, 17], [17...</td>\n",
       "      <td>[{16}, {31}, {29}, {31}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55852</th>\n",
       "      <td>[(37, 8, 9, 45, 20, 21, 23, 27, 29), (35, 37, ...</td>\n",
       "      <td>5</td>\n",
       "      <td>[[29, 35], [35, 34], [37, 36], [36, 31]]</td>\n",
       "      <td>[[19, 21, 15], [19, 17, 25], [19, 19, 15], [17...</td>\n",
       "      <td>[{36}, {13}, {35, 36, 13}, {13}, {35}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55883</th>\n",
       "      <td>[(34, 35, 37, 10, 12, 45, 18, 25, 27), (34, 37...</td>\n",
       "      <td>6</td>\n",
       "      <td>[[35, 28], [27, 30], [30, 21], [21, 41], [28, ...</td>\n",
       "      <td>[[17, 17, 21], [17, 19, 15], [15, 19, 21], [21...</td>\n",
       "      <td>[{17}, {17, 35, 36}, {17}, {35}, {17, 26, 35},...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>3126 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                        barrier_sequence  sequence_length  \\\n",
       "18     [(39, 7, 10, 42, 18, 20, 23, 26, 30), (37, 39,...                4   \n",
       "34     [(34, 36, 37, 7, 45, 14, 17, 20, 28), (34, 36,...                6   \n",
       "45     [(32, 34, 11, 44, 13, 46, 15, 21, 30), (32, 34...                5   \n",
       "46     [(37, 7, 42, 44, 14, 20, 25, 28, 31), (37, 7, ...                5   \n",
       "60     [(34, 37, 10, 45, 14, 15, 24, 25, 27), (34, 37...                4   \n",
       "...                                                  ...              ...   \n",
       "55834  [(39, 8, 42, 16, 19, 21, 25, 27, 30), (39, 8, ...                5   \n",
       "55848  [(7, 42, 44, 14, 20, 23, 28, 30, 31), (7, 42, ...                4   \n",
       "55850  [(36, 39, 8, 10, 42, 19, 21, 24, 27), (39, 8, ...                4   \n",
       "55852  [(37, 8, 9, 45, 20, 21, 23, 27, 29), (35, 37, ...                5   \n",
       "55883  [(34, 35, 37, 10, 12, 45, 18, 25, 27), (34, 37...                6   \n",
       "\n",
       "                                         barrier_changes  \\\n",
       "18                        [[26, 37], [10, 17], [20, 24]]   \n",
       "34     [[17, 25], [36, 26], [26, 41], [41, 32], [34, ...   \n",
       "45              [[13, 16], [16, 10], [30, 20], [20, 36]]   \n",
       "46              [[31, 17], [17, 16], [16, 30], [37, 21]]   \n",
       "60                        [[24, 39], [39, 28], [27, 36]]   \n",
       "...                                                  ...   \n",
       "55834           [[16, 10], [21, 36], [36, 17], [17, 24]]   \n",
       "55848                     [[31, 17], [17, 37], [30, 17]]   \n",
       "55850                     [[36, 30], [24, 17], [21, 24]]   \n",
       "55852           [[29, 35], [35, 34], [37, 36], [36, 31]]   \n",
       "55883  [[35, 28], [27, 30], [30, 21], [21, 41], [28, ...   \n",
       "\n",
       "                                     reward_path_lengths  \\\n",
       "18     [[25, 19, 17], [15, 19, 19], [25, 17, 19], [17...   \n",
       "34     [[23, 19, 17], [15, 19, 23], [21, 19, 15], [15...   \n",
       "45     [[21, 15, 19], [17, 25, 19], [19, 15, 19], [19...   \n",
       "46     [[15, 17, 21], [23, 17, 17], [15, 19, 17], [15...   \n",
       "60     [[19, 21, 15], [19, 15, 17], [19, 17, 15], [17...   \n",
       "...                                                  ...   \n",
       "55834  [[17, 23, 17], [19, 15, 17], [17, 15, 19], [21...   \n",
       "55848  [[15, 17, 21], [23, 17, 17], [15, 17, 19], [23...   \n",
       "55850  [[19, 17, 23], [19, 25, 17], [21, 15, 17], [17...   \n",
       "55852  [[19, 21, 15], [19, 17, 25], [19, 19, 15], [17...   \n",
       "55883  [[17, 17, 21], [17, 19, 15], [15, 19, 21], [21...   \n",
       "\n",
       "                                           choice_points  \n",
       "18                      [{29}, {17, 26, 29}, {29}, {26}]  \n",
       "34     [{35}, {13}, {35}, {26, 35, 13}, {35, 36, 13},...  \n",
       "45                [{24}, {31}, {16, 24, 31}, {31}, {16}]  \n",
       "46                [{13}, {29}, {26}, {26, 13, 29}, {29}]  \n",
       "60              [{36}, {16, 24, 36}, {16, 35, 36}, {16}]  \n",
       "...                                                  ...  \n",
       "55834             [{31}, {16, 29, 31}, {16}, {29}, {31}]  \n",
       "55848                   [{13}, {29}, {26, 13, 29}, {29}]  \n",
       "55850                           [{16}, {31}, {29}, {31}]  \n",
       "55852             [{36}, {13}, {35, 36, 13}, {13}, {35}]  \n",
       "55883  [{17}, {17, 35, 36}, {17}, {35}, {17, 26, 35},...  \n",
       "\n",
       "[3126 rows x 5 columns]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Load the database of your choice of different barrier sequences as 'barrier_sequence_df'\n",
    "barrier_sequence_df = pd.read_pickle('../Barrier_Sequence_Databases/barrier_sequence_database.pkl')\n",
    "display(barrier_sequence_df)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f3f25e9d-505a-4e3d-9fb8-72553f695b9c",
   "metadata": {},
   "source": [
    "## 2. Filter the database based on certain criteria"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "id": "1dc6c3d4-9c86-439c-8936-51284a77da31",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "There are 1179 barrier sequences in our database that are at least 5 mazes long:\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>barrier_sequence</th>\n",
       "      <th>sequence_length</th>\n",
       "      <th>barrier_changes</th>\n",
       "      <th>reward_path_lengths</th>\n",
       "      <th>choice_points</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>[(34, 36, 37, 7, 45, 14, 17, 20, 28), (34, 36,...</td>\n",
       "      <td>6</td>\n",
       "      <td>[[17, 25], [36, 26], [26, 41], [41, 32], [34, ...</td>\n",
       "      <td>[[23, 19, 17], [15, 19, 23], [21, 19, 15], [15...</td>\n",
       "      <td>[{35}, {13}, {35}, {26, 35, 13}, {35, 36, 13},...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>45</th>\n",
       "      <td>[(32, 34, 11, 44, 13, 46, 15, 21, 30), (32, 34...</td>\n",
       "      <td>5</td>\n",
       "      <td>[[13, 16], [16, 10], [30, 20], [20, 36]]</td>\n",
       "      <td>[[21, 15, 19], [17, 25, 19], [19, 15, 19], [19...</td>\n",
       "      <td>[{24}, {31}, {16, 24, 31}, {31}, {16}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46</th>\n",
       "      <td>[(37, 7, 42, 44, 14, 20, 25, 28, 31), (37, 7, ...</td>\n",
       "      <td>5</td>\n",
       "      <td>[[31, 17], [17, 16], [16, 30], [37, 21]]</td>\n",
       "      <td>[[15, 17, 21], [23, 17, 17], [15, 19, 17], [15...</td>\n",
       "      <td>[{13}, {29}, {26}, {26, 13, 29}, {29}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>123</th>\n",
       "      <td>[(37, 40, 9, 42, 17, 18, 20, 25, 28), (37, 40,...</td>\n",
       "      <td>6</td>\n",
       "      <td>[[17, 10], [42, 32], [32, 36], [36, 26], [25, ...</td>\n",
       "      <td>[[23, 17, 17], [15, 19, 17], [17, 19, 15], [15...</td>\n",
       "      <td>[{29}, {17, 26, 29}, {17, 36, 29}, {17}, {29},...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>296</th>\n",
       "      <td>[(34, 37, 7, 41, 10, 44, 15, 18, 25), (34, 37,...</td>\n",
       "      <td>5</td>\n",
       "      <td>[[7, 17], [17, 20], [20, 11], [44, 24]]</td>\n",
       "      <td>[[15, 17, 19], [21, 15, 19], [15, 21, 19], [17...</td>\n",
       "      <td>[{24, 17, 26}, {24}, {26}, {16, 24, 26}, {26}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55773</th>\n",
       "      <td>[(32, 37, 7, 40, 11, 44, 17, 20, 28), (32, 35,...</td>\n",
       "      <td>5</td>\n",
       "      <td>[[17, 35], [35, 21], [37, 36], [21, 17]]</td>\n",
       "      <td>[[21, 17, 15], [17, 17, 23], [19, 17, 15], [17...</td>\n",
       "      <td>[{29}, {13}, {13, 36, 29}, {13}, {29}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55797</th>\n",
       "      <td>[(32, 34, 37, 10, 45, 14, 15, 25, 30), (32, 34...</td>\n",
       "      <td>5</td>\n",
       "      <td>[[30, 23], [23, 40], [32, 41], [40, 20]]</td>\n",
       "      <td>[[19, 15, 21], [19, 17, 15], [19, 15, 17], [17...</td>\n",
       "      <td>[{16}, {16, 35, 36}, {16, 24, 36}, {16, 24, 26...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55834</th>\n",
       "      <td>[(39, 8, 42, 16, 19, 21, 25, 27, 30), (39, 8, ...</td>\n",
       "      <td>5</td>\n",
       "      <td>[[16, 10], [21, 36], [36, 17], [17, 24]]</td>\n",
       "      <td>[[17, 23, 17], [19, 15, 17], [17, 15, 19], [21...</td>\n",
       "      <td>[{31}, {16, 29, 31}, {16}, {29}, {31}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55852</th>\n",
       "      <td>[(37, 8, 9, 45, 20, 21, 23, 27, 29), (35, 37, ...</td>\n",
       "      <td>5</td>\n",
       "      <td>[[29, 35], [35, 34], [37, 36], [36, 31]]</td>\n",
       "      <td>[[19, 21, 15], [19, 17, 25], [19, 19, 15], [17...</td>\n",
       "      <td>[{36}, {13}, {35, 36, 13}, {13}, {35}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55883</th>\n",
       "      <td>[(34, 35, 37, 10, 12, 45, 18, 25, 27), (34, 37...</td>\n",
       "      <td>6</td>\n",
       "      <td>[[35, 28], [27, 30], [30, 21], [21, 41], [28, ...</td>\n",
       "      <td>[[17, 17, 21], [17, 19, 15], [15, 19, 21], [21...</td>\n",
       "      <td>[{17}, {17, 35, 36}, {17}, {35}, {17, 26, 35},...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>1179 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                        barrier_sequence  sequence_length  \\\n",
       "34     [(34, 36, 37, 7, 45, 14, 17, 20, 28), (34, 36,...                6   \n",
       "45     [(32, 34, 11, 44, 13, 46, 15, 21, 30), (32, 34...                5   \n",
       "46     [(37, 7, 42, 44, 14, 20, 25, 28, 31), (37, 7, ...                5   \n",
       "123    [(37, 40, 9, 42, 17, 18, 20, 25, 28), (37, 40,...                6   \n",
       "296    [(34, 37, 7, 41, 10, 44, 15, 18, 25), (34, 37,...                5   \n",
       "...                                                  ...              ...   \n",
       "55773  [(32, 37, 7, 40, 11, 44, 17, 20, 28), (32, 35,...                5   \n",
       "55797  [(32, 34, 37, 10, 45, 14, 15, 25, 30), (32, 34...                5   \n",
       "55834  [(39, 8, 42, 16, 19, 21, 25, 27, 30), (39, 8, ...                5   \n",
       "55852  [(37, 8, 9, 45, 20, 21, 23, 27, 29), (35, 37, ...                5   \n",
       "55883  [(34, 35, 37, 10, 12, 45, 18, 25, 27), (34, 37...                6   \n",
       "\n",
       "                                         barrier_changes  \\\n",
       "34     [[17, 25], [36, 26], [26, 41], [41, 32], [34, ...   \n",
       "45              [[13, 16], [16, 10], [30, 20], [20, 36]]   \n",
       "46              [[31, 17], [17, 16], [16, 30], [37, 21]]   \n",
       "123    [[17, 10], [42, 32], [32, 36], [36, 26], [25, ...   \n",
       "296              [[7, 17], [17, 20], [20, 11], [44, 24]]   \n",
       "...                                                  ...   \n",
       "55773           [[17, 35], [35, 21], [37, 36], [21, 17]]   \n",
       "55797           [[30, 23], [23, 40], [32, 41], [40, 20]]   \n",
       "55834           [[16, 10], [21, 36], [36, 17], [17, 24]]   \n",
       "55852           [[29, 35], [35, 34], [37, 36], [36, 31]]   \n",
       "55883  [[35, 28], [27, 30], [30, 21], [21, 41], [28, ...   \n",
       "\n",
       "                                     reward_path_lengths  \\\n",
       "34     [[23, 19, 17], [15, 19, 23], [21, 19, 15], [15...   \n",
       "45     [[21, 15, 19], [17, 25, 19], [19, 15, 19], [19...   \n",
       "46     [[15, 17, 21], [23, 17, 17], [15, 19, 17], [15...   \n",
       "123    [[23, 17, 17], [15, 19, 17], [17, 19, 15], [15...   \n",
       "296    [[15, 17, 19], [21, 15, 19], [15, 21, 19], [17...   \n",
       "...                                                  ...   \n",
       "55773  [[21, 17, 15], [17, 17, 23], [19, 17, 15], [17...   \n",
       "55797  [[19, 15, 21], [19, 17, 15], [19, 15, 17], [17...   \n",
       "55834  [[17, 23, 17], [19, 15, 17], [17, 15, 19], [21...   \n",
       "55852  [[19, 21, 15], [19, 17, 25], [19, 19, 15], [17...   \n",
       "55883  [[17, 17, 21], [17, 19, 15], [15, 19, 21], [21...   \n",
       "\n",
       "                                           choice_points  \n",
       "34     [{35}, {13}, {35}, {26, 35, 13}, {35, 36, 13},...  \n",
       "45                [{24}, {31}, {16, 24, 31}, {31}, {16}]  \n",
       "46                [{13}, {29}, {26}, {26, 13, 29}, {29}]  \n",
       "123    [{29}, {17, 26, 29}, {17, 36, 29}, {17}, {29},...  \n",
       "296       [{24, 17, 26}, {24}, {26}, {16, 24, 26}, {26}]  \n",
       "...                                                  ...  \n",
       "55773             [{29}, {13}, {13, 36, 29}, {13}, {29}]  \n",
       "55797  [{16}, {16, 35, 36}, {16, 24, 36}, {16, 24, 26...  \n",
       "55834             [{31}, {16, 29, 31}, {16}, {29}, {31}]  \n",
       "55852             [{36}, {13}, {35, 36, 13}, {13}, {35}]  \n",
       "55883  [{17}, {17, 35, 36}, {17}, {35}, {17, 26, 35},...  \n",
       "\n",
       "[1179 rows x 5 columns]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# For example, we only want sequences >= length 5\n",
    "filtered = barrier_sequence_df[barrier_sequence_df['sequence_length'] >= 5]\n",
    "print(f\"There are {len(filtered)} barrier sequences in our database that are at least 5 mazes long:\")\n",
    "display(filtered)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "id": "b5023e7c-ef58-4b8b-b9d7-9f393f448b0f",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "There are 1147 barrier sequences in our database where each maze in the sequence has only 1 choice point:\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>barrier_sequence</th>\n",
       "      <th>sequence_length</th>\n",
       "      <th>barrier_changes</th>\n",
       "      <th>reward_path_lengths</th>\n",
       "      <th>choice_points</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>66</th>\n",
       "      <td>[(9, 42, 44, 17, 22, 23, 24, 27, 30), (9, 42, ...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[24, 20], [17, 13], [20, 26]]</td>\n",
       "      <td>[[17, 23, 17], [23, 17, 17], [15, 21, 17], [23...</td>\n",
       "      <td>[{31}, {29}, {31}, {29}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>118</th>\n",
       "      <td>[(39, 9, 42, 10, 15, 22, 24, 25, 30), (35, 39,...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[24, 35], [9, 11], [35, 20]]</td>\n",
       "      <td>[[15, 21, 17], [15, 17, 19], [17, 15, 19], [17...</td>\n",
       "      <td>[{31}, {17}, {16}, {31}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>193</th>\n",
       "      <td>[(34, 37, 42, 13, 45, 14, 18, 19, 25), (34, 37...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[14, 7], [42, 27], [7, 31]]</td>\n",
       "      <td>[[21, 17, 17], [15, 19, 17], [17, 19, 15], [19...</td>\n",
       "      <td>[{35}, {26}, {36}, {35}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>201</th>\n",
       "      <td>[(34, 37, 41, 10, 14, 15, 17, 19, 25), (34, 37...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[17, 31], [31, 29], [19, 30]]</td>\n",
       "      <td>[[21, 17, 17], [17, 17, 21], [17, 21, 17], [17...</td>\n",
       "      <td>[{35}, {16}, {26}, {16}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>252</th>\n",
       "      <td>[(34, 37, 40, 10, 12, 18, 20, 25, 27), (34, 35...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[20, 35], [35, 31], [27, 42]]</td>\n",
       "      <td>[[17, 21, 17], [17, 17, 21], [21, 17, 17], [15...</td>\n",
       "      <td>[{36}, {17}, {24}, {17}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55556</th>\n",
       "      <td>[(32, 37, 40, 10, 12, 45, 18, 25, 29), (32, 37...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[40, 13], [32, 41], [13, 31]]</td>\n",
       "      <td>[[17, 17, 21], [17, 19, 15], [15, 19, 17], [15...</td>\n",
       "      <td>[{17}, {36}, {26}, {17}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55682</th>\n",
       "      <td>[(37, 42, 10, 12, 45, 18, 25, 29, 30), (37, 10...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[30, 28], [42, 27], [28, 40]]</td>\n",
       "      <td>[[15, 17, 19], [15, 19, 17], [17, 19, 15], [17...</td>\n",
       "      <td>[{17}, {26}, {36}, {17}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55712</th>\n",
       "      <td>[(34, 37, 10, 42, 45, 14, 19, 24, 25), (34, 37...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[24, 17], [17, 31], [42, 13]]</td>\n",
       "      <td>[[17, 21, 17], [21, 17, 17], [17, 17, 21], [19...</td>\n",
       "      <td>[{26}, {35}, {16}, {35}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55755</th>\n",
       "      <td>[(9, 42, 10, 44, 13, 15, 22, 25, 30), (9, 10, ...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[13, 29], [9, 8], [29, 24]]</td>\n",
       "      <td>[[15, 21, 17], [15, 17, 19], [17, 15, 19], [17...</td>\n",
       "      <td>[{31}, {17}, {16}, {31}]</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55850</th>\n",
       "      <td>[(36, 39, 8, 10, 42, 19, 21, 24, 27), (39, 8, ...</td>\n",
       "      <td>4</td>\n",
       "      <td>[[36, 30], [24, 17], [21, 24]]</td>\n",
       "      <td>[[19, 17, 23], [19, 25, 17], [21, 15, 17], [17...</td>\n",
       "      <td>[{16}, {31}, {29}, {31}]</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>1147 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                        barrier_sequence  sequence_length  \\\n",
       "66     [(9, 42, 44, 17, 22, 23, 24, 27, 30), (9, 42, ...                4   \n",
       "118    [(39, 9, 42, 10, 15, 22, 24, 25, 30), (35, 39,...                4   \n",
       "193    [(34, 37, 42, 13, 45, 14, 18, 19, 25), (34, 37...                4   \n",
       "201    [(34, 37, 41, 10, 14, 15, 17, 19, 25), (34, 37...                4   \n",
       "252    [(34, 37, 40, 10, 12, 18, 20, 25, 27), (34, 35...                4   \n",
       "...                                                  ...              ...   \n",
       "55556  [(32, 37, 40, 10, 12, 45, 18, 25, 29), (32, 37...                4   \n",
       "55682  [(37, 42, 10, 12, 45, 18, 25, 29, 30), (37, 10...                4   \n",
       "55712  [(34, 37, 10, 42, 45, 14, 19, 24, 25), (34, 37...                4   \n",
       "55755  [(9, 42, 10, 44, 13, 15, 22, 25, 30), (9, 10, ...                4   \n",
       "55850  [(36, 39, 8, 10, 42, 19, 21, 24, 27), (39, 8, ...                4   \n",
       "\n",
       "                      barrier_changes  \\\n",
       "66     [[24, 20], [17, 13], [20, 26]]   \n",
       "118     [[24, 35], [9, 11], [35, 20]]   \n",
       "193      [[14, 7], [42, 27], [7, 31]]   \n",
       "201    [[17, 31], [31, 29], [19, 30]]   \n",
       "252    [[20, 35], [35, 31], [27, 42]]   \n",
       "...                               ...   \n",
       "55556  [[40, 13], [32, 41], [13, 31]]   \n",
       "55682  [[30, 28], [42, 27], [28, 40]]   \n",
       "55712  [[24, 17], [17, 31], [42, 13]]   \n",
       "55755    [[13, 29], [9, 8], [29, 24]]   \n",
       "55850  [[36, 30], [24, 17], [21, 24]]   \n",
       "\n",
       "                                     reward_path_lengths  \\\n",
       "66     [[17, 23, 17], [23, 17, 17], [15, 21, 17], [23...   \n",
       "118    [[15, 21, 17], [15, 17, 19], [17, 15, 19], [17...   \n",
       "193    [[21, 17, 17], [15, 19, 17], [17, 19, 15], [19...   \n",
       "201    [[21, 17, 17], [17, 17, 21], [17, 21, 17], [17...   \n",
       "252    [[17, 21, 17], [17, 17, 21], [21, 17, 17], [15...   \n",
       "...                                                  ...   \n",
       "55556  [[17, 17, 21], [17, 19, 15], [15, 19, 17], [15...   \n",
       "55682  [[15, 17, 19], [15, 19, 17], [17, 19, 15], [17...   \n",
       "55712  [[17, 21, 17], [21, 17, 17], [17, 17, 21], [19...   \n",
       "55755  [[15, 21, 17], [15, 17, 19], [17, 15, 19], [17...   \n",
       "55850  [[19, 17, 23], [19, 25, 17], [21, 15, 17], [17...   \n",
       "\n",
       "                  choice_points  \n",
       "66     [{31}, {29}, {31}, {29}]  \n",
       "118    [{31}, {17}, {16}, {31}]  \n",
       "193    [{35}, {26}, {36}, {35}]  \n",
       "201    [{35}, {16}, {26}, {16}]  \n",
       "252    [{36}, {17}, {24}, {17}]  \n",
       "...                         ...  \n",
       "55556  [{17}, {36}, {26}, {17}]  \n",
       "55682  [{17}, {26}, {36}, {17}]  \n",
       "55712  [{26}, {35}, {16}, {35}]  \n",
       "55755  [{31}, {17}, {16}, {31}]  \n",
       "55850  [{16}, {31}, {29}, {31}]  \n",
       "\n",
       "[1147 rows x 5 columns]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Or we only want sequences where the each maze only has a single choice point\n",
    "filtered = barrier_sequence_df[barrier_sequence_df['choice_points'].apply(lambda x: all(len(cp) == 1 for cp in x))]\n",
    "print(f\"There are {len(filtered)} barrier sequences in our database where each maze in the sequence has only 1 choice point:\")\n",
    "display(filtered)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "8a3e1b96",
   "metadata": {},
   "source": [
    "Note that searches like the one above simply rule out all sequences where ANY maze has more than one choice point. \n",
    "If a sequence breaks this rule in the 5th maze in the sequence (as many long sequences do), it does not return a valid subsequence, even if there is one.\n",
    "\n",
    "In these cases, it is often preferable to generate a new database that fits the desired criteria (which is why we have the `single_choice_point` database!). \n",
    "\n",
    "\n",
    "See [`Generate_Custom_Barrier_Sequence_Database.ipynb`](Generate_Custom_Barrier_Sequence_Database.ipynb) for more information."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.12.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}