diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md
index d5af724c00..ee36827170 100644
--- a/CONTRIBUTING.md
+++ b/CONTRIBUTING.md
@@ -81,7 +81,7 @@ Once the pull request is approved, a team member will take care of merging.
 
 ## Setting up an Environment
 
-Python 3.7 or later is required.
+Python 3.9 or later is required.
 
 Setting up your KerasNLP development environment requires you to fork the
 KerasNLP repository and clone it locally. With the
@@ -93,72 +93,53 @@ cd keras-nlp
 ```
 
 Next we must setup a python environment with the correct dependencies. We
-recommend using `conda` to install tensorflow dependencies (such as CUDA), and
-`pip` to install python packages from PyPI. The exact method will depend on your
-OS.
-
-**Note**: Please be careful not to use the `tensorflow` pre-packaged with conda,
-which is incompatible with `tensorflow-text` on PyPi, and follow the
-instructions below.
+recommend using `conda` to set up a base environment, and `pip` to install
+python packages from PyPI. The exact method will depend on your OS.
 
 ### Linux (recommended)
 
-To setup a complete environment with TensorFlow, a local install of keras-nlp,
-and all development tools, run the following or adapt it to suit your needs.
+For devloping and unit testing the library, a CPU only environment is often
+sufficient. For any training or inference with the library, you will quickly
+want accelerator support. The easiest way to get GPU support across all of our
+backends is to set up a few different python environements and pull in all cuda
+dependencies via `pip`.
+
+The shell snippet below will install four conda environments: `keras-nlp-cpu`,
+`keras-nlp-jax`, `keras-nlp-torch`, and `keras-nlp-tensorflow`. The cpu
+environement supports all backends without cuda, and each backend environement
+has cuda support.
 
 ```shell
-# Create and activate conda environment.
-conda create -n keras-nlp python=3.9
-conda activate keras-nlp
-
-# The following can be omitted if GPU support is not required.
-conda install -c conda-forge cudatoolkit-dev=11.2 cudnn=8.1.0
-mkdir -p $CONDA_PREFIX/etc/conda/activate.d/
-echo 'export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$CONDA_PREFIX/lib/' >> $CONDA_PREFIX/etc/conda/activate.d/env_vars.sh
-echo 'export XLA_FLAGS=--xla_gpu_cuda_data_dir=$CONDA_PREFIX/' >> $CONDA_PREFIX/etc/conda/activate.d/env_vars.sh
-source $CONDA_PREFIX/etc/conda/activate.d/env_vars.sh
-
-# Install dependencies.
-python -m pip install --upgrade pip
-python -m pip install -r requirements.txt
-python -m pip install -e "."
+conda create -y -n keras-nlp-cpu python=3.10
+conda activate keras-nlp-cpu
+pip install -r requirements.txt  # install deps
+python pip_build.py --install  # install keras-nlp
+
+for backend in "jax" "torch" "tensorflow"; do
+    conda create -y -n keras-nlp-${backend} python=3.10
+    conda activate keras-nlp-${backend}
+    pip install -r requirements-${backend}-cuda.txt  # install deps
+    python pip_build.py --install  # install keras-nlp
+done
 ```
 
-### MacOS
-
-⚠️⚠️⚠️ MacOS binaries are for the M1 architecture are not currently available from
-official sources. You can try experimental development workflow leveraging the
-[tensorflow metal plugin](https://developer.apple.com/metal/tensorflow-plugin/)
-and a [community maintained build](https://github.com/sun1638650145/Libraries-and-Extensions-for-TensorFlow-for-Apple-Silicon)
-of `tensorflow-text`. These binaries are not provided by Google, so proceed at
-your own risk.
-
-#### Experimental instructions for Arm (M1)
+To activate the jax environment and set keras to use jax, run:
 
 ```shell
-# Create and activate conda environment.
-conda create -n keras-nlp python=3.9
-conda activate keras-nlp
-
-# Install dependencies.
-conda install -c apple tensorflow-deps=2.9
-python -m pip install --upgrade pip
-python -m pip install -r requirements-macos-m1.txt
-python -m pip install -e "."
+conda activate keras-nlp-jax && export KERAS_BACKEND=jax
 ```
 
-#### Instructions for x86 (Intel)
+### MacOS
 
-```shell
-# Create and activate conda environment.
-conda create -n keras-nlp python=3.9
-conda activate keras-nlp
-
-# Install dependencies.
-python -m pip install --upgrade pip
-python -m pip install -r requirements.txt
-python -m pip install -e "."
-```
+`tensorflow-text` does not release precompiled binaries for MacOS M-series
+chips, though the library does support building from source on MacOS.
+
+We strongly recommend a Linux development environment for an easy contribution
+experience. To build a dev environement from scratch on MacOS, see the following
+guides:
+
+https://developer.apple.com/metal/tensorflow-plugin/
+https://github.com/tensorflow/text
 
 ### Windows
 
diff --git a/requirements-common.txt b/requirements-common.txt
index 21334a40c2..44661e315a 100644
--- a/requirements-common.txt
+++ b/requirements-common.txt
@@ -16,3 +16,6 @@ namex
 # Optional deps.
 rouge-score
 sentencepiece
+tensorflow-datasets
+# Breakage fix.
+ml-dtypes==0.2.0
diff --git a/requirements-jax-cuda.txt b/requirements-jax-cuda.txt
new file mode 100644
index 0000000000..09f50a4d8c
--- /dev/null
+++ b/requirements-jax-cuda.txt
@@ -0,0 +1,9 @@
+# Tensorflow (and cuda).
+tensorflow==2.14.0.rc1
+tensorflow-text==2.14.0.rc0
+
+# Jax.
+--find-links https://storage.googleapis.com/jax-releases/jax_cuda_releases.html
+jax[cuda11_pip]==0.4.14
+
+-r requirements-common.txt
diff --git a/requirements-macos-m1.txt b/requirements-macos-m1.txt
deleted file mode 100644
index 05dd07e604..0000000000
--- a/requirements-macos-m1.txt
+++ /dev/null
@@ -1,16 +0,0 @@
-# WARNING: KerasNLP has no official support for MacOS M1 at this time. The
-# following will pull required depenencies from the following external sources.
-# - https://developer.apple.com/metal/tensorflow-plugin/
-# - https://github.com/sun1638650145/Libraries-and-Extensions-for-TensorFlow-for-Apple-Silicon/
-# These are not provided by Google, please review both of these dependencies
-# before proceeding.
-
-# Core deps.
-tensorflow-macos~=2.9
-https://github.com/sun1638650145/Libraries-and-Extensions-for-TensorFlow-for-Apple-Silicon/releases/download/v2.9/tensorflow_text-2.9.0-cp39-cp39-macosx_11_0_arm64.whl
-tensorflow-datasets
-# The metal plugin breaks many tests, so is not enabled by default.
-# tensorflow-metal~=0.5
-
-# Common deps.
--r requirements-common.txt
diff --git a/requirements-nightly.txt b/requirements-nightly.txt
deleted file mode 100644
index 22a0c6e55a..0000000000
--- a/requirements-nightly.txt
+++ /dev/null
@@ -1,7 +0,0 @@
-# Core deps.
-tf-nightly
-tensorflow-text-nightly
-tfds-nightly
-
-# Common deps.
--r requirements-common.txt
diff --git a/requirements-tensorflow-cuda.txt b/requirements-tensorflow-cuda.txt
new file mode 100644
index 0000000000..449493cb8d
--- /dev/null
+++ b/requirements-tensorflow-cuda.txt
@@ -0,0 +1,8 @@
+# Follow the version in https://github.com/googlecolab/backend-info
+# This gives us version of cuda, torch, jax, and tf that all cooperate.
+
+# Tensorflow (and cuda).
+tensorflow[and-cuda]==2.14.0.rc1
+tensorflow-text[and-cuda]==2.14.0.rc0
+
+-r requirements-common.txt
diff --git a/requirements-torch-cuda.txt b/requirements-torch-cuda.txt
new file mode 100644
index 0000000000..2555fdded2
--- /dev/null
+++ b/requirements-torch-cuda.txt
@@ -0,0 +1,10 @@
+# Tensorflow (and cuda).
+tensorflow==2.14.0.rc1
+tensorflow-text==2.14.0.rc0
+
+# Torch.
+--extra-index-url https://download.pytorch.org/whl/cu117
+torch==2.0.1+cu117
+torchvision==0.15.2+cu117
+
+-r requirements-common.txt
diff --git a/requirements.txt b/requirements.txt
index 99adbbd656..81e67080ee 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -1,7 +1,13 @@
-# Core deps.
-tensorflow~=2.13.0
-tensorflow-text~=2.13.0
-tensorflow-datasets
+# Tensorflow (and cuda).
+tensorflow[and-cuda]==2.14.0.rc1
+tensorflow-text[and-cuda]==2.14.0.rc0
+
+# Torch.
+--extra-index-url https://download.pytorch.org/whl/cpu
+torch==2.0.1
+torchvision==0.15.2
+
+# Jax.
+jax[cpu]==0.4.14
 
-# Common deps.
 -r requirements-common.txt