Welcome to the getting started guide for Coiled! This page
covers installing and setting up Coiled as well as running your first computation
Coiled can be installed from PyPI using pip or from the conda-forge
channel using conda:
Install with pip
pip install coiled
Install with conda
conda install -c conda-forge coiled
Coiled comes with a coiled login command line tool to configure
your account credentials. From the command line enter:
$ coiled login
You’ll then be asked to navigate to https://cloud.coiled.io/profile to log in and
retrieve your Coiled token.
Please login to https://cloud.coiled.io/profile to get your token
Upon entering your token, your credentials will be saved to Coiled’s local
configuration file. Coiled will then pull credentials from the configuration
file when needed.
When performing computations on remote Dask clusters, it’s important to have the same libraries
installed both in your local Python environment (e.g. on your laptop), as well as on the remote
Dask workers in your cluster.
Coiled helps you seamlessly synchronize these software environments.
While there’s more detailed information on this topic is available in the Software Environments section,
for now we’ll just use the coiled install command line tool for creating a standard
conda environment locally. From the command line:
# Create local version of the coiled/default software environment
$ coiled install coiled/default
$ conda activate coiled-coiled-default
The above snippet will create a local conda environment named “coiled-coiled-default”,
activate it, and then launch an IPython session. Note that while we’re creating a local software
environment, all Dask computations will happen on remote Dask workers on AWS, not on your
local machine (for more information on why local software environments
are needed, see our FAQ page).
Now that we have our software environment set up, we can walk through the following example:
# Create a remote Dask cluster with Coiled
cluster = coiled.Cluster(configuration="coiled/default")
# Connect Dask to that cluster
client = dask.distributed.Client(cluster)
print("Dask Dashboard:", client.dashboard_link)
Make sure to check out the
(link can be found at client.dashboard_link) which has real-time information about
the state of your cluster including which tasks are currently running, how much memory and CPU workers
are using, profiling information, etc.
Note that when creating a coiled.Cluster, resources for our Dask cluster are
provisioned on AWS. This provisioning process takes about a minute to complete
# Perform computations with data on the cloud
import dask.dataframe as dd
df = dd.read_csv(
The example above goes through the following steps:
Spins up a remote Dask cluster by creating a coiled.Cluster instance.
Connects a Dask Client to the cluster.
Submits a Dask DataFrame computation for execution on the cluster.
Coiled in action!
Check out easy-to-run example notebooks using Coiled
See Coiled example notebooks
Learn how you can manage software environments with Coiled
Go to software environments page
Learn to launch Dask clusters with Coiled
Go to clusters page
Learn how to manage teams, set resource limits, and track costs with Coiled
Go to teams page