Coiled Docs#

👋 Welcome to Coiled’s documentation!

How Coiled works#

Coiled handles the creation and management of Dask clusters in the cloud through a continuously running control plane.

Coiled Architecture

Coiled Architecture (click image to enlarge)#

  • User Environment

    This is where you use the Coiled Python package along with your preferred tools to create Dask clusters and submit Dask computations. This could be a Jupyter Notebook on your laptop, a Python script on a cloud-hosted VM, or Python code within a task in a workflow management system.

  • Coiled Cloud

    Coiled Cloud provides a dashboard that you can use to manage clusters, users, teams, software environments, etc. Coiled Cloud also handles provisioning the necessary cloud infrastructure in your cloud account for your Dask clusters so you don’t have to!

  • Cloud Computing Environment

    This is the cloud environment where Dask clusters will be created and where your Dask computations will run. You can configure Coiled to run on your AWS or GCP account.

Where does Coiled run?#

You can run Coiled from your own cloud provider account.

Use Coiled with AWS

Use Coiled with Amazon Web Services (AWS)

Use Coiled with GCP

Use Coiled with Google Cloud Platform (GCP)

What can you do with Coiled?#

Coiled provides cluster-as-a-service functionality to provision hosted Dask clusters on demand. It takes the DevOps out of data science and enables data engineers and data scientists to spend more time on their real job and less time setting up networking, managing fleets of Docker images, etc.

Hosted Dask Clusters

Securely deploy Dask clusters from anywhere you run Python.

Software Environments

Build, manage, and share conda, pip, and Docker environments. Use them locally or in the cloud.

Manage Teams & Costs

Manage teams, collaborate, set resource limits, and track costs.