Coiled Docs#
👋 Welcome to Coiled’s documentation!
What can you do with Coiled?#
Coiled provides cluster-as-a-service functionality to provision hosted Dask clusters on demand. It takes the DevOps out of data science and enables data engineers and data scientists to spend more time on their real job and less time setting up networking, managing fleets of Docker images, etc.
Managed Dask Clusters
Securely deploy Dask clusters from anywhere you run Python.
Package Sync
Automatically replicate your local Python environment in your cluster.
GPUs
Create a GPU-enabled cluster for working with libraries like RAPIDS or PyTorch.
Where does Coiled run?#
Coiled creates and manages Dask clusters in your own cloud provider account.
Use Coiled with AWS
Use Coiled with GCP
How Coiled works#
Coiled handles the creation and management of Dask clusters in the cloud through a continuously running control plane.
Coiled Architecture (click image to enlarge)#
User Environment
This is where you use the Coiled Python package along with your preferred tools to create Dask clusters and submit Dask computations. This could be a Jupyter Notebook on your laptop, a Python script on a cloud-hosted VM, or Python code within a task in a workflow management system.
Coiled Cloud
Coiled Cloud provides a dashboard that you can use to manage clusters, users, teams, software environments, etc. Coiled Cloud also handles provisioning the necessary cloud infrastructure in your cloud account for your Dask clusters so you don’t have to!
Cloud Computing Environment
This is the cloud environment where Dask clusters will be created and where your Dask computations will run. You can configure Coiled to run in your AWS or Google Cloud account (see Automatic Setup).