{"id":944,"date":"2023-06-15T18:03:03","date_gmt":"2023-06-15T18:03:03","guid":{"rendered":"https:\/\/bandittracker.com\/?p=944"},"modified":"2023-06-15T18:03:07","modified_gmt":"2023-06-15T18:03:07","slug":"what-is-a-databricks-workspace","status":"publish","type":"post","link":"https:\/\/bandittracker.com\/what-is-a-databricks-workspace\/","title":{"rendered":"What Is A Databricks Workspace? (Explained)"},"content":{"rendered":"\n<p>Are you just getting started with Databricks? Getting confused about the difference between workspaces, notebooks, and clusters?<\/p>\n\n\n\n<p>This article tells you all you need to know about the important concept of a workspace on the Databricks platform.<\/p>\n\n\n\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_64 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<p class=\"ez-toc-title\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-661376bace748\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-661376bace748\" checked aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/bandittracker.com\/what-is-a-databricks-workspace\/#What_Is_A_Databricks_Workspace\" title=\"What Is A Databricks Workspace?\">What Is A Databricks Workspace?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/bandittracker.com\/what-is-a-databricks-workspace\/#What_Does_A_Databricks_Workspace_Look_Like\" title=\"What Does A Databricks Workspace Look Like?\">What Does A Databricks Workspace Look Like?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/bandittracker.com\/what-is-a-databricks-workspace\/#What_Is_Inside_A_Workspace\" title=\"What Is Inside A Workspace?\">What Is Inside A Workspace?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/bandittracker.com\/what-is-a-databricks-workspace\/#Workspace_Roles_And_Permissions\" title=\"Workspace Roles And Permissions\">Workspace Roles And Permissions<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/bandittracker.com\/what-is-a-databricks-workspace\/#Workspace_Vs_Clusters\" title=\"Workspace Vs Clusters\">Workspace Vs Clusters<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/bandittracker.com\/what-is-a-databricks-workspace\/#What_Is_The_Data_Science_Engineering_Workspace\" title=\"What Is The Data Science &amp; Engineering Workspace\">What Is The Data Science &amp; Engineering Workspace<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/bandittracker.com\/what-is-a-databricks-workspace\/#How_To_Get_the_Workspace_ID\" title=\"How To Get the Workspace ID\">How To Get the Workspace ID<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/bandittracker.com\/what-is-a-databricks-workspace\/#How_To_Find_Your_Workspace_Name\" title=\"How To Find Your Workspace Name\">How To Find Your Workspace Name<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/bandittracker.com\/what-is-a-databricks-workspace\/#Quick_History_Of_The_Databricks_Workspace\" title=\"Quick History Of The Databricks Workspace\">Quick History Of The Databricks Workspace<\/a><\/li><\/ul><\/nav><\/div>\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"What_Is_A_Databricks_Workspace\"><\/span>What Is A Databricks Workspace?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>A Databricks workspace is a shared environment where you can collaborate with others on various tasks related to data engineering, data science, machine learning, and more.<\/p>\n\n\n\n<p>Think of an office workspace with areas where you keep all your reports, documents, and tools for work. A Databricks workspace is similar but in a digital format.<\/p>\n\n\n\n<p>It has areas for your notebooks, libraries, experiments, and jobs. Each user can view, create, edit, or run these components within the workspace, subject to their permissions.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"What_Does_A_Databricks_Workspace_Look_Like\"><\/span>What Does A Databricks Workspace Look Like?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>When you log into Databricks, you land into the Workspace user interface. The left sidebar is your is your starting point for all tasks.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"600\" height=\"400\" src=\"https:\/\/bandittracker.com\/wp-content\/uploads\/2023\/06\/databricks-workspace.jpg\" alt=\"\" class=\"wp-image-945\" srcset=\"https:\/\/bandittracker.com\/wp-content\/uploads\/2023\/06\/databricks-workspace.jpg 600w, https:\/\/bandittracker.com\/wp-content\/uploads\/2023\/06\/databricks-workspace-300x200.jpg 300w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/figure><\/div>\n\n\n<p>Here is a rundown of the left sidebar:<\/p>\n\n\n\n<ul>\n<li>Workspace: shows your notebooks, libraries, and other assets.<\/li>\n\n\n\n<li>Recent: shows recently used or viewed notebooks and other resources.<\/li>\n\n\n\n<li>Data: an interface to databases and tables.<\/li>\n\n\n\n<li>Compute: an interface to create, view, and manage clusters.<\/li>\n\n\n\n<li>Worfklows: create and schedule jobs, and monitor their execution.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"What_Is_Inside_A_Workspace\"><\/span>What Is Inside A Workspace?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>There are several types of assets that a workspace can hold. As a beginner, you\u2019ll quickly learn how to use the first two types on this list (notebooks, jobs, and clusters). It may be a while before you get to the rest of these assets.<\/p>\n\n\n\n<ul>\n<li>Notebooks<\/li>\n\n\n\n<li>Jobs<\/li>\n\n\n\n<li>Clusters<\/li>\n\n\n\n<li>Libraries<\/li>\n\n\n\n<li>Repos<\/li>\n\n\n\n<li>Models<\/li>\n<\/ul>\n\n\n\n<p>Notebooks are the workhorses of Databricks. This is where users write and execute code, analyze data, and document their findings. You can learn more in our <a href=\"https:\/\/bandittracker.com\/what-is-a-databricks-notebook\/\" data-type=\"post\" data-id=\"926\">introduction to Databricks Notebooks<\/a>.<\/p>\n\n\n\n<p>The workspace also provides a user-friendly dashboard to manage jobs. These are tasks or series of tasks executed on clusters. If you&#8217;re not sure about how this works, check out our <a href=\"https:\/\/bandittracker.com\/what-are-databricks-clusters\/\" data-type=\"post\" data-id=\"918\">introduction to Databricks clusters<\/a>.<\/p>\n\n\n\n<p>The workspace organizes and manages libraries. These are packages or modules that provide additional functionality. For example, you could use a machine-learning Python library like scikit. Libraries can be added to clusters and used within notebooks.<\/p>\n\n\n\n<p>Repos are repositories for source control that are integrated with Git. Depending on your environment, you may not use them.<\/p>\n\n\n\n<p>A Model in the Databricks workspace generally refers to a machine learning model that has been trained and logged to the Model Registry using MLflow. This is very specific \u2013 if you\u2019re not involved with machine learning, you won\u2019t encounter these in your workspace.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Workspace_Roles_And_Permissions\"><\/span>Workspace Roles And Permissions<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"600\" height=\"400\" src=\"https:\/\/bandittracker.com\/wp-content\/uploads\/2023\/06\/security.jpg\" alt=\"\" class=\"wp-image-946\" srcset=\"https:\/\/bandittracker.com\/wp-content\/uploads\/2023\/06\/security.jpg 600w, https:\/\/bandittracker.com\/wp-content\/uploads\/2023\/06\/security-300x200.jpg 300w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/figure><\/div>\n\n\n<p>A role in Databricks is a collection of permissions. The permissions define what actions a user with that role can perform.<\/p>\n\n\n\n<p>The permissions of a role are scoped to workspace objects. This means that a role&#8217;s permissions can be applied to individual notebooks, jobs, and other objects within the workspace.<\/p>\n\n\n\n<p>For example, a user might have permission to edit one notebook but only view another.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Workspace_Vs_Clusters\"><\/span>Workspace Vs Clusters<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Workspaces and clusters play key roles in a Databricks set-up, but they are fundamentally different and serve unique purposes.<\/p>\n\n\n\n<p>&nbsp;A workspace is the shared environment where users carry out their tasks using assets like notebooks, libraries, jobs, and data.<\/p>\n\n\n\n<p>Clusters are sets of computational resources where the actual data processing occurs. In Databricks, a cluster is a distributed computing system made up of a driver node and worker nodes that process your data and execute your commands.<\/p>\n\n\n\n<p>The essential difference is that the workspace is where users write code, but the cluster is where that code gets executed.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"What_Is_The_Data_Science_Engineering_Workspace\"><\/span>What Is The Data Science &amp; Engineering Workspace<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\"><div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"600\" height=\"400\" data-id=\"947\" src=\"https:\/\/bandittracker.com\/wp-content\/uploads\/2023\/06\/data-science-engineering-workspace.jpg\" alt=\"\" class=\"wp-image-947\" srcset=\"https:\/\/bandittracker.com\/wp-content\/uploads\/2023\/06\/data-science-engineering-workspace.jpg 600w, https:\/\/bandittracker.com\/wp-content\/uploads\/2023\/06\/data-science-engineering-workspace-300x200.jpg 300w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/figure><\/div><\/figure>\n\n\n\n<p>If you\u2019re trying the Databricks Community Edition, the first place you\u2019ll land when you log in is the Data Science &amp; Engineering Workspace. So, what is it?<\/p>\n\n\n\n<p>This workspace is a collaborative platform specifically designed for data scientists and data engineers to work together.<\/p>\n\n\n\n<p>These notebooks support multiple languages (Python, SQL, R, Scala), allowing data scientists and engineers to use the language they are most comfortable with.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"How_To_Get_the_Workspace_ID\"><\/span>How To Get the Workspace ID<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>To find your Workspace ID, log into your Databricks account and go to the workspace (if you have several).<\/p>\n\n\n\n<p>Look at the URL displayed in your browser address area. I\u2019ve highlighted mine in the picture below.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"600\" height=\"400\" src=\"https:\/\/bandittracker.com\/wp-content\/uploads\/2023\/06\/find-workspace-ID.jpg\" alt=\"\" class=\"wp-image-948\" srcset=\"https:\/\/bandittracker.com\/wp-content\/uploads\/2023\/06\/find-workspace-ID.jpg 600w, https:\/\/bandittracker.com\/wp-content\/uploads\/2023\/06\/find-workspace-ID-300x200.jpg 300w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/figure><\/div>\n\n\n<p>The ID is a series of a numbers displayed after the text \u201c<strong>o=<\/strong>\u201d.<\/p>\n\n\n\n<p>If there is no <strong>o=<\/strong> in the URL, the ID is 0.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"How_To_Find_Your_Workspace_Name\"><\/span>How To Find Your Workspace Name<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>In Databricks, your workspace name typically corresponds to the workspace URL that appears before the numeric ID.<\/p>\n\n\n\n<p>To find the name visually, look at the URL in your browser&#8217;s address bar. As long as you\u2019re not using the Community Edition, the URL will be something like:<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p><strong><em>https:\/\/&lt;workspace-name>.cloud.databricks.com<\/em><\/strong><\/p>\n<\/blockquote>\n\n\n\n<p>The &lt;workspace-name&gt; part of the URL is typically the name of your workspace.<\/p>\n\n\n\n<p>You can also capture this name programmatically in a Python Notebook. Here is one way to do so:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>spark.conf.get(\"spark.databricks.workspaceUrl\").split('.')&#91;0]<\/code><\/pre>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Quick_History_Of_The_Databricks_Workspace\"><\/span>Quick History Of The Databricks Workspace<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Databricks was launched as a company in 2013 when they raised $14 million in Series A funding.<\/p>\n\n\n\n<p>The company launched their cloud platform in the summer of 2014. The marketing spiel described the Databricks Workspace as an interface that provided: <\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>three powerful web-based applications: notebooks, dashboards, and a job launcher .<\/p>\n<cite><a href=\"https:\/\/www.databricks.com\/blog\/2014\/07\/14\/databricks-cloud-making-big-data-easy.html\" target=\"_blank\" rel=\"noreferrer noopener\">Databricks blog<\/a><\/cite><\/blockquote>\n\n\n\n<p>You may have noticed that some assets I mentioned early are missing from that list. That\u2019s because the original Workspace was quite limited in what it offered. This hampered widespread adoption of the platform.<\/p>\n\n\n\n<p>Things changed drastically in 2020 when the Workspace features expanded to include libraries, repos, and models.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Are you just getting started with Databricks? Getting confused about the difference between workspaces, notebooks, and clusters? This article tells you all you need to know about the important concept of a workspace on the Databricks platform. What Is A Databricks Workspace? A Databricks workspace is a shared environment where you can collaborate with others &#8230; <a title=\"What Is A Databricks Workspace? (Explained)\" class=\"read-more\" href=\"https:\/\/bandittracker.com\/what-is-a-databricks-workspace\/\" aria-label=\"More on What Is A Databricks Workspace? (Explained)\">Read more<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[29],"tags":[],"_links":{"self":[{"href":"https:\/\/bandittracker.com\/wp-json\/wp\/v2\/posts\/944"}],"collection":[{"href":"https:\/\/bandittracker.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bandittracker.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/bandittracker.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/bandittracker.com\/wp-json\/wp\/v2\/comments?post=944"}],"version-history":[{"count":2,"href":"https:\/\/bandittracker.com\/wp-json\/wp\/v2\/posts\/944\/revisions"}],"predecessor-version":[{"id":950,"href":"https:\/\/bandittracker.com\/wp-json\/wp\/v2\/posts\/944\/revisions\/950"}],"wp:attachment":[{"href":"https:\/\/bandittracker.com\/wp-json\/wp\/v2\/media?parent=944"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bandittracker.com\/wp-json\/wp\/v2\/categories?post=944"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bandittracker.com\/wp-json\/wp\/v2\/tags?post=944"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}