{"id":501836,"date":"2024-08-19T09:47:34","date_gmt":"2024-08-19T08:47:34","guid":{"rendered":"https:\/\/blog.jetbrains.com\/?post_type=pycharm&#038;p=501836"},"modified":"2025-10-15T15:05:51","modified_gmt":"2025-10-15T14:05:51","slug":"introducing-the-pycharm-databricks-integration","status":"publish","type":"pycharm","link":"https:\/\/blog.jetbrains.com\/zh-hans\/pycharm\/2024\/08\/introducing-the-pycharm-databricks-integration","title":{"rendered":"Introducing the PyCharm Databricks Integration"},"content":{"rendered":"\n<p>We&#8217;re introducing the Databricks integration with <a href=\"https:\/\/www.jetbrains.com\/pycharm\/\" data-type=\"link\" data-id=\"https:\/\/www.jetbrains.com\/pycharm\/\" target=\"_blank\" rel=\"noopener\">PyCharm Professional<\/a> to make it easier for you to process, store, and analyze your data!&nbsp;<\/p>\n\n\n\n<p>The integration allows you to build your data and AI apps on the <a href=\"https:\/\/www.databricks.com\/\" target=\"_blank\" rel=\"noopener\">Databricks Data Intelligence Platform<\/a> directly within PyCharm Professional, enhancing the data analytics platform with the powerful Python IDE by JetBrains. It enables you to write code quickly and easily and run it in the cloud without extra configurations, and it offers additional benefits for working with data.&nbsp;<\/p>\n\n\n\n<p>Read this blog post to learn more about the integration, who it will be useful for, and what benefits it offers.<\/p>\n\n\n\n<!--more-->\n\n\n    <div class=\"buttons\">\n        <div class=\"buttons__row\">\n                                                <a href=\"https:\/\/plugins.jetbrains.com\/plugin\/24359-databricks\" class=\"btn\" target=\"\" rel=\"noopener\">Install the Databricks plugin<\/a>\n                                                    <\/div>\n    <\/div>\n\n\n\n\n\n\n\n<h2 class=\"wp-block-heading\">Watch the plugin in action<\/h2>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"PyCharm Databricks plugin\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/b2q8zbZppHI?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">What is Databricks?<\/h2>\n\n\n\n<p>The <a href=\"https:\/\/www.databricks.com\/\" target=\"_blank\" rel=\"noopener\">Databricks Data Intelligence Platform<\/a> allows your entire organization to use data and AI. It\u2019s built on a lakehouse to provide an open, unified foundation for all data and governance, and is powered by a Data Intelligence Engine that understands the uniqueness of your data.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What is PyCharm Professional?<\/h2>\n\n\n\n<p><a href=\"https:\/\/www.jetbrains.com\/pycharm\/\" target=\"_blank\" rel=\"noopener\">PyCharm Professional<\/a> is a leading IDE for Python and other programming languages. It allows you to write high-quality and efficient code using superior code completion, refactoring capabilities, code inspections, seamless code and project navigation, a debugger, and a wide range of integrations, including Jupyter notebooks, testing frameworks, Git, CI\/CD solutions, and more \u2013 all available in one place right out of the box.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Who will the integration be useful for?&nbsp;<\/h2>\n\n\n\n<p>Organizations and data professionals using data lakehouses, data lakes, and data warehouses via Databricks will benefit from this integration.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">What benefits does the integration bring?<\/h2>\n\n\n\n<p>The integration combines the most powerful capabilities of each platform, allowing you to easily build all of your data and AI applications at scale within PyCharm:&nbsp;<\/p>\n\n\n\n<ul>\n<li><a href=\"https:\/\/www.jetbrains.com\/pycharm\/download\/\" target=\"_blank\" rel=\"noopener\">Use <strong>PyCharm<\/strong><\/a> to implement software development best practices, which are essential for large codebases, such as source code control, modular code layouts, testing, and more.\u00a0<\/li>\n\n\n\n<li><strong>Databricks<\/strong> enables the use of powerful clusters, allowing you to work on projects too large for a local machine and helping you orchestrate data processing efficiently.&nbsp;<\/li>\n<\/ul>\n\n\n\n<p>You can write the code for your pipelines and jobs in PyCharm, then deploy, test, and run it in real time on your Databricks cluster without any additional configurations.&nbsp;<\/p>\n\n\n\n<p>Let\u2019s dive into more details about what the PyCharm Databricks integration provides.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Connect to your cluster via PyCharm<\/h3>\n\n\n\n<p>You can connect directly to the Databricks cluster via PyCharm and monitor the process within the IDE. This allows you to check if the cluster is running, see the results of the current session&#8217;s runs, and view process outcomes along with additional details.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1600\" height=\"378\" src=\"https:\/\/blog.jetbrains.com\/wp-content\/uploads\/2024\/08\/image-20.png\" alt=\"Connect to your cluster via PyCharm\" class=\"wp-image-501860\"\/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">Run Python scripts on a remote cluster<\/h3>\n\n\n\n<p>In addition, you can run Python scripts on a remote cluster, which is particularly useful for working with big data, and view the results in the IDE.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1600\" height=\"384\" src=\"https:\/\/blog.jetbrains.com\/wp-content\/uploads\/2024\/08\/image-21.png\" alt=\"Run Python scripts on a remote cluster\" class=\"wp-image-501871\"\/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">Run Jupyter notebooks or Python scripts as workflows<\/h3>\n\n\n\n<p>Additionally, you can run your notebook or Python scripts as a Databricks workflow and see the output in the console.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1510\" height=\"938\" src=\"https:\/\/blog.jetbrains.com\/wp-content\/uploads\/2024\/08\/image-22.png\" alt=\"Run Jupyter notebooks or Python scripts as workflows\" class=\"wp-image-501882\"\/><\/figure>\n\n\n\n<p>You can see the results of the runs on the Databricks platform, including the runs initiated from PyCharm.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1600\" height=\"886\" src=\"https:\/\/blog.jetbrains.com\/wp-content\/uploads\/2024\/08\/image-23.png\" alt=\"See the results of the runs on the Databricks platform from PyCharm\" class=\"wp-image-501893\"\/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">Synchronize project files to the Databricks workspace<\/h3>\n\n\n\n<p>The synchronization of project files with the Databricks workspace allows you to access and work with the same files in both PyCharm and Databricks workspaces. You can also schedule your notebooks and scripts and utilize other platform features for projects completed in PyCharm.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"1600\" height=\"336\" src=\"https:\/\/blog.jetbrains.com\/wp-content\/uploads\/2024\/08\/image-24.png\" alt=\"Synchronize project files to the Databricks workspace\" class=\"wp-image-501904\"\/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">How to get started<\/h2>\n\n\n\n<p>Make sure you have the following ready to go:<\/p>\n\n\n\n<ul>\n<li><a href=\"https:\/\/www.jetbrains.com\/pycharm\/download\/\" target=\"_blank\" rel=\"noopener\">PyCharm Professional 2024.2<\/a> and further editions<\/li>\n\n\n\n<li><a href=\"https:\/\/plugins.jetbrains.com\/plugin\/21713-big-data-tools-core\" target=\"_blank\" rel=\"noopener\">Big Data Tools Core plugin<\/a>&nbsp;<\/li>\n\n\n\n<li><a href=\"https:\/\/www.databricks.com\/\" target=\"_blank\" rel=\"noopener\">Databricks account<\/a><\/li>\n<\/ul>\n\n\n\n<p>You can install the Databricks plugin either from JetBrains Marketplace or directly from within the PyCharm IDE.<\/p>\n\n\n    <div class=\"buttons\">\n        <div class=\"buttons__row\">\n                                                <a href=\"https:\/\/plugins.jetbrains.com\/plugin\/24359-databricks\" class=\"btn\" target=\"\" rel=\"noopener\">Install the Databricks plugin<\/a>\n                                                    <\/div>\n    <\/div>\n\n\n\n\n\n\n\n<p><a href=\"https:\/\/www.jetbrains.com\/help\/pycharm\/databricks.html\" target=\"_blank\" rel=\"noopener\">Head over to the documentation<\/a> to get step-by-step instructions on how to get started and use the plugin.<\/p>\n\n\n\n<p>What do you think about this integration? Share your thoughts in the comments below.<\/p>\n","protected":false},"author":1407,"featured_media":501838,"comment_status":"closed","ping_status":"closed","template":"","categories":[89],"tags":[8550],"cross-post-tag":[],"acf":[],"_links":{"self":[{"href":"https:\/\/blog.jetbrains.com\/zh-hans\/wp-json\/wp\/v2\/pycharm\/501836"}],"collection":[{"href":"https:\/\/blog.jetbrains.com\/zh-hans\/wp-json\/wp\/v2\/pycharm"}],"about":[{"href":"https:\/\/blog.jetbrains.com\/zh-hans\/wp-json\/wp\/v2\/types\/pycharm"}],"author":[{"embeddable":true,"href":"https:\/\/blog.jetbrains.com\/zh-hans\/wp-json\/wp\/v2\/users\/1407"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.jetbrains.com\/zh-hans\/wp-json\/wp\/v2\/comments?post=501836"}],"version-history":[{"count":5,"href":"https:\/\/blog.jetbrains.com\/zh-hans\/wp-json\/wp\/v2\/pycharm\/501836\/revisions"}],"predecessor-version":[{"id":648762,"href":"https:\/\/blog.jetbrains.com\/zh-hans\/wp-json\/wp\/v2\/pycharm\/501836\/revisions\/648762"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.jetbrains.com\/zh-hans\/wp-json\/wp\/v2\/media\/501838"}],"wp:attachment":[{"href":"https:\/\/blog.jetbrains.com\/zh-hans\/wp-json\/wp\/v2\/media?parent=501836"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.jetbrains.com\/zh-hans\/wp-json\/wp\/v2\/categories?post=501836"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.jetbrains.com\/zh-hans\/wp-json\/wp\/v2\/tags?post=501836"},{"taxonomy":"cross-post-tag","embeddable":true,"href":"https:\/\/blog.jetbrains.com\/zh-hans\/wp-json\/wp\/v2\/cross-post-tag?post=501836"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}