Big Data Tools

A data engineering plugin

Get Plugin

News

In this release, we’ve added integration with Kafka Schema Registry, Kerberos authentication, and extended support for all cloud storages in Big Data Tools.

Roman Poborchiy, the Marketing Manager for the Machine Learning team, interviewed Pasha Finkelshteyn, a Big Data IDE Developer Advocate.

In this update we've added integrations with AWS Glue, Tencent Cloud Object Storage, enhanced Zeppelin notebooks support, and delivered important fixes. Read on to learn about the most important changes in the Big Data Tools plugin or try it right away by installing it to the 2022.3 of IntelliJ…

The highlights of this release include integration with Hive Metastore and the ability to monitor Flink jobs right inside your IDE, as well as SSO authentication on Amazon S3. The new version provides many other noteworthy changes that are covered below. Get the latest version by installing it to…

Big Data Tools 2022.2 EAP is now available. You can try the newly added features right away by installing the latest plugin version to the 2022.2 EAP of your IDE. Please note this is an Early Access Program build, meaning it’s not fully tested. Hive Metastore support Ability to creat…

Explore the new features for data engineers in the JetBrains Big Data Tools plugin, including Amazon EMR support and streamlined work with remote file systems.

We’ve just released a new build of the Big Data Tools plugin that is compatible with the 2021.3 versions of IntelliJ IDEA Ultimate, PyCharm Professional Edition, and DataGrip. The plugin also supports our new data science IDE, DataSpell. In this release, we’ve introduced a number of changes to th…

We’ve just released a new build of the Big Data Tools plugin that is compatible with the 2021.3 version of IntelliJ IDEA Ultimate, PyCharm Professional, and DataGrip. The plugin also supports our new data science IDE, DataSpell. In this release, we’ve introduced a number of changes to the user in…

Recently we released a new build of the Big Data Tools plugin that is compatible with the 2021.3 EAP versions of IntelliJ IDEA Ultimate and PyCharm Professional. DataGrip 2021.3 EAP support will be available immediately after the release in October. The plugin also supports our new data science IDE …

The Kotlin API for Apache Spark is now widely available. This is the first stable release of the API that we consider to be feature-complete with respect to the user experience and compatibility with core Spark APIs. Get on Maven Central Let’s take a look at the new features this release bring…

In recent Big Data Tools releases, we've added a lot of new features, like Kafka support, a New Project wizard, additional Zeppelin settings, improved Python support, and more. We’ve received a lot of requests for us to polish these new additions, and we’ve taken this feedback to heart. This Vers…

We released another update of the Big Data Tools plugin recently, and this article is an overview of its new features. The previous release was a momentous event for us as the plugin left the Early Access preview stage and became generally available. Since then, we've received a lot of feedback f…

Big Data Tools

News

Big Data Tools 2023.1 Is Out!

Data Engineers Are Like Plumbers Who Install Pipes for Big Data

Big Data Tools 2022.3: Integration with AWS Glue Data Catalog, Code Completion for SQL Expressions in Zeppelin Notebooks

Big Data Tools 2022.2 is here!

Big Data Tools 2022.2 EAP: What’s New?

Big Data Tools: Amazon EMR Support, Alibaba OSS Integration, and more

Big Data Tools 2021.3.1 Is Now Available

Big Data Tools 2021.3 Is Now Available

Big Data Tools 2021.3 EAP

Kotlin API for Apache Spark 1.0 Released

Big Data Tools Compatible with 2020.3 Is Now Available

Big Data Tools Update