Zeppelin

Update 12 of the Big Data Tools plugin for IntelliJ IDEA Ultimate, PyCharm Professional, and DataGrip has been released. You can install it from the JetBrains Plugin Repository or from inside your IDE. The plugin allows you to edit Zeppelin notebooks, upload files to cloud filesystems, and monitor Hadoop and Spark clusters. In this release, we've added experimental Python support and global search inside Zeppelin notebooks. We’ve also addressed a variety of bugs. Let's talk about the details. Experimental and preliminary Python support Although PySpark in Zeppelin is getting a lot of attent

Zeppelin is a web-based notebook for data engineers that enables data-driven, interactive data analytics with Spark, Scala, and more. The project recently reached version 0.9.0-preview2 and is being actively developed, but there are still many things to be implemented. One such thing is an API for getting comprehensive information about what's going on inside the notebook. There is already an API that completely solves the problems of high-level notebook management, but it doesn’t help if you want to do anything more complex. That was a real problem for Big Data Tools, a plugin for IntelliJ I

I am pleased to announce that EAP 10 of the Big Data Tools plugin for IntelliJ IDEA Ultimate is available from today. Our goal was to fix as many problems as possible and improve the plugin from the inside out. In addition to some under-the-hood changes, two visible improvements have been made: With just a couple of mouse clicks, you can enable SSH tunnels to forward ports for Hadoop and Spark connections. Filters and limits in the Applications tab of the Spark Monitoring tool window give you control over how much data is loaded from servers. SSH tunneling The servers we need are not always