Big Data Tools: Amazon EMR Support, Alibaba OSS Integration, and more
In this new release of Big Data Tools, we’ve added support for more instruments for data engineers, including Amazon EMR data processing platform and Alibaba Cloud Object Storage Service. Now you can work with them directly from your IDE. Read on to learn about these and other enhancements introduced in this release.
Amazon EMR Support
Now you can monitor clusters and nodes in the Amazon EMR data processing platform.
User-friendly and simple UI interface to work with clusters.
With just one click, you can create a connection to:
- HDFS
- Hadoop and Spark Monitoring
- Zeppelin
- AWS S3
- SFTP main and data nodes
You can also open internal cluster service web pages (like Ganglia) through an automatically created SSH tunnel.
Run applications with Spark Submit on Amazon EMR
You can configure all Spark-Submit parameters inside the IDE without using the console, as well as upload jars from a local machine to S3 or a similar cluster.
Remote File Systems support improvements
Alibaba Cloud Object Storage Service support
Alibaba OSS has been added to an extensive list of remote and cloud file storages supported by the plugin, including AWS S3, Google Cloud Storage, Microsoft Azure, and more. Now you can connect your Alibaba OSS and access its data directly from the IDE.
New file viewer
With the new full-size viewer for remote file systems, you can find more metainfo about folders and files and view file information in a separate panel.
Those are the most notable highlights of our major release. For the full list of new features and enhancements see the What’s new on the JetBrains Big Data tools plugin page. Please share your feedback with us and report any issues you encounter to our issue tracker.
Follow us on Twitter!
The Big Data Tools team
Subscribe to Big Data Tools Blog updates
